problem on large ascii-file

Mailing List

Home

Forum Home

MySQL General - General MySQL discussion

MaxDB - Everything about MaxDB, formerly known as SAP DB

MySQL on Win32 - Runing MySQL on Windows 9x/Me/NT/2000/XP

MySQL++ - Programming with the C++ API to MySQL

ODBC - ODBC with the MySQL Connector/ODBC driver

Java Help - Mostly related to the MySQL Connector/J driver

Perl - Perl support for MySQL with DBI and DBD::mysql

GUI - MySQL GUI Tools

Announcement

Subjects

•	mysql openssl Question
•	mysql:it 's a db not a dbms how it 's possible?!
•	Does the binary log enabling affect the MySQL performances?
•	Strange behavior, Table Level Permission
•	FULLTEXT query format question
•	Preventing Duplicate Entries
•	Comparing and writing out BLOBS
•	Executing MySQL Commands From Within C Program
•	Can 't access mysql after kernel upgrade
•	Mysql 4 0 Oracle Stored Procedure Trigger Conversion
•	Downgrade Mysql from 4 to 3 23
•	MySQL Cluster Software
•	mysql test 4 1 fails with the gis test
•	ERROR 2002: Can 't connect to local MySQL server through socket
•	Getting Identity after INSERT
•	Update one field with more fields from another table
•	ERROR 1045: Access denied for user: 'root@localhost ' (Using password: NO)
•	mysql have same function mthod as Oracle decode()

problem on large ascii-file

problem on large ascii-file

2005-05-10 - By Thomas Unternaehrer

Back

Reply: 1 2

Dear List,

I have a problem with my MySQL Server 4.1 on winXP SP2 (NTFS).

I try to read in an ascii-file with

CREATE TABLE VehicleStreamAll(
Station tinyint(3) unsigned,
Lane tinyint(3) unsigned,
Length float(8) unsigned,
Speed float(8) unsigned,
WeekDay char(3),
nDate date,
Hour tinyint(2),
Min tinyint(2),
Sec float(6) unsigned,
UpON int(9),
UpOff int(9),
DownON int(9),
DownOff int(9)
);

LOAD DATA LOCAL INFILE "d:/VehicleStreamAll/AllVS.txt" INTO TABLE
VehicleStreamAll;

The file is around 39GB, but I should have enough space on my drive.

The first rows of the file are (TAB-spaced):
1 9 3.630769e+00 50.6769231 Thu 2004-06-03
13 54 6.000000e+01 3006000 3006024 3006026 3006050
2 2 3.620994e+00 105.5769231 Thu 2004-06-03
13 55 1.666667e-01 3006010 3006022 3006023 3006034
5 9 4.551852e+00 48.8000000 Thu 2004-06-03
13 55 2.166667e-01 3006013 3006042 3006040 3006069
1 5 4.354167e+00 54.9000000 Thu 2004-06-03
13 55 2.166667e-01 3006013 3006038 3006037 3006062
1 3 4.100000e+00 101.3538462 Thu 2004-06-03
13 55 2.333333e-01 3006014 3006027 3006027 3006040
1 7 4.102542e+00 53.8020000 Thu 2004-06-03
13 55 7.500000e-01 3006045 3006069 3006069 3006094
1 9 4.102017e+00 47.9285714 Thu 2004-06-03
13 55 9.500000e-01 3006057 3006085 3006085 3006112
2 4 3.664286e+00 94.1142857 Thu 2004-06-03
13 55 1.050000e+00 3006063 3006076 3006077 3006090
2 2 1.985795e+00 114.7909091 Thu 2004-06-03
13 55 1.316667e+00 3006079 3006086 3006090 3006098
3 6 6.692500e+00 104.3100000 Thu 2004-06-03
13 55 5.000000e-02 3006003 3006032 3006033 3006040

If I try to read this first rows everything works fine.
But if I try to read the whole file the MySQL Server crashes with the
following error (after a few seconds):
"Lost connection to MySQL Server during query" ErrorNr. 2013

What could that mean? How can I scan a file of 39GB?
I suppose that somewhere in the file is a problematic sign, but how
should I find it?
Or do I miss something really basic?

thanks for any hints and sorry for my poor english

Thomas

Content Security by MailMarshal

--
MySQL Windows Mailing List
For list archives: http://lists.mysql.com/win32
To unsubscribe: http://lists.mysql.com/win32?unsub=mysql@(protected)

Earn $52 per hosting referral at Lunarpages.