LAE

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: zaldington

Hi
I am trying to export a 1.3m row file as a CSV. I've split this into four ~350k data sets. This runs fine, but then when I open the CSVs, they only contain 175k rows each. This might be on the Excel side rather than the Lavastorm side but any insight would be appreciated!
Thanks

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: ejones

I know there are limits on the number of records that Excel will read. The limit in earlier versions was somewhere over 65K records. I don't remember what the limits are now.

You might read the CSV files you've created with the CSV input node and see how many records are found.

If you are on a Unix computer and have access to the command prompt, and if there are no line feeds inside the data itself so that every record has only the line feed at the end, then you could use the Unix command "wc -l <filename>" to count the number of lines in each data file. Note that the count will usually include the header record as one more record than the number you wrote. I don't know if Windows has a similar command, but a good text editor may be helpful because you can open the file and see if all the data is there.

Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

Originally posted by: epetrou

If you are using Excel 2007+ the limit should be around 1 million lines. If you are only getting 175k there must be something wrong with the csv file (format not recognized,therefore not loaded) .

Why dont you try to export it as text file and then open it in excel ?