LAE

Welcome to the LAE community!  Please feel free to start a discussion in the discussion tab or join in a conversation.

Discussions

Members

Resources

Events

 View Only
  • 1.  CSV import

    Employee
    Posted 07-18-2011 03:53

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: MarkCunningham

    HI
    I am trying to Load a CSV file into Laverstorm and it appears to be adding the correct number of rows but is not populating them with any data. the node I am using is below :

    ]node:SB_Activation_Data_CSV_File
    bretype:core::CSV File
    editor:Label=SB Activation Data CSV File
    editor:sortkey=4e15aea359bd424a
    output:@41e6c6cd11e613c6/=
    prop:FieldNames=RegisteredDate,ActivationDate,Tran sactionNumber,MobileNumberActivated,ProductActivat ed,CustomerEmail,BranchID
    prop:File=Y:\=NETWORK_COMPLIANCE=\Task Management\Revenue Assurance (R&D)\Sales Assurance\MYHUB\Spare Backup Data\SB Activations\Copy of Adhoc_CPW_Activation_Report.csv
    prop:FilenameOutputField=FileName
    editor:XY=600,190
    end:SB_Activation_Data_CSV_File



    I have tried using a delimited node and this still produces the same output, I can not see anything wrong with the file I am trying to import.

    any help would be much appreciated as I am stumped

    Many Thanks
    Mark
    Attachments:
    Copy of Adhoc_CPW_Activation_Report.zip


  • 2.  RE: CSV import

    Employee
    Posted 07-18-2011 07:26

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: timonk

    When loading the file you sent, I was getting errors on my nodes about all whitespace field names. Looking at your file in Excel, it seemed okay, but just for a test I highlighted a few (seemingly empty) columns directly to the right of your data and deleted them, then a few rows directly below your data and deleted them. Then I re-ran my nodes and they loaded your data fine. There seems to be some extra characters in your file. Try doing as I did and see if it starts working.

    Regards
    Timon Koufopoulos
    MDA Support.


  • 3.  RE: CSV import

    Employee
    Posted 07-18-2011 08:33

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: MarkCunningham

    Hi Timon

    Thanks for this, the file is now loading fine and all rows are returning data.

    However when I loaded the original file in Textpad I did not see any additional fields and all rows had ended with a character return and was not showing any additional fields within the data.
    So it is strange that I needed to delete columns within the data that did not visible exist.
    Any idea on why this would be the case?

    Thanks Again
    Mark


  • 4.  RE: CSV import

    Employee
    Posted 07-18-2011 08:41

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: rboccuzzi

    Mark, there seems to be something fishy with this file...if I open up the raw file you sent, there is a lot of NULL bytes in it, as if it were in another format, possibly some international format or odd byte ordering, but there is no BOM (Byte Order Mark) that helps identify it. I opened the file in Excel 2010, and then immediately saved it back to csv (just pressed save, and agreed to the "loss of functionality with format" warning), and then I was able to process it fine.

    I'm not sure where the data came from, but in it's current form, it is not a straight ASCII or windows-1252 encoded comma separated values file. I'm not sure what caused this, it could have been the source of the data, or possibly one of the steps used to transfer the file along it's path.

    Cheers
    Rich


  • 5.  RE: CSV import

    Employee
    Posted 07-19-2011 02:10

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: MarkCunningham

    Thanks Rich

    Much appreciated and I'll keep an eye on the data that is being sent to me.


    Thanks again

    Mark