LAE

Welcome to the LAE community!  Please feel free to start a discussion in the discussion tab or join in a conversation.

Discussions

Members

Resources

Events

 View Only
  • 1.  Excel file with duplicated column names

    Employee
    Posted 03-16-2015 19:05

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: dinokape

    I am trying to process a number of Excel files which have multiple duplicates of the same column name. For example, the header of the file looks something like this:

    Name, Phone, Address, Name, Phone, Address

    I am getting this error, as Lavastorm won't allow me to read in the file which has more than one column with same name:

    ERROR: Duplicate field name encountered while calculating metadata. Field "Name" is defined at both column 1, and 4 in worksheet in (0): "Sheet1", in file: /raw_data/File-20150317.xlsx.

    The only way for me to process the files is to rename duplicated columns, but it's a very time consuming task, considering that there are a few hundred files in a directory that I'd like to read in. Any ideas how to get around that?

    P.S. I'm using BRE v 4.5.3.0 Build 365 and upgrade to the latest version is not an option, as it is on the company's server.


  • 2.  RE: Excel file with duplicated column names

    Employee
    Posted 03-17-2015 03:05

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: andycooper

    Hi,

    I dont have access to a v4.5 system, but v4.6 includes an option in the exception tab on how to treat duplicate field names. If this option isn't in v4.5 then you could use the get metadata and change metadata options as a quicker alternative to renaming the columns. I've attached an example graph which includes examples of these options: -

    Change Metadata Examples.brg