LAE

Welcome to the LAE community!  Please feel free to start a discussion in the discussion tab or join in a conversation.

Discussions

Members

Resources

Events

 View Only
  • 1.  Delete all the NULL columns in a file

    Employee
    Posted 11-06-2014 08:50

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: gauravdb

    Hi Team,

    I have a file with about 100 attributes but about 50 of them are FULLY NULL. Is there a way to drop all these attributes or capture them somewhere as "NullAttributes" ??

    Thanks
    GK


  • 2.  RE: Delete all the NULL columns in a file

    Employee
    Posted 11-06-2014 09:09

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: ryeh

    Take a look at the attached. The key is using the 'Change Metadata' node. I use a filter which takes the 2nd output pin from the 'Data Analyzer' to mark all fields that contain only NULL's.
    Attachments:
    removeNullFields.brg


  • 3.  RE: Delete all the NULL columns in a file

    Employee
    Posted 11-10-2014 03:50

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: gauravdb

    Hi ryeh,

    This works fine. Thanks a lot for your help.
    Can you just elaborate a bit about "omitField" please.

    Thanks
    GK


  • 4.  RE: Delete all the NULL columns in a file

    Employee
    Posted 11-12-2014 11:14

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: ryeh

    In the 'Omit fields' filter, I check to see if there is only one distinct value of "none." If so, that means all the values are null. For these fields, I tag the field with a omitField of 1. For all other fields, omitField = 0. When I emit, I only emit when omitField = 0. This will give me a list of only the fields where there is actual data.


  • 5.  RE: Delete all the NULL columns in a file

    Employee
    Posted 11-25-2014 02:06

    Note: This was originally posted by an inactive account. Content was preserved by moving under an admin account.

    Originally posted by: Wizardous

    Thank you Ryeh.