List of Contributions

Ernest Jones

Employee

Contact Details

My Content

1 to 20 of 36 total

RE: concatenating N amount of columns and values comma separated

Posted By Ernest Jones 04-23-2024 09:54
Found In Egroup: Data360 Analyze \ view thread
I have been doing this a lot lately. I use the Lookup node where the second input somehow specifies the rules for how the data in the first input should be combined. So in this lookup, the fields in the second input are combined into an output field. the name of that output field is specified by the ...

RE: Create a Temporary List or Set in Transform Node

Posted By Ernest Jones 04-22-2024 09:27
Found In Egroup: Data360 Analyze \ view thread
What you are describing that you are doing is similar to what I've done very often lately. So I am pretty sure that the problem you are dealing with is a typo or mistake. Here is a simple way to do what I understand you are asking for using an Agg node: Input: Agg: Note that the second ...

RE: Search for a Future Date using wildcards

Posted By Ernest Jones 04-19-2024 10:10
Found In Egroup: Data360 Analyze \ view thread
Hi Mike, Would it be as simple as using a Filter node to find records that have a date after some date you specify? Ernest ------------------------------ Ernest Jones Precisely Software Inc. PEARL RIVER NY ------------------------------

RE: Data Flows that are "Locked for Editing"

Posted By Ernest Jones 04-01-2024 09:08
Found In Egroup: Data360 Analyze \ view thread
How about maybe refreshing the browser window without saving first? ------------------------------ Ernest Jones Precisely Software Inc. PEARL RIVER NY ------------------------------

RE: Batch insert query optimization

Posted By Ernest Jones 03-25-2024 10:05
Found In Egroup: Data360 Analyze \ view thread
Hi Henrik, I am unconvinced that the JDBC Store node is not the better option, but I'll answer. I have not tested to see if this approach to creating that SQL insert statement is faster. I often run across the need to build a single string value using a concatenated lest of values from multiple ...

RE: Calculate Fields Node

Posted By Ernest Jones 02-23-2024 09:08
Found In Egroup: Data360 Analyze \ view thread
What are you wanting to do with a calculate fields node? It looks like that example code is from a ProcessRecords property of a Transform node. So it is not the code that determines what columns to create. ------------------------------ Ernest Jones Precisely Software Inc. PEARL RIVER NY ---- ...

RE: Excel Node - Import Help!!

Posted By Ernest Jones 01-30-2024 09:08
Found In Egroup: Data360 Analyze \ view thread
I had another thought on what to do with mapping the various column names, because for a production environment I would not want to use a Fuzzy match to column and sheet names because I would not be able to trust it. Instead, what I've seen work well in another context is to create a mapping table. ...

RE: Excel Node - Import Help!!

Posted By Ernest Jones 01-29-2024 11:07
Found In Egroup: Data360 Analyze \ view thread
Hi Andrew, I won't try to answer the question about how to map field names to the fields you are looking for, or sheet names to the sheets you are looking for. Maybe the "Fuzzy Join" could be helpful. I just want to point out that the Excel node can be configured to write the sheets of an Excel file ...

RE: Synchronization of flows within Execute Data Flow Node

Posted By Ernest Jones 01-29-2024 10:49
Found In Egroup: Data360 Analyze \ view thread
Hi The first idea that comes to mind is to use the Sleep node to wait the 2 minutes before starting a dataflow. This attached screen shot shows how it might be structured. Disclaimer: I can't guarantee this will work because it relies on the controller that runs nodes inside dataflows to determine ...

RE: D360 Analyse - Load JSON Lines file using JSON Node

Posted By Ernest Jones 11-27-2023 15:53
Found In Library: Data360 Analyze

RE: D360 Analyse - Load JSON Lines file using JSON Node

Posted By Ernest Jones 11-27-2023 15:53
Found In Egroup: Data360 Analyze \ view thread
Hi Scott, So far, when I've had this problem I have done one of the following: If I don't need that part of the JSON data, I use the ability of the JSON node to split off certain parts of the JSON documents to additional outputs. So for your example, add an output named Attributes.Unde ...

RE: Number Stored as Text Error in Inserting Data in Excel

Posted By Ernest Jones 10-10-2023 10:13
Found In Egroup: Data360 Analyze \ view thread
When loading Excel, the int and long datatypes do get converted to text. You'll need to make those into double types if you want them to appear in Excel as numbers. ------------------------------ Ernest Jones Precisely Software Inc. PEARL RIVER NY ------------------------------

RE: Find special character and replace it and everything after it

Posted By Ernest Jones 09-29-2023 07:44
Found In Egroup: Data360 Analyze \ view thread
The "Trim Fields" node requires specifying the specific set of characters that will be removed, and it removes all of them. This is not aligned with what I understand to be the result you want. You could solve it using the find() method and slicing: In a Transform node it might look like this: ...

RE: Efficient method of splitting datasets

Posted By Ernest Jones 09-22-2023 09:25
Found In Egroup: Data360 Analyze \ view thread
I don't know the performance requirements you have, nor the performance expectations of the Analyze nodes. I can think of other ways to split up the data that probably run more slowly. You could add outputs to a Transform node and use the Python modulus operator on the value of node.execcount and ...

RE: Flattening rows

Posted By Ernest Jones 09-13-2023 10:15
Found In Egroup: Data360 Analyze \ view thread
My first thought was closer to what Peter Sykes did, but with a Transform node and a Sort. What he did is better than my first thought. Here is an answer that requires no Python code: ------------------------------ Ernest Jones Precisely Software Inc. PEARL RIVER NY ...

RE: Lookup node & performance

Posted By Ernest Jones 09-06-2023 08:51
Found In Egroup: Data360 Analyze \ view thread
My experience has been that the lookup node aborts if the right input is too big. About 10 years ago I would have the trouble when approaching a million records on the right input, but half a million records was ok. I did not analyze that with respect to the amount of memory available for that ...

RE: git/source control for LNA/data flow files

Posted By Ernest Jones 08-14-2023 17:02
Found In Egroup: Data360 Analyze \ view thread
Instead of exporting everything using "/", try exporting "/Users" or "/Public Documents". I've run into trouble exporting every single object by specifying the root folder. Maybe the new version will fix it. ------------------------------ Ernest Jones Precisely Software Inc. PEARL RIVER NY ------- ...

RE: Used datasets/attributes in Flows

Posted By Ernest Jones 06-27-2023 09:10
Found In Egroup: Data360 Analyze \ view thread
Hi The AnalyzeCli tool can be used to run searches through all the dataflows. https://doc.infogixsaas.com/analyzecli/Default.htm#c-getting-started/getting-started.htm ------------------------------ Ernest Jones Precisely Software Inc. PEARL RIVER NY ------------------------------

RE: Output Excel - File Name

Posted By Ernest Jones 05-05-2023 08:16
Found In Egroup: Data360 Analyze \ view thread
You can use the template feature as part of the steps to specify the output field names. First create the template spreadsheet with the column names you want using the Excel output node. Then use that spreadsheet as the template in a second Excel output node and this time tell it not to write the column ...

RE: DB Execute Node Performance

Posted By Ernest Jones 04-21-2023 09:02
Found In Egroup: Data360 Analyze \ view thread
That last thing you said about "crappy execution plan" is what stands out to me.  Has the DBA team made any suggestions as to why their database system would choose a different execution plan for one connection than it does for the other?  DBAs often have tools that can provide insight into what is ...