List of Contributions

Peter Sykes

Contact Details

My Content

1 to 18 of 18 total

RE: Edit/Change Field API Name

Posted By Peter Sykes 04-18-2024 08:56
Found In Egroup: Data360 Govern \ view thread
Certainly this is the way it has been for some time. It would be great to have the option to just do it. Maybe you want to post that to the ideas forum. ------------------------------ Peter Sykes Data Governance & Architecture Vontobel Holding AG Zurich ------------------------------

RE: Check field type and Convert to int dynamically in a transform node?

Posted By Peter Sykes 02-09-2024 03:15
Found In Egroup: Data360 Analyze \ view thread
Something I have some stuff which converts to unicode. Process records: for fieldName in in1: out1[fieldName] = unicode Configurefields: for fieldName in in1: if in1[fieldName] is not Null: out1[fieldName] = unicode(in1[fieldName], "utf-8") You can do something similar for integers. ...

RE: Field name with spaces

Posted By Peter Sykes 02-02-2024 03:03
Found In Egroup: Data360 Analyze \ view thread
Once field names become interesting, e.g. the output from JSON with dots etc, I find it easier to use the dictionary notation. (Not sure if its really called that). Its a few more chars to type, but seems bombproof. Configure fields: out1['Feed Identifier'] = unicode Process Records: out1['Feed Identifier']= ...

RE: Proper Syntax to call Oracle Stored Procedure using DB Execute

Posted By Peter Sykes 10-17-2023 04:50
Found In Egroup: Data360 Analyze \ view thread
There are some options, but with a JDBC execute node you can just paste in a valid anonymous PL/SQL e.g. from SQL developer to run it. You don't seem to require any parameters so something like this: Also the JDBC execute node needs an input, even if just dummy data from a create data node. sql query: ...

RE: Flattening rows

Posted By Peter Sykes 09-13-2023 09:41
Found In Egroup: Data360 Analyze \ view thread
Nice. ------------------------------ Peter Sykes Vontobel Holding AG Zurich ------------------------------

RE: D360 - Excel SOLVER Equivalent

Posted By Peter Sykes 08-17-2023 02:26
Found In Egroup: Data360 Analyze \ view thread
Hi Andrew, This is certainly possible, but even a back of the envelope implementation is a bit of work. As you know, what you are trying to do is linear optimization. You would have two approaches in general: a library based approach or a native one one. For the library based approaches - there ...

RE: Execute Stored Procedure oddity

Posted By Peter Sykes 07-12-2023 03:26
Found In Egroup: Data360 Analyze \ view thread
If this is Oracle, then there are some strange cache behavior, even when you have nocache set in the sequence definition, especially when different users are used to insert rows. The default sequence cache for oracle is 20. In a developer session, you will probably always have the sequences cached ...

RE: Changing query

Posted By Peter Sykes 05-30-2023 01:58
Found In Egroup: Data360 Analyze \ view thread
Hi Henrik, I have been able to use the snowflake version of an anonymous pl/sql block in the jdbc execute node. (needed as the exception handling is not helpful in Analyze). I would try if Oracle pl/sql works in the same way, (begin.. xzy... end). If so, there are many examples out there with running ...

RE: Calculating max dates with transform node

Posted By Peter Sykes 03-28-2023 03:09
Found In Egroup: Data360 Analyze \ view thread
It is probably possible to do all at once, but I would probably just aggregate the data (using an an aggregate node), get the max date, and do a lookup with the original stream and the output of the aggregate to "join" and then filter/split the rest of the values. This does take some more components, ...

RE: Removing spaces from string in column

Posted By Peter Sykes 03-28-2023 03:05
Found In Egroup: Data360 Analyze \ view thread
Something like this would be easier to comment on if you include a couple records of sample data. I think you might want to change the line fields['S&E'] = str2 to be out1['S&E'] = str2 If you don't expect an array then I probably wouldn't personally use "in". I don't think its doing what you expect ...

RE: Use Oracle Sequence and add to incoming data

Posted By Peter Sykes 03-26-2023 16:49
Found In Egroup: Data360 Analyze \ view thread
If your organization's coding standards allow for it, then the easiest thing to do is to set the column default value to the sequence.NEXTVAL you want to use, and ignore the entire column in the insert statement. This works with JDBC store, I think it should work with DB Store. ------------------------------ ...

RE: Fetch XML from Database

Posted By Peter Sykes 02-10-2023 07:54
Found In Egroup: Data360 Analyze \ view thread
It should be more or less the same (use the same DB Query parameters now in the more or less the same fields on the JDBC node). Depending on how friendly the tnsnames has been set up in your organization that will work. If that is not so nice, e.g. if you use ldap, then you will need to use the same ...

RE: Fetch XML from Database

Posted By Peter Sykes 02-10-2023 03:15
Found In Egroup: Data360 Analyze \ view thread
I reproduced your problem with the Db Query node. I think this is a very low level issue due to the CLOB datatype and OCI. I would stay away and use the JDBC interface to get the data / as below with the same SQL it works for me. If you can-t you need to raise a ticket with support. ------ ...

RE: Fetch XML from Database

Posted By Peter Sykes 02-09-2023 04:08
Found In Egroup: Data360 Analyze \ view thread
I have a few places where I select from a clob and then do JSON node - which is more or less the same thing as I think you're trying to do. It works out of the box for me, but I do use the JDBC driver to connect to Oracle. Since you have a clob already, you could also consider pushing down the xml ...

RE: Iteration

Posted By Peter Sykes 01-10-2023 12:22
Found In Egroup: Data360 Analyze \ view thread
Hi Juan, I would suggest that this is more of a master data management question than an analyze question. Analyze will do anything that you can algorithmically formulate. So you just need to be clear what your business rule is for the task before you code it.  My opinion is that there is no perfect ...

RE: Accessing flow runtime/statistics outside of Analyze

Posted By Peter Sykes 01-10-2023 03:05
Found In Egroup: Data360 Analyze \ view thread
Hi Irakli, Look into the Analyze API.  When logged into your server, press the help (i) button on the top right near your user name and look for "System Administration" / "API Developer documentation" in the menu. The look for the tutorial in that section For me this looks like:  https:// ...

RE: version 3.10 is extremely slow

Posted By Peter Sykes 11-24-2022 08:25
Found In Egroup: Data360 Analyze \ view thread
Hi Marisa, for us - this particular error usually happens when we run out of disk space on the disk with the "temporary execution" area. For our flows they can consume a lot of space very quickly especially, when a few flows run at the same time, so we try to keep 100GB more than we need at any moment.  ...

RE: Python Version

Posted By Peter Sykes 04-12-2022 04:36
Found In Egroup: Data360 Analyze \ view thread
We would also be interested in what time timeline is here. We have some python specific 2.7 code that would be much better in 3.x