Data360 Analyze

Hi,

How can I  see all rows (when over 1000 rows are in question) in Data Viewer?

In Bre I just needed to right click on the wanted output and choose Data Viewers (all). However I couldn't find this feature in Dataverse. How can I see all line items in Data Viewer if there are more than 1000 lines in output? In most of my data flows the data is way more than 1000 rows.

Best regards,

Pauli

Hi Pauli,

the current release of Dataverse only enables the first 1000 records to be displayed in the Data Viewer, It is a roadmap candidate to offer mechanisms to view more than 1000 records in the Data Viewer.

You can currently use the 'Export to CSV' menu item on the right side of the Data Viewer to export all the data in the data set of the selected tab to a file.

Regards,

Adrian

Here's a trick for you: If you simply want to review the records 1000-1999, then add a HEAD node and configure it for 2000 records, and send that output to a TAIL node set for 1000.   That will give you the second block of records.

From Data360 Analyze v.3.4.3 you can set the maximum number of records that are displayed in the Data Viewer:

A system property has been added that you can use to define the number of records that are displayed in the Data Viewer. Previously, the data viewer displayed a maximum of 1000 records.
To configure the property, add the following line to your cust.prop file, replacing <records> with the required value:

ls.lae.dataviewer.pageSize=<records>

The value will be applied to all users. The maximum value is 20 000. If you enter a value greater than 20 000, the first 20 000 records will be displayed.

See this article for details of the system property files.

https://support.infogix.com/hc/en-us/articles/360048214134-Data360-Analyze-prop-files-explained

Hi Adrian, will this parameter after the GUI:n prestanda and the execution file size since we load more data in every node?

Is there a way in Analyse to choose in the node itself to show more than 1000?

thank you

Sebastien

I'm not entirely sure I understand your questions but I will state the following:

When a node runs the data associated with an output pin's records are stored in an application temporary data file. The size of this file is not affected by how many records are configured to be displayed in the data viewer (since all of the records are always stored). 

The ls.lae.dataviewer.pageSize property only affects the maximum number of records that will be displayed by the Data Viewer. However, the data to be displayed must be transferred from the server-side to the client browser. So, if the property value is increased then more data will be transferred when the output pin has more records than the current limit (1000) - requiring additional bandwidth and processing on both the server-side and client (browser). Compression of HTTP responses from the web app was introduced in the v.3.6.0 release, which will partially mitigate the extra bandwith required for transferring the additional records and also increases the responsiveness of UI in general. Increasing the property value will increase the data transferred to all clients so this may increase delays in displaying data, especially for clients on slow internet links when the data set is very wide. The system maximum of 20,000 was set as a protective control to limit the overall impact on the operation of an Analyze Server intance. 

There is no per-node control to determine the maximum number of records that are displayed by the Data Viewer. A Head (or Tail) node can be used to extract a defined maximum number of records from a data set of an upsteam node. 

The Data Viewer allows (subject to permissions) a user to download the entire data set for an output pin. This data is downloaded by the client browser as a zipped file.