Data360 Analyze

The new profiling side panel looks like a great feature to have. Are there any instructions available on how exactly you could add this to your technical assets? Can it be done via Analyze? Any suggestions?

Thanks

Hi Jonas,

If you look at the Swagger page for the API in the integration option from the left hand menu, so can easily see how to post a payload to Govern to display your data. The best thing is that you can use Swagger to test it without having to build anything in Analyze just yet 

<Instance>.data3sixty.com/swagger/ui/index#!/DataProfiles/DataProfiles_PostDataProfiles

You can use the below payload in Swagger to have a quick test - you just need to swap the UID for the asset you want to test with 

[
{
"ExecutionItemUid": "00000000-0000-0000-0000-000000000000",
"assetUid": "XXXXXXXXXXXXXXXXXXX",
"profileSetDate": "2021-07-27T08:36:42.212Z",
"sampleCount": 100,
"blankCount": 0,
"nullCount": 10,
"min": "string",
"max": "string",
"mean": 0,
"minLength": 3,
"maxLength": 27,
"standardDeviation": 0,
"multiline": true,
"regExp": "string",
"confidence": 1,
"type": "string",
"typeQualifier": "string",
"logicalType": true,
"leadingWhiteSpace": true,
"leadingZeroCount": 0,
"trailingWhiteSpace": true,
"matchCount": 0,
"outlierCardinality": 0,
"outlierDetail": [
{
"key": "string",
"count": 0
}
],
"possibleKey": true,
"dataSignature": "string",
"structureSignature": "string",
"bottomK": [
"string"
],
"topK": [
"string"
],
"cardinality": 0,
"cardinalityDetail": [
{
"key": "string",
"count": 0
}
],
"shapesCardinality": 0,
"shapesDetail": [
{
"key": "string",
"count": 0
}
],
"totalCount": 1000,
"outlierCount": 0,
"keyConfidence": 0,
"detectionLocale": "string",
"ftaVersion": "string",
"decimalSeparator": ""
}
]

 

 

You can then build the above payload using analyse from whichever tool you are using to do the profiling and then push it in via analyse or any other tool

Any questions, let me know

Thanks

John

As John states above, you can use the APIs and build your own solution to populate the data. No additional configuration is required to add the profiling data to the technical assest.

Following the release of Analyze v.3.8.0 in August, you will also be able to purchase an Analyze data flow that will be able to populate the data.

Thanks,

When using the swagger, I receive the error (see attached). Any suggestions on how to fix this?

Attached files

Screenshot 2021-07-27 140123.jpg

what is the attribute ""mean": ," set to in your payload 

The Mean value should be set as a Floating point number and not a decimal by the looks of the error message

it may be as simple as you have too many decimal places in your floating point number and therefore the system is seeing it as a decimal

<x-zendesk-user data-user-name="John Taylor">418727439473</x-zendesk-user>; have you already been able to get this side panel working?

Yeah I have it working fine.

We typically don't connect to transactional data to do quality scoring or profiling using Data360, so we currently have limited use cases, but this may certainly change over time.

More than happy to support you to get a test working for you too. If you can reply back with some dummy data you want to load and I will craft the payload for you

Thanks

John

Hi John,

Sorry for the late reply... what kind of data would you need? 

The asset UID? And the details as mentioned in the body here? https://dta.dev.data3sixty.com/swagger/ui/index#!/DataProfiles/DataProfiles_PostDataProfiles

Thanks,

Jonas

Not really the Asset UID more the content of the body of the payload you are trying to push and failing.

I'll then push the same payload to a test record in my dev instances and work out why it is failing for you. It is likely to be the format of a number field that the API endpoint is expecting and you are supplying something slightly different.

can you send me you test body payload?

Hi John,

In the meantime, we have successfully added this new profiling panel.

Thanks for your feedback on this topic.

Kind Regards,

Jonas