As part of integration, data fabrics, or organisation-wide analytics, developers have to pull in (or reach out and retrieve) data from disparate data sources.
The typical normalise and build a common/canonical data model of tables and fields that are populated with data from these different sources, and then utilised at an organisation level for reporting, machine learning and other practices.
It would be great to have a toolkit that allows user to quickly setup and define a canonical data model with these features:
- define a common data model through UI
- define data source contributors of this data model
- define how fields from the data sources are mapped into fields from the common model, include the ability to normalise/transform data on the way in
- introduce a set of interoperability business services/DTLs, and other utility specifically developed to quickly allow for onboarding additional data sources.
InterSystems advanced data modelling capabilities, schema free document databases, and experience in Information Exchanges all seem to be attributes that would help in developing this to.
I believe we are heading down this path with Total View for Asset management, (and even supply chain orchestrator), where Total View for <fill in the blanks> will eventually be possible, so it seems this idea is going to be embraced eventually
There is a comment on this idea from a Community Team expert.
The idea was transferred to the status “Will not implement”, since the author did not respond to comment for several months.
If the author responds to this comment, the status of this idea may be changed.
@Stephen Pisani, you have a comment on your idea. Please answer it to help your idea to be promoted.
It does not look like something has to be done on IRIS side. This mostly looks like the work for some external tool.
I have needed anything like that, but pretty sure, there are many tools like that (probably proprietary), suitable for that.