Skip to main content
Answer

How to keep Master data in CDF

  • August 25, 2023
  • 5 replies
  • 101 views

Forum|alt.badge.img+3

How to keep Master data in CDF: the data which is not part of any asset hierarchy 

Best answer by Ben Petree

@nabanitakar You have a few options available to you.

  1. You can create a new database and table by going to Integrate > Prepare data for transformation
    1. You should then see the RAW Explorer. From here you can click the plus (+) sign to create a database. On the next page you will be able to create a table and you can drag and drop your csv right here.
  2. You can use one of the SDKs to do the same thing. Here’s the python SDK documentation:
    1. https://cognite-sdk-python.readthedocs-hosted.com/en/latest/data_ingestion.html#raw

5 replies

Forum|alt.badge.img

Hi @nabanitakar,

 

To better help answer or direct you to someone who can help you answer your question; What kinds of data represent “Master data” fin your question?


Forum|alt.badge.img+3
  • Author
  • Committed
  • August 29, 2023

Master data means set of data in table which does not depend on assets : its just reference data


Ben Petree
Seasoned Practitioner
Forum|alt.badge.img+4
  • Seasoned Practitioner
  • Answer
  • August 29, 2023

@nabanitakar You have a few options available to you.

  1. You can create a new database and table by going to Integrate > Prepare data for transformation
    1. You should then see the RAW Explorer. From here you can click the plus (+) sign to create a database. On the next page you will be able to create a table and you can drag and drop your csv right here.
  2. You can use one of the SDKs to do the same thing. Here’s the python SDK documentation:
    1. https://cognite-sdk-python.readthedocs-hosted.com/en/latest/data_ingestion.html#raw

Glen Sykes
Seasoned Practitioner
  • Seasoned Practitioner
  • August 30, 2023

Hi,

The view from Product Management considering the direction we are taking CDF, with Data Modelling at the core, we would recommend first considering creation of a data model for your Master Data (with all its requisite types and relationships) in the Data Modelling service

In future we are likely to position RAW as a temporary, staging store for data onboarding workflows, and not as a persistent storage location.

It would still be valuable if you could provide more information about the Master Data though @nabanitakar.  Is it just a simple, single reference table?  How many properties /columns in the table, and how many rows is it likely to grow to?

Thanks!


  • Seasoned Practitioner
  • September 12, 2023

Hi @nabanitakar, would you be able to give Glen a bit more information as requested?