Skip to main content
N
Seasoned ⭐️⭐️
nabanitakar
Seasoned ⭐️⭐️
August 25, 2023
Solved

How to keep Master data in CDF

  • August 25, 2023
  • 5 replies
  • 125 views

How to keep Master data in CDF: the data which is not part of any asset hierarchy 

    Best answer by Ben Petree

    @nabanitakar You have a few options available to you.

    1. You can create a new database and table by going to Integrate > Prepare data for transformation
      1. You should then see the RAW Explorer. From here you can click the plus (+) sign to create a database. On the next page you will be able to create a table and you can drag and drop your csv right here.
    2. You can use one of the SDKs to do the same thing. Here’s the python SDK documentation:
      1. https://cognite-sdk-python.readthedocs-hosted.com/en/latest/data_ingestion.html#raw

    5 replies

    T
    Expert ⭐️⭐️⭐️⭐️
    Thomas Sjolshagen
    Lead Product Manager
    August 29, 2023

    Hi @nabanitakar,

     

    To better help answer or direct you to someone who can help you answer your question; What kinds of data represent “Master data” fin your question?

    N
    Seasoned ⭐️⭐️
    nabanitakarAuthor
    Seasoned ⭐️⭐️
    August 29, 2023

    Master data means set of data in table which does not depend on assets : its just reference data

    Ben Petree
    Expert ⭐️⭐️⭐️⭐️
    Ben PetreeAnswer
    Expert ⭐️⭐️⭐️⭐️
    August 29, 2023

    @nabanitakar You have a few options available to you.

    1. You can create a new database and table by going to Integrate > Prepare data for transformation
      1. You should then see the RAW Explorer. From here you can click the plus (+) sign to create a database. On the next page you will be able to create a table and you can drag and drop your csv right here.
    2. You can use one of the SDKs to do the same thing. Here’s the python SDK documentation:
      1. https://cognite-sdk-python.readthedocs-hosted.com/en/latest/data_ingestion.html#raw
    Glen Sykes
    Expert ⭐️⭐️⭐️⭐️
    Glen Sykes
    Expert ⭐️⭐️⭐️⭐️
    August 30, 2023

    Hi,

    The view from Product Management considering the direction we are taking CDF, with Data Modelling at the core, we would recommend first considering creation of a data model for your Master Data (with all its requisite types and relationships) in the Data Modelling service. 

    In future we are likely to position RAW as a temporary, staging store for data onboarding workflows, and not as a persistent storage location.

    It would still be valuable if you could provide more information about the Master Data though @nabanitakar.  Is it just a simple, single reference table?  How many properties /columns in the table, and how many rows is it likely to grow to?

    Thanks!

    Glen | Cognite Product Management
    C
    Expert ⭐️⭐️⭐️⭐️
    Carin Meems
    Expert ⭐️⭐️⭐️⭐️
    September 12, 2023

    Hi @nabanitakar, would you be able to give Glen a bit more information as requested? 

    Terms & ConditionsAccessibility statement