.csv file Ingestion into CDF using Python SDK [Community Contributed]

Forum|Forum|3 years ago
May 24, 2023
4 replies
198 views

hello community,

can anyone tell me is there any way to upload .csv files to CDF using Python SDK.

Best answer by roman.chesnokov

@Viswanadha Sai Akhil Pujyam to insert CSV as a RAW table, you can use the following snippet:

import numpy as np
import pandas as pd
from cognite.client import CogniteClient

DATABASE_NAME = "db"
TABLE_NAME = "table"
CSV_FILENAME = "source.csv"

client = CogniteClient()

client.raw.databases.create(DATABASE_NAME)
client.raw.tables.create(DATABASE_NAME, TABLE_NAME)

df = pd.read_csv(CSV_FILENAME, index_col=0).fillna('')

client.raw.rows.insert_dataframe(DATABASE_NAME, TABLE_NAME, df)

H

Håkon V. Treider

Practitioner ⭐️⭐️⭐️

To upload an actual file, check out:

https://cognite-sdk-python.readthedocs-hosted.com/en/latest/cognite.html#upload-a-file-or-directory

Or do you want to read the data and upload for example the rows as assets?

roman.chesnokovAnswer

Expert ⭐️⭐️⭐️⭐️

@Viswanadha Sai Akhil Pujyam to insert CSV as a RAW table, you can use the following snippet:

import numpy as np
import pandas as pd
from cognite.client import CogniteClient

DATABASE_NAME = "db"
TABLE_NAME = "table"
CSV_FILENAME = "source.csv"

client = CogniteClient()

client.raw.databases.create(DATABASE_NAME)
client.raw.tables.create(DATABASE_NAME, TABLE_NAME)

df = pd.read_csv(CSV_FILENAME, index_col=0).fillna('')

client.raw.rows.insert_dataframe(DATABASE_NAME, TABLE_NAME, df)

V

Viswanadha Sai Akhil PujyamAuthor

Committed ⭐️⭐️⭐️

thank you roman_chesnokov

Dilini Fernando

Expert ⭐️⭐️⭐️⭐️

Hi @Viswanadha Sai Akhil Pujyam,

We appreciate your contribution to our community hub! We have chosen to move your article to our hub's How-To section as it will greatly benefit other members of our community. Thank you for your understanding, and we look forward to seeing more great contributions from you in the future!

Best regards,
Dilini

Sign up

Welcome to Cognite Hub