Skip to main content
Answer

csv_extractor extraction pipeline

  • October 12, 2023
  • 2 replies
  • 46 views

Forum|alt.badge.img+3

Hello,

I am running a csv_extractor that loads data to Raw explorer. I run the extractor from my machine locally through cmd. How do I set up an extraction pipeline to monitor this extractor? I created an extraction pipeline from “monitor extractor”, but not sure how to link it to my extractor.

Regards,

Diana

Best answer by Gaetan Helness

Hi, 

You can use the API https://api-docs.cognite.com/20230101/tag/Extraction-Pipelines-Runs/operation/createRuns or the SDK for that purpose https://cognite-sdk-python.readthedocs-hosted.com/en/latest/data_ingestion.html#cognite.client._api.extractionpipelines.ExtractionPipelineRunsAPI.create

 

If using our python extractor-utils library, you get that out of the box

https://cognite-extractor-utils.readthedocs-hosted.com/en/latest/uploader.html#extraction-pipeline-runs

 Hope that helps, let me know if any additional questions

2 replies

Gaetan  Helness
MVP
Forum|alt.badge.img+1

Forum|alt.badge.img+3

Thank you, this was very helpful!