Cognite Data Fusion: Cognite Streaming data Extractor

Related products: Extractors

As a developer, I want to use a Streaming data connector in the data integration, so that the data pipeline codebase can be reduced in complexity. 

 

Extracting data from a Stream prorcess to CDF RAW/CLEAN is a critical piece of  infrastructure maintained at Statnett. The same features as exists for SQL extraction would allow us to reduce complexity and increase maintainability of the extraction process. 

This code  must be executable on-prem at Statnett. 

Updated idea statusNewGathering Interest

Hi Robert, thanks for providing the detailed request and relevant initiative from Statnett end.

Understanding the criticality - we have captured this into our planning and will soon share details about the plans. Let us connect a bit more to strip down this capability need into concrete functions that should be enabled by CDF, work towards a success definition.

As a developer, I want to use a Streaming data connector in the data integration, so that the data pipeline codebase can be reduced in complexity. 

 

Extracting data from a Stream prorcess to CDF RAW/CLEAN is a critical piece of  infrastructure maintained at Statnett. The same features as exists for SQL extraction would allow us to reduce complexity and increase maintainability of the extraction process. 

This code  must be executable on-prem at Statnett. 

 


Thank you for your input on the use of a Streaming data connector in our data integration process. We understand the importance of reducing complexity and increasing maintainability in the extraction process, and we will take your suggestions into consideration as we continue to develop and improve our products. Thank you for being a valued customer of ours, and please don't hesitate to reach out if you have any further questions or concerns.

 

You can find our current roadmap here - 

 

You can subscribe for our product updates here - https://hub.cognite.com/product-updates

 

Thanks,

 

Samar Vir singh 

Data Onboarding Group, Cognite