Consent

Cognite Hub is going public. So far, Cognite Hub has required users to log in to access some of its content. Now we have decided to open most parts of the community up to the public. For more information, please read our Privacy Policy and Terms and Conditions.

If you don’t agree with this privacy statement, you can reach out to support@cognite.com

×

COGNITE HUB

Check the documentation

Ask the Community

Take a look at Academy

Cognite Status Page

Contact Cognite Support

Products Cognite Data Fusion

Cognite InField

Cognite InRobot

Cognite Maintain

Cognite Remote

Website cognite.com

Groups
- - Knowledge Base
Product Updates
Product Ideas
Docs
Events
Academy
Our Partners

Impact 2024: The Industrial Data and AI Conference for and by Users | Nominate Speakers Now for a Ch...

(Mon, 14 Oct, 2:00 pm)

Home
Search

Replies posted by Gaetan Helness

72 Replies

Oldest first

Newest first

ZachHActive

asked in Developer and User Community

Does CDF support MQTT and Azure IoTHub for Time Series Data?

Hi,Thank you for your question.We have done MQTT integration for multiple customers. We have used our extractor-utils library that can be found onhttps://github.com/cognitedata/python-extractor-utils and the extractor can be deployed as a docker container.A simple configuration file containing connection information is read by the extractor to connect to MQTT and push data points to Cognite Data Fusion.We have also done GCP functions in the past triggering on messages from GCP Core (same as IoT Hub in Azure) as you are suggesting in your question.Let me know if that answers your question and if you would like additional information

Dhande RushikeshCommitted

asked in Developer and User Community

Black black --check is failing

You can clone the repository and runblack .locally on your environment and push it to the remote repository

Dhande RushikeshCommitted

asked in Developer and User Community

Black black --check is failing

You should install the python package black via pip or poetrypip install blackorpoetry install black

Anders BrakestadSeasoned

asked in Developer and User Community

Wildcard listing resources

Hi Anders, There is not any fuzzy search on the externalID field, but we do support fuzzy search on the name and description. https://docs.cognite.com/api/v1/#tag/Time-series/operation/searchTimeSeriesDepending on the data model, do you have possibility to filter on that information somewhere else like the metadata field for example? If not, I guess filtering after the fact is a way to go as well.

Luis Ramon Ramirez RodriguezCommitted

asked in Open Industrial Data

Did the sampling frequency changed over the years?

Regarding the ingestion and the sampling frequency there, this is not something we control as part of Open Industrial Data, the data is replicated from a data source we do not control, so it is very possible that something has changed over there

Pierre PernotPractitioner

posted in How-To Guides

How to run the OPC UA extractor with Docker [Cognite Official]

I can also recommend the guide the integration team has created regarding troubleshootinghttps://docs.cognite.com/cdf/integration/guides/extraction/opc_ua/opc_ua_troubleshootingAnd the OPC UA extractor can also run as a Windows service or as Linux executable if that is your choice of infrastructure. More to come on this soon.

Pierre PernotPractitioner

posted in How-To Guides

How to create and run a REST extractor [Cognite Official]

Excellent post Pierre!

Pierre PernotPractitioner

posted in How-To Guides

How to package a custom extractor as a Docker image [Cognite Official]

As usual, great article Pierre!

jaydeepCommitted

posted in Developer and User Community

Error running the Cognite replicator with Option 5

Yes, if you src_boolean_client_secret: True then you need to specify a client_secret as environment variables like you did. There could be a lot of events, it might take some time to replicate. the script is not hanging, but replicating in the background. Depending on the number of events on the source, it could take a considerate amount of time. For your case, they are over 40 million events in the publicdata project, which is why it takes some time

Frank DanielsenPractitioner

published in How-To Guides

How to use extraction pipeline configuration to configure Cognite functions [Cognite Official]

Interesting article @Frank Danielsen and @Jan Inge Bergseth

jaydeepCommitted

posted in Developer and User Community

Error running the Cognite replicator with Option 5

That is strange, it looks like the client secret you are not using does not have enough rights to list the events on publicdata. I would check with Cognite support who provided you the key to make sure you have the rights to view events.Otherwise, if you are confident using the Cognite SDK, you can perform a token inspect or try to list events manually to pinpoint the issue.

jaydeepCommitted

posted in Developer and User Community

Error running the Cognite replicator with Option 5

What is the value of “batch_size”? It looks like it is an dictionary. its value is set in the config file for examplelen(ts_src) is an int and printed above (408)batch_size should also be an int, can be set to 10000 for example

jaydeepCommitted

posted in Developer and User Community

Error running the Cognite replicator with Option 5

Ok, apologies, i think you found a bug, we will look into it and fix it today

jaydeepCommitted

posted in Developer and User Community

Error running the Cognite replicator with Option 5

Could you upgrade the package to the latest versionpip install cognite-replicator --upgradeVersion should be 1.2.3

jaydeepCommitted

posted in Developer and User Community

Error running the Cognite replicator with Option 5

Great to hear. Thank you for identifying this bug

tomaskurtenperezActive

asked in Developer and User Community

Error in Learn to Use the Cognite Python SDK

HiDid you run through the 1st notebook? (1_Authentication.ipynb)This is where the function to create the client is created and defined

tomaskurtenperezActive

asked in Developer and User Community

Error in Learn to Use the Cognite Python SDK

Have a setup the secret in your local environment?“Make Sure, You've created an environment variable CLIENT_SECRET with the value of the client secret obtained from admin.” There are multiple ways you can do that, either by using an .env file, you can get more information here You can also set the client secret using getpass, see more info here. The lines of code for that are in the notebook, but commented The line to check if the client is connected should beclient.iam.token.inspect()We will update the code on the notebook.

Pierre PernotPractitioner

Transformations: Asset External IDs instead of IDs for linking Events, Timeseries, Sequences to AssetsGathering Interest

+1 or at least to extend the functionhttps://docs.cognite.com/cdf/integration/guides/transformation/write_sql_queries/#asset_idsto be able to use externalId as wellUsing names can lead to unexpected results since they are not unique

Pierre PernotPractitioner

Transformations: Asset External IDs instead of IDs for linking Events, Timeseries, Sequences to AssetsGathering Interest

Similar to the one for dataset i guesshttps://docs.cognite.com/cdf/integration/guides/transformation/write_sql_queries/#asset_ids

Pierre PernotPractitioner

Transformations: Asset External IDs instead of IDs for linking Events, Timeseries, Sequences to AssetsGathering Interest

In general, we would also like to be able to create our own custom SQL function as well

Gaetan HelnessSeasoned Practitioner

Delete RAW rows using TransformationsParked

Thank you for the feedback Sunil

Pierre PernotPractitioner

posted in Developer and User Community

How to create events for different assets with transformations

Great article Pierre. Pierre also opened a product idea around that topic, if you are interested, please upvote it

Pierre PernotPractitioner

Transformations: Asset External IDs instead of IDs for linking Events, Timeseries, Sequences to AssetsGathering Interest

thanks @Thomas Sjølshagen , yes that makes sense. Yes as a data engineer, you will most likely know the external_id so having a way to find the id from external_id is necessary. It would be good to have either a custom function for that or allowed directly in transformations

jaydeepCommitted

posted in Developer and User Community

Cognite replicator fails to replicate asset data with inconsistent behaviour

Thank you for the feedback, we will look into it and try to replicate the issue

Gaetan HelnessSeasoned Practitioner

Save output of calculations in chartsPlanned for development

cc @roman.chesnokov

1
2
3

Page 1 / 3

Generate client secret for OID

Please generate a client secret once every 180 days.

Choose the application:

Badge winners

Grayson Guilherme Silva Cunhahas earned the badge Cognite Data Fusion Fundamentals
Mayuri Bhogehas earned the badge Cognite Data Engineer Basics - Transform and Contextualize
Vijaya Vandanahas earned the badge Working with Cognite InField
Dixonhas earned the badge Cognite Data Fusion Fundamentals
Christian Slettenhas earned the badge Working with Cognite InRobot

Show all badges

Powered by Gainsight

Terms & Conditions Cookie Settings

Sign up

Already have an account? Login

Log in with your business account

Log in to the community

Log in with your business account

Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.

Username or e-mail

Back to overview

Scanning file for viruses.

Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.

OK

This file cannot be downloaded

Sorry, our virus scanner detected that this file isn't safe to download.

OK

RESOURCES Learn Documentation Support Status Page
GETTING STARTED Sign up to Cognite Hub Get Started with Cognite Hub About Us Contact Us
FOLLOW US

© 2022

Powered by inSided