Skip to main content

Developer and User Community

Join the discussions about delivering apps and data-driven decisions powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 818 Topics
  • 2,601 Replies
818 Topics
A
Seasoned
Anders WillersrudSeasoned
asked in Developer and User Community
Change name of dataset

We would like to change a name of our dataset in Fusion (specifically data set id=7661001648160088 on statnett, test), but get the error message [  {    "status": 400,    "message": "Either set must be populated or setNull must be true."  }]` The dataset has related timeseries and asssets. What does it mean that the dataset must be populated? And what are we missing?

4
A
Seasoned
2 years ago
K
KimStewartNew
asked in Developer and User Community
Code and URL for re-registering Cognite Hub in Authenticator app

A college has lost the Cognite hub account in the authenticator app.He cannot register as new account since his account exists.He needs to re-register Cognite hub but does not have the account details to manually enter them.Could you please provide details of the code and URL.Note that currently Cognite hub only provides the option to authenticate via the authenticator app. Could you also provide the option to authenticate via a text message. 

1
Maria Fonseca
Practitioner
2 years ago
B
Practitioner
Bernt ReinhardtSenior Data Engineer
posted in Developer and User Community
Migrating a CDF project from legacy to OIDC authentication using Azure as Identity Provider (idP)

This article is intended for customers that are planning to migrate, or are in the process of migrating, to Cognite Data Fusion’s (CDF) new authentication system which will be based on Open ID Connect (OIDC). It will cover in detail all aspects of this migration process, and hopefully help making this migration process as simple as possible.What is OIDC? OpenID Connect is an industry-standard protocol supported by many popular identity providers (IdP), such as Azure Active Directory (Azure AD), Microsoft's cloud-based identity and access management service.For more information about OIDC, please visit the official website. What are the benefits of using OIDC over CDF’s legacy authentication? The greatest benefit of using OIDC over CDF’s legacy authentication, is that the user’s identity will now have a single source of truth – the Identity Provider (idP). This simplifies identity management greatly, and makes it more secure by leveraging the idP’s strength – namely identity management.

0
B
Practitioner
2 years ago
Mari Sofie Korslund
Practitioner
Mari Sofie KorslundSenior Product Manager
posted in Developer and User Community
All your solutions in one place with Cognite Solutions Portal

Hi all, did you know you can activate Cognite Solutions Portal, your one stop shop to all your Cognite enabled solutions, with just a few clicks? Check out this video for a quick deep dive into the Solutions Portal.I presented the Solutions Portal at yesterday's Product Release Spotlight Webinar as well. I'd recommend you to watch this webinar, for a quick intro to our major December release features. The recording is available for you here.For any thoughts, ideas or feedback on Cognite Solutions Portal, I'd love to hear from you in the comment field below this post  

0
Mari Sofie Korslund
Practitioner
2 years ago
Emmy Reehorst
Practitioner
Emmy ReehorstPractitioner
asked in Developer and User Community
Do you have 20-30 minutes this week to help us improve Charts?

Hi!Im a designer,  working on improving the front page of Charts.I would love to talk to 4 of you, to get feedback on our thought so far. I will show you what we are thinking, and you can help us move forward in the right direction.Comment here, or send me a mail to emmy.reehorst@cognite.com We want to do this for more features and improvement in the future. So even though we only need to talk to four of you this time, there will be several more opportunities in the future!

3
Eric Stein-Beldring
Seasoned Practitioner
2 years ago
E
Seasoned Practitioner
Eniko FarkasCognite Academy Instructor
posted in Developer and User Community
New introductory courses about Cognite Data Fusion

Hey Everyone,I’m Enikő from Cognite Academy. In our team, we create the e-learning courses and deliver the training events you can find on Cognite Learn.I’m excited to share with you the newest content we have just released: Cognite Data Fusion Fundamentals. This is the learning path for you if you’re new to Cognite Data Fusion and don’t know where to start your learning journey. The courses in this path walk you through the building blocks of CDF and help you get started with using the platform through guided hands-on exercises.Check out this article to learn more.

0
E
Seasoned Practitioner
2 years ago
Eric Stein-Beldring
Seasoned Practitioner
Eric Stein-Beldring
posted in Developer and User Community
Thanks for joining our first New Features & Feedback Webinar — recording & slides

Thanks to those of you who joined us live for our first webinar in our New Features & Feedback series.You will find the session recording, below, and you can view the slides that we presented by clicking here.We look forward to our next New Features & Feedback session in January 2022! 

1
Johan
Committed
2 years ago
thomafred
Seasoned
thomafredSeasoned
asked in Developer and User Community
Python SDK Azure B2C Authentication

Hi there,I am trying to authenticate the CogniteClient in bluefield using our Azure B2C: response = requests.request("POST", "https://oceandataplatform.b2clogin.com/oceandataplatform.onmicrosoft.com/B2C_1A_ROPC_Auth/oauth2/v2.0/token", headers={ 'Content-Type': 'application/x-www-form-urlencoded'}, data={ "grant_type": 'password', "client_id": client_id, "scope": 'openid https://westeurope-1.cognitedata.com/user_impersonation', "username": username, "password": password,})creds = response.json()client = CogniteClient( token=creds["access_token"], project="oceandata", base_url='https://westeurope-1.cognitedata.com', client_name="cognite-python-dev", debug=True,)This works perfectly :) Edit: I initially asked how to get this working before spotting a typo in the code. Everything works fine now. Leaving the post here so that others may use it for reference.

1
thomafred
Seasoned
2 years ago
Eric Stein-Beldring
Seasoned Practitioner
Eric Stein-Beldring
posted in Developer and User Community
Reminder: New Features & Feedback Webinar TODAY 15:00-16:00 CET (see post for MSFT Teams link to join)

This is a friendly reminder that we will be hosting our New Features & Feedback webinar today from 15:00-16:00 CET  → You can join the Microsoft Teams call by clicking here ←If you have any trouble joining, please leave a comment in this thread or send an email to eric.stein@cognite.com We’ll be giving a deep dive tutorial about the new no-code calculations builder and automatic data alignment, which were released yesterday. We’ll also be hearing from you – our early adopters – with your feedback and ideas for how we might improve upon these features in the future.This session will also be recorded and the video will be shared here in the Early Adopter Group afterwards. The team and I are looking forward to talking with you soon!

0
Eric Stein-Beldring
Seasoned Practitioner
2 years ago
Christian Dalen
Active
Christian DalenActive
asked in Developer and User Community
Unable to trigger transformations through Playground API

 Since last week, I have not been able to trigger any transformations via the Playground API.({{baseUrl}}/api/playground/projects/{{project}}/transformations/:id/run)I am getting :404 Not foundwith response body: {"code":4(Yes; a incomplete json)I noticed also that the API has now been included in API v1. Is maybe this error related to this change?Related (?):I can see that when I run a “GET” using the new endpoint, I get the same error ({"code":4). Have you been a bit quick in the implementation and running a GET on the v1 API from the playground API? I can also mention that it does actually work using the new v1 endpoint, so this will solve the problem. My problem is, off course, that I am currently using the Playground API which is currently failing and I have to replace the logic and test/release it (Taking extra time).Working Example:POST {{baseUrl}}/api/v1/projects/{{project}}/transformations/runThe example from Postman is with externalId, so you will have to replace it with “id”

1
Emel Varol
Practitioner
2 years ago
J
Committed
Jonas DigernesCommitted
posted in Developer and User Community
Charts feature requests

Hi,Some feature requests I would like to see in Charts:-Function like pandas where. We have sensors with for instance zero point error. In many calculations it can be useful to set values bellow a point to zero to avoid larger errors to sum up over time.-When Charts and AIR are integrated it would be nice to have more logic and comparing functions. For instance to set an alarm if only certain conditions are met.-Writing own python code in a function block would have been nice, but I guess that could be a problem with the security?-Text box to comment in the function blocks would be nice.-Xy-plot and table output would be nice. If export to Grafana is fixed the function is available there.-Custom units or more default units in calculations.

13
Eric Stein-Beldring
Seasoned Practitioner
2 years ago
Eric Stein-Beldring
Seasoned Practitioner
Eric Stein-Beldring
posted in Developer and User Community
A new version of Charts has been released! Join tomorrow's webinar (15:00-16:00 CET) for more info

Hello Charts community,We have just released a new version of Charts (charts.cogniteapp.com), which is available for all of you to use! Please try it for yourself and, of course, share your feedback here in the Charts group.You can read more details about this release below. You can also read about the other Cognite Data Fusion features that have been released today here.Also, remember to join tomorrow's webinar over Microsoft Teams, where we'll be walking through the details of this release and asking for your direct input and feedback. For details and joining info, please visit this post.  Release DetailsA new and improved no-code calculation builder experience (read more below) Numerous bug fixes & improvements included in this feature @Johan this includes the zooming and scrolling functionality that you had requested  Automatic data alignment (read more below) Searching for externalID in the search bar will highlight when there's an exact match Updated login page, matching

0
Eric Stein-Beldring
Seasoned Practitioner
2 years ago
Eric Stein-Beldring
Seasoned Practitioner
Eric Stein-Beldring
posted in Developer and User Community
Charts Webinar: New Features & Feedback (December 8, 2021, 15:00-16:00 CET)

Hello Charts Early Adopter Community,You're invited to a webinar where we in the product team will be sharing the latest and greatest features in Charts!When: Wednesday December 8th from 15:00-16:00 CET→ Click here to add the event invitation to your calendar.Where: Virtually (Microsoft Teams)→ We'll be hosting this webinar over a Microsoft Teams video call (click here to join the call) so all of you who attend can directly engage with the Cogniters who are presenting. The features we’ll highlight in this session will include…Our new, no-code calculation builder with an improved UI and numerous improvements and new features.Automatically data alignment in calculations, so you can spend more time performing industrial data analytics and less time worrying about data alignment.I will be giving an in-depth walkthrough of these features and how to use them. We'll also have an open discussion between you, our early adopters, and the members of the Charts team about ideas for future improvem

0
Eric Stein-Beldring
Seasoned Practitioner
2 years ago
thomafred
Seasoned
thomafredSeasoned
posted in Developer and User Community
CDF Modelling Challenge - SpatioTemporal Asset Catalog

Hi everyone,We in are running a series where we are challenging the community to model a certain problem in CDF. The aim with this series is to facilitate discussion and invite the community members to share interesting solutions and techniques.In this second entry of the series we will focus on the SpatioTemporal Asset Catalog (STAC).The SpatioTemporal Asset Catalog (STAC) specification provides a common language to describe a range of geospatial information, so it can more easily be indexed and discovered. A 'spatiotemporal asset' is any file that represents information about the earth captured in a certain space and time.The goal is for all providers of spatiotemporal assets (Imagery, SAR, Point Clouds, Data Cubes, Full Motion Video, etc) to expose their data as SpatioTemporal Asset Catalogs (STAC), so that new code doesn't need to be written whenever a new data set or API is released.(source)In C4IR Ocean, we are primarily dealing with geospatial data. The data originates from mult

3
S
Practitioner
2 years ago
A
Seasoned
Andreas KimsåsSeasoned
asked in Developer and User Community
Can data access rights be scoped by other means than datasets?

What are the alternatives for scoping read/write rights to different users?Dataset is the most intuitive way of limiting access rights to subsets of data, but if i would like to share data that is scattered across different datasets, but  easily identifiable by sharing a common label, are there any options? 

4
L
Practitioner
2 years ago
Sunil Krishnamoorthy
Seasoned Practitioner
Sunil KrishnamoorthyProduct Manager
posted in Developer and User Community
Transformations APIs and SDK Early Adopter Group

Do you want to learn how your siloed data gets enhanced and made ready for consumption in Cognite Data Fusion? Or, do you want to manage your transformation jobs programmatically?Search no more, we have the new Transformations APIs and SDK available. Join the user group, the entire Data Integrations team is there!As a member of the Transformations APIs and SDK Early Adopter Group, you will: GET ACCESS Introductory courses for data transformation in Cognite Data Fusion, the latest product updates, tips and tricks GET INSPIRED We share use cases and identify best practices BE HEARD We encourage and welcome your feedback BE IN THE KNOW By seeing how your feedback impacts our decisions and get a preview of what we are working on next Hop over to the Group

0
Sunil Krishnamoorthy
Seasoned Practitioner
2 years ago
Emel Varol
Practitioner
Emel VarolPractitioner
posted in Developer and User Community
Check out our course Integration Fundamentals!

New to data transformations? The course Integration Fundamentals walks you through the data’s journey from source systems through the staging area to being transformed into Cognite Data Fusion (CDF) resource types. Learn what the typical uses of transformations are and watch a demo the built-in transformation tool in CDF.After completing this course, you’ll be able to:Summarize the data’s journey from source systems to the staging area. Explain why it is important to write data to RAW first. Explain why we use transformations. Describe tools you can use to extract and transform data.This course is independent but also part of the Cognite Data Fusion Fundamentals learning path. We recommend that you complete all courses from this path and take the assessment at the end to receive a certificate of completion and the Onboarding badge here on Cognite Hub.Any questions? Let us know!Let’s go! Integration Fundamentals

0
Emel Varol
Practitioner
2 years ago
Sunil Krishnamoorthy
Seasoned Practitioner
Sunil KrishnamoorthyProduct Manager
posted in Developer and User Community
APIs and Python SDK for SQL Transformations

Hey there! I am Sunil, Product Manager for Data Integrations. Since this is our first post in the Hub, let me introduce my team and what we do. My team is responsible for the Ctrl+C Ctrl+V of your data from source systems to Cognite Data Fusion . But on a serious note, we are responsible for ELT - Extract, Load, and Transform of data. We are thrilled that you are interested in learning about the Transformations Python SDK. Yayy!In this post, I list a couple of use-cases/scenarios where the python SDK for transformations makes managing and orchestrating transformation jobs simple and seamless. Our goal is to make the transformations SDK more developer-friendly and would like to hear your feedback. Do check out the API and SDK docs for more details, but now on to a few use cases! Use Case 1: Triggering TransformationsCognite Data Fusion helps liberate industrial data silos and provides a unified and contextualized view of the data. It is now easy to derive insights and build application

0
Sunil Krishnamoorthy
Seasoned Practitioner
2 years ago
Eric Stein-Beldring
Seasoned Practitioner
Eric Stein-Beldring
posted in Developer and User Community
Charts Product Update: New version of calculations backend ⇒ Faster calculations, bug fixes, ++

If you’ve been feeling like that calculations in your Charts are running faster than before… they are!Yesterday, we released a new version (V2) of our calculations backend to production. This update includes  numerous performance improvements, bug fixes, and quality improvements.In short, it’s an all-around better experience built on higher quality code.Test it for yourself on your CDF project. As always, let us know in this group if you have any questions or feedback!

0
Eric Stein-Beldring
Seasoned Practitioner
2 years ago
Eric Stein-Beldring
Seasoned Practitioner
Eric Stein-Beldring
posted in Developer and User Community
Thanks for joining yesterday's Charts webinar! Here's the link to the recording.

Thank you again to everyone who joined us live for yesterday’s Product Spotlight webinar! To those of you who couldn’t make it to the live event or if you want to re-watch, you can take a look at the recording, below.If you want to read about the the details of the October CDF release, you can visit the post in Product Updates by clicking here. We already received some great feedback and we’re happy to hear several of you found the product demo with a practical use case example to be helpful. If you haven’t already submitted your feedback about the webinar, please do so here. We’re reading and discussing each response so we can make all of our future product webinars as valuable as possible. We’re already planning a new event about Charts, exclusively available for all of you in our Early Adopter community, so stay tuned for updates and invitations.Have a great rest of your week, everyone!P.S. We also appreciate everyone’s patience with the technical difficulties that were experienced

0
Eric Stein-Beldring
Seasoned Practitioner
2 years ago
Eric Stein-Beldring
Seasoned Practitioner
Eric Stein-Beldring
posted in Developer and User Community
Product Spotlight Webinar on November 3rd, 2021: Special focus on Charts

Hello Charts Group! On November 3rd 15:00-15:45 CET, we will be hosting a live webinar to present highlights from the latest CDF release, with a special focus on CHARTS AND THE CHARTS EARLY ADOPTER GROUP.You will learn about why we’re building Charts, what problems it can solve, and how to use key features and functionalities. We’ll demonstrate how to leverage this new CDF functionality as we build and solve real use cases in Charts step by step. From finding the relevant data, to using P&IDs to gain a systems understanding, to configuring the chart, to creating the no-code calculations to solve the problem at hand. This will be an interactive session for asking questions, discussing ideas, and providing feature requests directly with the team. By the end of this session, you’ll feel confident about using Charts in your day-to-day work and feel empowered to think creatively about the solutions you could build to shape a safer, more efficient, more sustainable industrial future.You

0
Eric Stein-Beldring
Seasoned Practitioner
2 years ago
thomafred
Seasoned
thomafredSeasoned
posted in Developer and User Community
CDF Modelling Challenge - Open Lineage

Hi everyone,We in C4IR Ocean are starting a series where we are challenging the community to model a certain problem in CDF. The aim with this series is to facilitate discussion and invite community members to share interesting solutions and techniques.The first challenge focuses on Open LineageOpenLineage is an Open standard for metadata and lineage collection designed to instrument jobs as they are running. It defines a generic model of run, job, and dataset entities identified using consistent naming strategies. The core lineage model is extensible by defining specific facets to enrich those entities.In C4IR Ocean, we are dealing with data from multiple providers. Some datasets are open and publicly available, others are closed. It is therefore important to keep track of where data is coming from, and what transformations have been applied to the data after it is read from the provider.We are seeing a good landscape of data lineage solutions - both open and closed source. At the sam

2
thomafred
Seasoned
2 years ago
Z
Active
ZachHActive
asked in Developer and User Community
Does CDF support MQTT and Azure IoTHub for Time Series Data?

In the CDF docs I see there is a PI and OPCUA connector. Many industry 4.0 community members see MQTT rather than OPCUA as the future of Industrial IoT cloud based communication, as it is lightweight, report by exception, client driven, etc…If I want to onboard a facility that has an IoT MQTT gateway, how does Cognite recommend we integrate? I have used Azure IoTHub and Azure Functions to connect and transform the data in the past. Do you have a reference architecture for this? Can we connect to the gateway directly with a CDF connector, or do you recommend using Azure IoTHub and Functions (or similar GCP/AWS)?Also Azure has some neat tools like IoT Device Provisioning Services, be nice to know a POV on if/how to utilize those. Thanks! 

2
Z
Active
2 years ago
thomafred
Seasoned
thomafredSeasoned
asked in Developer and User Community
CDF Templates API documentation and itroduction

Hi there,I am looking for resources on CDF templates API.So far I the best introduction I have found is the Python SDK documentation, as well as the information at docs.cognite.com which focuses on using templates in fusion.Can you provide more information about how to use the templates API?

3
J
Practitioner
2 years ago
N
Active
Niros ManoharanActive
asked in Developer and User Community
Data Streaming with CDF

I am trying to stream data from CDF to Azure Event Hub with the Python SDK and cannot find anything related to streaming datasets. Only option so far (as I know) is dps = c.datapoints.retrieve_latest(id=184691546499795)which would need a trigger of some sort to keep running. Data from CDF are so called timeseries from different types of sensors. Is there any documentation on Streaming Data for CDF that I could look at or is Streaming really supported? 

1
K
Practitioner
2 years ago

Badge winners

  • Cognite Data Engineer Basics - Integrate
    Felipe Fariashas earned the badge Cognite Data Engineer Basics - Integrate
  • Cognite Data Fusion Fundamentals
    Eddyhas earned the badge Cognite Data Fusion Fundamentals
  • Cognite Data Fusion Fundamentals
    Nancyhas earned the badge Cognite Data Fusion Fundamentals
  • Cognite Domain Expert Basics
    pavandogiparthihas earned the badge Cognite Domain Expert Basics
  • Cognite Data Engineer Basics - Transform and Contextualize
    Shuvankar Patihas earned the badge Cognite Data Engineer Basics - Transform and Contextualize
Show all badges
Terms & ConditionsCookie Settings