Developer and User Community

Join the discussions about delivering apps and data-driven decisions powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 690 Topics
  • 2,166 Replies

690 Topics

Carlos.Herrera
Practitioner
Carlos.HerreraPractitioner
asked in Developer and User Community

Unable to link an engineering diagram to assets

While doing the CDF Fundamentals, I’ve found out that if you don’t select a Data Set ID while uploading your PDF file, you later won’t be able to link it to your Asset, as your Data Set won’t be found. Also I didn’t find a way to edit this later. I had to upload a new file and select my Data Set ID. Is this expected? What was confusing to me is the fact that the Data Set ID is marked as optional. If this is not the case, this should be flagged as mandatory in order to upload any file.

3
Brad Downen
6 days ago
J
Active
JasminePActive
asked in Developer and User Community

Empty time series after insert datapoints

Hi guys, Could you please help me find out why it still shows empty time series even though I have insert data points? I am able to list the data points in “my_ts1” time series with API but I can’t view them in chart.How can I view the time series data in chart? Thanks a lot!

3
J
Active
2 months ago
S
Active
sudheerchonateActive
asked in Developer and User Community

How to make use of Azure OpenAI that runs in the Cognite subscription for Custom App deveopment

I am developing a custom app for performing semantic search using Cognite FDM GraphQL endpoint and LLM and done some research using ChatGPT 3.5 to generate GraphQL query from natural language.To my understanding Cognite copilot feature find under data model UX  is using Azure OpenAI that runs in the Cognite subscription.Want to know how to make use of Azure OpenAI that runs in the Cognite subscription for Custom App deveopment?

3
Dilini Fernando
Seasoned Practitioner
1 month ago
S
Active
sebastianheibo.aksoActive
asked in Developer and User Community

Requesting training material on using advanced functionality in data modeling

Hi.I would like to experiment with using more of the advanced functionality in data modeling. For instance, everything related to importing views and mapping properties between data models. However, I feel like the documentation (https://docs.cognite.com/cdf/dm/dm_graphql/dm_data_modeling_language#specification-of-directives) is a bit lacking of examples of how to use the functionality. Are there any end-to-end (both basic and advanced) examples or other training material of how to reference data in other data models using all the different directives specified. For example examples of best practices when referencing between a source model and a domain model, and when referencing between a domain model and a solution model.Thank you!Sebastian

3
Andre Alves
Seasoned
2 months ago
Ryutaro Yano
Practitioner
Ryutaro YanoPractitioner
asked in Developer and User Community

Sign in issue - Postman set up

Hi,Could you advise me on how to fix the following error popped up from Microsoft when I get a new access token through the “Authentication” tab in Cognite API collection?AADSTS70011: The provided request must include a 'scope' input parameter. The provided value for the input parameter 'scope' is not valid. The scope {{baseURL}}/.default is not valid. The scope format is invalid. Scope must be in a valid URI form <https://example/scope> or a valid Guid <guid/scope>. I’m taking the course “Set up postman using OpenID connect” (https://lab.cognite.com/understanding-open-industrial-data/1328002)Here is my Postman setting.AuthorizationVariables 

3
Dilini Fernando
Seasoned Practitioner
2 months ago
S
Active
SouzaActive
asked in Developer and User Community

Performance Issue cognite-sdk

While testing versions of the cognite-sdk python >= 7.37.0, we noticed a performance issue in the "retrieve_dataframe" method of the time series API for all versions 7.37.x ( x >= 0 and x <= 3). Example: For the same data window, we tested with version 7.0.0 and the latest versions. The processing time for version 7.0.0 in this method was less than 5 seconds, while for newer versions the processing time was 3 minutes.

3
Andre Alves
Seasoned
5 days ago
R
Committed
Rani SupriyaCommitted
asked in Developer and User Community

Infield- Not able to create Discipline List

Create assignment list of Assignees with Discipline Area while assigning checklist to user.

3
Dilini Fernando
Seasoned Practitioner
8 days ago
A
Active
abraaotanan1Active
asked in Developer and User Community

Unable to calculate on Charts

Hello, I am trying to perform a calculation on Charts but it does not work. It is a multiplication of 4 time series, all of them with a resample to granularity to 1m. One of them has real values and 3 of them are 0/1 steps. When I zoom out, I can see the calculation and it shows a pick of values, that is not accurate as it shows average data. Although when I zoon in to see the data, the trend disappears, the error says “One of the time series has less than two values”. As I resampled the data to 1 minute, I was expecting to see one values per minute, but it does not seems to happen. Is there other way to calculate the data correctly? Zoom in: 

3
A
Active
8 days ago
K
Committed
Karina SaylemaCommitted
asked in Developer and User Community

How does the timeout restriction work in the functions?

Hi everyone,  I would like to know if there are timeout restrictions for functions, as I've been executing a function that reads data from a RAWs table in batches, and since there are many records (1M), it takes up to 10 minutes and I get a timeout error. Is there a way to configure this restriction? Running the same function code on a local machine takes around 2 or 3 hours. Regards,Karina Saylema@Aditya Kotiyal  @HanishSharma  @Jason Dressel  @Jairo Salaya @Liliana Sierra   

3
K
Committed
21 days ago
Ben Brandt
Seasoned
Ben BrandtSeasoned
asked in Developer and User Community

Show Average KPI For Time Series From Today to End That is Read Often

Hello, Thank you for all the great docs and tutorials you’ve put together on CDF.  I would like to get an expert opinion on the best way to accomplish a specific use case I have.We have a daily time series that we calculate for predicted availability of an asset, for a time range that is usually between 5 and 40 years (usually between 1,826 and 14,610 data points per time series).  We have a view were an engineer will want to see this time series graphed, but also will want to see a single KPI value that represents the average of the time series from today to end of the range.  For all of our assets, this KPI could be ready several times a day as people view this KPI.  When we were storing this data in Azure SQL, to speed it up, we pre-calculated and stored this KPI average and stored a new time series (throwing away some of the time series points and linear interpolating).  That way, reading a single data point representing the average of from today to the end of the range and display

2
Ben Brandt
Seasoned
2 years ago
S
Practitioner
Shehan KarunaratnePrincipal Support Engineer
posted in Developer and User Community

Monitoring the Cognite service status

Subscribe to webhookhttps://status.cognite.com reports the health of Cognite's services and products. You can sign up to get email and SMS notifications for status changes and upcoming maintenance for specific products and clusters. You can also subscribe to webhook notifications to integrate with your monitoring systems. You will receive notifications for all components and clusters and can filter the information to fit your needs. To subscribe to webhooks, select "Subscribe to updates" and then the webhook option (<>). Specify the URL we should send the webhooks to and provide an email address if your endpoint fails. The table below lists the product IDs you can use to filter the notifications. For details about the format of the notifications, see https://support.atlassian.com/statuspage/docs/enable-webhook-notifications/ . If you don't know which cluster your CDF project is on, contact Cognite Support or Customer Success. Cluster names and product IDsIf you're subscribing to

2
joar.saether
Practitioner
10 months ago
R
Seasoned
RobersoSNSeasoned
posted in Developer and User Community

Flexible time-series models

Hey! In accordance with how you’re thinking about flexible-datamodels. Has Cognite done any exploration around flexible time-series modelling? Akin to what you’re doing with charts, a fleet of sensors might be viewed as having the same transformational needs as an Asset does.  At Statett, we have “views” of  data (typically some linear combination of time-series). We persist these with synthetic time-series as an intermediary, then upload to a new TimeSeries. Unfortunately, the data is not immune to updates or backfills. So these computed TimeSeries either have to have a pretty severe lag, or we have to re-compute at an alarming rate, wasting compute. These computed time-series are further used in computations that we would like persisted. Do you envision expanding Charts to cover this functionality? I.e. having the configuration as code, with Stream logic for re-computes etc.? Or, do you have no plans for Managed Data Transformations?  Thanks for your response :) 

2
R
Seasoned
2 years ago
David Liu
Seasoned Practitioner
David LiuSeasoned Practitioner
posted in Developer and User Community

Feature Feedback: New Data Model Visualizer + Editor

Hello! We have worked on a new prototype experience with Templates. Data model editorWe have heard feedback on the current editor UI and the lack of parity with the actual possibilities of the Data Modeling via Code. For example, there is no ability to add List, references to other custom declared types. This is all resolved via the new data model UI prototype.  Data Model VisualizationAnother common request is to visualize the data model as a "graph" or "relationships". We have created a new visualizer to show the data model as nodes with relationships to other types. Note this does not show the data within the data model (yet) and we would love to hear if you would like this feature. Here is a Loom video to the prototype showing both features.What's next? We would love to hear if you would like to try out these features, given enough requests we may add this back to the Templates UI. Alternatively, we can also grant you access to a test CDF project you can use to try these features. 

2
Anders Hafreager
Practitioner
2 years ago
DanielJohnLevings
Practitioner
DanielJohnLevingsPractitioner
posted in Developer and User Community

Aggregation of fields

As an application developer, a very common interface to build is filtering user interfaces. There are a few types of aggregation that would be very useful to us! #1 Unique value aggregationIn order to allow for effective filtering, aggregating a field by all its unique values is vital for this, to enable showing the user all possible options for a certain filter.Generally the amount of results can be limited to perhaps 1000, but having this paginate (or a higher number of 10000) would be even better! This also allows us in many cases to avoid needing expensive ‘substring queries’ on fields, as doing this in the front end on several thousand strings is trivial. Not all fields needs this, so if its required to add a `@aggregatable` decorator, then this is fine!In addition to this, having the amount of each of these values would be useful, to allow us to sort by the most commonly occurring fields.This is by far the highest priority for our use case! #2 Count aggregationSecond most importa

2
DanielJohnLevings
Practitioner
2 years ago
Ben Brandt
Seasoned
Ben BrandtSeasoned
asked in Developer and User Community

GraphQL Federation with Schema Services/Templates

At release, will Schema Services support being federated into a GraphQL schema, like with Hot Chocolate or Apollo?  This is how we are planning to utilize combining what is available in CDF with what we are providing in our GraphQL schemas and I was assuming this is feasible.  But, a dev mentioned that the downstream services have to support being federated for it to be made available at the federation gateway. If you are using Lighthouse for your implementation, then I see it has preview support for being federated, but I need to confirm you will configure it this way or whatever you may be using will support being federated. Thanks!

2
David Liu
Seasoned Practitioner
2 years ago
B
Practitioner
Branko DimitrijoskiSenior Software Engineer
posted in Developer and User Community

Solution Data Model to DMS mapping

I was thinking around the idea of adding the bindings and mappings into the Solution Data Model as directives to have more simpler syntax and UX. The idea is to “hide” the data model storage syntax and bindings syntax so everything can be merged into Solution Data Model GraphQL SDL.For example if we have following Solution data model type Person @view { firstName: string lastName: string}The following DMS should be automatically created Data model storage-----PersonTablefirstName: stringlastName: string However, if I want to make some overrides, I can use the additional directives. For example: type Activity @view @bind(filter: { hasData: { "in": "Risk" } }) { position: string @bind("dms.Table2.position") action: string line: Asset @bind("dms.Asset") equipment: Asset}In this case, in DMS, the Activity data model can be created automatically as well as the bindings and mappings to the related tables.Thoughts?

2
Anita Hæhre
Seasoned Practitioner
2 years ago
thomafred
Seasoned
thomafredSeasoned
posted in Developer and User Community

CDF Modelling Challenge - Open Lineage

Hi everyone,We in C4IR Ocean are starting a series where we are challenging the community to model a certain problem in CDF. The aim with this series is to facilitate discussion and invite community members to share interesting solutions and techniques.The first challenge focuses on Open LineageOpenLineage is an Open standard for metadata and lineage collection designed to instrument jobs as they are running. It defines a generic model of run, job, and dataset entities identified using consistent naming strategies. The core lineage model is extensible by defining specific facets to enrich those entities.In C4IR Ocean, we are dealing with data from multiple providers. Some datasets are open and publicly available, others are closed. It is therefore important to keep track of where data is coming from, and what transformations have been applied to the data after it is read from the provider.We are seeing a good landscape of data lineage solutions - both open and closed source. At the sam

2
thomafred
Seasoned
2 years ago
Z
Active
ZachHActive
asked in Developer and User Community

Does CDF support MQTT and Azure IoTHub for Time Series Data?

In the CDF docs I see there is a PI and OPCUA connector. Many industry 4.0 community members see MQTT rather than OPCUA as the future of Industrial IoT cloud based communication, as it is lightweight, report by exception, client driven, etc…If I want to onboard a facility that has an IoT MQTT gateway, how does Cognite recommend we integrate? I have used Azure IoTHub and Azure Functions to connect and transform the data in the past. Do you have a reference architecture for this? Can we connect to the gateway directly with a CDF connector, or do you recommend using Azure IoTHub and Functions (or similar GCP/AWS)?Also Azure has some neat tools like IoT Device Provisioning Services, be nice to know a POV on if/how to utilize those. Thanks! 

2
Z
Active
2 years ago
Marte Nielsen
Practitioner
Marte NielsenPractitioner
posted in Developer and User Community

Two of the important goals with a Data Mesh Architecture

Two of the important goals with a Data Mesh Architecture would be:Ensure that the users of data can easily find and trust the data – through carefully consider distribution of ownership and governance throughout the company/domains Ensure that data is “interoperable” across domains – to understand the meaning of data from one domain in the context of another domain.Question: What are the challenges and advantages of a Data Mesh Architecture to achieve these goals? E.g.:Domain expert knowledge and capacity within the business area/domain vs centralized knowledge Ability to make data interoperable across domains vs all-inclusive master data management Make it easier for end users to make use of the data Change management – move towards a distributed data ownership model where ownership is understood and prioritized day-to-day.Other thoughts? 👀

2
I
Practitioner
1 year ago
R
Committed
rmaidlaCommitted
posted in Developer and User Community

Automated Identification & Reporting (AIR) Feature - Alert Workflow

Hello everyone,I was curious if anyone has leveraged Cognite AIR (Automated Identification and Reporting) in a way where alerts could be triggered off of other alerts? If so, how has this been done?I’d like for this to be a core feature of AIR where you can build a workflow from a visual canvas (similar to the charts function builder) and say “If this alert is triggered, check if this other alert has been triggered also” and so on. This would allow for setting up “offline conditions” so we don’t see all anomaly alerts or threshold alerts unless we can confirm the equipment is running, or even automate root cause investigations. Currently if I build an alert, I’m getting too many “false positives” of sorts that I’d like to filter out. Any input is welcome. Thank you,Richard Maidla (Hess Corporation)

2
Arun Arunachalam
Seasoned Practitioner
2 years ago
Eric Stein-Beldring
Seasoned Practitioner
Eric Stein-Beldring
posted in Developer and User Community

Webinar: New Features & Feedback (January 26,2022 from 15:00-16:00)

Hello Charts Early Adopter Community and happy 2022!We’re going to kick off the new year with our second New Features & Feedback invited to a webinar where we in the product team will be sharing the latest and greatest features in Charts.When: Wednesday January 26th from 15:00-16:00 CETWhere: Virtually (Microsoft Teams)→ Click here to join the call; we’ll be re-posting this link on January 26th before the webinar. The features we’ll highlight in this session will include…An in-depth walkthrough of the latest features and functionalities, including... New list component design Better usability for y-axis zooming and scrolling  New InDSL functions for creating lines and synthetic signals + more A sneak peak of the features we're working on nextLike last time, I’ll be giving an in-depth walkthrough of these features and how to use them. We'll also have an open discussion between you, our early adopters, and the members of the Charts team about ideas for future improvements – we’l

2
L
2 years ago
H
Seasoned
henning.kvinneslandSeasoned
asked in Developer and User Community

Fallback for missing values when calculating synthetic timeseries

Hi! If one or more of the source-timeseries are missing data-points they will also be missing in the synthetic timeseries output..We would like an option to default to zero for missing values so that the API will use the available values to calculate a partial result. Example:TS1: [1,2,3]TS2: [3, undefined, 4] Output now if calculating a sum of TS1 + TS2:[4, undefined, 7] What we would like:[4, 2, 7]  

2
O
Committed
2 years ago
Eric Stein-Beldring
Seasoned Practitioner
Eric Stein-Beldring
posted in Developer and User Community

Thanks for joining our New Features & Feedback Webinar — recording & slides

Thanks to those of you who joined us live for yesterday’s New Features & Feedback webinar series.You will find the session recording, below, and you can view the slides that we presented by clicking here.As always, if you have any comments, questions, or feedback on these new features or anything else Charts-related, please do post about it here on Cognite Hub.

2
Eric Stein-Beldring
Seasoned Practitioner
2 years ago
David Liu
Seasoned Practitioner
David LiuSeasoned Practitioner
posted in Developer and User Community

Frequently Asked Questions (FAQ) - Flexible Data Modeling

Below we have outlined several frequently asked questions and their corresponding answers.Don’t see the answer to your question? Post as a reply in this thread and we’ll be sure to answer and/or add it to the FAQ list below!Protip: Use [cmd+f] or [cntrl+f] to search for keywords related to your question.Be sure to also let us know what else we can help answer here in the comments below! Q: What is the plans with Templates going forward?Please check out the documentation hereor https://pr-1023.docs.preview.cogniteapp.com/dev/guides/data-modeling/get-started#templates-future Q: Will there be new features built on top of Templates?Yes and no. We will not be doing any development of backend features (like new capabilities) into Templates. However, we will actually be building a lot of additional tooling on top of Templates (better UI, visualization layers, code generation, CLI etc.). Stay tuned in this Cognite Hub to see how you can use these tooling. 

2
Anders Hafreager
Practitioner
1 year ago
David Liu
Seasoned Practitioner
David LiuSeasoned Practitioner
posted in Developer and User Community

Flexible Data Modeling: Bug/Feature Request

Found a bug? Have a question about how something works? Want something new with Flexible Data Modelling? We want to hear about it!You can choose to either create a dedicated post (topic) in the Flexible Data Modelling group by clicking the Create topic button OR simply post a reply below in this thread.Be sure to tag with “bugs” or “feature request” Features requests You can choose to either create a dedicated post (topic) in the Charts group by clicking the Create topic button OR simply post a reply below in this thread. Remember to say whether your feature request is Nice to have, Important, or Critical to you and why. Screenshots, sketches, or explanatory videos are also encouraged. We will follow up and share progress on features periodically as well! Bugs Remember to include a screenshot or video to help the product team best understand what exactly you’re talking about or referring to.

2
David Liu
Seasoned Practitioner
1 year ago

Badge winners

Show all badges
Terms & ConditionsCookie Settings