Developer and User Community

Join the discussions about delivering apps and data-driven decisions powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.

  • 691 Topics
  • 2,167 Replies

691 Topics

Pierre Pernot
Practitioner
Pierre PernotPractitioner
posted in Developer and User Community

Interactions with Cognite Data Fusion in an Android app

Today’s topic is about interacting with Cognite Data Fusion (CDF) from Android devices. Android devices can be phones, but also other kind of devices like hands-free devices (with speech commands). Since Kotlin, the Android preferred language, has interoperability with Java, it facilitates the integration of interactions with CDF in your Android apps. You can indeed use our Java SDK in an Android application, which makes it really easy to retrieve and upload data from/to CDF. The Cognite Java SDK is complete and maintained. This can broaden your thoughts/ideas about what to do with CDF. Below a few examples of what can be done : Retrieve information from CDF to display it on your mobile device Upload data to CDF from a mobile device, which can be useful in an industrial context Using specific features, from mobile devices (like a camera for example) to upload particular data to CDF (raw, or to extract features from them with an ML model, thanks to a Cognite function for example)   

0
Pierre Pernot
Practitioner
1 year ago
B
Active
Bonthala AnvithaActive
asked in Developer and User Community

Cognite UI App

Hi, Just wanted to know if there's any way to use Cognite UI Apps instead of we developing custom UI App. If yes, could you please let us know the process and how to use it? 

1
A
Practitioner
1 year ago
E
Practitioner
erlend.vollsetSenior Software Engineer
posted in Developer and User Community

Bug identified in time series datapoints API in Python SDK versions 2.47 through 2.51

We have identified a bug in the time series datapoints fetcher in the Python SDK which may cause duplicated timestamps to be returned. Affected versions are 2.47 through 2.51. Please check if you have anything deployed using the datapoints API in this version range. If you do, please upgrade to >=2.52 ASAP.https://github.com/cognitedata/cognite-sdk-python/blob/master/CHANGELOG.md

1
A
Practitioner
1 year ago
Jo Øvstaas
Seasoned
Jo ØvstaasSeasoned
posted in Developer and User Community

Woman in Data Science and coral reef watch

On 8th March our amazing data scientists at HUB Ocean and Cognite gave a workshop at the Woman in Data Science (WiDS) event in Oslo. Have a look at the video and blog post. The data challenge was related to coral reef bleaching events applying open data on the Ocean Data Platform.Closing the gender gap in Ocean Science? — HUB Ocean | Dedicated to Unlocking Ocean Datahttps://www.linkedin.com/posts/hubocean_coralreefs-biodiversity-collaboration-activity-6928641478181154816-IImk?utm_source=linkedin_share&utm_medium=member_desktop_web

0
Jo Øvstaas
Seasoned
1 year ago
Eric Stein-Beldring
Seasoned Practitioner
Eric Stein-Beldring
posted in Developer and User Community

New feature: Calculations are now running on up to 100k data points

As we announced in our last release post, we recently updated our calculations backend to run on individual data points if the total count of data points is less than the predefined maximum limit.(You can watch the video walkthrough for more information.)When this improved functionality was released a few weeks ago, this limit was set at the intentionally low value of 10,000 individual data points. We did this to test our infrastructure, gather feedback, and ensure our backend will not crash with these more expensive requests — Thanks to those of you who have provided us with input!As of today, we have released an update which increases this limit from 10,000 data points → 100,000 data points.This 10x improvement in performance will help to provide accurate, trustworthy calculation results for larger ranges of time and data. With this new 100k limit, we’ve reached the maximum number of data points we can retrieve from the Cognite Data Fusion Time series API with a single request.While

3
Philippe Bettler
Practitioner
1 year ago
C
Seasoned Practitioner
Crystal Connor RichardsSeasoned Practitioner
asked in Developer and User Community

Charts: Help with 12 month BTU Rolling Average - says too long time frame

 Hello  @brendan Buckbee at Celanese has created a chart for the 12 month, but gets an error message. Is there any way that this can be created into a chart. I have attached a screenshot of the calcs. cc: @Kylie R  

11
Simon Funke
Practitioner
1 year ago
Nimesh Madandas
Practitioner
Nimesh MadandasPractitioner
posted in Developer and User Community

Enhance your knowledge on CDF Transformations!

Putting your learning into practice can be challenging. Not to worry, we're here to help! 🚀  Our subject matter experts and the Cognite Academy team joined forces to create a course on CDF Transformations. The course is designed for data engineers and anyone who wants to learn about CDF Transformations.In this course, you'll learn how to transform data into the CDF data model using CDF Transformations. This course will walk you through lessons on the target schema, writing SQL queries, and running and scheduling transformations, accompanied by interactive knowledge checks, reading materials, and a hands-on exercise.Upon completion, you'll be able to: Understand why you should use CDF Transformations.  Find detailed information about the target schema. Write SQL queries and use SparkSQL and Cognite's custom functions to transform data. Schedule and run data transformations. Register for this course right away! 🕰Happy Learning! 😊

0
Nimesh Madandas
Practitioner
1 year ago
David Liu
Seasoned Practitioner
David LiuSeasoned Practitioner
posted in Developer and User Community

Flexible Data Modeling: Bug/Feature Request

Found a bug? Have a question about how something works? Want something new with Flexible Data Modelling? We want to hear about it!You can choose to either create a dedicated post (topic) in the Flexible Data Modelling group by clicking the Create topic button OR simply post a reply below in this thread.Be sure to tag with “bugs” or “feature request” Features requests You can choose to either create a dedicated post (topic) in the Charts group by clicking the Create topic button OR simply post a reply below in this thread. Remember to say whether your feature request is Nice to have, Important, or Critical to you and why. Screenshots, sketches, or explanatory videos are also encouraged. We will follow up and share progress on features periodically as well! Bugs Remember to include a screenshot or video to help the product team best understand what exactly you’re talking about or referring to.

2
David Liu
Seasoned Practitioner
1 year ago
S
Committed
simenriCommitted
asked in Developer and User Community

AIR: Bug when choosing custom time-span

Hi, In the AIR application, one can choose to see the relevant time series for 5 years, 1 year, 6 months, 1 month, and “Custom”. When clicking “Custom”, a date choosing panel shows up. When selecting the end date, the application freezes, and one has to refresh the application to get it back. (Feilkode: RESULT_CODE_HUNG)  

2
A
Practitioner
1 year ago
K
Seasoned
Kristian NymoenSeasoned
asked in Developer and User Community

Aggregates of synthetic timeseries on templates / datapointsWithGranularity

Hi. How can I get aggregated values from synthetic timeseries fields on templates? Intuitively, I would expect the “datapointsWithGranularity” operator in the graphQL query to give me this, but I get the same results as for the “datapoints” operator. Should the aggregation type and granularity be part of the definition of the synthetic timeseries field in the template? If so, how? 

2
E
Practitioner
1 year ago
H
Committed
Håvard KnappskogCommitted
asked in Developer and User Community

Grafana: Flow to volume per day / week

Hi! I’m curious what is the best practice to do this basic thing and visualize on Grafana ( ideally without code): With a flow transmitter, summarize the total volume per day or week.  Correct the above against a threshold or a running signal. Ie. I now when the flow should be 0Here’s how I do nr 1, it feels a bit like a hack. Nr2 I am solving with Functions in CDF, however it would be nice if there’s a quick way of doing it without code,  The query looks like this: 24*ts{externalId="arba:one:s=0:PLC_03!Vc_S07_200_FT01_PV", alignment=1653386400000}-Should the alignment be at the middle of the day, 12:00, or at midnight 00:00? When we get back to wintertime, it will be off by one hour..  

4
K
Practitioner
1 year ago
R
Seasoned
RobersoSNSeasoned
posted in Developer and User Community

Limitations on asset subtree queries

Hi, When parsing a large production model some high level concepts we want to filter on are structured as assets. I.e. a fiscal region for power in the Statnett case.  Our model is now hitting limitations of subtree queries. With more than 100k assets per region for some regions. What is your thinking around how to handle such cases in a model? To spike the conversation we’ve considered moving high-concept parts of the tree to labels, or making more of the DB type of operations locally. However, the former demands a pipeline for moving concepts suited for a tree  to a Label “just because”. The latter requires quite a lot of iron present on the local instance processing the query. An instance of the SDK quering we do can be seen in the power-SDK in github.

3
Shakya Ganguly
Practitioner
1 year ago
Pierre Pernot
Practitioner
Pierre PernotPractitioner
posted in Developer and User Community

Cognite Functions

Hello, Today’s topic is about Cognite functions: Cognite functions enable the user to run and schedule arbitrary code to clean, process and do calculations on your data. They are easy to use and have seamless integration with Cognite Data Fusion (CDF), allowing the Cognite Function to interact with CDF directly. The service automatically scales the computing infrastructure to handle a fluctuating number of function calls.   They can be triggered on schedule, on click in the UI, and even with the experimental Python SDK, which makes them adaptable to a lot of use cases. We also have a full CI/CD flow for them, which allows to deploy and maintain them really easily. Some examples of use cases that can be done with Cognite functions:Change point detection, thanks to machine learning models, that run on schedule Anonymisation of videos, with computer vision models @Gaetan Helness is quite familiar with Cognite Functions. If you have any questions, don't hesitate to reach out to us in t

0
Pierre Pernot
Practitioner
1 year ago
Rhuan Barreto
Practitioner
Rhuan BarretoPractitioner
asked in Developer and User Community

User Data Models

After confirmation from @Geir Engdahl, is there any plans for developing models where application developers can attach data to users, like preferences or even work orders?

1
H
Practitioner
1 year ago
David Liu
Seasoned Practitioner
David LiuSeasoned Practitioner
posted in Developer and User Community

Getting started with Flexible Data Modeling

The best way to play around with Flexible Data Modeling in CDF is through Templates.  Please be aware of the following before getting started! Currently, the App Dev Journey team at Cognite is working on a new Schema Service that will replace Templates towards the end of 2022. For more details on the differences between Schema Service and Templates, go here.There will need to be a migration between Templates and Schema Service in the second half of 2022. The migration will be simple for the data modeling features and querying features as they will be both be using a GraphQL interface. However, moving the data could be a more difficult migration.Hence we highly recommend continuing with Templates for POCs and early experimentation. You can also productionalize with Templates, but please reach out further clarification around quota and SLAs on this Cognite Hub group. Click to see the official documentation on Getting Started with Templates

1
A
Practitioner
1 year ago
H
Practitioner
Håkon V. TreiderPractitioner
published in Developer and User Community

Cognites guide to code quality in Python - Part 2

Introduction In this post we continue to share some of our internal material aimed towards solution builders, such as data scientists, who want to develop their ability to develop high quality solutions by creating more reliable, maintainable and readable code. This is the second part of 2.MotivationHigh code quality is easy to recognize but can be very hard to describe concretely. The assumed benefits are easier maintainability, modifiability, and more. While code style, like formatting, can be a matter of different taste, most parties agree that other code practices that fall under the umbrella term “anti-patterns” should be avoided. To stop endless formatting discussions and the like, having (and adhering to the industry) standard makes reading and understanding code across repositories easier.What this guide is notThis guide will not tackle the topic of  “how to set up a Python project” the right way . Please let us know in the comments if you would like us to share more of our ex

990
H
Practitioner
1 year ago
E
Practitioner
Einar OmangPractitioner
posted in Developer and User Community

The Cognite OPC-UA Extractor is now open-sourced

The Cognite OPC UA extractor reads data from OPC UA servers and writes data to Cognite RAW, assets, time series, events, and relationships, depending on how it is configured.  Now, we’ve made the GitHub repository public. The extractor serves as a comprehensive example for using the .NET extractor utils, or as a baseline for developing custom applications working with OPC UA and CDF. The repository also contains the Cognite OPC UA Extractor test server, which comes with a CLI and can be used to test OPC UA client applications. Use this test server to simulate common server issues and generate data points, events, and even new nodes and references. With the open-source OPC UA extractor code, you’ll get insight into how Cognite works with OPC UA which will hopefully make it easier to develop your own extractors.

0
E
Practitioner
1 year ago
R
Active
Reza ParsehActive
asked in Developer and User Community

Is it possible to run Cognite Spark Data Source locally?

I am doing some ETL jobs in Azure Databricks and have successfully managed to use Cognite’s Spark Data Source to read and write time-series, datapoints etc from and to CDF. I know that databricks itself is a cloud platform. However, it is interesting for me to be able to run some or all of the jobs locally during development phase. I wonder if it is still possible to somehow test-run Spark jobs locally? The configuration does not seem to be trivial.  I played a little bit with PySpark, and I was able to run it on my Mac but I could not create a connection to “cognite.spark.v1” to read or write data. Do you know if it is possible to perform such operation? If not, what would you suggest?  

12
Håkon Trømborg
Practitioner
1 year ago
Anita Hæhre
Seasoned Practitioner
Anita HæhreCommunity Director
posted in Developer and User Community

How to submit feature requests

In this short video you’ll see how you can submit feature requests, so we can build better products together. Share the feature requests you’d like to see in our products, applications, and solutions, and support ideas submitted by others by upvoting them. Watch the video and head over to Product Ideas to get started:)   

0
Anita Hæhre
Seasoned Practitioner
1 year ago
Anita Hæhre
Seasoned Practitioner
Anita HæhreCommunity Director
posted in Developer and User Community

Course - Introduction to Cognite Data Fusion

Many organizations need to integrate and discover their IT (Information Technology) and OT (Operational Technology) data to explore and resolve operational issues.Cognite Data Fusion (CDF) streams your data into the CDF data model where the data is normalized and enriched by adding connections between data resources of different types and stored in a graph index in the cloud. With your data in the cloud, you can use the CDF services and tools to build solutions and applications to meet your business needs.This course gives you a high-level overview of the CDF architecture and data model and the main steps to fast-track your CDF implementation.Take the course and let us know if you have questions or thoughts!  

0
Anita Hæhre
Seasoned Practitioner
1 year ago
Anita Hæhre
Seasoned Practitioner
Anita HæhreCommunity Director
posted in Developer and User Community

Cognite Application Developer Session May 10, 2022 - Write your questions here!

Make sure not to miss Cognite Application Developer Session at 4PM CEST/10AM EST May 10th! From simple multiple data source dashboards to cutting-edge hybrid AI solutions, join us for this one hour and learn how Cognite Data Fusion makes industrial application development easier.Watch recording:     

5
Anita Hæhre
Seasoned Practitioner
1 year ago
S
Practitioner
Satoshi YamadaPractitioner
asked in Developer and User Community

Charts: What is the easiest way to configure float precision?

Hi community!I got a query from our customer that they’d like to control the float precision in Chart.I found “Round” function in “Operators” and confirmed applying that indsl to the timeseries data does work.But I’d like to ask if there is any other, easier, way because creating function per every timeseries data is a bit boring.Thanks!

2
S
Practitioner
1 year ago
P
Committed
Pedersen Jon-RobertCommitted
asked in Developer and User Community

SQL query from Cognit Function?

Hi,Is possible to make a sql query to an external SQL server from a Cognite Function? 

4
V
Practitioner
1 year ago
Stig Harald Gustavsen
Seasoned
Stig Harald GustavsenSeasoned
asked in Developer and User Community

Why is first day of the week a Sunday and not Monday?

Can the default option be that the week start on a Monday, or maybe give the user the ability to say what day is the first day of the week? This probably varies in different parts of the world. Where I work and live and do things; Monday is always the first day of the week :). 

1
Eric Stein-Beldring
Seasoned Practitioner
1 year ago
M
Committed
Marit Owren ValmotCommitted
asked in Developer and User Community

FirebaseError: Missing or insufficient permissions

Hi, Both a colleague of mine and I keep getting the following message for the first 10-30 seconds when we try to view the list of public charts :  “Could not load chartsFirebasError: {code=permission-denied]: Missing or insufficient permissions.”After some time, the list of public charts appear. This time interval can vary between a few seconds and up to over a minute. Other colleagues of us are not experiencing this issue.  It seems strange that the error only occurs for a short time, but it reappears every time we try to open public charts. We have tried deleting all cookies in the web browser without this affecting the issue. Do you have any clue what could cause this? 

6
M
Committed
1 year ago

Badge winners

  • Cognite Data Fusion Fundamentals
    Hieu Nguyenhas earned the badge Cognite Data Fusion Fundamentals
  • Cognite Data Fusion Fundamentals
    Mohammad Mateen Khanhas earned the badge Cognite Data Fusion Fundamentals
  • Working with Cognite InField
    AnnaMariahas earned the badge Working with Cognite InField
  • Cognite Data Fusion Fundamentals
    RERPALMEROhas earned the badge Cognite Data Fusion Fundamentals
  • Cognite Data Fusion Fundamentals
    Yushu Rajhas earned the badge Cognite Data Fusion Fundamentals
Show all badges
Terms & ConditionsCookie Settings