Join the discussions about products powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.
Recently active
Hi! I’m Dilini Fernando from Cognite! This is my first post, and I am super excited to share a how to guide on Cognite’s DB extractor. This post is targeted to folks who have not used the DB extractor before and wish to extract data from popular tabular databases like MySQL, Oracle, and PostgreSQL databases and ingest it to CDF.The post contains three major steps. The first two focus on setting up a database and ODBC driver, and the third step focuses on running the Cognite DB extractor. You could skip steps that are not required for you. For example, if you already have a database setup, you could skip the first step. Step 1: Setting up a databaseDownload Micorosoft SQL Server Express Edition 2019Install the server Note: Remember the password. You need to enter the password when you are login to SQL Server Install SQL Server Management Studio. Connect SQL Server Management with SQL server 2019. Open SQL Server Management and select the Authentication as SQL Server Authentication.
Hello everyone,I was curious if anyone has leveraged Cognite AIR (Automated Identification and Reporting) in a way where alerts could be triggered off of other alerts? If so, how has this been done?I’d like for this to be a core feature of AIR where you can build a workflow from a visual canvas (similar to the charts function builder) and say “If this alert is triggered, check if this other alert has been triggered also” and so on. This would allow for setting up “offline conditions” so we don’t see all anomaly alerts or threshold alerts unless we can confirm the equipment is running, or even automate root cause investigations. Currently if I build an alert, I’m getting too many “false positives” of sorts that I’d like to filter out. Any input is welcome. Thank you,Richard Maidla (Hess Corporation)
At release, will Schema Services support being federated into a GraphQL schema, like with Hot Chocolate or Apollo? This is how we are planning to utilize combining what is available in CDF with what we are providing in our GraphQL schemas and I was assuming this is feasible. But, a dev mentioned that the downstream services have to support being federated for it to be made available at the federation gateway. If you are using Lighthouse for your implementation, then I see it has preview support for being federated, but I need to confirm you will configure it this way or whatever you may be using will support being federated. Thanks!
Hello!We have a new version of the new documentation around Templates out live on our Documentation portal!https://docs.cognite.com/dev/concepts/resource_types/templates/Here we provide a full guide on how to go from modeling the data to querying the data. As well, we provide much more detailed specifications on what is doable via the UI and also the SDKs.Please provide feedback on what else you would like to see documented and if you run into any issues with the code samples / guides!
As an application developer, a very common interface to build is filtering user interfaces. There are a few types of aggregation that would be very useful to us! #1 Unique value aggregationIn order to allow for effective filtering, aggregating a field by all its unique values is vital for this, to enable showing the user all possible options for a certain filter.Generally the amount of results can be limited to perhaps 1000, but having this paginate (or a higher number of 10000) would be even better! This also allows us in many cases to avoid needing expensive ‘substring queries’ on fields, as doing this in the front end on several thousand strings is trivial. Not all fields needs this, so if its required to add a `@aggregatable` decorator, then this is fine!In addition to this, having the amount of each of these values would be useful, to allow us to sort by the most commonly occurring fields.This is by far the highest priority for our use case! #2 Count aggregationSecond most importa
Congratulations to #PGS @Cerys James @Sverre Olsen, selected as one of the 11 winners of the Verdantix Innovation Excellence Awards!PGS won the Safety Performance Improvement award for an incident management tool that uses artificial intelligence to identify trends, automate alerts, and proactively prevent incidents.PGS is using Industrial DataOps software, including Cognite Data Fusion®, to take a more proactive approach to HSEQ incident management. PGS worked together with Cognite to ingest observations from the reporting system into the data platform and sort observations into larger categories.Learn more here: https://hubs.ly/Q016VkD00
The @searchable field is a great addition! Fundamental for certainThe final point to make it usable for us will be to allow the user to select what searchable field they want to be able to filter on. e.g. given the schematype Equipment { name: String @searchable @filterable description: String @searchable @filterable} Its very common that the user will know that they want to search on specifically name or description.
We are working on some new features in Charts, and would love to show and talk to some of you about it. If you have 30 minutes next week to help us make the best tool possible, please write me at emmy.reehorst@cognite.com Emmy, designer in the Charts team
Hello! We have worked on a new prototype experience with Templates. Data model editorWe have heard feedback on the current editor UI and the lack of parity with the actual possibilities of the Data Modeling via Code. For example, there is no ability to add List, references to other custom declared types. This is all resolved via the new data model UI prototype. Data Model VisualizationAnother common request is to visualize the data model as a "graph" or "relationships". We have created a new visualizer to show the data model as nodes with relationships to other types. Note this does not show the data within the data model (yet) and we would love to hear if you would like this feature. Here is a Loom video to the prototype showing both features.What's next? We would love to hear if you would like to try out these features, given enough requests we may add this back to the Templates UI. Alternatively, we can also grant you access to a test CDF project you can use to try these features.
Hei!In the current schema setup, I might make a query such as this:The terms ‘edges’ and ‘node’ is a bit confusing to me. I’m not sure what they really mean in this context (I understand it from a graph db point of view, but its a bit confusing from other points. I might expect something like this instead{ listAsset() { items { externalId } pageinfo { cursor, ... } }} Curious to hear your thoughts on this :)
Hi, I am trying to use templates to model domain specific connections between assets and time series in CDF, and I have come across an issue that I would like some feedback on.If I have the following schema type:type StringOrNumber @template { Asset: Asset NumericTS: TimeSeries}and do the following query:query StringOrNumber { stringOrNumberQuery { items { NumericTS { __typename isString datapoints(limit: 1) { __typename timestamp value } } } }}then the datapoint output __typename has the value “DatapointString” even though the timeseries is not a string timeseries:{ "data": { "stringOrNumberQuery": { "items": [ { "NumericTS": { "__typename": "TimeSeries", "isString": false, "datapoints": [ { "__typename": "DatapointString", "timestamp": 1634534671570, "value": 14.3
Hi I'm Knut, I’m Product Management Lead working on Cognite Data Fusion. I had the pleasure of meeting some of you in our Product Release Spotlight webinar this Monday. Here's the recording if you missed it.We'd love to hear your thoughts!
Release v0.19 of ChartsHello everyone,The team and I are happy to announce that a new version of Charts (charts.cogniteapp.com) has been released! In place of a live webinar, I’ll be posting videos soon to provide both a walkthrough of these new features and some concrete examples of use cases they help to solve. In the meantime, enjoy reading the release notes and, as always, please leave your feedback or questions in the comments below. Release DetailsFilters are now available in the search panel We’ve released some important and frequently asked for filtering capabilities in the + Add time series search panel. Everyone who uses Charts is always interested in and looking for time series. Equipment tags (assets) that do not have any time series directly related to them are now automatically filtered out of the results list, providing you with more relevant and useful results. You can always show the “empty” equipment tags, if you’d like via the new filters dropdown. Empty equ
What is best practice for global error-handling in the JS-SDK?
Can machines think? Hello Community! As this is my first post, I would like to introduce myself. I'm Shailja, my team and I work on Cognite Learn where you can find Cognite's e-learning courses and live virtual training sessions. Cognite allows me to continue my passion for cinematography and editing, and I genuinely love what I do. Today, I’d like to introduce you to our digital upskilling offering. With the help of our learning paths and bite-sized courses, you can learn about technologies that enable digital transformation. One of the topics you can explore is artificial intelligence (AI). Understanding how AI works in our daily lives would benefit all of you.The buzz around artificial intelligence began in 1950, followed by deep learning. Until the late 1970s, it was a part of AI’s evolution. Then, it branched off to evolve on its own.Artificial Intelligence (AI) allows machines to learn from their mistakes, adapt to new inputs, and execute tasks like humans. From chess-playing co
Issue:When we install Cognite python SDK if you are observing an error warning as below,WARNING: Discarding https://files.pythonhosted.org/packages/25/50/0466d5d83e1859c5ca38351ee932d64cc5635f9d4dad522879e58f4b0018/Fiona-1.8.2.tar.gz#sha256=4c6419b7ac29136708029f6a44b4ccd458735a4d241016c7b1bab41685c08d8f (from https://pypi.org/simple/fiona/). Command errored out with exit status 1: python setup.py egg_info Check the logs for full command output.Downloading Fiona-1.8.1.tar.gz (1.1 MB)|████████████████████████████████| 1.1 MB 3.2 MB/sERROR: Command errored out with exit status 1:command: 'c:\users\mithila\appdata\local\programs\python\python39\python.exe' -c 'import io, os, sys, setuptools, tokenize; sys.argv[0] = '"'"'C:\\Users\mithila\AppData\Local\Temp\pip-install-3ru45mbx\fiona_e5daa4b655dd467bb03096ab64aa19ae\setup.py'"'"'; file='"'"'C:\\Users\mithila\AppData\Local\Temp\pip-install-3ru45mbx\fiona_e5daa4b655dd467bb03096ab64aa19ae\setup.py'"'"';f = getattr(tokenize, '"'"'open'"'"', op
For the Retrieve data points API and a few other API’s that allow date range input, we are able to specify a string where, “The format is N[timeunit]-ago where timeunit is w,d,h,m,s.” This is able to specify a time in the past. I am now trying to specify end as “-365d-ago” to set a date 365 days in the future, but this is giving an error.Is there another syntax available for specifying future dates?N[timeunit]-afterNow?365d-afterNow?
Hey,At Statnett we’re thinking about our progress towards a world of more flexible data models. Although your introductions have been great, we’re still confused about the particulars surrounding the transition between types of models.In particular, we consider the lineage of and managability of transformations of data. In the language of your data-modelling: we want the arrows between Source, Domain and Solution models to be versioned and configured as code. Is this a planned feature? If so, do you have any sketches of how this will look?Transformations might be what we call “Interfaces” in the Domain and Solution models. I.e. the physical transformer from (e.g.) Siemens is implemented by a functional 300kv to 132kv transformer at the Substation “Foo”. Currently, we model this as two assets (phys. trafo and func.trafo) with a Relationship with label “Implements”. These relationships are more or less hand-crafted. But, we would like to have these mappings, and links, as code. Preferra
Yesterday, we hosted our first Digital Services and Sales Forum for our manufacturing customers who are building new applications on top of CDF. The goal of this forum is to create a space for our customers to learn from each other on key topics relevant to building and launching digital services and software. The focus for this forum was pricing where we heard from @mortenhuse from Properate and Rune Larsen of Accenture, but in the future we’ll cover other areas such as recruiting, product positioning, onboarding, customer success, etc. Thanks to all who attended! The presentations we shared are attached. If you weren’t able to attend, but would like to in the future, please contact your Customer Success Director. Hope to see you at the next event!All attendees of our first Manufacturing Digital Services and Sales ForumMorten Huse and Morten Hveding Juel presenting their Properate solution, built on CDF
If you’re at CERAWeek this week, we hope you’d like to stop by and say hello us! Look out for some of our leaders @John Markus Lervik, @Paula Doyle, and @Francois Laborie in the CERAWeek Executive Conference and Agora sessions, and come find us at the @Cognite and @Aker Horizons house at Innovation Agora.
Are Synthetic Time Series able to reference other Synthetic Time Series in their formulas specified? This is the problem I am trying to solve:Synthetic Time Series is limited to referencing 100 time series Sometimes a unit/facility/system/functional location/site may have more than 100 direct child assets I need to calculate a “Synthetic Time Series” that is the daily average of a time series found on all child assets My thought is that, for 300 assets, I would have:STS A: Sum for assets 1-100 STS B: Sum for assets 101-200 STS C: Sum for assets 201-300 STS D: Sum of STS A, B, and C divided by 300Is there a better way to accomplish something like this in CDF?
Hey! In accordance with how you’re thinking about flexible-datamodels. Has Cognite done any exploration around flexible time-series modelling? Akin to what you’re doing with charts, a fleet of sensors might be viewed as having the same transformational needs as an Asset does. At Statett, we have “views” of data (typically some linear combination of time-series). We persist these with synthetic time-series as an intermediary, then upload to a new TimeSeries. Unfortunately, the data is not immune to updates or backfills. So these computed TimeSeries either have to have a pretty severe lag, or we have to re-compute at an alarming rate, wasting compute. These computed time-series are further used in computations that we would like persisted. Do you envision expanding Charts to cover this functionality? I.e. having the configuration as code, with Stream logic for re-computes etc.? Or, do you have no plans for Managed Data Transformations? Thanks for your response :)
I tried logging in with these commands: platypus login --cluster greenfield --tenant "schema-test"which didn’t work as I thought the tenant was a CDF tenant and not an Azure AD tenant. Then I tried:platypus login --cluster greenfield --tenant "c08c2afd-4823-482b-9113-ed2746fe6026"Which gave me a “Login successful” webpage, but the CLI said: “failed to authenticate against CDF project: platypus”. Then Soumesh pointed out that platypus is the default project, and I needed to type: platypus login --cluster greenfield --tenant "c08c2afd-4823-482b-9113-ed2746fe6026" schema-testWhich worked I think having default values made it harder to use as the CLI didn’t guide me on missing project name / CDF cluster etc, and maybe a better name than tenant as it can be interpreted as CDF tenant/project.
Feel free to join this session on 9 March at 7-8pm CET by Inna Zrajaeva about ocean data in situated experiences. Get ideas about how complicated ideas and concepts can be explained in a direct environment and situation. Inna is writing her master thesis together with UiT Norges arktiske universitet and HUB Ocean 🐳https://www.eventbrite.com.au/e/ocean-data-and-situated-experiences-tickets-289415408277#oceandataplatform
We are happy to announce a new CLI tool for managing your Template Data Models. This should help you in developing an application, and we hope to also make this tool useful for data science workflows as well.Here’s the link to the public documentation for the CLIhttps://www.npmjs.com/package/@cognite/cdf-cliInstallation instructionsTo install, make sure you have Node (at least v14) installedand then runnpm install --global @cognite/cdf-clioryarn global add @cognite/cdf-cli Key features:This CLI is meant to be an additional tooling that allows you to do everything the UI can.1. Logging in/out through the CLI for users and machines (Users for local workflow, Machines for CI/CD)Logging in as a user - Loom demo, docs Logging in as a machine - Loom demo, docs2. Managing Templates via CLI - docsCreating, deleting and listing templates3. Development Workflow via CLI - docsInitializing workspace Code generation Please comment and add any request or comments around features below or as a new t