Product User Community

Is there any way to read CSV files in an incremental manner from a drop folder following a file name pattern and ingest the data into specific RAW tables.Eg. I have file names which have timeseries data from daily report with columns like asset id, timestamp, data point. With file name pattern as “timeseries_<unique number/date>.csv”. Users are pasting these files in a public sharepoint location in an incremental manner. 

As 2022 comes to a close, we thought we’d take a moment to reflect on all the improvements that have been put into InField this year. From small bug fixes to big feature releases, from requests from Hub to user research sessions in person, many of you have contributed to make InField the best it can be for all its users. Throughout the year, InField has been updated with a total of 30 updates packed with user-centered functionality and improvements – and at the same time, the InField team is rebuilding the foundational backend, which sets us up for 2023 and beyond.  Users can expect to see major improvements to performance, much improved 3D- and file-viewing, better scheduling of checklists and more capable templates. While we’re working on that, here are some of the improvement and additions the team has made in 2022: January: The Weekly Summary page was introduced We updated the progress indicator to a new status bar, and made it available on mobile Much improved formatting on de

I am currently working on a concept for representing tag data in a simple graph (subject - predicate - object - style)An instance of the triple could be something like this D-20VA00001 - hasDryWeight - 5000In parallell I have instanciated another graph holding ontology data and mapping (like CFIHOS, mapping between CFIHOS class and function code and sap referance data etc.) Lets call it the meta-graph.What I want to do is to take a “traditional” tag as input, map the function code on the tag to corresponding CFIHOS-class, and get required attributes in return from the meta-graph. Further I then want to dynamically instanciate every attribute as relation in the triple’ish graph. In order to do this I need to be able to query a data model (FDM) in a transformation- is that far away?Further, now I am faking a labeled property graph in FDM - is LPG functionality far away? 

When creating a transform into an FDM type, it is necessary to provide the externalId of the instance. Does the value of externalId need to be unique across all instances of all types in the model or only across instances of the given type?

Hi I attempt twice and got 73% but not able to attend Assessment one more time. kindly enable so that I will attend assessment.  Rajesh

While setting up credentials while transforming getting this error.Error : Session Create Error:Request failed: Status code 401 Tried creating multiple times no luck any help pls

Hi from HUB Ocean and the Ocean Data Platform. We are participating in the open ocean data cataloging scene, for instance through the EU ILIAD “Digital twin of the ocean” project.Home | Iliad - Digital Twin of the Ocean (ocean-twin.eu)In order to improve the interoperability between the myriad of ocean data portals, web services and data catalogues out there, it will be very important for the Ocean Data Platform data catalog to support technologies and concepts like RDF (Resource Description Framework), SHACL (Shapes Constraint Language) and SPARQL (RDF query language). Is this already supported by FDM or is it on the roadmap?

As we develop richer models supporting a greater variety of workflows, we have started asking questions about model maintenance and modularization. Decomposing large models into sub-models that have low coupling seems attractive, but would require some type of referential support across models. Is Cognite considering such a feature, or how do we envision managing complex models in general? As you are probably aware large models have an increased risk that a breaking change in a peripheral type will force a new version on the entire model. Since data must be manually migrated today, this creates a maintenance load that we would be keen to address.

Hello All,I have created dataset, it is available at data set section and but when it comes to contextualize=> “Match entities”=> “Quick match”. and then tried to find my data set with resource type “time series” At this point, i am not able to find the data set, which is already there in the section “manage dataset catalog”. Any specific reason for this?

I used to see a link to Jupyter Notebook on CDF Main Page. Now I dont, what happened?

Below we have outlined several frequently asked questions and their corresponding answers.Don’t see the answer to your question? Post as a reply in this thread and we’ll be sure to answer and/or add it to the FAQ list below!Protip: Use [cmd+f] or [cntrl+f] to search for keywords related to your question.Be sure to also let us know what else we can help answer here in the comments below! Q: What is the plans with Templates going forward?Please check out the documentation hereor https://pr-1023.docs.preview.cogniteapp.com/dev/guides/data-modeling/get-started#templates-future Q: Will there be new features built on top of Templates?Yes and no. We will not be doing any development of backend features (like new capabilities) into Templates. However, we will actually be building a lot of additional tooling on top of Templates (better UI, visualization layers, code generation, CLI etc.). Stay tuned in this Cognite Hub to see how you can use these tooling. 

Team - is there a way to generate a calculation in Cognite charts where you’re comparing data from the current timestamp value to something several minutes prior (say 30 minutes)? Any assistance on this would be welcome!

Cognite Team - thank you for bringing back the ability to overlay events directly on the chart as was previously a capability in ADI. It’s a welcome return and valuable add to the application.After utilizing the app a bit, I have a couple of “low hanging fruit” recommendations:Can we add the event description to the metadata that’s shown on the event? Is there a way to toggle using both start time and end time vs. just using start time? Some of the events that we have run for months and the start time is really the only relevant point for the trendHere are some more complex recommendations:Since charts is now integrated directly in Data Explorer - is there a way to click on the event results and actually go to the event directly in CDF to look at all the metadata? When filtering for events by selecting the asset - is there a way to toggle “select all children” as well? An example is that we have several pumps where work is tagged to the smallest component, but if we filter the events t

Hi,I’m just getting started with Cognite. I’m trying to create some assets. I’ve loaded them into RAW and I’m trying to write a SQL transformation to load them into assets. Is there documentation on what functions are available? I’ve gone through the online training and the simple example there, but it doesn’t cover what I’m trying to do.My specific questions are that I’m looking for documentation to answer are (for now):What data type is the id, parentid, and other fields How do I cast the string data in the csv to right type. I assume there is a Cast function The UI tells me I have the wrong type. It doesn’t tell me which field and what type it expects. That would really be helpful. In this case, I know what field, but I don’t know the type it’s looking for. For a top level asset in the hierarchy, what do I use for parentID? If I have spaces in the field names in my CSV, how can I reference the field?

Asset Data Insight (ADI) looks to be a very promising analysis tool. I realize it is in beta, but I want to share a couple of my impressions from using it over the last couple of days. Perhaps these suggestions can make it to a list of features to be implemented for the coming releases.I am a bit confused about the future development of ADI and Cognite Charts. There is clear overlap in functionality, and yet key features in ADI are not present in Charts, and vice versa. Will one take over for the other? Will they coexist? If one will be deprecated in the future, my feedback still is relevant for the one that survives.#1 Make all Chart functionality available in ADI.The calculation node editor is especially useful, but the interface for customizing how toe visualization looks is better in Charts than in ADI. #2 Improve the Events layerOverlaying events, such as maintenance history, on key time series can be very useful. However, the current implementation is lacking. The filtering of ev

Hi Team,  We have deployed Grafana on Azure using Grafana Labs available under Azure Marketplace.We need to install “Cognite Data Fusion” Plugin, but the plugin is not available, and we are unable to install it.Could you please let me know how to install “Cognite Data Fusion” Plugin for Grafana labs on Azure.PFA screenshot for the same. Also, please let me know any alternative ways to deploy grafana on Azure which has “Cognite Data Fusion” Plugin already installed. Thanks & Regards,Swati Mane

Hello,I wanted to checkout on any upper limits for following if limit exists.Max no of Schemas that can be created in one Data Model in FDM Max no of fields that could be added in one schema Max no of Data Models under one project Also any other limits around the data size or count or number of records that could be fetched in one query or anything related in general if exists.Please help us out with these numbers, this would help us to plan accordingly!

Today is the December release of Cognite Data Fusion. As you might have seen in last week’s Product Tour or read in today’s release post, there are several new and exciting Charts-specific updates in the latest release, namely...Charts is now an integral part of Cognite Data Fusion (fusion.cognite.com).A long awaited improvement, charting and no-code analytics finally lives alongside all other industrial DataOps functionalities available in Cognite Data Fusion. No URL switching and additional sign-in required.For those of you who have been using Charts before, all private and public charts that you and your colleagues have created will still be available via Cognite Data Fusion (fusion.cognite.com).Note that charts.cogniteapp.com will still work and be available. This teams, for those of you who are linking to Charts in your third party applications, Microsoft Teams, etc., this will still function exactly as expected. We will be working on an automatic redirect for coming releases, how

Hi,We are working on POC to build spotfire dashboard on top of CDF for which we are trying spotfire oData connector to trigger CDF APIs. But it returns error code: 426 (attached screenshot).plus, how we can authenticate cdf apis here? oData provides only 3 authentication methods - username/password, windows authentication, Microsoft azure marketplace. 

Hi could you share an example of a transformation to load a type that has multiple links to another type? All the examples I’ve seen only set startNode and endNode but no place to specify which field. For example:type Composite {   frontPart: Part   backPart: Part}type Part {  ...}

Hi, there! At Cognite, our customers are at the center of everything we do. Our goal is to help you to solve the industrial data problems daily. It's all about you & your industrial data.  To make sure we're giving you the best experience possible with the Flexible Data Model (FDM), we'd like to learn about your FDM expectations. Please spend a few minutes to share your thoughts with us in this short survey. The information you give will be confident, so be honest. We really want to know what you think. The survey 👉  https://forms.gle/d8BzpW4jmG4YN9kSA Thanks for your help! Cheers,On behalf of the FDM team   

If you are curious on how to get the most out of your Cognite Data Fusion subscription, you have come to the right place. This is part of a series of posts where we share some of our experience from working with customers in their journey towards an Industrial DataOps organization. We want to share lessons learned, mistakes made, good practices observed, and observations of pitfalls and risks. This is not the absolute truth, but hopefully a way to spark good discussions around an inherently complex topic!To quickly introduce ourselves, we are @Arjo Oosten, Digital Transformation Leader, winter sport addict and passionate about driving hands-on digital growth strategies and value based decision making, and @Karolina Luna, Solution Architect, cat lover, and passionate about the lifecycle perspective of everything (like solutions and data products).To learn more about Cognite Data Fusion, we recommend this post. Cognite’s Solution SupportWe have presented some models for organization we h

I created a data model that contains an interface (this is to allow polymorphism). When a type references the interface then the the Data Management table shows this error:It seems the UI relies on every reference to contain an externalId field, and that this field is implicitly defined for types but not for interfaces, as the GraphQL query returns with this error: "Validation error of type FieldUndefined: Field 'externalId' in type 'Twin' is undefined @ 'listEquipment/items/twins/items/externalId'"In the above Twin is an interface type, and Equipment contains a field which is a reference to an array of Twin.

We are getting error while deployment. We have tried reformatting in local with black. Also while committing we are getting error fatal: Authentication failed for 'https://gitlab.com/pycqa/flake8.git/'. Project is in repo of team member, I have already given access to the samefatal: Authentication failed for 'https://gitlab.com/pycqa/flake8.git/'

I see in videos you can click/drag on the chart to zoom the time axis. When I try that it will only allow “panning”. Is there some mode I need to set? I see that the mouse scroll wheel does zoom the chart but the click drag would be beneficial.