Product User Community

A common setup in CDF (Cognite Data Fusion) is to first build an asset hierarchy, and then to attach events, timeseries etc. to those assets. One way to do it is to use transformations. In this short article, we’ll take events as an example. It works the same way for timeseries and sequences. Let’s assume we already have an asset hierarchy and we want to attach events to it. We’ll suppose that we have a RAW table, from which we want to create events, that looks like this:   In transformations, to attach an asset to a created event, you need to specify the corresponding asset ID (assetId in the target schema). Asset IDs being automatically generated, we usually prefer using external IDs because we know what they are made of: an ID from an ERP, a value following a naming convention, etc.  Since the asset ID is the expected value for the assetId field in the target schema, we need to retrieve for each asset its ID, based on its external ID. As mentioned in the documentation, we can read f

The coordinates of a document in CDF are normalized. In a normalized document, it has (0,0) coordinates in the upper left corner and (1,1) coordinates in the right bottom corner.Convert xml coordinates to normalized coordinatesTo convert xml coordinates to normalized coordinates you need to divide X coordinates with the width of the page and the Y coordinates with the height of the page. If the xml Y coordinate is 0 at the bottom of the page and the <height> is at the top of the page, the Y coordinate should be flipped as below.Normalized Y = 1- Normalized YOnce the coordinates are flipped;NewMinY = 1 - OldMaxYNewMaxY = 1 - OldMinY Example scenarioIf a user would like to add manual annotations to a P&ID file in CDF the user should convert the xml coordinates of the file to normalized coordinates. 

In Charts, we have been using the “Shift Time Series” function (for creating a new Calculation time series) to assess data more effectively, but have now noticed a limitation where the calculation is limited to the data from the source time series already displayed.  If you look at the first image below (just a 10-min shift), you can see in the green calculation that there is a gap on the left where the calculation doesn’t exist due to the source data being “off the page”.  If we go to a more extreme scenario (2nd image below), now of the data shows since we are attempting a 2+ day shift in a time series.  Is there a solution where this limitation can be removed?  For our scenario specifically, we are looking closely at (and comparing) three separate incidents that lasted about 1 minute each, but were spread out over the course of a week, so we are super zoomed in to look at the behavior signatures.  Thanks for the input!Kind regards,Richard10-minute shift​​​​​ Multiple-day shift 

I have asset hierarchy table and time series table imported, but I want to link asset to timeseries or vice-versa. asset hierarchy table looks like:level 1, level 2.e1, entity 1;level 1, level 2.e1, entity 2;level 1, level 2.e2, entity 3;time series table looks like:t1, entity 1, x1, y1t2, entity 1, x2, y2when I click asset entity 1 in Explore view, it shows time series data count but the name and description of the time series are empty; when click time series, the count of linked Assets is 0. I do not know how to fix the issue.  

Hello from the Solutions Portal team!We have a new release coming, which is by far our largest release yet! We hope this release will make it easier toBrowse through your data inside your CDF Project Enable new solutions built on top of CDF Enable new no code solution possibilities  We have a new home screen with new functionality!Any user can now ‘Browse solutions’. Through here, you can view all solutions that Cognite has to offer. If they’re not enabled, a demo can be requested. If you are an admin, SOME applications can be installed through a wizard for free (today, blueprint) and some are automatically installed (Charts).An explorer designed for SMEs. We’ve taken the old ADI explorer, made some improvements based on feedback, and now have an early version out for early adopters.An early version of global search is included also - easily search your way through any CDF resource (with more resources to come!) New CDF application: Blueprint!Blueprint is a no code solution that allows

I might need to create 100,000s - 1,000,000 of individual timeseries. I would like to understand if the number of timeseries impacts the API performance. e.g. retrieving data points for 1 of the timeseries. Would the API response be similar if I had 100 or 1 million timeseries?Also is there a maximum number of timeseries that can be created per CDF project?

Hi.Would it be possible to change the name format of the CSV file downloaded from cognite charts? The colon in “New chart 2023-02-22 15:43:59 (timeseries).csv” makes it difficult to unzip the file on Windows.

While using cognite-sdk-dotnet, it needs API key whereas I have client-id and secret with me. How can I get the API key for the same? Or there is some alternative way to work with client-id and secret.

I am trying new FDM APIs. In POST endpoints I am facing issue “Missing body for POST request”Am I missing some parameters? I am using POST body as per documentation 

Is there documentation for the import calculation json in Charts? 

Digitalization PoCs are commonplace. Real return on investment (ROI) isn’t.So how do investments in digital transformation efforts translate into real value for your business (or company)?We, at Cognite, commissioned a study from Forrester Consulting to examine the potential ROI and business benefits asset-heavy industrial organizations can expect from deploying Cognite Data Fusion. Forrester interviewed six representative customers across our customer base in Oil and Gas, Manufacturing, and Power & Cleantech with experience using Cognite Data Fusion, and found $21.6 million in added net present value at a 400% ROI. Key results of the ROI study include:* $9 million gained through the optimization of heavy machinery and industrial processes* $5.1 million saved through optimized energy use and reduced operational costs* $4.8 million added value through reduced shutdown time* $4.3 million cost reduction by optimizing planned maintenance  Do you want to know what stands behind these nu

I have set up both the environment variables SOURCE_CLIENT_SECRET (Note that the Client secret is generated from the OID widget as per the documentation)and DEST_CLIENT_SECRET and running the replicator with the config file using option 5.I am getting error as per below logAMAC02Z3123LVCJ:oid-replicator j.subhash.parandekar$ poetry run python3 ./oid_replicator/replicate.py 2023-02-17 18:46:48,239 root INFO - Config file - Repeat line 5: 2023-02-17 18:46:48,239 root INFO - Config file - Repeat line 14: 2023-02-17 18:46:48,239 root INFO - Config file - Repeat line 23: Starting replication of resourcesReplicating assets...Traceback (most recent call last):  File "/Users/j.subhash.parandekar/Library/Caches/pypoetry/virtualenvs/oid-replicator-cwaK-6ym-py3.11/lib/python3.11/site-packages/cognite/client/credentials.py", line 364, in _refresh_access_token    token_result = self.__oauth.fetch_token(                   ^^^^^^^^^^^^^^^^^^^^^^^^^  File "/Users/j.subhash.parandekar/Library/Caches/py

Using transformations to create/update data can be cumbersome especially for complex FDM models. I understand there are plans to generate APIs from models, but are there any alternatives in the short term, such as implementing GraphQL mutations? Are the APIs used by transformations internal to CDF?

I am running the notebook for my own Cognite project as per the example https://github.com/cognitedata/dshub-tutorials/blob/master/advanced/Comparing%20Entity%20Matching%20models%20with%20SDK%20demo.ipynbI am getting below error ModelFailedException: EntityMatchingModel 3531921825900910 failed with error 'JobFailedException: AttributeError('TfidfVectorizer' object has no attribute 'get_feature_names')' at line  results = model.predict(sources=time_series_test, targets=assets).result

Hi All, I am getting error while importing CogniteClient from cognite.experimental.Please refer the below screenshot of the error.    

I’m experimenting with filter nodes https://pr-ark-codegen-1646.specs.preview.cogniteapp.com/v1.json.html#tag/Instances-(New)/operation/advancedListInstance using a payload like:{  "includeTyping": false,    "sources": [        {            "source": {                "type": "view",                "space": "jca-domain",                "externalId": "Facility",                "version": "0_3"            }        }    ],  "instanceType": "view"}It seems to return entities not of the type of the given source (Facility/0_3). For example it returns Equipment/0_3 entities. Is this the expected behavior and do I have to separately filter for view type? If so how do I do that? Thanks.

We planned to Download 3d files from CDF - fundamentals through API , However I can able to find correct API for this. Can anyone explain which api will for work this scenario and what is the concept of asset when  models addition. 

Hi Digitalization Community!As we grow we're constantly looking to improve our community, and one of the changes you might notice is your new level badge. You can read more about it below 🏅     

Cognite Asset Performance Management addresses common business problems faced in the asset-heavy industry, such as aging assets and workforce, increasing maintenance costs, and unplanned downtime. A challenge to close the improvement loopSolving the current business problems spans three main business processes; reliability, maintenance, and operations, forming an industrial improvement loop. However, it’s  challenging to close this improvement loop due to siloed architectures, siloed tools, and manually orchestrated processes where often excel and paper-based knowledge gets stuck.  Cognite aims to systematically bring these industrial processes together to create a dynamic and optimized asset performance management process that keeps improving.  Unlock your tribal knowledge to complete the APM data catalogueCognite Data Fusion (CDF) ties together unstructured and structured data to make a complete APM data catalog. However, CDF can only do this in conjunction with applications anchored

Hi, please help me to clarify on the below details as our SLB team is aiming to setup a project with CDF to do some features,Sandbox tenant for SLB  How to connect to production data Embed Python preprocessing script into the Cognite pipeline

Hi, I am trying to transform data from Raw to timeseries in CDF. I made a query and everything seems ok, but when I use distinct to check the external id uniqueness, I get error message:"Cannot have map type columns in DataFrame which calls set operations(intersect, except, etc.), but the type of column metadata is map<string,string>; I don’t know why I get this message, Isn’t it possible to use distinct when wi do MAP or To_Metadata mapping? 

Hi fellow Community Members! Here’s a quick update on our joint community achievements in a little over a year: 3200 Community Members 2800 Posts 2000 Questions Answered 250 Product Ideas  1100 Badges AwardedTHANK YOU for making our community a special and inspiring place to make data do more for our industries.As we grow we're constantly looking to improve our community, and one of the changes you might notice is your new level badge. You can read more about your new level badge below. We hope you like it, you’ve earned it! 🏅     

On behalf of Celanese Clear Lake Utilities super userDoes Charts currently support the option to create cumulative sum calculations? For example, when calculating total usage/consumption of fuel gas across the site, the user usually has to get the individual data points from the raw data sources and then do the calculation manually in an excel sheet. The user has to repeat these calculations every month.Could Charts potentially automate this calculation to provide real-time data to display a summary of data as it grows over time for consumption/usage? Also, would Charts be able to “reset” this calculation every month?  

I realizd that when leveraging Cognite REVEAL in application development, can we not have Point Cloud/360 Images annd 3D in one REVEAL? Why do i have to select which one? is that not embedded within the same where i can turn on or off the Point Cloud or 360 Images?

Hi, I am trying to use the Data Modeling API (https://pr-ark-codegen-1646.specs.preview.cogniteapp.com/v1.json.html#tag/Instances-(New)/operation/applyNodeAndEdges) to create instances of Views I have defined, including a reference property from one view to another. The reference property in the view looks like this:                "facility": {                    "type": {                        "space": "jca-domain",                        "externalId": "EquipmentFacility"                    },                    "source": {                        "type": "view",                        "space": "jca-domain",                        "externalId": "Facility",                        "version": "0_1"                    },                    "direction": "outwards"                }I’m not including the whole definition as it is kind of lengthy, but basically there is a Facility view and an Equipment view, and the above property is on the Equipment so I can link it to a Facility. I am able