Community Discussions

Dear Cognite Community,I hope this message finds you well. Firstly, I'd like to acknowledge that I've been asking quite a few questions lately, and I sincerely appreciate the time and effort many of you have invested in guiding me. This community has evolved into a mentorship hub for me, and for that, I'm deeply grateful. :)I've been working extensively with Cognite Charts to visualize my time-series data and have been greatly impressed by its capabilities. However, I have a couple of specific needs that I'd like to discuss, and I was hoping to get some insights from the experts in this community.Dynamic Visualization of Actual vs. Predicted Model:I'm looking for a way to dynamically visualize my actual data against the predicted model within Cognite Charts. I came across Data Point Subscriptions as a potentially relevant feature. While the documented use-cases don't exactly match my needs, they seem to be the closest match. Would this feature be applicable to my scenario or is there a

As Cognite provides APIs to access RAW tables from database, is there any way to get the actual datatype (text/bool/timestamp etc.) of the table’s column.

Hi I received a few P&ID diagram where the tags aren’t spelled out in-place (because the space perhaps was limiting), but just an indexed number is given. And in a separate table, the index is mapped with the tag name.Please see that attached image which can provide further illustration. I am not sure if the OCR + contextualization logic can map the index out and place the tag at the correct place. I am thinking it is unlikely. In such case, can you please provide clues on how one can map it - some amount of manual steps and tweaks, if expected, are fine. Thanks for your inputs! 

Hi Team, We are working on the Cognite Pi Extractor to fetch the data from OSIsoft PI Data Archive. From the documentation we understood that we can use the OSIsoft PI Web API or PI SDK to retrieve the data we need from OSIsoft PI Server. But it is not specifically mentioned in Cognite PI Extractor's documentation that which method it is internally using. Is it using PI SDK or PI AF SDK or PI Web API?

Hi team,I have a Honeywell PHD source system. I have a got a suggestion to use Cognite OPC Classic Extractor. But I can see Extractor suggested is beta version. Can I know, it is efficient to use the Cognite OPC Classic Extractor, or we should go with custom extractor.If we use ,Cognite OPC Classic Extractor it connects over COM+ or DCOM to OPC servers and streams live and historical data into CDF. Can you please elaborate on COM+COM+ or DCOM connectivity to OPC Servers. How to connect with Honeywell PHD server using either of the ways?    Thanks

Hello,I’m trying to publish a new version of an existing data model and I’m receiving this error message:containers must be unique across space and externalId, regardless of caseCan you please help me with some details regarding where to look here?Thanks,Regards,

I am trying to establish Parent-Child relationships between two types of events ingested and transformed in CDF which are Workorders and Maintenance Notifications. I have two different datasets for each where the Raw data is staged and have also given corresponding labels (Work_order, Notification) for dataset and later these workorders and Maintenance notifications are linked to Assets in CDF using transformations. Now I need to establish the relationship between the workorders and Maintenance notifications. Although I went through the Documentation for relationship ( Relationships | Cognite Documentation) not able to get the hold of it. Any reference SQL for how relationships are established would also do.

There is a problem in fetching raw tables records through SDK. This was working till last week and something has changed now.  client.raw.rows.retrieve_dataframe(db_name="Eashwar_MOTDB-db",table_name="lp_input",limit=None)Now getting this error below. Please advise.--------------------------------------------------------------------------MissingSchema Traceback (most recent call last)Cell In[6], line 1----> 1 client.raw.rows.retrieve_dataframe(db_name="Eashwar_MOTDB-db",table_name="lp_input",limit=None,columns=None)File /lib/python3.11/site-packages/cognite/client/_api/raw.py:538, in RawRowsAPI.retrieve_dataframe(self, db_name, table_name, min_last_updated_time, max_last_updated_time, columns, limit) 514 """`Retrieve rows in a table as a pandas dataframe. <https://developer.cognite.com/api#tag/Raw/operation/getRows>`_ 515 516 Rowkeys are used as the index. (...) 535 >>> df = c.raw.rows.retrieve_dataframe("db1", "t1",

Hello esteemed members of the Cognite community,I come to you with a sense of urgency and a deep need for expert guidance. I've been attempting to familiarize myself with Cognite for the last six months, and despite my best efforts, I find myself at an impasse with some critical aspects. My situation is time-sensitive, and I am truly hoping for your assistance to navigate this complex but fascinating journey.My Setup:Environment: Google Colab (Free version)SDK: Cognite Python SDKAssets: Wind Farm with two sub-assets (Asset A and Asset B)My Goals:Connect to Cognite Project via Python SDK: I need to use my client ID and client secret to establish a connection from Google Colab.Create Hierarchical Assets: My aim is to create a parent asset, named "Wind Farm," and within this parent asset, include two child assets, Asset A and Asset B.Upload Time-Series Data from CSV: I have CSV files containing wind-speed and wind-power data for Asset A and Asset B. I need to upload these as time-series d

List Projects API (https://{cluster}.cognitedata.com/api/v1/projects) - no corresponding way to use this from Python SDK.Is there any specific reason why this method to get the CDF Projects is not available in python sdk.If it is present I was not able to find it in the documentation. https://cognite-sdk-python.readthedocs-hosted.com/en/latest

We want to extract data from Bentley AssetWise APM. Can Cognite OPC UA Extractor be used for this use case? If yes, how? If no, which Extractor from Cognite’s prebuilt extractors is suitable for this?

In the below example, suppose “Heating cable” needs to be deleted. How can this be achieved? If “Heating cable” needs to be renamed like “Heating-Cable”, how can this be achieved? If “Heating Cable” needs to move from Pump_A to Pump_B, how can this be achieved? SYSTEM 11└───Pump (Pump_A)│   └───Heating cable└───Pump (Pump_B)

I am trying to connect to an MQTT broker with Cognite’s MQTT Extractor.I know that the broker is fully functional, verified by several tools.However, when completing the “Add MQTT Topic”.Error code indicates that the API does not accept “Datapoints” as “Target type”, even though “Target type” is a mandatory field in the interface window. And: “Datapoints” is the only available selection.Any quick feedback to progress my testing is appreaciated! 

Even after I change the name of a synthetic tag with the new InField 2.0 feature release, I still only see the original tag name in the first edit view. I have to click on the pencil icon to edit the tag, and then I will be able to see what the new name I changed it to, is. The name that shows up in the first edit task view should show as the updated tag, rather than the original tag name.

We are having a multilevel asset hierarchy in cdf, and ground level assets are only having timeseries linked.we are trying to create Relationships between every parent asset and its child asset’s Timeseries.we used python sdk code snippets to do this. Which are been attached to this for your reference.In python sdk, after running the python relationship code, it is showing relationships are established. But in UI it is not showing from Assets, But we are able to see under Timeseries.even after we tried interchanging the Source and target between assets and timeseries, same result.one unique observation is that we could see the relationship established just for 1 asset which is having 3 timeseries linkage. rest others are not showing(they have more than 20 relations, even 500 for root asset.)we would like to know are we following correct manner, or any restrictions are from CDF tool. plz help us in this regard.from cognite.client import CogniteClientfrom cognite.client.data_classes impo

Hello I am trying to run entity matching on the data that is in FDM (Data modelling) and not in the classic assets model. I don’t see an option to fetch such items in the entity matching screen (contextualize menu). Is this by design, do we expect a support to search and select such custom models for matching in the future. Also a similar case for data explorer, even when I have updated all my records to have a data set id, I am not able to search for them in the Data explorer. Just wondering when the explorer can start supporting such data. PS:I imagine, the entity matching can also work if I invoke the APIs directly,  but then I’ll have to extract names + description myself and also need to link the results back to their original ids. A visual ways in CDF Fusion UI will be very helpful. RegardsAlex 

Hello All,In the past, we encountered some performance issues when extracting data from the PI System using PI API. As an alternative, we have been using PI SDK to extract data from both PI Archive and AF. The question is, does Cognite PI Extract utilize PI SDK, and are there any performance limitations?

How to keep Master data in CDF: the data which is not part of any asset hierarchy 

Hi,We saw quite frequently an error message like below:"could not add instances: 500 - Internal server error. Please report this error to support@cognite.com and provide us with your request id: 4594f717-51c0-9708-86d3-5c5431f60cd1 and cluster name: westeurope-1"But when run it again it worked. The issue happens quite often(the number of instances in the request is close to 1000), could you have a check? Thanks. Regards,Xiaofeng 

Hi, is it possible to host a web-hook endpoint in a Cognite function?And is it a good idea?

How do I store a dataframe as an XLS in CDF files? I have to perform this within CDF functions.  

How to connect azure devops variable group and read its variable to manifest.yaml file for transformation deployment . in manifest.yaml, secret is visible. I want to hide it. transformation is getting deployed using azure devops CI/CD pipeline.

I had run transformation giving me error for Duplicate node externalIds for space 'PDM' even after deleting all the data from the model for space PDM still giving the same error, I also verified by api still there is no data still giving the error for Duplicate node externalIds for space 'PDM' . 

Currently Cognite’s Streamlit apps have issues with for example:with st.spinner('Wait for it...'): time.sleep(5)st.success('Done!')The code itself should wait 5 seconds before writing out Done!, but is executed instantly. Another example is when you try to make your application responsive while waiting for some data to arrive from a remote location. For example, when you want to print out a wait message for the user because sometimes it takes some seconds to load the data, but the app doesn't work as intended. In the following example I am trying to print out a message while waiting for the function to finish, but it fails:call_func_button = st.button("Call function with current parameters", key="button_func_call")if call_func_button: func_call = example_function.call(data=input_data, wait=False) st.info("Waiting for function...") while func_call.status == "Running": func_call.update() if func_call.status == "Failed": st.error("Function failed to run!")

I wanted to know, can I create a Table in RAW database, which will contain only column names initially with 0 rows added in it?