Community Discussions

Hello,I am running a csv_extractor that loads data to Raw explorer. I run the extractor from my machine locally through cmd. How do I set up an extraction pipeline to monitor this extractor? I created an extraction pipeline from “monitor extractor”, but not sure how to link it to my extractor.Regards,Diana

What is “YOUR_SECRET_API_KEY”? How to get this secret key? Please tell 

Hello,Can I get an example of a CDF function that deploys a .pickle or .joblib model into CDF, then calls the model?Thanks,Diana

Hello all, I’m trying to connect CDF data source to my Grafana instance that I already installed as a plugin, and I get this message:“Angular plugin This data source plugin uses a deprecated, legacy platform based on AngularJS and is incompatible with your current Grafana configuration.”  Then when I try to add it as a new data source, the CDF is not available on the drop list  Is the Angular plugin warning message preventing me from adding the data source? if so, is there any way I can resolve this? Thank you,Yasir

I am working on Cognite Documentum Extractor and using D2 as mode of connectivity. I have not received any CA root certificate from Documentum Server from Client. Client have mentioned that, they don’t have the certificate. So, Can Documentum Extractor work without CA root certificate? If not, Is there any alternate approach which we can use to make it work using D2 mode?Also, If it can’t work without root CA certificate, Please suggest me an approach or steps to generate the certificate from Documentum Server.

Hi team, We are facing an issue while uploading a file to CDF using smb yaml configurations using File Extractor, please find the error below.2023-10-05 12:38:42.043 UTC [ERROR   ] MainThread - Could not upload file xxx.pdf to CDF: [Error 1] [NtStatus 0xc0000043] The process cannot access the file because it is being used by another process: xxx.pdf'How can we fix this issue as many users might be using file share in different locations at the same time while uploading it will be difficult to know? 

Hello Cognite team, Greetings! Below is a screen shot of 4 data points available for a specific timeseries id in a duration of 1 hour For the above mentioned data points when i select the aggregate function (similar value being resulted from aggregate function api) i see an average value which is significantly higher than the original value (calculated manually) The data interval for the below points is for every 15 mins the first 4 data points for this timeseries is what you see in the below screen shot  

New to Cognite.Can anyone help on this:We have CSV files uploaded into CDF dataset (thru’ FileExtractor), and now need to read and parse the csv files contents in the CDF into TimeSeries? And how to run it automatically or scheduled?Thank a lots.​​​​​

Hi Cognite Team,Is there any document which can show , how to fetch confidential information from private end point key vault  on Microsoft azure key vault. 

Hello,We have off late moved from Rest calls to SDK and post that we have started seeing the below errorError generating access token: invalid_request, 400, too many calls What is recommended for this type of error ? Can’t we add a exponential delay at sdk side ?Also it would be important for us to know that this error is given after how many calls ? 

How to load data from Alteryx (ETL tool) to CDF Raw Database? I don’t see any connector in Alteryx for connecting to CDF. 

I am getting below error while executing Documentum Extractor. FATAL: Invalid YAML file: Both database and table must be set when metadata destination is RAWcom.cognite.connector.dctm.config.InvalidConfigException: Invalid YAML file: Both database and table must be set when metadata destination is RAW. I have gone through the cognite documentation for possible configuration, it is not mentioned in the documentation. There is no parameter for metadata_destination, database, table. Please help me with details, from where we can get this parameter info? or how can I configure it in YAML? Please find my config.yaml file contents as below: version: 1logger:    console:        level: INFOcognite:    # Read these from environment variables    host: #${COGNITE_BASE_URL}    project: #${COGNITE_PROJECT}    idp-authentication:        # token-url: ${COGNITE_TOKEN_URL}        tenant: #${tenant}        client-id: #${COGNITE_CLIENT_ID}        secret: #${COGNITE_CLIENT_SECRET}        scopes:         

Dear Cognite Community,I hope this message finds you well. Firstly, I'd like to acknowledge that I've been asking quite a few questions lately, and I sincerely appreciate the time and effort many of you have invested in guiding me. This community has evolved into a mentorship hub for me, and for that, I'm deeply grateful. :)I've been working extensively with Cognite Charts to visualize my time-series data and have been greatly impressed by its capabilities. However, I have a couple of specific needs that I'd like to discuss, and I was hoping to get some insights from the experts in this community.Dynamic Visualization of Actual vs. Predicted Model:I'm looking for a way to dynamically visualize my actual data against the predicted model within Cognite Charts. I came across Data Point Subscriptions as a potentially relevant feature. While the documented use-cases don't exactly match my needs, they seem to be the closest match. Would this feature be applicable to my scenario or is there a

As Cognite provides APIs to access RAW tables from database, is there any way to get the actual datatype (text/bool/timestamp etc.) of the table’s column.

Hi I received a few P&ID diagram where the tags aren’t spelled out in-place (because the space perhaps was limiting), but just an indexed number is given. And in a separate table, the index is mapped with the tag name.Please see that attached image which can provide further illustration. I am not sure if the OCR + contextualization logic can map the index out and place the tag at the correct place. I am thinking it is unlikely. In such case, can you please provide clues on how one can map it - some amount of manual steps and tweaks, if expected, are fine. Thanks for your inputs! 

Hi Team, We are working on the Cognite Pi Extractor to fetch the data from OSIsoft PI Data Archive. From the documentation we understood that we can use the OSIsoft PI Web API or PI SDK to retrieve the data we need from OSIsoft PI Server. But it is not specifically mentioned in Cognite PI Extractor's documentation that which method it is internally using. Is it using PI SDK or PI AF SDK or PI Web API?

Hi team,I have a Honeywell PHD source system. I have a got a suggestion to use Cognite OPC Classic Extractor. But I can see Extractor suggested is beta version. Can I know, it is efficient to use the Cognite OPC Classic Extractor, or we should go with custom extractor.If we use ,Cognite OPC Classic Extractor it connects over COM+ or DCOM to OPC servers and streams live and historical data into CDF. Can you please elaborate on COM+COM+ or DCOM connectivity to OPC Servers. How to connect with Honeywell PHD server using either of the ways?    Thanks

Hello,I’m trying to publish a new version of an existing data model and I’m receiving this error message:containers must be unique across space and externalId, regardless of caseCan you please help me with some details regarding where to look here?Thanks,Regards,

I am trying to establish Parent-Child relationships between two types of events ingested and transformed in CDF which are Workorders and Maintenance Notifications. I have two different datasets for each where the Raw data is staged and have also given corresponding labels (Work_order, Notification) for dataset and later these workorders and Maintenance notifications are linked to Assets in CDF using transformations. Now I need to establish the relationship between the workorders and Maintenance notifications. Although I went through the Documentation for relationship ( Relationships | Cognite Documentation) not able to get the hold of it. Any reference SQL for how relationships are established would also do.

There is a problem in fetching raw tables records through SDK. This was working till last week and something has changed now.  client.raw.rows.retrieve_dataframe(db_name="Eashwar_MOTDB-db",table_name="lp_input",limit=None)Now getting this error below. Please advise.--------------------------------------------------------------------------MissingSchema Traceback (most recent call last)Cell In[6], line 1----> 1 client.raw.rows.retrieve_dataframe(db_name="Eashwar_MOTDB-db",table_name="lp_input",limit=None,columns=None)File /lib/python3.11/site-packages/cognite/client/_api/raw.py:538, in RawRowsAPI.retrieve_dataframe(self, db_name, table_name, min_last_updated_time, max_last_updated_time, columns, limit) 514 """`Retrieve rows in a table as a pandas dataframe. <https://developer.cognite.com/api#tag/Raw/operation/getRows>`_ 515 516 Rowkeys are used as the index. (...) 535 >>> df = c.raw.rows.retrieve_dataframe("db1", "t1",

Hello esteemed members of the Cognite community,I come to you with a sense of urgency and a deep need for expert guidance. I've been attempting to familiarize myself with Cognite for the last six months, and despite my best efforts, I find myself at an impasse with some critical aspects. My situation is time-sensitive, and I am truly hoping for your assistance to navigate this complex but fascinating journey.My Setup:Environment: Google Colab (Free version)SDK: Cognite Python SDKAssets: Wind Farm with two sub-assets (Asset A and Asset B)My Goals:Connect to Cognite Project via Python SDK: I need to use my client ID and client secret to establish a connection from Google Colab.Create Hierarchical Assets: My aim is to create a parent asset, named "Wind Farm," and within this parent asset, include two child assets, Asset A and Asset B.Upload Time-Series Data from CSV: I have CSV files containing wind-speed and wind-power data for Asset A and Asset B. I need to upload these as time-series d

List Projects API (https://{cluster}.cognitedata.com/api/v1/projects) - no corresponding way to use this from Python SDK.Is there any specific reason why this method to get the CDF Projects is not available in python sdk.If it is present I was not able to find it in the documentation. https://cognite-sdk-python.readthedocs-hosted.com/en/latest

We want to extract data from Bentley AssetWise APM. Can Cognite OPC UA Extractor be used for this use case? If yes, how? If no, which Extractor from Cognite’s prebuilt extractors is suitable for this?

In the below example, suppose “Heating cable” needs to be deleted. How can this be achieved? If “Heating cable” needs to be renamed like “Heating-Cable”, how can this be achieved? If “Heating Cable” needs to move from Pump_A to Pump_B, how can this be achieved? SYSTEM 11└───Pump (Pump_A)│   └───Heating cable└───Pump (Pump_B)

I am trying to connect to an MQTT broker with Cognite’s MQTT Extractor.I know that the broker is fully functional, verified by several tools.However, when completing the “Add MQTT Topic”.Error code indicates that the API does not accept “Datapoints” as “Target type”, even though “Target type” is a mandatory field in the interface window. And: “Datapoints” is the only available selection.Any quick feedback to progress my testing is appreaciated!