Join the discussions about products powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.
Recently active
Is there an example available for setting up the metric feature using Prometheus for the OPC-UA extractor, similar to what is shown for the PI extractor in the Cognite Academy?
Hello,I am running a csv_extractor that loads data to Raw explorer. I run the extractor from my machine locally through cmd. How do I set up an extraction pipeline to monitor this extractor? I created an extraction pipeline from “monitor extractor”, but not sure how to link it to my extractor.Regards,Diana
What is “YOUR_SECRET_API_KEY”? How to get this secret key? Please tell
Hello,Can I get an example of a CDF function that deploys a .pickle or .joblib model into CDF, then calls the model?Thanks,Diana
Hello all, I’m trying to connect CDF data source to my Grafana instance that I already installed as a plugin, and I get this message:“Angular plugin This data source plugin uses a deprecated, legacy platform based on AngularJS and is incompatible with your current Grafana configuration.” Then when I try to add it as a new data source, the CDF is not available on the drop list Is the Angular plugin warning message preventing me from adding the data source? if so, is there any way I can resolve this? Thank you,Yasir
I am working on Cognite Documentum Extractor and using D2 as mode of connectivity. I have not received any CA root certificate from Documentum Server from Client. Client have mentioned that, they don’t have the certificate. So, Can Documentum Extractor work without CA root certificate? If not, Is there any alternate approach which we can use to make it work using D2 mode?Also, If it can’t work without root CA certificate, Please suggest me an approach or steps to generate the certificate from Documentum Server.
Hi team, We are facing an issue while uploading a file to CDF using smb yaml configurations using File Extractor, please find the error below.2023-10-05 12:38:42.043 UTC [ERROR ] MainThread - Could not upload file xxx.pdf to CDF: [Error 1] [NtStatus 0xc0000043] The process cannot access the file because it is being used by another process: xxx.pdf'How can we fix this issue as many users might be using file share in different locations at the same time while uploading it will be difficult to know?
Hello Cognite team, Greetings! Below is a screen shot of 4 data points available for a specific timeseries id in a duration of 1 hour For the above mentioned data points when i select the aggregate function (similar value being resulted from aggregate function api) i see an average value which is significantly higher than the original value (calculated manually) The data interval for the below points is for every 15 mins the first 4 data points for this timeseries is what you see in the below screen shot
New to Cognite.Can anyone help on this:We have CSV files uploaded into CDF dataset (thru’ FileExtractor), and now need to read and parse the csv files contents in the CDF into TimeSeries? And how to run it automatically or scheduled?Thank a lots.
Hello,We have off late moved from Rest calls to SDK and post that we have started seeing the below errorError generating access token: invalid_request, 400, too many calls What is recommended for this type of error ? Can’t we add a exponential delay at sdk side ?Also it would be important for us to know that this error is given after how many calls ?
How to load data from Alteryx (ETL tool) to CDF Raw Database? I don’t see any connector in Alteryx for connecting to CDF.
I am getting below error while executing Documentum Extractor. FATAL: Invalid YAML file: Both database and table must be set when metadata destination is RAWcom.cognite.connector.dctm.config.InvalidConfigException: Invalid YAML file: Both database and table must be set when metadata destination is RAW. I have gone through the cognite documentation for possible configuration, it is not mentioned in the documentation. There is no parameter for metadata_destination, database, table. Please help me with details, from where we can get this parameter info? or how can I configure it in YAML? Please find my config.yaml file contents as below: version: 1logger: console: level: INFOcognite: # Read these from environment variables host: #${COGNITE_BASE_URL} project: #${COGNITE_PROJECT} idp-authentication: # token-url: ${COGNITE_TOKEN_URL} tenant: #${tenant} client-id: #${COGNITE_CLIENT_ID} secret: #${COGNITE_CLIENT_SECRET} scopes:
Dear CDF UsersWe are thrilled to announce the open beta release of the monitoring and alerting functionality in Charts within CDF. This release marks a significant leap forward in providing you with a comprehensive monitoring and alerting solution, designed to empower you in managing and optimizing your data flows. Key Features of Release:Native Thresholds on CDF Data: Now, within Charts, you can seamlessly create thresholds on time series data. This native capability allows you to monitor or both your time series data and KPI’s generated from no code calculations, ensuring that you are alerted precisely when needed. Save your no-code calculations in CDF: Now within Charts you have the ability to save your no code calculations within CDF so that they are consumable in other context for example your own dashboards, monitoring etc. This write back is now scoped to a dataset to ensure that the integrity of the data is maintained. Email Notifications: Stay informed in real-time! Our monit
Open Beta Release of Monitoring and Alerting in Charts!Dear CDF User,We are thrilled to announce the open beta release of the monitoring and alerting functionality in Charts within CDF. This release marks a significant leap forward in providing you with a comprehensive monitoring and alerting solution, designed to empower you in managing and optimizing your data flows.Key Features of the Open Beta Release:Native Thresholds on CDF Data: Now, within Charts, you can seamlessly create thresholds on time series data. This native capability allows you to monitor or both your time series data and KPI’s generated from no code calculations, ensuring that you are alerted precisely when needed. Save your no-code calculations in CDF: Now within Charts you have the ability to save your no code calculations within CDF so that they are consumable in other context for example your own dashboards, monitoring etc. This write back is now scoped to a dataset to ensure that the integrity of the data is mai
Dear Cognite Community,I hope this message finds you well. Firstly, I'd like to acknowledge that I've been asking quite a few questions lately, and I sincerely appreciate the time and effort many of you have invested in guiding me. This community has evolved into a mentorship hub for me, and for that, I'm deeply grateful. :)I've been working extensively with Cognite Charts to visualize my time-series data and have been greatly impressed by its capabilities. However, I have a couple of specific needs that I'd like to discuss, and I was hoping to get some insights from the experts in this community.Dynamic Visualization of Actual vs. Predicted Model:I'm looking for a way to dynamically visualize my actual data against the predicted model within Cognite Charts. I came across Data Point Subscriptions as a potentially relevant feature. While the documented use-cases don't exactly match my needs, they seem to be the closest match. Would this feature be applicable to my scenario or is there a
As Cognite provides APIs to access RAW tables from database, is there any way to get the actual datatype (text/bool/timestamp etc.) of the table’s column.
Hi community!Monitoring asset health, performing root cause analysis, and doing on-the-fly troubleshooting can be a complex process for both seasoned experts and new engineers. In this video I'll be sharing some tips on how to gather and analyze data efficiently, which we believe will boost your confidence in managing asset health.I'd love to hear your thoughts and encourage you to share your experiences and insights to help improve our asset health program.Cheers,Andreea.
Have you already tried and used the latest features released in our Industrial Canvas? We would like to hear your feedback! 🙌Here is the full list of features and how you can use them:Managing your canvasCanvas visibility can now be set to either private or public. By default, when you create a canvas, it will be “marked” as private. You can change it to public by using the Share option while in the canvas. View live datapoints signalled with traffic lights based on basic rulesPin time series connected to assets in engineering diagrams and visualize their “live” values (the latest value is refreshed every 30s). Add simple rules on these values. For example “if the temperature is higher than 30°C, show the tag in colour red”.Leave comments and tag colleagues in the canvas You can easily add comments while working in the canvas and tag your colleagues. You can find all the comments in the “Comments panel” where you can also search for the content. General fixes, tweaks and small improv
Hi I received a few P&ID diagram where the tags aren’t spelled out in-place (because the space perhaps was limiting), but just an indexed number is given. And in a separate table, the index is mapped with the tag name.Please see that attached image which can provide further illustration. I am not sure if the OCR + contextualization logic can map the index out and place the tag at the correct place. I am thinking it is unlikely. In such case, can you please provide clues on how one can map it - some amount of manual steps and tweaks, if expected, are fine. Thanks for your inputs!
Hi Team, We are working on the Cognite Pi Extractor to fetch the data from OSIsoft PI Data Archive. From the documentation we understood that we can use the OSIsoft PI Web API or PI SDK to retrieve the data we need from OSIsoft PI Server. But it is not specifically mentioned in Cognite PI Extractor's documentation that which method it is internally using. Is it using PI SDK or PI AF SDK or PI Web API?
Hi team,I have a Honeywell PHD source system. I have a got a suggestion to use Cognite OPC Classic Extractor. But I can see Extractor suggested is beta version. Can I know, it is efficient to use the Cognite OPC Classic Extractor, or we should go with custom extractor.If we use ,Cognite OPC Classic Extractor it connects over COM+ or DCOM to OPC servers and streams live and historical data into CDF. Can you please elaborate on COM+COM+ or DCOM connectivity to OPC Servers. How to connect with Honeywell PHD server using either of the ways? Thanks
Hello,I’m trying to publish a new version of an existing data model and I’m receiving this error message:containers must be unique across space and externalId, regardless of caseCan you please help me with some details regarding where to look here?Thanks,Regards,
I am trying to establish Parent-Child relationships between two types of events ingested and transformed in CDF which are Workorders and Maintenance Notifications. I have two different datasets for each where the Raw data is staged and have also given corresponding labels (Work_order, Notification) for dataset and later these workorders and Maintenance notifications are linked to Assets in CDF using transformations. Now I need to establish the relationship between the workorders and Maintenance notifications. Although I went through the Documentation for relationship ( Relationships | Cognite Documentation) not able to get the hold of it. Any reference SQL for how relationships are established would also do.
There is a problem in fetching raw tables records through SDK. This was working till last week and something has changed now. client.raw.rows.retrieve_dataframe(db_name="Eashwar_MOTDB-db",table_name="lp_input",limit=None)Now getting this error below. Please advise.--------------------------------------------------------------------------MissingSchema Traceback (most recent call last)Cell In[6], line 1----> 1 client.raw.rows.retrieve_dataframe(db_name="Eashwar_MOTDB-db",table_name="lp_input",limit=None,columns=None)File /lib/python3.11/site-packages/cognite/client/_api/raw.py:538, in RawRowsAPI.retrieve_dataframe(self, db_name, table_name, min_last_updated_time, max_last_updated_time, columns, limit) 514 """`Retrieve rows in a table as a pandas dataframe. <https://developer.cognite.com/api#tag/Raw/operation/getRows>`_ 515 516 Rowkeys are used as the index. (...) 535 >>> df = c.raw.rows.retrieve_dataframe("db1", "t1",
We are currently exploring potential use cases with our team, and one of them involves implementing data quality techniques. I was wondering if anyone could share their experience in order to identify the best approach within the Cognite Platform for conducting data quality checks to ensure that all fields in critical tables are populated correctly.In the past, we have implemented a similar solution with a different vendor, utilizing a system that can prevent the flow of erroneous data through our data pipelines by employing validation and integrity checks based on declarative quality expectations.Thank you in advance.