Join the discussions about products powered by Cognite Data Fusion. Click the + CREATE TOPIC button in the menu bar to start the conversation.
Recently active
Hi guys, Could you please help me find out why it still shows empty time series even though I have insert data points? I am able to list the data points in “my_ts1” time series with API but I can’t view them in chart.How can I view the time series data in chart? Thanks a lot!
Hi all!Data Workflows (re-named) is now in Public Beta, as part of the latest release of Cognite Data Fusion. See the Product Release Spotlight post for more information.We have also added a new feature for subworkflows which you can read more about here.You can find updated documentation at Cognite Docs and Cognite API spec, replacing all earlier versions. Note that the user interface in Fusion remains in Alpha pending the development of a new version. If you lack access to the user interface, get in touch with a Cognite representative or leave a comment below.Let us know if you have any questions or comments!
Hello group members, “If you were to use CDF as an Industrial Historian, what features relating to versioning, tracking of changes and auditing would you need from our Time Series API”.In an upcoming release, we are planning to introduce support for versioning on Time Series, with the intention to enable our Time Series service to be used in the same way as you would a traditional industrial Historian.I am keen to gather information and insights from you to understand the scenarios where such a capability is required, in order that we build the right thing. Please feel free to send me a direct message if this is of interest to you!Kind Regards, Glen
Dear Community,How do we transform or create transformation of SQL Table data with some time series values in to Timeseries Tags In CDF?Sample Data:index datetime CO2 H2O 0 2019-05-07 01:00:00+00:00 50.5 25.0 1 2019-05-07 02:00:00+00:00 55.0 27.7 All we need is 2 tags CO2 & H2O with 2 data points (TS) in a dataset. I can run each tag under separate transformation.Please help with SQL query to do in Transformation .
If you are one of those, who either have a big vision of maintenance transformation or are working on optimizing one part of the maintenance management process, here is a suggestion on how to optimize to meet ambitious OPEX reduction goals while building sustainable and integrated Maintenance management processes. My name is Aleksandra, and I am a maintenance domain expert in Cognite. Together with my colleagues, we have a mission to empower the maintenance ecosystem with the data and technology so maintenance professionals can efficiently optimize and transform their underlying and fundamental maintenance management processes. Here are some tips on building with the end in mind and avoiding optimization in silos. Optimize using data from multiple systemsMany companies these days are busy with the optimization of their maintenance strategy for equipment and moving it from calendar to condition-based maintenance (CBM), where possible. One way of doing it is to use a centralized conditio
Hello everyone,I created a calculated timeseries based on an existing one and everything went well, except that the calculated timeseries does not have a linked asset. As a result, when I am looking at the asset on data fusion this calculation does not show up. Did I miss something? Is there a way to link this calculated time series to the asset that I want?Thank you.
Hello, I am working at HubOcean as a backend engineer and I need to access the logs for the API calls we make to CDF. Is there are procedure we can follow to get the logs?
Can Cognite Write back to the controller? Or in other words, is it just an open loop solution or can be integrated to work as closed loop system ?
Hi.It would be useful to access metadata from time series in Grafana. Some of our time series contain simple integers 0, 1, 2.., and the meaning of each value is a string described in a metadata field set on the time series. Could this functionality be added to the CDF Grafana data source? Or is there a way to access this information in Grafana through another Grafana plugin? I see that there is a CDF PostgreSQL gateway, but its documentation says that it’s only for writing data to CDF, so assume this cannot be used for fetching timeseries metadata through the Grafana PostgreSQL data source?
Hi Experts, Few queries: Can I create a ML model directly using CDF functions? - I believe we can. If yes, how can I retrain a model without using any external AI platform? Can I use workflow orchestration to retrain a model with new data? Thanks,Aditya
Hello everyone in the group!I’m delighted to announce that in the upcoming release, the Time Series Subscriptions feature will mature to a Generally Available level of maturity. But…! The feedback does not stop there. Please do continue to use this group to ask questions about the feature, request improvements or provide any other form of feedback.In light of the news, I also feel that this group in its current form has served its purpose. However, we would like the group to continue as we appreciated your engagement on our product developments. Therefore, we would like to repurpose this group to cover more topics and features relating to the Time Series API, and our other OT services too, such as Events.We hope you continue to be members of the group, and look forward to collaborating with you with our future developments, and thank you so much for your contributions in bringing the Subscriptions feature to GA!
There’s an issue if you create a label and delete it as you might not be able to reuse the same external_id ever again. Even if you first delete the asset or relationship that the label is conected to first and then delete the label, you end up with a ghost label. With some random exceptions(say in 1 of 15 cases it’s not an issue). It feels like a cache issue, but as we’ve seen over the last half a year or so, the issue seems to persists over several months.For this example I’m using an empty dataset, I’ve created a label, tied it to an asset, deleted the asset and then deleted the label. The external id I’ve used for my label are now locked forever. I then try to create the label, if not found: Resulting in an error This is a bug across the C# and the Python SDK.
I want to move data from CDF Raw Database in Dev and Load it to CDF Prod.Could someone please let me know if there is a way in Cognite.
Hi Team, I want to change the message for the custom extractor’s run history message by python sdk. Right now, message says “successful shutdown” after successfully running the extractor, but I want to change it with how many datapoints are uploading and in how much time.I tried to do it by following methods:By using abstract class Extractor in our code to overwrite the _report_success method’s message. 2.By using this method cognite.extractorutils.util.add_extraction_pipeline(extraction_pipeline_ext_id: str, cognite_client: CogniteClient, heartbeat_waiting_time: int = 600, added_message: str = '') 3. By using below class too:cclient.data_classes.extractionpipelines.ExtractionPipeline(id: int | None = None, external_id: str | None = None, last_message: str | None = None) There is no way of passing the custom message here in my knowledge if it’s there let me know!And is there any way to pass logs in extraction pipeline?
How can we use hybrid configs (local and remote) in custom extractor utils?Edit: while trying to consume combination of local and remote configs (published in extraction pipeline mentioned in local config), it just loads local configs. example configs:type: localcognite: extraction_pipeline: external_id: extraction-pipeline-idcustom: property1: some-valuetype: remotecustom: property2: some-value
Does Cognite copies all data from data sources to staging area?If yes, is there any limitation of datapoints/ size of data? Does size of data, affects the performance of CDF or any other functionalities?
I have Cognite functions that are being reused, but I need to define correct inputs.Today I have scheduled jobs that run for each function/input and they depend on one another to run. I arbitrarily set 30min difference from the schedule for hopefully one start when the other finished. But I’m already seeing problems with timeouts, so I may need to break the functions in smaller steps so they can finish on time, but I won’t be able to hope the schedule match as this will be much more complicated than my current scenario.Today, while looking at the workflow I notice that I cannot pass a input for each function thru the UI. Is that intentional? Is there another way to reuse functions using workflow?
Appears to be an obvious question, may have been asked before. Just wondering if there is an extractor available to read the spreadsheet files and load it into raw/staged data. The Excel can contain multiple spread sheet and perhaps with configuration each of that spreadsheet and its columns can be mapped to the staged tables/columns?
I updated and published a new version of the flow. When I am trying to run the updated flow it is still running the older version.Below is the updated version - Below is the version after initiating the Run
How can the Cognite SAP extractor be linked to the SAP BW system?Could you offer comprehensive documentation regarding this connection?We are aware that the extractor mentions compatibility with SAP BW.
Hi.We’re looking at how to work with larger geographic areas - inflow catchments for our hydropower reservoirs. The smallest one being a polygon with 3119 coordinates. Trying to create these catchments as assets with geolocation fails, due to the size limit on the GeoLocation field. Error message: “Maximum size of GeoLocation field is 10240.”I assume this means that the preferred approach is to use GeoSpatial, rather than assets with a geolocation field? If so, is the assetIds property the preferred way to connect GeoSpatial objects to assets? And is there a simple way to retrieve the shape of an asset using the Python SDK? (something equivalent to using asset.geolocation?) Also; Any plans for showing geolocation ar geospatial information in the Fusion UI?
I am learning GraphQL queries in Congite by following the documentation About data modeling | Cognite DocumentationHow can I add an additional filter condition based on functionalLocationParent object name value.query{listEquipment (filter: {and: [{catalogProfileDescription: {eq: "Compressors"}}]}) { items { externalId name description catalogProfileDescription functionalLocationParent { name description } cfihosEquipmentClass { name description } }}}
Hi.Is it possible to update the geolocatoin of assets using the Python SDK?It seems I’m able to update the asset with a geolocation that renders the SDK unable to interact further with the asset. Example below: ## Create a new asset with geolocationdsid = <data set id>from cognite.client.data_classes import GeoLocation, Asset, Geometrygeometry1 = Geometry( type="Point", coordinates=[9.6573149,59.142253] )asset = Asset( name="geotest", data_set_id=dsid, geo_location=GeoLocation( type="Feature", geometry=geometry1 ))res = client.assets.create(asset)## List all assets matching the name .. it works wellclient.assets.list(name="geotest") ## Update the geolocation, returns KeyError: 'type'geometry2 = Geometry( type="Point", coordinates=[8.6573149,57.142253] )res.geo_location = geometry2res2 = client.assets.update([res])## Now try to list the assets again. It fails, returning KeyError: 'type'client.assets.list(name="geotest")
while connecting to Powerbi I am getting this error.! access_denied: AADSTS50052: The app is trying to access a service '7ca96- b66-4a2-b4-17a5c3f68ac4'(Cognitedata API: europe-west1-1) that your organization '9c52-3833-46c4-bc-8bc70ee52' lacks a service principal for. Contact your IT Admin to review the configuration of your service subscriptions or consent to the application in order to create the required service principal. Trace ID: f1efa-e663-4167-a1cb-bd8482300 Correlation ID: 7cce22-0f55-420d-801-002d835ed Timestamp: 2024-02-08 09:57:26Z.
I am able to run the code in the given Google Colab sheet. But when I am running the same code in my IDE (Spyder or Jupyter), I am facing Cognite Connection Error in step 3.Error message: File ~\Python Projects\myenv\Lib\site-packages\urllib3\connectionpool.py:467 in _make_request self._validate_conn(conn) File ~\Python Projects\myenv\Lib\site-packages\urllib3\connectionpool.py:1096 in _validate_conn conn.connect() File ~\Python Projects\myenv\Lib\site-packages\urllib3\connection.py:642 in connect sock_and_verified = _ssl_wrap_socket_and_match_hostname( File ~\Python Projects\myenv\Lib\site-packages\urllib3\connection.py:782 in _ssl_wrap_socket_and_match_hostname ssl_sock = ssl_wrap_socket( File ~\Python Projects\myenv\Lib\site-packages\urllib3\util\ssl_.py:470 in ssl_wrap_socket ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname) File ~\Python Projects\myenv\Lib\site-packages\urllib3\util\ssl_.py:514 in _ssl_wrap_socket_impl return ssl