Product User Community

Hi Experts, Few queries: Can I create a ML model directly using CDF functions? - I believe we can. If yes, how can I retrain a model without using any external AI platform? Can I use workflow orchestration to retrain a model with new data? Thanks,Aditya

Hello everyone in the group!I’m delighted to announce that in the upcoming release, the Time Series Subscriptions feature will mature to a Generally Available level of maturity.  But…!  The feedback does not stop there.  Please do continue to use this group to ask questions about the feature, request improvements or provide any other form of feedback.In light of the news, I also feel that this group in its current form has served its purpose.  However, we would like the group to continue as we appreciated your engagement on our product developments.  Therefore, we would like to repurpose this group to cover more topics and features relating to the Time Series API, and our other OT services too, such as Events.We hope you continue to be members of the group, and look forward to collaborating with you with our future developments, and thank you so much for your contributions in bringing the Subscriptions feature to GA! 

There’s an issue if you create a label and delete it as you might not be able to reuse the same external_id ever again. Even if you first delete the asset or relationship that the label is conected to first and then delete the label, you end up with a ghost label. With some random exceptions(say in 1 of 15 cases it’s not an issue). It feels like a cache issue, but as we’ve seen over the last half a year or so, the issue seems to persists over several months.For this example I’m using an empty dataset, I’ve created a label, tied it to an asset, deleted the asset and then deleted the label. The external id I’ve used for my label are now locked forever. I then try to create the label, if not found: Resulting in an error This is a bug across the C# and the Python SDK.

I want to move data from CDF Raw Database in Dev and Load it to CDF Prod.Could someone please let me know if there is a way in Cognite. 

Hi Team, I want to change the message for the custom extractor’s run history message by python sdk. Right now, message says “successful shutdown” after successfully running the extractor, but I want to change it with how many datapoints are uploading and in how much time.I tried to do it by following methods:By using abstract class Extractor in our code to overwrite the _report_success method’s message.       2.By using this method  cognite.extractorutils.util.add_extraction_pipeline(extraction_pipeline_ext_id: str, cognite_client: CogniteClient, heartbeat_waiting_time: int = 600, added_message: str = '')       3. By using below class too:cclient.data_classes.extractionpipelines.ExtractionPipeline(id: int | None = None, external_id: str | None = None, last_message: str | None = None)  There is no way of passing the custom message here in my knowledge if it’s there let me know!And is there any way to pass logs in extraction pipeline?

How can we use hybrid configs (local and remote) in custom extractor utils?Edit: while trying to consume combination of local and remote configs (published in extraction pipeline mentioned in local config), it just loads local configs. example configs:type: localcognite:    extraction_pipeline:        external_id: extraction-pipeline-idcustom:    property1: some-valuetype: remotecustom:    property2: some-value 

Does Cognite copies all data from data sources to staging area?If yes, is there any limitation of datapoints/ size of data? Does size of data, affects the performance of CDF or any other functionalities? 

I have Cognite functions that are being reused, but I need to define correct inputs.Today I have scheduled jobs that run for each function/input and they depend on one another to run. I arbitrarily set 30min difference from the schedule for hopefully one start when the other finished. But I’m already seeing problems with timeouts, so I may need to break the functions in smaller steps so they can finish on time, but I won’t be able to hope the schedule match as this will be much more complicated than my current scenario.Today, while looking at the workflow I notice that I cannot pass a input for each function thru the UI. Is that intentional? Is there another way to reuse functions using workflow?

 Appears to be an obvious question, may have been asked before. Just wondering if there is an extractor available to read the spreadsheet files and load it into raw/staged data. The Excel can contain multiple spread sheet and perhaps with configuration each of that spreadsheet and its columns can be mapped to the staged tables/columns? 

I updated and published a new version of the flow. When I am trying to run the updated flow it is still running the older version.Below is the updated version -  Below is the version after initiating the Run  

On January 9th, the new industrial data Search experience gets available for all our customers from the renewed Cognite Data Fusion landing page. You will be able to toggle on/off this new experience - see the banner below.  Re-focused Cognite Data Fusion landing page, with quick access to Search and Data Explorer, Industrial Canvas and Charts.With this launch of the Industrial data search experience we are simplifying how you can search, browse and find your industrial data across different types of data (including both from your Industrial Knowledge Graph and the classic Resources from Asset Centric modelling).You are able to search and browse across 3D, sensor data, equipment, documents, work orders and more, all in one place. The refreshed experience is optimized for you as industrial end users looking for quick answers across complex data. We have made sure to offer built in Generative AI search where you can use natural language to get simple answers to complex questions. Summari

How can the Cognite SAP extractor be linked to the SAP BW system?Could you offer comprehensive documentation regarding this connection?We are aware that the extractor mentions compatibility with SAP BW.

Hi.We’re looking at how to work with larger geographic areas - inflow catchments for our hydropower reservoirs. The smallest one being a polygon with 3119 coordinates. Trying to create these catchments as assets with geolocation fails, due to the size limit on the GeoLocation field. Error message: “Maximum size of GeoLocation field is 10240.”I assume this means that the preferred approach is to use GeoSpatial, rather than assets with a geolocation field? If so, is the assetIds property the preferred way to connect GeoSpatial objects to assets?  And is there a simple way to retrieve the shape of an asset using the Python SDK? (something equivalent to using asset.geolocation?) Also; Any plans for showing geolocation ar geospatial information in the Fusion UI? 

I am learning GraphQL queries in Congite by following the documentation About data modeling | Cognite DocumentationHow can I add an additional filter condition based on functionalLocationParent object name value.query{listEquipment (filter: {and: [{catalogProfileDescription: {eq: "Compressors"}}]}) {  items {     externalId    name    description     catalogProfileDescription    functionalLocationParent {      name      description    }    cfihosEquipmentClass {      name      description    }  }}}

Hi.Is it possible to update the geolocatoin of assets using the Python SDK?It seems I’m able to update the asset with a geolocation that renders the SDK unable to interact further with the asset. Example below: ## Create a new asset with geolocationdsid = <data set id>from cognite.client.data_classes import GeoLocation, Asset, Geometrygeometry1 = Geometry( type="Point", coordinates=[9.6573149,59.142253] )asset = Asset( name="geotest", data_set_id=dsid, geo_location=GeoLocation( type="Feature", geometry=geometry1 ))res = client.assets.create(asset)## List all assets matching the name .. it works wellclient.assets.list(name="geotest") ## Update the geolocation, returns KeyError: 'type'geometry2 = Geometry( type="Point", coordinates=[8.6573149,57.142253] )res.geo_location = geometry2res2 = client.assets.update([res])## Now try to list the assets again. It fails, returning KeyError: 'type'client.assets.list(name="geotest") 

while connecting to Powerbi I am getting this error.! access_denied: AADSTS50052: The app is trying to access a service '7ca96- b66-4a2-b4-17a5c3f68ac4'(Cognitedata API: europe-west1-1) that your organization '9c52-3833-46c4-bc-8bc70ee52' lacks a service principal for. Contact your IT Admin to review the configuration of your service subscriptions or consent to the application in order to create the required service principal. Trace ID: f1efa-e663-4167-a1cb-bd8482300 Correlation ID: 7cce22-0f55-420d-801-002d835ed Timestamp: 2024-02-08 09:57:26Z.

I am able to run the code in the given Google Colab sheet. But when I am running the same code in my IDE (Spyder or Jupyter),  I am facing Cognite Connection Error in step 3.Error message:  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connectionpool.py:467 in _make_request    self._validate_conn(conn)  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connectionpool.py:1096 in _validate_conn    conn.connect()  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connection.py:642 in connect    sock_and_verified = _ssl_wrap_socket_and_match_hostname(  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connection.py:782 in _ssl_wrap_socket_and_match_hostname    ssl_sock = ssl_wrap_socket(  File ~\Python Projects\myenv\Lib\site-packages\urllib3\util\ssl_.py:470 in ssl_wrap_socket    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)  File ~\Python Projects\myenv\Lib\site-packages\urllib3\util\ssl_.py:514 in _ssl_wrap_socket_impl    return ssl

I changed my new phone so need to re-register Cognite Hub in Authenticator app again.Please help to reset for new register with my e-mail : speguan@rockwellautomation.com

Hello All, Does Cognite have regional servers available for South-East Asia or specifically for Indian sub-continent?Like aws asia pacific (mumbai) region.

I am trying to access the lab.cognite.com in my company laptop and not able to login. Is that path will not be accessible in company provided laptop rather should I use my personal laptop for lab sessions practice?Can anyone suggest on this?

Hi. In our CDF project, we have 19 time series whose external IDs ends with .EUR. Examples:NordPool.Price.Regulationmarket.RegulationDownPrices.NO1.EUR NordPool.Price.Actual.Dayahead.SE4.EUR NordPool.Price.Actual.Dayahead.NO2.EURUsing the CDF Grafana connector, I would expect that I could extract all of these using a “Time series custom query” like this: ts{externalId=~".*EUR"}However, the query only returns a single time series. The same problem occurs for trying to apply a regex filter on name or on a metadata value. E.g. ts{metadata={timeSeriesCategory=~'.*Lifetime'}} returns only 6 of our 116 “Remaining Lifetime” time series.Does anyone else have this problem? Is it a bug in the Grafana CDF connector?

Hello Team, I have recently completed my initial certification, and now I wanted to explore how my custom domain based AI-ML models can be integrated with Cognite. Is it possible to try this out using congnite-learn login credentials which is used for training. I would like to explore the possibilities of testing out my custom Python Apps on Cognite.

Is there any way like extraction pipeline apis to configure for Cognite MQTT Extractor?

Hi Team,I am trying to get details of broken files uploaded in CDF . Is there any way to query actual file size from CDF using python sdk without downloading the file? Please add a feature to query file size using python sdk to get the corrupted/broken files. Thanks in advance.

I was trying to create a flow to refresh all views in one of my solution model in a project. All my transformations are running individually without failing. But as soon as I run the Flow, only first transformation runs, the second one fails with an unclear message “Something went wrong”. I understand this is an EA features as of now, but I see a lot of application of this feature in one of our projects hence I am trying to setup some flows in it. Could you please help in checking if I am doing something wrong here?Task ID - 1dfb440d-c678-43a4-8c67-0d98467694e8 Flow Definition:[  {    "externalId": "tr-tr-SDM-WellStatus-Entity",    "type": "transformation",    "name": "1706783603193",    "parameters": {      "transformation": {        "externalId": "tr-tr-SDM-WellStatus-Entity",        "concurrencyPolicy": "fail"      }    },    "onFailure": "abortWorkflow",    "dependsOn": []  },  {    "externalId": "tr-tr-SDM-Well-Status-Hierarchy",    "type": "transformation",    "name": "1706783606