Community Discussions

Hello, I am working at HubOcean as a backend engineer and I need to access the logs for the API calls we make to CDF. Is there are procedure we can follow to get the logs?

Can Cognite Write back to the controller? Or in other words, is it just an open loop solution or can be integrated to work as closed loop system ?

Hi.It would be useful to access metadata from time series in Grafana. Some of our time series contain simple integers 0, 1, 2..,  and the meaning of each value is a string described in a metadata field set on the time series. Could this functionality be added to the CDF Grafana data source? Or is there a way to access this information in Grafana through another Grafana plugin? I see that there is a CDF PostgreSQL gateway, but its documentation says that it’s only for writing data to CDF, so assume this cannot be used for fetching timeseries metadata through the Grafana PostgreSQL data source?  

Hi Experts, Few queries: Can I create a ML model directly using CDF functions? - I believe we can. If yes, how can I retrain a model without using any external AI platform? Can I use workflow orchestration to retrain a model with new data? Thanks,Aditya

I want to move data from CDF Raw Database in Dev and Load it to CDF Prod.Could someone please let me know if there is a way in Cognite. 

Hi Team, I want to change the message for the custom extractor’s run history message by python sdk. Right now, message says “successful shutdown” after successfully running the extractor, but I want to change it with how many datapoints are uploading and in how much time.I tried to do it by following methods:By using abstract class Extractor in our code to overwrite the _report_success method’s message.       2.By using this method  cognite.extractorutils.util.add_extraction_pipeline(extraction_pipeline_ext_id: str, cognite_client: CogniteClient, heartbeat_waiting_time: int = 600, added_message: str = '')       3. By using below class too:cclient.data_classes.extractionpipelines.ExtractionPipeline(id: int | None = None, external_id: str | None = None, last_message: str | None = None)  There is no way of passing the custom message here in my knowledge if it’s there let me know!And is there any way to pass logs in extraction pipeline?

How can we use hybrid configs (local and remote) in custom extractor utils?Edit: while trying to consume combination of local and remote configs (published in extraction pipeline mentioned in local config), it just loads local configs. example configs:type: localcognite:    extraction_pipeline:        external_id: extraction-pipeline-idcustom:    property1: some-valuetype: remotecustom:    property2: some-value 

Does Cognite copies all data from data sources to staging area?If yes, is there any limitation of datapoints/ size of data? Does size of data, affects the performance of CDF or any other functionalities? 

I have Cognite functions that are being reused, but I need to define correct inputs.Today I have scheduled jobs that run for each function/input and they depend on one another to run. I arbitrarily set 30min difference from the schedule for hopefully one start when the other finished. But I’m already seeing problems with timeouts, so I may need to break the functions in smaller steps so they can finish on time, but I won’t be able to hope the schedule match as this will be much more complicated than my current scenario.Today, while looking at the workflow I notice that I cannot pass a input for each function thru the UI. Is that intentional? Is there another way to reuse functions using workflow?

 Appears to be an obvious question, may have been asked before. Just wondering if there is an extractor available to read the spreadsheet files and load it into raw/staged data. The Excel can contain multiple spread sheet and perhaps with configuration each of that spreadsheet and its columns can be mapped to the staged tables/columns? 

I updated and published a new version of the flow. When I am trying to run the updated flow it is still running the older version.Below is the updated version -  Below is the version after initiating the Run  

How can the Cognite SAP extractor be linked to the SAP BW system?Could you offer comprehensive documentation regarding this connection?We are aware that the extractor mentions compatibility with SAP BW.

Failed to resolve 'CraftBrewData.brew_assets'. API responded with: 403 Subject does not have 'READ' action for one of the specified tables. Getting the above error when I try do any transform on raw tables. Using default credentials which generate when I press run

Hi.We’re looking at how to work with larger geographic areas - inflow catchments for our hydropower reservoirs. The smallest one being a polygon with 3119 coordinates. Trying to create these catchments as assets with geolocation fails, due to the size limit on the GeoLocation field. Error message: “Maximum size of GeoLocation field is 10240.”I assume this means that the preferred approach is to use GeoSpatial, rather than assets with a geolocation field? If so, is the assetIds property the preferred way to connect GeoSpatial objects to assets?  And is there a simple way to retrieve the shape of an asset using the Python SDK? (something equivalent to using asset.geolocation?) Also; Any plans for showing geolocation ar geospatial information in the Fusion UI? 

I am learning GraphQL queries in Congite by following the documentation About data modeling | Cognite DocumentationHow can I add an additional filter condition based on functionalLocationParent object name value.query{listEquipment (filter: {and: [{catalogProfileDescription: {eq: "Compressors"}}]}) {  items {     externalId    name    description     catalogProfileDescription    functionalLocationParent {      name      description    }    cfihosEquipmentClass {      name      description    }  }}}

Hi.Is it possible to update the geolocatoin of assets using the Python SDK?It seems I’m able to update the asset with a geolocation that renders the SDK unable to interact further with the asset. Example below: ## Create a new asset with geolocationdsid = <data set id>from cognite.client.data_classes import GeoLocation, Asset, Geometrygeometry1 = Geometry( type="Point", coordinates=[9.6573149,59.142253] )asset = Asset( name="geotest", data_set_id=dsid, geo_location=GeoLocation( type="Feature", geometry=geometry1 ))res = client.assets.create(asset)## List all assets matching the name .. it works wellclient.assets.list(name="geotest") ## Update the geolocation, returns KeyError: 'type'geometry2 = Geometry( type="Point", coordinates=[8.6573149,57.142253] )res.geo_location = geometry2res2 = client.assets.update([res])## Now try to list the assets again. It fails, returning KeyError: 'type'client.assets.list(name="geotest") 

while connecting to Powerbi I am getting this error.! access_denied: AADSTS50052: The app is trying to access a service '7ca96- b66-4a2-b4-17a5c3f68ac4'(Cognitedata API: europe-west1-1) that your organization '9c52-3833-46c4-bc-8bc70ee52' lacks a service principal for. Contact your IT Admin to review the configuration of your service subscriptions or consent to the application in order to create the required service principal. Trace ID: f1efa-e663-4167-a1cb-bd8482300 Correlation ID: 7cce22-0f55-420d-801-002d835ed Timestamp: 2024-02-08 09:57:26Z.

I am able to run the code in the given Google Colab sheet. But when I am running the same code in my IDE (Spyder or Jupyter),  I am facing Cognite Connection Error in step 3.Error message:  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connectionpool.py:467 in _make_request    self._validate_conn(conn)  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connectionpool.py:1096 in _validate_conn    conn.connect()  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connection.py:642 in connect    sock_and_verified = _ssl_wrap_socket_and_match_hostname(  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connection.py:782 in _ssl_wrap_socket_and_match_hostname    ssl_sock = ssl_wrap_socket(  File ~\Python Projects\myenv\Lib\site-packages\urllib3\util\ssl_.py:470 in ssl_wrap_socket    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)  File ~\Python Projects\myenv\Lib\site-packages\urllib3\util\ssl_.py:514 in _ssl_wrap_socket_impl    return ssl

I changed my new phone so need to re-register Cognite Hub in Authenticator app again.Please help to reset for new register with my e-mail : speguan@rockwellautomation.com

Hello All, Does Cognite have regional servers available for South-East Asia or specifically for Indian sub-continent?Like aws asia pacific (mumbai) region.

I am trying to access the lab.cognite.com in my company laptop and not able to login. Is that path will not be accessible in company provided laptop rather should I use my personal laptop for lab sessions practice?Can anyone suggest on this?

Hi. In our CDF project, we have 19 time series whose external IDs ends with .EUR. Examples:NordPool.Price.Regulationmarket.RegulationDownPrices.NO1.EUR NordPool.Price.Actual.Dayahead.SE4.EUR NordPool.Price.Actual.Dayahead.NO2.EURUsing the CDF Grafana connector, I would expect that I could extract all of these using a “Time series custom query” like this: ts{externalId=~".*EUR"}However, the query only returns a single time series. The same problem occurs for trying to apply a regex filter on name or on a metadata value. E.g. ts{metadata={timeSeriesCategory=~'.*Lifetime'}} returns only 6 of our 116 “Remaining Lifetime” time series.Does anyone else have this problem? Is it a bug in the Grafana CDF connector?

Hello Team, I have recently completed my initial certification, and now I wanted to explore how my custom domain based AI-ML models can be integrated with Cognite. Is it possible to try this out using congnite-learn login credentials which is used for training. I would like to explore the possibilities of testing out my custom Python Apps on Cognite.

Is there any way like extraction pipeline apis to configure for Cognite MQTT Extractor?

Hi Team,I am trying to get details of broken files uploaded in CDF . Is there any way to query actual file size from CDF using python sdk without downloading the file? Please add a feature to query file size using python sdk to get the corrupted/broken files. Thanks in advance.