Product User Community

Does Cognite copies all data from data sources to staging area?If yes, is there any limitation of datapoints/ size of data? Does size of data, affects the performance of CDF or any other functionalities? 

I have Cognite functions that are being reused, but I need to define correct inputs.Today I have scheduled jobs that run for each function/input and they depend on one another to run. I arbitrarily set 30min difference from the schedule for hopefully one start when the other finished. But I’m already seeing problems with timeouts, so I may need to break the functions in smaller steps so they can finish on time, but I won’t be able to hope the schedule match as this will be much more complicated than my current scenario.Today, while looking at the workflow I notice that I cannot pass a input for each function thru the UI. Is that intentional? Is there another way to reuse functions using workflow?

 Appears to be an obvious question, may have been asked before. Just wondering if there is an extractor available to read the spreadsheet files and load it into raw/staged data. The Excel can contain multiple spread sheet and perhaps with configuration each of that spreadsheet and its columns can be mapped to the staged tables/columns? 

I updated and published a new version of the flow. When I am trying to run the updated flow it is still running the older version.Below is the updated version -  Below is the version after initiating the Run  

How can the Cognite SAP extractor be linked to the SAP BW system?Could you offer comprehensive documentation regarding this connection?We are aware that the extractor mentions compatibility with SAP BW.

Hi.We’re looking at how to work with larger geographic areas - inflow catchments for our hydropower reservoirs. The smallest one being a polygon with 3119 coordinates. Trying to create these catchments as assets with geolocation fails, due to the size limit on the GeoLocation field. Error message: “Maximum size of GeoLocation field is 10240.”I assume this means that the preferred approach is to use GeoSpatial, rather than assets with a geolocation field? If so, is the assetIds property the preferred way to connect GeoSpatial objects to assets?  And is there a simple way to retrieve the shape of an asset using the Python SDK? (something equivalent to using asset.geolocation?) Also; Any plans for showing geolocation ar geospatial information in the Fusion UI? 

I am learning GraphQL queries in Congite by following the documentation About data modeling | Cognite DocumentationHow can I add an additional filter condition based on functionalLocationParent object name value.query{listEquipment (filter: {and: [{catalogProfileDescription: {eq: "Compressors"}}]}) {  items {     externalId    name    description     catalogProfileDescription    functionalLocationParent {      name      description    }    cfihosEquipmentClass {      name      description    }  }}}

Hi.Is it possible to update the geolocatoin of assets using the Python SDK?It seems I’m able to update the asset with a geolocation that renders the SDK unable to interact further with the asset. Example below: ## Create a new asset with geolocationdsid = <data set id>from cognite.client.data_classes import GeoLocation, Asset, Geometrygeometry1 = Geometry( type="Point", coordinates=[9.6573149,59.142253] )asset = Asset( name="geotest", data_set_id=dsid, geo_location=GeoLocation( type="Feature", geometry=geometry1 ))res = client.assets.create(asset)## List all assets matching the name .. it works wellclient.assets.list(name="geotest") ## Update the geolocation, returns KeyError: 'type'geometry2 = Geometry( type="Point", coordinates=[8.6573149,57.142253] )res.geo_location = geometry2res2 = client.assets.update([res])## Now try to list the assets again. It fails, returning KeyError: 'type'client.assets.list(name="geotest") 

while connecting to Powerbi I am getting this error.! access_denied: AADSTS50052: The app is trying to access a service '7ca96- b66-4a2-b4-17a5c3f68ac4'(Cognitedata API: europe-west1-1) that your organization '9c52-3833-46c4-bc-8bc70ee52' lacks a service principal for. Contact your IT Admin to review the configuration of your service subscriptions or consent to the application in order to create the required service principal. Trace ID: f1efa-e663-4167-a1cb-bd8482300 Correlation ID: 7cce22-0f55-420d-801-002d835ed Timestamp: 2024-02-08 09:57:26Z.

I am able to run the code in the given Google Colab sheet. But when I am running the same code in my IDE (Spyder or Jupyter),  I am facing Cognite Connection Error in step 3.Error message:  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connectionpool.py:467 in _make_request    self._validate_conn(conn)  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connectionpool.py:1096 in _validate_conn    conn.connect()  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connection.py:642 in connect    sock_and_verified = _ssl_wrap_socket_and_match_hostname(  File ~\Python Projects\myenv\Lib\site-packages\urllib3\connection.py:782 in _ssl_wrap_socket_and_match_hostname    ssl_sock = ssl_wrap_socket(  File ~\Python Projects\myenv\Lib\site-packages\urllib3\util\ssl_.py:470 in ssl_wrap_socket    ssl_sock = _ssl_wrap_socket_impl(sock, context, tls_in_tls, server_hostname)  File ~\Python Projects\myenv\Lib\site-packages\urllib3\util\ssl_.py:514 in _ssl_wrap_socket_impl    return ssl

I changed my new phone so need to re-register Cognite Hub in Authenticator app again.Please help to reset for new register with my e-mail : speguan@rockwellautomation.com

Hello All, Does Cognite have regional servers available for South-East Asia or specifically for Indian sub-continent?Like aws asia pacific (mumbai) region.

I am trying to access the lab.cognite.com in my company laptop and not able to login. Is that path will not be accessible in company provided laptop rather should I use my personal laptop for lab sessions practice?Can anyone suggest on this?

Hi. In our CDF project, we have 19 time series whose external IDs ends with .EUR. Examples:NordPool.Price.Regulationmarket.RegulationDownPrices.NO1.EUR NordPool.Price.Actual.Dayahead.SE4.EUR NordPool.Price.Actual.Dayahead.NO2.EURUsing the CDF Grafana connector, I would expect that I could extract all of these using a “Time series custom query” like this: ts{externalId=~".*EUR"}However, the query only returns a single time series. The same problem occurs for trying to apply a regex filter on name or on a metadata value. E.g. ts{metadata={timeSeriesCategory=~'.*Lifetime'}} returns only 6 of our 116 “Remaining Lifetime” time series.Does anyone else have this problem? Is it a bug in the Grafana CDF connector?

Hello Team, I have recently completed my initial certification, and now I wanted to explore how my custom domain based AI-ML models can be integrated with Cognite. Is it possible to try this out using congnite-learn login credentials which is used for training. I would like to explore the possibilities of testing out my custom Python Apps on Cognite.

Is there any way like extraction pipeline apis to configure for Cognite MQTT Extractor?

Hi Team,I am trying to get details of broken files uploaded in CDF . Is there any way to query actual file size from CDF using python sdk without downloading the file? Please add a feature to query file size using python sdk to get the corrupted/broken files. Thanks in advance.

I was trying to create a flow to refresh all views in one of my solution model in a project. All my transformations are running individually without failing. But as soon as I run the Flow, only first transformation runs, the second one fails with an unclear message “Something went wrong”. I understand this is an EA features as of now, but I see a lot of application of this feature in one of our projects hence I am trying to setup some flows in it. Could you please help in checking if I am doing something wrong here?Task ID - 1dfb440d-c678-43a4-8c67-0d98467694e8 Flow Definition:[  {    "externalId": "tr-tr-SDM-WellStatus-Entity",    "type": "transformation",    "name": "1706783603193",    "parameters": {      "transformation": {        "externalId": "tr-tr-SDM-WellStatus-Entity",        "concurrencyPolicy": "fail"      }    },    "onFailure": "abortWorkflow",    "dependsOn": []  },  {    "externalId": "tr-tr-SDM-Well-Status-Hierarchy",    "type": "transformation",    "name": "1706783606

I am developing a outlier detection model. The model will be accessed by users through a Streamlit app. At the moment I am assessing whether deploying the model through the Streamlit page in CDF would be a good option. My issue is that I am not sure what the most efficient way to access and import the dataset into the app is. Would it be a good approach to create a data model and import the data from there, or extract the data straight from raw? Another idea I had was setting up a scheduled Cognite Function to download the data as a csv and letting the app access that. I need the data to be updated a few times a week and have the “import” time in the app to be fairly quick for the user experience in the app to be good.My dataset is around 1 million rows with three numeric and two non-numeric columns. For now, I have the data as a raw table in CDF.Thanks!

How can I use Machine Learning Models inside Cognite data fusion?

Hello, I am following the Learning path tutorial for CDF transformations.I’m in the step that I’m supposed to upload the csv data files to the RAW Database I’ve just created. After I select the file for upload the UI simply does nothing, poking around in DevTools I find out the upload request for the files I’m trying to upload is returning error 405 (Method Not Allowed).I am using the mocked files provided by the learning path tutorial: https://learn.cognite.com/path/data-engineer-basics-transform-and-contextualize/cdf-transformations-course/1196833 Am I doing something wrong, or is this a bug?

I am doing asset transformation asset Source Target key   categoryId   sourceDb source parentExternalId parentExternalId updatedDate   createdDate   externalId externalId isCriticalLine   description description tag   areaId   isActive   I don't have all the columns for mapping to target schemaThese are the rest target columns what to do if the mapping column is not there? and where should i add the rest additional columns from source? parentId metadata name dataSetId labels

Hi community,I have noticed a large discrepancy in runtime when running my handle function as a single Cognite Function call and when I run the handle function locally. And yes, this is the runtime of the actual CALL, not the creation/deployment of the Cognite Function. The handle function is doing some calculations on a time series with around 500 000 datapoints. Locally, it runs under 1 minute, while through Cognite Function call it takes around 9 minutes. Do you have any idea what could cause the large discrepancy?Thanks!

Hi everyone,Happy to share with you our latest features in Industrial Canvas:New features:While exploring data in Data Explorer you can now easily add any item (asset, event, 3D model etc) to a Canvas.   The entire canvas can be exported in a PDF, including the annotations. You can now customize which info/fields are relevant to you, when adding an asset or event to a canvas.      You can duplicate a canvas and copy-paste items from one canvas to another.   You can now change the order/layering of items in the Canvas. You can draw markups using the line tool when holding CMD. Several styling and bug issues have been fixed and tweaked.  Give it a try and share your feedback with us :) Thank you!

Hi Everyone,In case you haven’t discover them yet, I would like to share with your what brings January release as new features and capabilities in Industrial Canvas:Working with dataBetter visualization quality while working with time series and files. When exporting a canvas in a PDF we have eliminated the blank pages and the annotations are visible in the PDF as well. AI semantic document search Ask questions in natural language and get answers based on information found in a document. Verify answers by jumping to location of source in the document. Interpret information found in the document based on questions.CollaborationWhen I’m being tagged in a canvas, I’m getting notified via email.  Keep up to date with all your canvas versions, restore to an older version and lock a canvas for preventing changes from happening.ToolboxEnriching the toolbox with more tooling such as Industrial shapes and export your canvas in a PDF.Looking forward for your feedback!