Community Discussions

Dear Cognite Hub community: We are very happy to announce that our Cognite SAP Extractor is now generally available to CDF users!The extractor connects to OData V2.0 endpoints in the SAP NetWeaver Gateway, making use of many pre-built integrations available in S/4HANA and saving considerable implementation time, while also natively connecting to the SAP data you need in a standardised manner.To get started,  download the SAP Extractor from the “Extract Data” page directly from CDF. The documentation, including Server Requirements and how to set up your SAP extractor is available here.We have also prepared a short demo (less than 4 minutes long) showing the steps needed to setup a data extraction from SAP S/4HANA OnPremise to CDF from scratch, including how to find the standard service from SAP, enable it in S/4HANA, configure and run the extractor and then see the SAP data in CDF.   Any feedback is very welcome, after testing the extractor and/or watching the quick demo please make sur

ContextQuerying views with a large number of instances (>1 million), we frequently encounter query timeout issues. This has become a critical bottleneck affecting application performance and user experience. To mitigate this, we introduced on the app layer a pre-query caching strategy:Before sending a query to Cognite, we aggregate the number of instance spaces for a given view using the endpoint /models/instances/aggregate. This result is stored in a cache layer. When a query is initiated, we check if the user included a space filter. If not, we append the known relevant spaces from the cache to the query filter. This approach has significantly reduced timeouts across our applications. However, it introduces new challenges:One request per view is still needed to fetch associated spaces. Cache invalidation must be managed periodically, especially as user capabilities may change. This workaround does not help with timeouts in the CDF UI or Infield tools, where we cannot control the q

Hi Community,I am havng an issue where I tried to use the Cognite-Extractor-Manager (cogex) for custom extractor development.I just install and create new project using cogex init. When i tried to run using "poetry run test_extractor", it returned below error:  Also having another error when executing the "cogex build” command: Anyone having the same issue?Tools:python == 3.11.9cognite-extractor-manager == 2.0.0

We use DB Exctractor to push data from MSSQL Database to RAW, but have run into a problem.Over time the raw table grows much larger than the Database table and this is due to rows that are deleted in database will not be deleted in RAW. How can I set up the config yaml for db extractor to also handle rows that are deleted in database?  

HiI am looking into using the toolkit more actively for deploying resources to CDF. One question that was raised when researching how to use the toolkit is what kind of validations actually happens when doing a dry run for deploying data modeling resources. I do not really have any specific issue I want answered, but rather want to learn more about the tool so prepare for a lot of questions from my notes:)Does it test that the configuration of views and containers work together?Does a successful dry run mean that I can be sure that the deployment will always work?Are there anything I need to consider even after getting a successful dry run?What kind of responses do I get if the dry run finds that something is wrong? Do I get any hints about how to fix an issue?Does it consider what is already deployed into the CDF environment?Will it tell me about any issues that can happen with new breaking changes? Appreciate all kinds of insights and experiences around this topic :)Sebastian

Aker Solutions Verdal Production Line (VPL)Last week I had the chance to visit the Aker Solutions team at their impressive yard in Verdal, fabricating fit-for-purpose steel substructures and jackets for offshore developments, and a great example of industrial innovation done right.At the heart of the yard is the Verdal Production Line (VPL), a fully robotized line that opened in 2024. With automated welding, sandblasting, and painting, VPL is delivering production speeds up to 10x faster than traditional methods, cutting costs and improving safety by keeping people away from hazardous tasks.To push things even further, the team has developed their own software for weld planning. The robots scan each pipe, create a 3D model, and then autonomously plan and carry out the welding.Excited to follow VPL further. Aker Robotics 🦾Aker Solutions - Yards and Fabrication📸 Johan Arnt Nesgård 

Is there a limit on the number of characters for String data that can be stored in a Timeseries?I would like to manage a JSON file that defines the configuration values of a certain system in CDF. Since the JSON file will be changed frequently and I also want to check the historical configuration records, I am considering defining it as a string timeseries and storing the JSON string in data point.However, if there is a character limit, it would restrict the size of the JSON string that can be stored, so I would like to confirm the specifications. As far as I have searched, there is no mention of this in the documentation.

Hello people,I’m testing CDM and I want to extend a current model type, I may do it wrong, but my idea is. I’m creating a new type called MyModel, that will be pretty much and CogniteActivity + new fields.But I don’t know what I’m doing wrong.type MyModel @import ( dataModel: { externalId: "CogniteActivity", space: "cdf_cdm", version: "v1" } ){ FieldA: String, FieldB: String}I got some guidance from this link https://docs.cognite.com/cdf/dm/dm_guides/dm_extending_core_data_modelWhen I try to save, I got this error{   "title": "Error: could not update data model",   "message": "An error has occured. Data model was not published.",   "extra": "[Line: 40] Data model 'DataModelRef(space=cdf_cdm, externalId=CogniteActivity, version=v1)' cannot be found" }Thanks in advance

On behalf of CelaneseHi.I would like to report a potential issue with cursor-based pagination when sorting in descending order and request clarification on the undocumented forceCursorsDespitePerformanceHazard flag.We are executing a query against the view OEEEvent, which is defined with a cursorable BTREE index on the startDateTime property, as shown in the simplified schema below: type OEEEvent@container(  indexes: [    {      fields: ["startDateTime"]      identifier: "idx_oeev_startDateTime"      indexType: BTREE      cursorable: true    }  ]) {  startDateTime: Timestamp  endDateTime: Timestamp  totalDuration: Float} We are querying with the following time range filter: "startDateTime": {  "gte": "2024-12-31T00:00:00.000-03:00",  "lt":  "2025-05-01T00:00:00.000-03:00"} The result set includes 840 records.When applying a page size of 500 and using the following ascending sort configuration: {  "property": [    "INO-COR-ALL-DML",    "OEEEvent/472bdbcb9cd6f1",    "startDateTime"  ], 

Hi Drilling & Wells team! CDF & Atlas AI for Drilling & WellsOur aim is to revolutionise how operators, rig contractors and service companies plan and execute wells, by breaking down data silos that exist between companies, technologies and data sources to create a unified data layer that contextualizes all data across the well delivery process.  We’re also leading the way when it comes to applying GenAI to Drilling & Wells, through our industrial agent workbench - Atlas AI. With Atlas AI, you can build a suite of custom AI agents tailored to specific tasks focused on your data, whether it be for Well Design, Planning or operations. Atlas AI Example Use Cases For D&WOffset Well Analysis in particular is an area where we see agents having a significant impact:Find relevant offset well info in seconds rather hours Reduce reliance on engineer experience/knowledge Find and implement all relevant lessons learned and best practicesThe below video is a demo of Cognite’s be

Hi, I have moved to a new handset and require an MFA reset, is someone able to help please? Thank you!

Hi,Will there be any major changes to the API and Python SDK when moving from an asset centric data model to a flexible data model? Do we have to expect to refactor our backend using the current python sdk once the flexible data model is operationalized?Best regards,Vetle.

I am able to Delete data using python code using Primary key of the table in CDF staging/RAW. But I need help with deleting data based on where condition for columns other than primary key. I am following the below documentation for deleting based on primary key. Data Ingestion — cognite-sdk 7.74.5 documentation  Delete rows from table:>>> from cognite.client import CogniteClient>>> client = CogniteClient()>>> keys_to_delete = ["k1", "k2", "k3"]>>> client.raw.rows.delete("db1", "table1", keys_to_delete)

I’m trying to update the is_string value of Time Series from false to true using CDF python class ognite.client.data_classes.time_series.TimeSeriesUpdate. But I’m unable to update it. The value in CDF remains false even though I updated it. Is this an expected behavior of Time Series Update?

Hi,I have set up a monitoring job to generate alerts for specific time-series. Although, it is not clear to me where these alerts are being stored as I can’t find them anywhere in Data Explorer. The documentation (https://docs.cognite.com/cdf/charts/) also doesn’t provide details about it.Can someone share more details about how the alerts are stored and if it’s possible to access them outside Charts? 

Hello,I notice from the Events API documentation that the start_time can be specified by a TimestampRange object. However, the documentation does not explain what this object is, whether it is a class external to the Cognite SDK, or give any examples on how to use it.Can someone give more information?-Anders

Hi,When deploying functions through the OIDC pipeline with github actions, it fails on pre-commit:As I understand, this change has not been communicated clearly enough. Looks like the actions/cache package needs an update. Will the OICD github repo be updated? I know that the CDF toolkit may be the preferred way (we are migrating over to that shortly), but in the meantime we need this pipeline up and running. As I am not experienced in building packages, can someone guide me in the right directions regarding updating the package? Looks like the workflows needs to be updated to version 4 for the actions/cache to be supported again

Since yesterday, I've noticed that deploying functions via the Cognite SDK is failing. Our strategy involves uploading a zip file of the function and then creating the function. While the file uploads successfully, the function creation process returns a "Gateway Timeout" error. I've tried deploying both locally and through the Azure Pipeline, but the error persists. Initially, I thought it might be a temporary instability, but the issue continues this morning. Cognite API error 

Hello Team,I have a modeling question.We want to add some well information to all object types in our knowledge graph. At the same time, we don't want to create a link from the objects to the well.So, to avoid data duplication and updating these pieces of information, I thought about using the mapping functionality.For example, I have a casing object with two attributes: name and diameter. And I added a name_well attribute using the mapping functionality, which, as I understand, under the hood, performs a join.type Well { name: String}type Casing { name: String name_well: String @mapping(container: "Well", property: "name") diameter: Float32}Well transformation:select wh.IDWELL as externalId, wh.WELLNAME as namefrom well-data as whCasing transformationselect cas.IDCASING AS externalId, cas.NAME AS name, cas.DIAMETER as diameter, wh.WELLNAME as name_wellfrom casing-data as cas join well-data as wh on cas.IDWELL == cas.IDWELLWhat I don’t understand is how exactly this join i

Hi, I have been trying to use the sync API to try and pull changes from a data model - specifically node instances from a view. When testing, some fields within a view was changed / updated but I was not able to pull anything new using the sync API. This was after I created a baseline of the full dataset using the Query endpoint.The sync endpoint did work when new nodes were added to the view, it would only pull the new row, so I think my query is correct. Is there some sort of parameter to turn on / other way to use the sync API to retrieve changes and new additions to instances?

Hello, we are facing an SSL issue while trying to connect to cognite even if we’re disabling SSL verification.Could you please help ?from cognite.client import ClientConfig, CogniteClientfrom cognite.client.credentials import OAuthClientCredentialsfrom cognite.client.config import global_configglobal_config.disable_ssl = Truecreds = OAuthClientCredentials( **{ "client_id": "", "client_secret": "", "token_url": "", "scopes": ["https://westeurope-1.cognitedata.com/.default"], } )def get_cognite_client(project: str) -> CogniteClient: return CogniteClient( ClientConfig( client_name="Python-jupyter", project=project, credentials=creds, base_url="https://westeurope-1.cognitedata.com", ) )client = get_cognite_client("totalenergies-sandbox")res = client.units.list().to_pandas()------------------------------------------------------------------------------------

What is the maximum numbers of the rows supported in cognite staging tables

Hello, We have been trying to download this package (spgci) using Jupyter in CDF but are getting the following error: Based on this documentation, it seems like its not possible to do so. Could you please advise if there is a solution for this issue? 

I have created one dataset but not showing in Restrict access to the transformation dropdown

can someone please explain the this procedure for me with details ? because I got really confused. so first we register an app  and create a client secret and add api read all permission n Microsoft azure, after that we create an app in SharePoint  and we add the “permission request” to it later. after that what is next before downloading the extractor ? how are the two apps linked ? I saw someone at my work using Microsoft graph to link them but did not understand the logic behind it. and if this how they are linked , how ?  when in the Microsoft when doing the post each app dose not mention the other