Community Discussions

Hello,  We are using: Toolkit Version '0.5.20' We are having a file schedules.Function.yaml: - name: Run every 10 minutes to do some work functionExternalId: fn_name description: Run every 10 minutes to do some work cronExpression: "*/10 * * * *" data: extractionPipeline: "test"When deploying we have this error trace: Traceback (most recent call last): File "venv/bin/cdf-tk", line 8, in <module> sys.exit(app()) File "venv/lib/python3.10/site-packages/cognite_toolkit/_cdf.py", line 116, in app _app() File "venv/lib/python3.10/site-packages/typer/main.py", line 340, in __call__ raise e File "venv/lib/python3.10/site-packages/typer/main.py", line 323, in __call__ return get_command(self)(*args, **kwargs) File "venv/lib/python3.10/site-packages/click/core.py", line 1161, in __call__ return self.main(*args, **kwargs) File "venv/lib/python3.10/site-packages/typer/core.py", line 740, in main return _main( File "venv/lib/python3.10/site-packages/typer/core

Does it make the data available for optimal maintenance scheduling, or does it automatically generate maintenance plans based on that data? Does it predict failures?

Greetings,I was testing out the new Document Parser. Sometimes I would have a response saying the following: We had trouble parsing your documentOur team has been notified and will look into the issue. If you get stuck, contact support for help. Occasionally, I would get a successful parse, but I also get these failed parse jobs. I am unsure of the cause of the failure or whether the failure is preventable on the client side. I was wondering if someone could provide insight as to why the failure might be occurring.Thanks,Gabriel

Hi,We have uploaded a 3D .nwd model using the Fusion UI and noticed that the underlying processed 3D files (e.g., .glb, .reveal, .zip) are stored as file resources and are visible in the Data Explorer under the Files resource type.I couldn’t find any documentation or guideline on how to assign security categories to hide or restrict access to these files for end users. I also tried using dataset-based access control, but I’m looking for a better or recommended way to handle this.Appreciate your guidance or suggestions.

The python extractor utils requires the config to be stored as a local file there is not way to pass it directly as a string/yaml object. This makes it quite cumbersome to use as not all our deployments have access to local file storage for config files.Is there a way to add support for the config to be passed as an environment variable? Reading config from env example:  

I am getting following error when ingesting files from SharePoint site to CDF. send_request_body.failed exception=LocalProtocolError('Too much data for declared Content-Length')Anything I need to specify in .yaml file to allow content-length? Also how do I trace which file is causing the problem. I changed Logger to DEBUG level but still don’t see the file name info.Thanks,Zuber

Hello, We envision to implement a versioning based on minor and major version of our data models. So a data model version will be presented with two digits: <Major>.<Minor><Major>: incremented when we do a breaking change that is not backward compatible with the previous one and we know that it will break our consumers queries. Exp: delete an attribute in a view in the data model<Minor>: incremented when we do a change that is backward compatible and consumer queries will not break. Exp: add a new field. Is there a way to get a graphql url that maps always to the latest minor version of a given data model? This will avoid our data model consumers to redeploy their application every time we increment our minor version.  Thank you!

Hi all,I have a question regarding the use of nested attributes from linked objects when defining indexes.In my model, I have an object Cement that has a direct link to another object called ScenarioContent.I would like to use the attribute ScenarioContent.Type as part of the index on the Cement object.This is particularly useful, because I use views that filter Cement instances based on ScenarioContent.Type. For example, to expose only planned scenarios, I use the following rawFilter in a view:@view(  rawFilter: {    nested: {      scope: ["Cement", "ScenarioContent"]      filter: {        equals: {          property: ["ScenarioContent", "Type"]          value: "PLANNED"        }      }    }  }) Question:Can I use this nested attribute (ScenarioContent.Type) in the index definition of Cement?If this is not currently supported, is there a recommended alternative to support performant queries on this kind of filter?

Hi! I’m the scrum coordinator for NOVA Chemical’s SMM Team. I have some customization inquiries on behalf of the team:Customization to unlock Canvas by creator Advanced Markups: Cloud Shaped Comment/ Markup Canvas size selector (print all in one size) Cognite Stamp Function enhancement: The stamp and connector from P&ID to an Icon on Photo doesn't lock and freeze to the icons and stamp icon and equipment on P&ID Maintain Layouts saving column sequencesSince the ask is that we submit them here and provide a prioritized list, I will follow up with Ahmed/ Moe to provide the list.Thanks!Sophie Garcia

Hi, I did run transformation of assets and it worked first time successfully but today when I had a look, found a failed run and looking at logs, it says below error: Request with id 0b54c004-c667-9eab-a8c3-0a0047128fe1 to https://westeurope-1.cognitedata.com/api/v1/projects/cdf-ABCD/models/instances failed with status 400: Duplicate node externalIds for space 'icapi_dm_space' present in request: OSPRFIDRTO109:off_spec. Any idea how to fix this? and what is this error actually? 

Hi Community,I am using a toolkit and I am doing some transformation from RAW to the Data Model. From the Documentation Online, I only see example on how to apply the toolkit transformation to legacy tables (assets, events, timeseries,etc)This is sample of transformation format for toolkit:  Anyone know what is the configuration if we want to transform to Data Model? How to apply the space name and external id? Thank you.

I am locked out of MFA on my Microsoft Authenticator app. How can I reset this? 

Hi everyone,I'm currently using a nested filter in my view, and everything seems to work correctly — except in the tabular view.Here’s what I observe:In the tabular interface, the table shows 0 objects. However, when I click into the table, I can actually see that the instances are present.  Below is an example of the nested filter I’m using:Below is an example of the nested filter I’m using:@view( rawFilter: { and: [ { nested: { scope: ["Cement", "ScenarioContent"] filter: { equals: { property: ["ScenarioContent", "Type"] value: "PLANNED" } } } }, { nested: { scope: ["Cement", "ScenarioContent"] filter: { equals: { property: ["ScenarioContent", "IsLast"] value: true } } } } ]When checking the request, I see the following error:{ "errors": [ { "message": "Client r

Hi Hub, We have some backend code running as a Github Action that fetches events using `clients.events.list` over a period of 1 year. The fetching is of course chunked into smaller time frames to avoid memory overload. This has worked just fine until recently where we are frequently encountering aCogniteReadTimeouterror, which can be traced back to the following HTTP request error:requests.exceptions.ReadTimeout: HTTPSConnectionPool(host='az-ams-sp-002.cognitedata.com', port=443): Read timed out. (read timeout=30)The error occurs inconsistently and not necessarily at the same point in time of the workflow run. Have there been any recent changes/restrictions in the Cognite SDK that could explain the cause of the issue? As mentioned, some weeks ago the workflow succeeded without problems. For additional context, we are using multiple threads to fetch events in parallel over metadata, for events within same time interval. Also, we use multiple cores to parallelize fetching and subsequent

When deploying a function with the SDK you can specify the source code “folder” as a parameter. I have used this to deploy the functions with my own python module which is just a directory with some py files. I want to migrate to using the toolkit, but I am not sure how to deploy with the source code folder I want as I do not see a way to specify it in the yaml file. Can anyone help with this? I have multiple Cognite Functions that I want to deploy that all access the same source code I have written.Thank you!Sebastian

¿HOW COGNITE DATA FUSION HELP US TO IMPROVE THE ENEERGY EFFICIENCY IN AN INDUSTRIAL PROCESS?

I see there is a fork for ToolJet in the CogniteData git repo.  I’m curious to know if Cognite has done anything with this branch and if so, how it’s being used within the product. Thanks!

We are trying to implement automatic monitoring over our transformations in CDF. We are doing this by running a transformation and a monitoring function in the same workflow, where the monitoring function is dependent on the transformation being finished.Then we retrieve the sum of updated and created events like this: def _created_and_updated_sum(self, transformation_external_id: str) -> int: """ Get the sum of the number of created and updated events in the last transformation job. If there are no finished jobs, return 0 instead. """ transformation = self.cdf_client.transformations.retrieve( external_id = transformation_external_id, ) if transformation is None: raise ValueError(f"Transformation {transformation_external_id} not found") if transformation.last_finished_job is None: DUMMY = 0 self.logger.info(f"Transformation {transformation_external_id} has no finished jobs.

I noticed a few misses / potential improvements in the alerts & monitoring section of Cognite charts - Was wondering if anybody else had similar experiences?Email alerts always come in UTC (Considering we are based out of India, we may miss important alerts because of this). Let's say I have an Asset where I have generated a chart (in our case a particular well from a particular lift type showing critical parameters). A filter-based option where I can just switch Wells showing - using the same parameters as tagged before.

Hi,I would like to ask if Cognite Maintain or CDF can show the available bill of materials on equipment in the source system(for eg. in SAP).For example if technician can view the BoM on P&ID and the most frequently consumed materials on equipment, e.g compressor. 

Hi Community,I am havng an issue where I tried to use the Cognite-Extractor-Manager (cogex) for custom extractor development.I just install and create new project using cogex init. When i tried to run using "poetry run test_extractor", it returned below error:  Also having another error when executing the "cogex build” command: Anyone having the same issue?Tools:python == 3.11.9cognite-extractor-manager == 2.0.0

We use DB Exctractor to push data from MSSQL Database to RAW, but have run into a problem.Over time the raw table grows much larger than the Database table and this is due to rows that are deleted in database will not be deleted in RAW. How can I set up the config yaml for db extractor to also handle rows that are deleted in database?  

Is there a limit on the number of characters for String data that can be stored in a Timeseries?I would like to manage a JSON file that defines the configuration values of a certain system in CDF. Since the JSON file will be changed frequently and I also want to check the historical configuration records, I am considering defining it as a string timeseries and storing the JSON string in data point.However, if there is a character limit, it would restrict the size of the JSON string that can be stored, so I would like to confirm the specifications. As far as I have searched, there is no mention of this in the documentation.

Hello people,I’m testing CDM and I want to extend a current model type, I may do it wrong, but my idea is. I’m creating a new type called MyModel, that will be pretty much and CogniteActivity + new fields.But I don’t know what I’m doing wrong.type MyModel @import ( dataModel: { externalId: "CogniteActivity", space: "cdf_cdm", version: "v1" } ){ FieldA: String, FieldB: String}I got some guidance from this link https://docs.cognite.com/cdf/dm/dm_guides/dm_extending_core_data_modelWhen I try to save, I got this error{   "title": "Error: could not update data model",   "message": "An error has occured. Data model was not published.",   "extra": "[Line: 40] Data model 'DataModelRef(space=cdf_cdm, externalId=CogniteActivity, version=v1)' cannot be found" }Thanks in advance

On behalf of CelaneseHi.I would like to report a potential issue with cursor-based pagination when sorting in descending order and request clarification on the undocumented forceCursorsDespitePerformanceHazard flag.We are executing a query against the view OEEEvent, which is defined with a cursorable BTREE index on the startDateTime property, as shown in the simplified schema below: type OEEEvent@container(  indexes: [    {      fields: ["startDateTime"]      identifier: "idx_oeev_startDateTime"      indexType: BTREE      cursorable: true    }  ]) {  startDateTime: Timestamp  endDateTime: Timestamp  totalDuration: Float} We are querying with the following time range filter: "startDateTime": {  "gte": "2024-12-31T00:00:00.000-03:00",  "lt":  "2025-05-01T00:00:00.000-03:00"} The result set includes 840 records.When applying a page size of 500 and using the following ascending sort configuration: {  "property": [    "INO-COR-ALL-DML",    "OEEEvent/472bdbcb9cd6f1",    "startDateTime"  ],