Solved

Hi.We’re administering CDF deployments from Github using github actions and Cognite toolkit.I’m setting up a github action to automatically perform a dry-run for a pull request to main, and post the dry-run output as a comment on the PR to assist the reviewer.I’d preferably like to use a client with read-only access to CDF for this, but it seems cdf-tk requires full write access even for dry runs - is that so? Performing a dry-run locally with read-only credentials results in:ERROR (AuthorizationError): Don't have correct access rights to deploy iam.groups(all_scoped). Missing:GroupsAcl(actions=[<GroupsAcl Action.Create: 'CREATE'>], scope=AllScope()) -GroupsAcl(actions=[<GroupsAcl Action.Delete: 'DELETE'>], scope=AllScope())Please click here to visit the documentation and ensure that you have setup authentication for the CDF toolkit correctly.I would expect to see the same error on my github-action, but it stops without much useful information:Run cdf-tk deploy --env=dev --

I just have a new phone and I'm facing an issue with the Authenticator App. Please reset the MFA Access so that I can set up the authenticator again. Regards

Hi All,I am working with hosted extractors for kafka and it works pretty well for me with transformations when we have plain json data in kafka topics.Now I am trying to check if we can work with zlib gzip compressed data coming in topic, I have json string and messagepayload attribute of json string will be holding compressed data instead of whole message as compressed one, is it possible to write transformation for such data. e.g., in kafka topics{    "Header": {        "MessageId": 133367162,        "MessageType": "DATA_REPORT",        "Timestamp": 1741122422,        "PayloadCompression": "Z_LIB_COMPRESSION"            },    "MessagePayload": "eJyqVnJJLctMTi1WsoquVvJLzE1VslIyVNJRckksSQxJTIeIhySmQ6WCA3wVfFMTi0uLUlNgqioLQDIu/qFOPq7xYY4+oa5KOkphiTmlMLNCMnNTi0sScwuUrAzNTQwNjYxMjAwtzA11lAJLE3MySyqVrAxqY2tjawEBAAD//x5aKt0="}

As owner of a canvas, the Canvas UI identifies me as expected such as in version history or in comments. When another user makes edits and comments they are not identified and show up as seen in the attached screenshot. Just in case it matters, this is a Rockwell Automation DataMosaix project. Thanks!

After creating a new calculated time series in Charts, how can I replicate the same calculation across multiple similar assets?Let’s say I calculate [ampers / Fluid rate] in one pump; I’m now interesetd on repeating the same calculation across 10 other pumps (let’s assume timeseries have the same name for all pumps, i.e.: PumpX:AMP).Am I obliged to go to SDK and code that? Shouldn’t be an easier way to do that? Thanks!  

Hi,I have a datamodel in CDF and I want to run a GraphQL query through the SDK to retrieve specific data from the model. When I try to run response = client.data_modeling.graphql.query( id = ('sp_watercourse_data_model', 'Watercourse', 'v1'), query = query )I receive the following error message:CogniteGraphQLError: [GraphQLErrorSpec(message=Could not find data model with space=sp_watercourse_data_model, externalId=Watercourse and version=v1, locations=[], extensions={'classification': 'DataFetchingException'})]However, when I list my models usingmodels = client.data_modeling.data_models.list(limit=100).to_pandas()the model is in the dataframe as expected. What causes this problem and how can I fix it? thanks

Hi Cognite Team,I’m encountering an issue when trying to install cognite-toolkit (version 0.4.15) using Poetry. The installation fails with the following error:Installing C:\Users\andre.carvalho\AppData\Local\pypoetry\Cache\virtualenvs\cognite-toolkit-playgroud-gU7xo0oD-py3.11\Lib\site-packages\cognite_toolkit\_builtin_modules\contextualization\cdf_entity_matching\default.config.yaml - Installing cognite-toolkit (0.4.15): Failed FileNotFoundError: [Errno 2] No such file or directory: 'C:\\Users\\andre.carvalho\\AppData\\Local\\pypoetry\\Cache\\virtualenvs\\cognite-toolkit-playgroud-gU7xo0oD-py3.11\\Lib\\site-packages\\cognite_toolkit\\_builtin_modules\\contextualization\\cdf_entity_matching\\extraction_pipelines\\ctx_files_entity_matcher.ExtractionPipeline.yaml'Before running poetry add cognite-toolkit, I ensured my environment was set up correctly. However, it seems like the package is missing required files.Could you confirm if this is a known issue or if there’s a recommended workar

I had gotten a number of rest extractor pipe lines running the other day and then paused them. I am now trying to resume them and I am getting an Startup Error message “Missing required field session key”. I do not see a field session key referenced anywhere in the documentation on the rest extractor. Are you able to give any additional inform of where I can find this field?

We have a RDF-model based on CIM that we have imported to CDF Data Model via Neat. We are experimenting with Pygen. We are happy about both NEAT and Pygen and looking forward to explore further.  The names of the attributes of the dataclasses becomemes long with pygen and the CIM-naming convension.   Example 1: Model: cim:IdentifiedObject.name pygen: identified_object_name proposed pygen short: name Example 2: Model: nek:NEKACLineSegment.wireSegmentKind pygen: nekac_line_segment_wire_segment_kind proposed pygen short: wire_segment_kind Generic: Model. namespace:ClassName.attrName pygen: class_name_attr_name proposed pygen short: attr_name Is it possible to add an option in pygen to genreate short attributes? The rule would be to only the string followed by the . (dot ) I’m also interested in discussing other solutions with you. One options is ofc to change the names in the model, but then we are not conforming to CIM… Thanks! Regards, Olav  

Hi Neat Team,I know you are very busy, as I’ve been following all the commits and changes in the repo, and I really appreciate all the work you’re doing.We are probably going to be working on migrating from an asset-centric data model to a new domain data model that extends cdf_cdm, and one challenge we anticipate is that the existing model does not have an explicit equipment concept—only assets.Could you confirm if there are already plans within NEAT to address this, or if we can create a custom mapper using metadata.assetType to classify certain assets as equipment during transformation?Our proposed approach involves:Using metadata.assetType to filter and classify specific assets as equipment (e.g., pumps, motors, valves). Mapping asset metadata into the equipment structure in the new model. Retaining parent-child relationships where relevant.I understand this might not be a priority right now, but since this will likely be one of the tasks we’ll have to tackle soon, I wanted to chec

charts Daily average of the previous dayIf anyone knows a good way to do this, please let me know.I would like to see the previous day's 24-hour values by averaging the data over the day with a mean of 0 days 24:00:00 (resampling to granularity), but due to the UTC+9:00 specification, the previous day's processing does not occur until 9:00 AM in japan.I would like to see the previous day's nightly processing volume average at 8:00 AM.The only way I can think of is to use the “shift time series” to force it forward, i would be appriciated if anyone have a better idea.. 

Hello everyone,I’ve been working with Cognite Data Fusion for the past couple of months, and it has really caught my attention. Cognite AI can be a game-changer in our daily routine, helping us access the data and documents we need.I have a question regarding Cognite Industrial Canvas. I hope some of you are using it. Is there a shortcut key to switch from the arrow to the grab function? Each time I want to scroll the canvas, I have to click on the grab hand, which makes the process a bit slow. We have a shortcut key (“V”) to switch from the grab hand to the arrow, but I can’t find a shortcut key for the reverse. Can anyone help me with a solution?Thank you!

While reviewing the data-modeling-lifecycle documentation available on GitHub for Neat, one of the first steps mentioned is validating the sheet using Neat (a React app demonstrated in a YouTube video). However, I could not find any reference to the Neat UI for validating statements in the spreadsheet. Does this mean that this step can be skipped?

​​​​​​​Can Unified namespace architecture be implemented in Cognite Data Fusion

Hi,I understand that we can define properties on edges, but it isn’t clear from the documentation how these properties are populated. I am trying to implement the following modelAnd defined the data model using DML as follows How can I add a UserActivity edge with properties start_time and stop_time, that I can read while listing all the activities that a User has performed?Thank you

Hi Team,I wanted to know if it is possible to integrate Spotfire with Cognite Data Fusion. 

I came across this documentation regarding how we can use GQL to override the type of direct relation when using a CDM feature.Is there a similar documentation to highlight the changes needed to be made in the YAMLs when using CDF toolkit to deploy our model? Please note that I tried dumping the working GQL, but the resulting yamls did not work when tried the other way around.

Is it possible to trigger an email for a set of dynamically provided email IDs from a Cognite function? Since I don’t have a static list, I can’t integrate the Cognite function with the Extraction pipeline to use its notifications. I couldn’t find any documentation on this.If not, can we integrate a third-party library for sending emails inside a Cognite function?

When we deploy Data Model using GraphQL then we can put some comments like documentation giving relevant info. This is helpful for people who look into Data Model’s graphql in web application. However, when we deploy using toolkit via yaml files the generated Data Model’s GraphQL do not have comments. Though we can add comment by editing in UI but that has to be done manually. Is there any way to have documentation in generated Data Model’s GraphQL when we deploy yaml files using toolkit?

I usesthe scripts below with replacing the my_sdk with my generated sdk, which was generated by Pygen, and show me this error “ my client object has no attribute 'config' ”.  My scipts are  my_sdk.config import global_config; global_config.validate_retrieve = Falseand my_sdk.config.global_config.validate_retrieve = FalseAny guidance? 

I am trying to deploy data model using CDF toolkit in my azure devops pipeline. So I checked the following page: https://docs.cognite.com/cdf/deploy/cdf_toolkit/guides/cicd/ado_setup However, I see this message in top which says that its still in alpha stage.  We need this deployment to be done in our prod environments so what is current recommended approach. Also let me know when this feature is expected to be available.

I am using CogniteSdk c# to query data model from CDF. When I tried to execute it, it did not return row items. Instead it just returned below result:What is the correct way to use the DataModel in C# CogniteSdk to return rows of data as per below? 

Hi,The user is listed as UNKNOWN when the annotation is done manually from “Data explorer”. This is problematic as we need to be able to track who made the changes.Here is an annotation I added manually:And this is what I see from the API. I am able to identify the creating_app which is data explorer, but I need to know the user as well or at least some way to track which credentials made the change. UNKNOWN is not good enough.I’ve also notices that for our automated annotations this field does not work as expected. These are all made by the same user/credentials, but for some reason the are all different and it looks like the “creating_user” field is mapped to the “job_id” you get when sending a request to the API rather than the user that made the request. I don’t know about others, but we at least need to be able to track which users/credentials created the annotations, which batch job uploaded the annotation is not relevant to us at all.job.7445037198441218job.5162020989972303job.5

We have encountered a scenario where we are unable to continue deploying to our production environment. The deployment fails on the IAM groups which indicate an HTTP Error 400 with a note indicating the Cognite API Failed to bugger the request body. Here is the important parts of the error:  ...Deploying 19 iam.groups(resource_scoped) to CDF...╭──────────────────────────────────────────────────────────────────────────────╮│ Traceback (most recent call last): ││ File ││ "/opt/hostedtoolcache/Python/3.11.11/x64/lib/python3.11/site-packages/cognit ││ e_toolkit/_cdf_tk/commands/deploy.py", line 423, in _update_resources ││ updated = loader.update(resources) ││ ^^^^^^^^^^^^^^^^^^^^^^^^ ││ File ││ "/opt/hosted

I created a small configuration using “cdf modules init for the cdf_process_industry_extension_full” data model and tried to deploy. No changes to the configuration at this point have been made. I do intend to extend the data model.Deploying results with the following error:Deploying 1 spaces to CDF...Deploying 36 containers to CDF...Deploying 36 views to CDF...WARNING [LOW]: Resource(s) already exist(s), skipping creation. ← Note they shouldn’t aready exist???Deploying 1 data models to CDF...  ERROR (ResourceCreationError): Failed to create resource(s). Error: One or more views do not exist: 'Gemini_sp_enterprise_process_industry_full:WorleySB360ImageAnnotation/v1','Gemini_sp_enterprise_process_industry_full:WorleySBAnnotation/v1', ← All three related to Annotation??'Gemini_sp_enterprise_process_industry_full:WorleySBDiagramAnnotation/v1'. | code: 400 | X-Request-ID: 536ccf9d-05cb-932c-b032-2fc57fd77a4f |       cluster: az-eastus-1The API Failed to process some items.Successful (2xx):