Solved

Hi Guys,I tried to use a transformation from the SDK but i keep getting error on Transformation credentials. Do you guys know what I need to do to solve this credentials issue. I have check the current credential for the Service Account that I use and the access for tranformation has been granted. def fetch_raw_table_via_transformation(    client: CogniteClient,    db_name: str,    table_name: str,    calculation_date: Optional[str] = None,    columns: Optional[List[str]] = None) -> pd.DataFrame:    """    Fetch data by running a temporary CDF Transformation (uses Spark SQL engine).        This is the RECOMMENDED approach for production workloads:    - Runs on CDF's managed Spark infrastructure    - Handles billions of rows efficiently    - Server-side filtering and aggregation    - Can write results to temp Raw table or return directly        Note: Requires transformation permissions in CDF        Args:        client: CogniteClient instance        db_name: Name of the RAW database 

Hello,  Some capabilities, such as dataModelInstancesAcl or dataModelsAcl, support the spaceIdScope scope. Currently, we can only specify the spaces to which we want to grant access.To better support certain use cases, would it be possible to introduce support for exclusion rules or regex-based expressions within this scope? Thanks 

I have a bit of a conundrum here. I am trying to visualize the daily and weekly averages of a time series in Azure Managed Grafana v11.6.3 using the CDF datasource. Raw data is strictly on hourly resolution, and provided in CET/CEST. Grafana is set to browser tz (i.e. CET/CEST). I need the daily average to align with CET midnight (=23:00 UTC). I use these synthetic series parameters: aggregate='average', granularity='24h', alignment=82800000 (82800000 aligns the datapoints to the correct hour if I do aggregate='step_interpolation', granularity='1h'). The returned value is neither the UTC day average or the CET day average. It is exactly the average of the two. So from what I see it seems to be a 30-minute shift/interpolation in the backend. Case in point: CET day average for a specific day is 158,67, while its UTC equivalent is 159,83 (see screenshot). Neither value is found in Grafana for that day at 00:00 - here I see 159,25. Which coincidentally is equal to (158,67+159,83)/2. The ti

Hi Team, Is there any possibility that I can register for Bootcamp virtually or it can be in India location as I am from India.Also, want to know is the Bootcamp is for individual or group and the cost for attending the Bootcamp? Thanks,Navyasri Indupalli

Hello! I have got a new phone and am not able to restore microsoft authenticator from its backup.Could someboday please reset the MFA Access so that I can set up the authenticator again?

We have configured Asset Centric Location Filter based on the required Dataset Ids. No Asset Subtrees or External Id Prefix are used for the Filter. On the applying the Location Filter on Industrial Tool search, the UI list all the required assets. However, when we try to switch from LIST to HIERARCHY view the UI is unable to render the hierarchy view correctly.The error message in network logs states - <Request had 1 constraint violations. Please fix the request and try again. [<list element> must not be null]>In the request payload could see the parentIds are set to null which could be causing this error.NOTE: If I manually select all the hierarchy levels using the filters option - the hierarchy view works.

Dear Community,I have questions regarding the required access control for CDF  Canvas drag & drop featureand CDF Charts scheduling & creating a timeseries from calculation feature,As the people who use these features are usually granted read only capabilities (business users)But those two features I would assume require capability of writing to a dataset and files & timeseries create .I want to know what group permissions exactly need to be added for these users ( on the canvas&charts dataset)so that the new dataset start showing for them ( when needing to scheduel a timeseries in charts and drag/drop in canvas)So far we made an additional group, connected to the same azure group that includes the business users that have read only access,the permissions added to the new group are: timeseries read & write, files read & write ( scoped to the new dedicated dataset )but then, the new dataset still didn’t show in the drop down list for the business users ( in canvas

i want to pratice data modelling pratically ,concept based understood so now i want to pratice data modelling to gain more knowledge so is any chance to get the acces to created data model in cognite learning platform.https://cognite-learn.fusion.cognite.com/cdf-fundamentals/data-models?cluster=api.cognitedata.com&workspace=data-management&search=&page=1&sort=updatedTime&order=desc&tab=dmThankyou 

When doing the exercise “Valve mileage use case” of the Domain Expert training in CDF, this error appears (in Portuguese):It says:Competências necessáriasEntre em contato com seu administrador do CDF para solicitar as seguintes competências: timeSeriesAcl:WRITEIn English:Required SkillsContact your CDF administrator to request the following skills: timeSeriesAcl:WRITE Basically, someone should give me the timeSeriesAcl:WRITE permission. But who?   

How can we get access to work hands-on with the learning path athttps://cognite-learn.fusion.cognite.com/cdf-fundamentals/data-models?cluster=api.cognitedata.com&workspace=data-management?If not, how can we practice hands-on with Cognite Learn?

Hello everyone,I observe a difference in behavior that I cannot explain.My input data, few datapoints, and before the value is 0, timeseries.is_step = TrueInput datapointsWith client.time_series.data.retrieve, behavior is as expected :And with every granularity results are okay as expected.Nevertheless, with client.time_series.data.synthetic.query it’s… different.that’s okthat’s okNot ok, why the result is not 2 groups : from 46 to 49 then 49 to 52 ? another wrong exampleWhy the start timestamp is 48 and not at 46 ? Again, the timeseries endoint is good : I have lost hope.If anyone has anything to try or an explanation, i’ll be grateful.Thanks in advance,Pierre 

Hi All,I have a large production records data set which i am utilizing to create reports using GraphQL queries.I want to perform DESC sort to fetch the latest records for which i am using default ‘StartTime’ property(This property is derived from Schedulable Container). But system is generating this warning : "The sort is not backed by a cursorable index, which means query time sorting is necessary, which in turn means a lot more data must be read. Consider whether a cursorable index is a good fit."What’s the best way to approach this so that i can fetch large data sets with improved performance?Should i make a custom DateTime field as cursorable ? What are the impact of this ?

Hi Everyone,We're currently managing multiple CDF Toolkit solutions in a mono-repo and evaluating whether to maintain this approach or migrate to a multi-repo structure. We'd love to learn from teams who've navigated through this decision.Current Setup (Mono-repo):1. Single repository housing multiple solutions with shared infrastructure. 2. Shared auth-governance across all solutions.3. Teams need independence but also need to prevent cross-team overwrites.We're Looking For: 1. Real-world examples: How did you decide between mono/multi-repo? What factors mattered most?2. Tooling patterns: How do you handle shared resources (auth governance) in multi-repo? How do you manage CDF Toolkit versioning across repos?3. At how many solutions/teams did you reach the limit of mono-repo and decide to switch to multi-repo?4. How do teams with multi-repos handle toolkit version synchronization? Do you enforce a minimum/maximum version across repos?5. Documentation (runbooks or migration guidelines)

I have got a new phone and am not able to restore microsoft authenticator from the backup on it.Please reset the MFA Access so that I can set up the authenticator again.

I have Cognite Hub Account configured in Authenticator App on my phone since some time. Recently I have installed the Authenticator also on an iPad. The CogniteHub account appears on the list , however it wants me to log in. And I can’t remember the password. Is there  a way to get the password from the Authenticator on my phone?

Are there any extractors or connectors to seamlessly integrate Cognite CDF and Aspentech Mtell?If not, have you discussed approaches for that integration, and whether one of them should involve using Aspentech DataSource Interfaces to connect via Aspentech ODBC Datasource, Kafka Datasource, or MQTT Datasource?Please also share any other approaches you may have discussed for seamlessly integrating CDF and Aspentech Mtell.

Lineage doesn’t work. You click on it and it shows for 1 second, before you get this screen. Multiple people gets the same error. 

Following the training instructions(Date Engineer - Hands-on: Setting up the Equipment Container for RMDM), I installed cognite-toolkit==0.6.87. However, the training repository is pinned to:[modules]version = "0.6.19"This causes cdf build to fail with:"The version of the modules (0.6.19) does not match the version of the installed CLI (0.6.87)"The repo notes that the modules version should not be changed manually, so we're forced to downgrade the Toolkit, but this is not mentioned in the training material.

I’m currently working through the Data Engineer – Data Modeling learning course, specifically the hands-on section where we use the Cognite Toolkit to deploy and extend the provided cognite_dm_skilling repo repository.The course instructions state that, before starting, learners should have: VS Code set up CDF Toolkit installed The cognite_dm_skilling repo cloned Read and write access to a CDF project My question is: does Cognite provide a dedicated training or sandbox CDF project with read/write access for this course, or is access expected to be arranged separately (for example via an internal org project)?I can complete the local build steps with the Toolkit, but deploying and validating the model changes appears to require an actual CDF project with write access.Any guidance on the intended setup for learners here would be much appreciated.

I am working through Cognite Data Fusion Fundamentals: Part 2 – Hands-on, specifically the step to upload assets.csv to the staging area.When I select Upload CSV or JSON, choose the assets.csv file, and select “I don’t know the primary key”, I never get the Create button. The upload flow does not proceed after selecting the file.What I have tried so far: Deleting and recreating the RAW database Manually creating a blank table, then attempting to upload the CSV into it Repeating the process multiple times following the training steps exactly In all cases, the behavior is the same and the Create option never appears.Has anyone run into this issue during the training, or is there a known workaround or permission requirement I might be missing?

In Charts, when choosing a core data model as your source, Events are disabled preventing the choosing of core model “CogniteActivity” as “events” to overlay timeseries data from CogniteTimeSeries.Is this functionality on the roadmap and if so, when can we expect?  

Hi community,I’m learning to use the /models/instances/query endpoint (with Open Industrial Data, public project) and experiencing some confusion about how cursors and pagination work.{    "with": {        "cities": {            "nodes": {                "filter": {                    "and": [                        {                            "exists": {                                "property": [                                    "Geography",                                    "City",                                    "name"                                ]                            }                        }                    ]                }            }        },        "continents": {            "nodes": {                "filter": {                    "and": [                        {                            "exists": {                                "property": [                                    "Geography",                                    "Continent",           

Hi All,I’m unable to access Data Engineer Basics – Integrations and I’m getting the error shown below.Could someone please help me with this?Thanks!  

We’ve setup an MQTT Hosted Extractor that is recieving a SparkPlug B payload which some times contains a couple of null values, this values cannot be removed from the SparkPlug B payload. We believe that whenever the message contains null values the transformation for the datapoints fails.No more information is provided on the Transform Error, only the “Failed to transform data: Missing required field value”, could the null values just be ignored so the other values be inserted in the time series? We’re getting several empty time series that were created via the hosted extractor.

Is there an alert or notification that can be configured when the MQTT hosted extractor is down? Been having issues with  Request to CDF failed with error Error in middleware: Failed to authenticate request  This error is resolved by creating a new sink, however we don’t get a notification of any kind when the extractor is down.