Solved

Hi! I’m trying to create a Power BI Dataflow using CDF timeseries data. The same data is retrieved absolutely fine when using Power BI Desktop and Power Query inside the Power BI Desktop app, but when I try to use exactly the same query as a Dataflow instead, there is a warning about: “The query “Timeseries” contains columns with complex types that cannot be loaded. Some data is retrieved, but it’s incomplete with big parts of it missing. Looks like the CDF connector is not able to retrieve the data correctly when a Dataflow is used instead of a normal Power BI Desktop dataset. Is there a way to make Dataflow also compatible with the CDF connector?  

In the Cognite Data Fusion Fundamentals path, there is a hands on learning course where I need to create a data set; however, it seems like the UI has gone through a couple of iterations since and I don’t see the `create data set` option based on the path provided in the course. These are the instructions that were provided.This is what the UI that I currently see. (It’s possible my account doesn’t have the right access to create the data set) Can someone please help?

Hello team,We are trying to use the data modeling query instances SDK method.client.data_modeling.instances.query(query) our query is:query { "with": { "Min_15_50ts": { "nodes": { "filter": { "and": [ { "hasData": [ { "type": "view", "space": "QA_Test_Space", "externalId": "Min_15_50ts", "version": "3a62f20104e445" } ] }, { "in": { "property": [ "QA_Test_Space", "Min_15_50ts/3a62f20104e445", "entity" ],

Can someone please suggest, how we can add additional python libraries in CDF jupyter notebook?

Hi.I’m getting the following error:ERROR (ToolkitYAMLFormatError): Failed to load 7.<groupname>.writer.Group.yaml with iam.groups(resource_scoped). Error: CogniteAuthError("Don't have correct access rights. Need READ and WRITE on datasetsAcl.").) I’ve noticed that the “actions”-part of my YAML files have varying indentations. Like below, where the READ action is on a higher level than LIST and READ:- extractionPipelinesAcl: actions: - READ scope: datasetScope: ids: - <removed> - <removed>- groupsAcl: actions: - LIST - READ scope:In the YAML-configuration reference, there are examples of both: - dataModelInstancesAcl: actions: - READ scope: spaceIdScope: { spaceIds: [ 'my_space' ] }<...> - rawAcl: actions: - READ - WRITE scope: tableScope: dbsToTables: my_database: tables: []Does indentat

The information I found here is contradictory: Cognite HubSpecifically, I am interested in Aker BioMarine’s tag data on CDF (example shown below). I did not check the documentation, since I prefer to hear it here, “straight from the horse’s mouth”, if you will.Questions:Is the same time zone used for all of our assets, regardless of location of the geographic location of our manufacturing site? Is the time stamp preserved for time series downloaded using, e.g., Python / Jupyter notebook? Anything else I should be aware of?Thank you very much!

I’m currently writing my Master thesis in collaboration with Aize (represented by V. Flovik), where I’m trying to use Generative adversarial Networks (GAN) to generate synthetic time series data. To do this, I’m using data from Cognite OID. I’ve explored the data in the previous semester, and I figured that one of my main challenges is to find longer periods of data that are “Normal”. Meaning periods without to large irregularities and without too many missing data points. Because even when I aggregate the samples over 30 seconds, there are still samples missing in some periods. Some of these periods are hours long and can’t really be filled in without messing up the temporal development of the data. I can’t find any information about the cause of these periods either.The time series I’ve been looking at are:I’m no expert in process engineering, and I only chose these 9 sensors because another master thesis from 2019 had used these sensors in their project. I therefore reach out here t

I am unable to generate client code for the CDF openapi spec at https://api-docs.cognite.com/20230101/ using deepmap/oapi-codegen for Go, seemingly because the spec contains some errors. Do anyone know of a way to generate an api-client in go for the CDF-api spec? Both commands below rely on having openapi spec downloaded to the current directory from https://api-docs.cognite.com/20230101/ Testing the spec for errors with redocly/cli: docker run --rm -it -v $PWD/swagger.json:/swagger.json redocly/cli lint /swagger.jsonFor me this results in “Validation failed with 25 errors and 382 warnings” Generating the client library using deepmap/oapi-codegen: go run github.com/deepmap/oapi-codegen/v2/cmd/oapi-codegen@v2.0.0 --config oapi-codegen-config.yaml swagger.jsonwith the this config file:package: "cdf_api"output: "cdf_api.gen.go"generate: models: true client: truecompatibility: circular-reference-limit: 100For me this results in the message “error generating code: error creating operat

Hi team,This is what I am trying to achieve:I have written a function to create a new time series (in case it is not already created) and insert data points into it.The newly created timeseries needs to be added to a solution data model I have created.type ESPInputs @view(space: "workflow-sdm-spc", version: "1_0") {    well:Well    pump: ESP,    operatingFrequency: TimeSeries,    voltage: TimeSeries,    pumpIntakePress: TimeSeries,    pumpDischargePress: TimeSeries,    motorWindingTemp: TimeSeries,    current: TimeSeries,    vibration: TimeSeries,    torque: TimeSeries,    pmm: TimeSeries,    operatingFrequencyPmm: TimeSeries}The instances under this view are already present. The newly created time series need to be references to the property pmm that are filtered via well property (I have well external Id and pmm time series external id available with me in the function).I think I need to update the instance in the apply instance as per the documentation, but I am unable to find an up

I type in a comment in the comments pane and there is no way to submit the comment. I press enter and nothing happens. There is no button to submit. When I close the comments pane and reopen, the comment text has been deleted. Am I missing something?

Hyperlink in CDF is not navigate to right screen for the provided hyperlink. User will navigate to CDF by default screen not the intended hyper linke.g: https://oq.fusion.cognite.com/oq-test/explore/search/timeSeries?cluster=westeurope-1.cognitedata.com&env=westeurope-1&journey=timeSeries-114626196540160&q=separator  

The number of assets shown as linked to the file is not correct. The system is wrongly showing the number of assets linked in the file.And also Linked Asset to an asset count is wrong and same issue for linked files, linked time series, Linked events. These linked is different than directly linked items. (A) Linked (Files): this count means all decedent children of a given asset. (B) Directly linked (files): this count is the number of files that are connected directly to the asset. (C) The file count on top: This count may vary since there might be duplicated IDs amongst the different types - the total number is a distinct value. The linked assets are not relevant to the Asset which user try to refer and these Linked assets will not linked to the Asset.Directly linked assets are linked to the assets which user try to refer.User don't want to see linked asset tab in CDF because its doesn't have a meaningful assets linked to it, however Directly linked asset have meaningful tab and same

Hi, I’m doing the data science modules, I’m on Notebook 2 (List/Search/Retrieve) and I note that when I use the LabelFilter on the assets, I find a number of assets with a label called ‘COLD’.  However, when I do c.labels.list               (limit=None), I get only 4 labels and none of them match the ‘COLD’ label. Are labels for assets different from labels that are found using c.labels.list?

Is the following use case a good fit for Data Workflows?Cognite Function that is reading data from Time Series and writing "event-like" data into Data Modeling continuous processing for metric type A ideally an execution every minute, but more importantly no overlapping executions (i.e., if execution takes longer than a minute) passing state from one to another function execution hourly processing for metrics type B Idea:2 Data workflows:Hourly execution of trigger Cognite Function to calculate metric B Daily execution of a workflow that triggers Cognite Function that recursively outputs a dynamic task, which calculates metric A. The Function outputs information for the next execution run (i.e., timestamp for next execution, state, and other info). At the end of the day the dynamic task would not output a timestamp for the next execution and workflow would complete. The execution trigger could also be daily.

Hello, When I tried to run the DBExtractor, I get the following error: “polars\_cpu_check.py:232: RuntimeWarning: Missing required CPU features.The following required CPU features were not detected:    avx, avx2, fmaContinuing to use this version of Polars on this processor will likely result in a crash.Install the `polars-lts-cpu` package instead of `polars` to run Polars with better compatibility.Hint: If you are on an Apple ARM machine (e.g. M1) this is likely due to running Python under Rosetta.It is recommended to install a native version of Python that does not run under Rosetta x86-64 emulation.If you believe this warning to be a false positive, you can set the `POLARS_SKIP_CPU_CHECK` environment variable to bypass this check.”After doing some googling, I was able to install the polars-lts-cpu package referenced using python, but I got the same error. I’m not sure how to make the extractor reference the polars-lts-cpu package when it runs. See attached screenshot.The extractor i

Hello,I have to import FDM data into Power BI. There’s a field I need from a table that’s in the edge of a relationship with another table. As you can see in the image below: In order to import the data, I just expanded the field.But when I apply the changes I get the fallowing error:  Is there another way of importing this data?  Thanks,Pablo

In the Introduction to CDF & Grafana course, the demo demonstrates how to create a client secret for training purposes by clicking the "Create Client Secret" button available on the training page. But when I click on the Create client secret it was not generating it was showing error. How to overcome this and generate client secret? 

Hi,In the documentation it is mentioned that 10,000 timeseries is the limit in each subscription. Is this the hard limit or it can be changed based on use cases? We are using CDF workflow and in that our first function to read data points subscriptions to get the timeseries and datapoints. Based on our use cases, 10,000 number for timeseries in subscription is too small. We are considering 10,000 wellbores and 200 properties. (10,000 * 200 = 2 Million timeseries).  Any recommendations?     

I am creating a transformation where I am joining data from two different views/containers, where table B has a node reference to table A. I have tried to find documentation for this, but I have not found any so far.  Through friends and trial and error I have found two options, and neither seems to be performing well. Example:Type A {    Name: String}Type B{   Name: String   A_ref: A}What I have found as possible solutions are to go through cdf_data_models and picking the externalId from the node-reference:from cdf_data models(<spc>, <mod>,<ver>, “A”) as A join cdf_… as B on A.external_id = B.A_ref.externalIdSame as above, but join on a as a nodereference: on B.A_ref = node_reference(<spc>, A)   Neither of these options seems to be documented anywhere, and I can’t find any other ways documented. The performance when reading when using these joins seems slow, even though I have set up a few indexes which should cover the different joins. This is also slower then

We are a bit unclear on the difference in meaning between the "Uploaded at" vs. "Last Updated"  times for Files in CDF.For example, we have seen un-intuitive examples where the "Uploaded at" time is newer than the "Last Updated" time - we would expect that would never be the case.Can you define the logic for these two fields, and update the documentation here? https://cognite-sdk-python.readthedocs-hosted.com/en/latest/files.html#module-cognite.client.data_classes.filesThank you.

Hello everyone, I’m facing a difficulty, and perhaps someone has already encountered this… I’m using the SDK to extract data using Python, but I’m having trouble finding the information I need. To access the data, I go to ‘Data Management,’ ‘Explore,’ ‘Data Models.’ I select a Data Model, click on ‘Data Management,’ and on the left side of Data Management, I need data from three tables (which I believe are views) that appear below the Filter. When I try to use cognite_client.data_modeling.view.list(), I can’t select one of these specific views; I can only filter parts of them, not the entire view. Does anyone have any guidance or tips on how to select the entire ‘table’ that appears in Data Management?

Hi Team, I work with Celanese and we are trying to work on creating Power BI dashboards for streaming Data (Timeseries).  I am following below solution for doing the same. Streaming data from Cognite Data Fusion to Power BI [Cognite Official]I am facing same “timeout” error while creating Subscriptions. I am using below code. my_filter = f.Prefix(    property=p.external_id,    value="EVE")sub = DataPointSubscriptionCreate(    external_id="powerbi-subscription-test",    name="PowerBI Subscription Test",    description="Subscription for PowerBI",    partition_count=1,    filter=my_filter)client.time_series.subscriptions.create(sub)

 I am simplifying my query.How can I upload a Python library that I have modified to support a function I am deploying to CDF?********************************************************************************** I am receiving the below error when executing a function I have created in cdf.  If I am understanding the error correctly the suod library is attempting to write to a read-only directory.  I have not found the suod library to allow for setting an alternate path.   I did locate the dump command in the cost_predictor.py file, in which I placed commands to write in the /tmp directory.  However, I could use some guidance on how to get the altered suod library loaded into cdf with my function?  I have attached both the original and updated cost_predictor.py files with code to redirect the dump to the system temp directory and would appreciate any guidance on whether I am on the right path here or not.  Thanks in advance! Error text:2024-05-16 04:15 Function started2024-05-16 04:15 : T

I am unable to use indsl library here in Streamlit.Getting the below error when I include “indsl” in Installed Packages list. Can someone suggest a workaround? Error during booting upTraceback (most recent call last): File "/lib/python3.11/site-packages/micropip/_commands/install.py", line 146, in install raise ValueError(ValueError: Can't find a pure Python 3 wheel for: 'pandas<2.3.0,>=2.2.0'See: https://pyodide.org/en/stable/usage/faq.html#why-can-t-micropip-find-a-pure-python-wheel-for-a-package