Community Discussions

I’m currently writing my Master thesis in collaboration with Aize (represented by V. Flovik), where I’m trying to use Generative adversarial Networks (GAN) to generate synthetic time series data. To do this, I’m using data from Cognite OID. I’ve explored the data in the previous semester, and I figured that one of my main challenges is to find longer periods of data that are “Normal”. Meaning periods without to large irregularities and without too many missing data points. Because even when I aggregate the samples over 30 seconds, there are still samples missing in some periods. Some of these periods are hours long and can’t really be filled in without messing up the temporal development of the data. I can’t find any information about the cause of these periods either.The time series I’ve been looking at are:I’m no expert in process engineering, and I only chose these 9 sensors because another master thesis from 2019 had used these sensors in their project. I therefore reach out here t

We need to understand if Cognite endpoints offer a way to do few shot learning (custom prompt)

I am unable to generate client code for the CDF openapi spec at https://api-docs.cognite.com/20230101/ using deepmap/oapi-codegen for Go, seemingly because the spec contains some errors. Do anyone know of a way to generate an api-client in go for the CDF-api spec? Both commands below rely on having openapi spec downloaded to the current directory from https://api-docs.cognite.com/20230101/ Testing the spec for errors with redocly/cli: docker run --rm -it -v $PWD/swagger.json:/swagger.json redocly/cli lint /swagger.jsonFor me this results in “Validation failed with 25 errors and 382 warnings” Generating the client library using deepmap/oapi-codegen: go run github.com/deepmap/oapi-codegen/v2/cmd/oapi-codegen@v2.0.0 --config oapi-codegen-config.yaml swagger.jsonwith the this config file:package: "cdf_api"output: "cdf_api.gen.go"generate: models: true client: truecompatibility: circular-reference-limit: 100For me this results in the message “error generating code: error creating operat

Hi team,This is what I am trying to achieve:I have written a function to create a new time series (in case it is not already created) and insert data points into it.The newly created timeseries needs to be added to a solution data model I have created.type ESPInputs @view(space: "workflow-sdm-spc", version: "1_0") {    well:Well    pump: ESP,    operatingFrequency: TimeSeries,    voltage: TimeSeries,    pumpIntakePress: TimeSeries,    pumpDischargePress: TimeSeries,    motorWindingTemp: TimeSeries,    current: TimeSeries,    vibration: TimeSeries,    torque: TimeSeries,    pmm: TimeSeries,    operatingFrequencyPmm: TimeSeries}The instances under this view are already present. The newly created time series need to be references to the property pmm that are filtered via well property (I have well external Id and pmm time series external id available with me in the function).I think I need to update the instance in the apply instance as per the documentation, but I am unable to find an up

The navigation around a busy canvas is awkward. For example having to switch from Select mode to Grab mode to move around is not intuitive. Relatedly, when in grab mode and you hover over a chart for example, you would expect to be able to click the chart and then interact with it. You cannot. You must switch to select mode to do that.I suggest that if the mouse is in “white space” then grab mode is in effect by default. If the mouse is over an object then it should switch to select mode automatically. 

I type in a comment in the comments pane and there is no way to submit the comment. I press enter and nothing happens. There is no button to submit. When I close the comments pane and reopen, the comment text has been deleted. Am I missing something?

Data Explorer (all resources tab) inconsistencies. Login to CDF Navigate to Data Explorer screen. Search the Asset name e.g: 'Inlet separator' in search field. Click on the All-Resource tab to open. Expected Results: All resources screen data should be relevant to the Asset which user searched in search tab.Observed Results: All resources page does not point to relevant relationships – better to focus on direct linkages.

Hyperlink in CDF is not navigate to right screen for the provided hyperlink. User will navigate to CDF by default screen not the intended hyper linke.g: https://oq.fusion.cognite.com/oq-test/explore/search/timeSeries?cluster=westeurope-1.cognitedata.com&env=westeurope-1&journey=timeSeries-114626196540160&q=separator  

The number of assets shown as linked to the file is not correct. The system is wrongly showing the number of assets linked in the file.And also Linked Asset to an asset count is wrong and same issue for linked files, linked time series, Linked events. These linked is different than directly linked items. (A) Linked (Files): this count means all decedent children of a given asset. (B) Directly linked (files): this count is the number of files that are connected directly to the asset. (C) The file count on top: This count may vary since there might be duplicated IDs amongst the different types - the total number is a distinct value. The linked assets are not relevant to the Asset which user try to refer and these Linked assets will not linked to the Asset.Directly linked assets are linked to the assets which user try to refer.User don't want to see linked asset tab in CDF because its doesn't have a meaningful assets linked to it, however Directly linked asset have meaningful tab and same

CDF - Filter option is not working as expected under common filters at Data Explorer screen. Login to CDF Click on Data Explorer tab in CDF menu bar. Click on Files tab in right side of the panel. Set Data set as 'src:006:documentum:b60:ds under Common filters in left side of the screen. Select the check box ‘Before’ under common filters in left side of the penal. Click on the Calendar icon and set data as (e.g.) '10-01-2023' Expected results: Document ‘Amarjeet_Test_DT.docx’ should not display in results window because its created after the set date.Actual results: Document Amarjeet_Test_DT.docx is displaying in CDFNote Issue exists for all Date filters like Created time, updated time with Before, After, During in CDF, user want to know what date is used for filtering the documents in CDF with these filters.

Is the following use case a good fit for Data Workflows?Cognite Function that is reading data from Time Series and writing "event-like" data into Data Modeling continuous processing for metric type A ideally an execution every minute, but more importantly no overlapping executions (i.e., if execution takes longer than a minute) passing state from one to another function execution hourly processing for metrics type B Idea:2 Data workflows:Hourly execution of trigger Cognite Function to calculate metric B Daily execution of a workflow that triggers Cognite Function that recursively outputs a dynamic task, which calculates metric A. The Function outputs information for the next execution run (i.e., timestamp for next execution, state, and other info). At the end of the day the dynamic task would not output a timestamp for the next execution and workflow would complete. The execution trigger could also be daily.

Hello, When I tried to run the DBExtractor, I get the following error: “polars\_cpu_check.py:232: RuntimeWarning: Missing required CPU features.The following required CPU features were not detected:    avx, avx2, fmaContinuing to use this version of Polars on this processor will likely result in a crash.Install the `polars-lts-cpu` package instead of `polars` to run Polars with better compatibility.Hint: If you are on an Apple ARM machine (e.g. M1) this is likely due to running Python under Rosetta.It is recommended to install a native version of Python that does not run under Rosetta x86-64 emulation.If you believe this warning to be a false positive, you can set the `POLARS_SKIP_CPU_CHECK` environment variable to bypass this check.”After doing some googling, I was able to install the polars-lts-cpu package referenced using python, but I got the same error. I’m not sure how to make the extractor reference the polars-lts-cpu package when it runs. See attached screenshot.The extractor i

Hello,I have to import FDM data into Power BI. There’s a field I need from a table that’s in the edge of a relationship with another table. As you can see in the image below: In order to import the data, I just expanded the field.But when I apply the changes I get the fallowing error:  Is there another way of importing this data?  Thanks,Pablo

Hi,In the documentation it is mentioned that 10,000 timeseries is the limit in each subscription. Is this the hard limit or it can be changed based on use cases? We are using CDF workflow and in that our first function to read data points subscriptions to get the timeseries and datapoints. Based on our use cases, 10,000 number for timeseries in subscription is too small. We are considering 10,000 wellbores and 200 properties. (10,000 * 200 = 2 Million timeseries).  Any recommendations?     

I am creating a transformation where I am joining data from two different views/containers, where table B has a node reference to table A. I have tried to find documentation for this, but I have not found any so far.  Through friends and trial and error I have found two options, and neither seems to be performing well. Example:Type A {    Name: String}Type B{   Name: String   A_ref: A}What I have found as possible solutions are to go through cdf_data_models and picking the externalId from the node-reference:from cdf_data models(<spc>, <mod>,<ver>, “A”) as A join cdf_… as B on A.external_id = B.A_ref.externalIdSame as above, but join on a as a nodereference: on B.A_ref = node_reference(<spc>, A)   Neither of these options seems to be documented anywhere, and I can’t find any other ways documented. The performance when reading when using these joins seems slow, even though I have set up a few indexes which should cover the different joins. This is also slower then

We are a bit unclear on the difference in meaning between the "Uploaded at" vs. "Last Updated"  times for Files in CDF.For example, we have seen un-intuitive examples where the "Uploaded at" time is newer than the "Last Updated" time - we would expect that would never be the case.Can you define the logic for these two fields, and update the documentation here? https://cognite-sdk-python.readthedocs-hosted.com/en/latest/files.html#module-cognite.client.data_classes.filesThank you.

Hello everyone, I’m facing a difficulty, and perhaps someone has already encountered this… I’m using the SDK to extract data using Python, but I’m having trouble finding the information I need. To access the data, I go to ‘Data Management,’ ‘Explore,’ ‘Data Models.’ I select a Data Model, click on ‘Data Management,’ and on the left side of Data Management, I need data from three tables (which I believe are views) that appear below the Filter. When I try to use cognite_client.data_modeling.view.list(), I can’t select one of these specific views; I can only filter parts of them, not the entire view. Does anyone have any guidance or tips on how to select the entire ‘table’ that appears in Data Management?

Hi Team, I work with Celanese and we are trying to work on creating Power BI dashboards for streaming Data (Timeseries).  I am following below solution for doing the same. Streaming data from Cognite Data Fusion to Power BI [Cognite Official]I am facing same “timeout” error while creating Subscriptions. I am using below code. my_filter = f.Prefix(    property=p.external_id,    value="EVE")sub = DataPointSubscriptionCreate(    external_id="powerbi-subscription-test",    name="PowerBI Subscription Test",    description="Subscription for PowerBI",    partition_count=1,    filter=my_filter)client.time_series.subscriptions.create(sub)

 I am simplifying my query.How can I upload a Python library that I have modified to support a function I am deploying to CDF?********************************************************************************** I am receiving the below error when executing a function I have created in cdf.  If I am understanding the error correctly the suod library is attempting to write to a read-only directory.  I have not found the suod library to allow for setting an alternate path.   I did locate the dump command in the cost_predictor.py file, in which I placed commands to write in the /tmp directory.  However, I could use some guidance on how to get the altered suod library loaded into cdf with my function?  I have attached both the original and updated cost_predictor.py files with code to redirect the dump to the system temp directory and would appreciate any guidance on whether I am on the right path here or not.  Thanks in advance! Error text:2024-05-16 04:15 Function started2024-05-16 04:15 : T

How does Cognite handle data encryption at rest? Is there any documentation available regarding this requirement? Additionally, concerning data encryption in transit, are there alternative approaches to TLS or MTLS?

Hi! We are developing a monitoring solution that depend on deployed Cognite Functions running our Python backend. What is the exact environment for a Cognite Function? How is the container configured? We would like to test our backend code in a runtime environment as close as possible to the deployed environment. Currently we build a docker image and execute our tests within the image based on “FROM python:3.11-slim”, and install all our dependencies here. How can we configure the environment to be as similar as possible to a Cognite Function? Is there a publicly available image we can base our container on that would ensure a more similar environment? Or is our current method “good enough”? All help appreciated!Anders

When I look at event data, I mostly see***  ( i think this is like NULL or NaN - not filled)see some worktask, rule_broken. Condition, etc.I am new to open industrial data. Thinking of using it for a Thesis, etc. Is there a way to get the different event “types” - i tried scrolling, api is not working well for me. Any advice on this front would be greatly appreciated. Thank you very much. 

HI:How can I configure that a user has access to only a specific dataset?

HiThere are some bugs when doing contextualization in the fusion GUI. It should be possible to “select all” when i do a search query in the interactive engineering diagrams contextualization workflow. 

Hello!I tried to setup a simple cogex extractor, but get an error that is not letting me proceed following the course. Please help.SyntaxWarning: invalid escape sequence '\e' """csv_extractor_2/__main__.py:13: error: Argument "run_handle" to "Extractor" hasincompatible type"Callable[[CogniteClient, AbstractStateStore, Config, Event], None]"; expected"Callable[[CogniteClient, AbstractStateStore, Config, CancellationToken], None] | None" [arg-type] run_handle=run_extractor, ^~~~~~~~~~~~~Found 1 error in 1 file (checked 4 source files)