Product User Community

I am creating a transformation where I am joining data from two different views/containers, where table B has a node reference to table A. I have tried to find documentation for this, but I have not found any so far.  Through friends and trial and error I have found two options, and neither seems to be performing well. Example:Type A {    Name: String}Type B{   Name: String   A_ref: A}What I have found as possible solutions are to go through cdf_data_models and picking the externalId from the node-reference:from cdf_data models(<spc>, <mod>,<ver>, “A”) as A join cdf_… as B on A.external_id = B.A_ref.externalIdSame as above, but join on a as a nodereference: on B.A_ref = node_reference(<spc>, A)   Neither of these options seems to be documented anywhere, and I can’t find any other ways documented. The performance when reading when using these joins seems slow, even though I have set up a few indexes which should cover the different joins. This is also slower then

We are a bit unclear on the difference in meaning between the "Uploaded at" vs. "Last Updated"  times for Files in CDF.For example, we have seen un-intuitive examples where the "Uploaded at" time is newer than the "Last Updated" time - we would expect that would never be the case.Can you define the logic for these two fields, and update the documentation here? https://cognite-sdk-python.readthedocs-hosted.com/en/latest/files.html#module-cognite.client.data_classes.filesThank you.

Hello everyone, I’m facing a difficulty, and perhaps someone has already encountered this… I’m using the SDK to extract data using Python, but I’m having trouble finding the information I need. To access the data, I go to ‘Data Management,’ ‘Explore,’ ‘Data Models.’ I select a Data Model, click on ‘Data Management,’ and on the left side of Data Management, I need data from three tables (which I believe are views) that appear below the Filter. When I try to use cognite_client.data_modeling.view.list(), I can’t select one of these specific views; I can only filter parts of them, not the entire view. Does anyone have any guidance or tips on how to select the entire ‘table’ that appears in Data Management?

Hi Team, I work with Celanese and we are trying to work on creating Power BI dashboards for streaming Data (Timeseries).  I am following below solution for doing the same. Streaming data from Cognite Data Fusion to Power BI [Cognite Official]I am facing same “timeout” error while creating Subscriptions. I am using below code. my_filter = f.Prefix(    property=p.external_id,    value="EVE")sub = DataPointSubscriptionCreate(    external_id="powerbi-subscription-test",    name="PowerBI Subscription Test",    description="Subscription for PowerBI",    partition_count=1,    filter=my_filter)client.time_series.subscriptions.create(sub)

 I am simplifying my query.How can I upload a Python library that I have modified to support a function I am deploying to CDF?********************************************************************************** I am receiving the below error when executing a function I have created in cdf.  If I am understanding the error correctly the suod library is attempting to write to a read-only directory.  I have not found the suod library to allow for setting an alternate path.   I did locate the dump command in the cost_predictor.py file, in which I placed commands to write in the /tmp directory.  However, I could use some guidance on how to get the altered suod library loaded into cdf with my function?  I have attached both the original and updated cost_predictor.py files with code to redirect the dump to the system temp directory and would appreciate any guidance on whether I am on the right path here or not.  Thanks in advance! Error text:2024-05-16 04:15 Function started2024-05-16 04:15 : T

How does Cognite handle data encryption at rest? Is there any documentation available regarding this requirement? Additionally, concerning data encryption in transit, are there alternative approaches to TLS or MTLS?

Hi! We are developing a monitoring solution that depend on deployed Cognite Functions running our Python backend. What is the exact environment for a Cognite Function? How is the container configured? We would like to test our backend code in a runtime environment as close as possible to the deployed environment. Currently we build a docker image and execute our tests within the image based on “FROM python:3.11-slim”, and install all our dependencies here. How can we configure the environment to be as similar as possible to a Cognite Function? Is there a publicly available image we can base our container on that would ensure a more similar environment? Or is our current method “good enough”? All help appreciated!Anders

HI:How can I configure that a user has access to only a specific dataset?

HiThere are some bugs when doing contextualization in the fusion GUI. It should be possible to “select all” when i do a search query in the interactive engineering diagrams contextualization workflow. 

Hello!I tried to setup a simple cogex extractor, but get an error that is not letting me proceed following the course. Please help.SyntaxWarning: invalid escape sequence '\e' """csv_extractor_2/__main__.py:13: error: Argument "run_handle" to "Extractor" hasincompatible type"Callable[[CogniteClient, AbstractStateStore, Config, Event], None]"; expected"Callable[[CogniteClient, AbstractStateStore, Config, CancellationToken], None] | None" [arg-type] run_handle=run_extractor, ^~~~~~~~~~~~~Found 1 error in 1 file (checked 4 source files) 

I'm experiencing significant delays while using the menu bar on Cognite Notebooks. Specifically, when I try to reopen menus like "File," "Edit," and "View," they take an unusually long time to respond. Additionally, I have a folder named "Notebooks" with several subfolders, and it takes a long time for all the subfolders to display when I try to access them.Has anyone else encountered similar issues? Is there any way to solve these problems?Thanks!

Display events in Cognite Charts which does not have End time.Presently Events does not have End time will not display in Cognite Charts if user try to customize Timeseries for specific duration.Not showing the failures linked to the asset in Charts CDF view, not consistent with the linked failures in Data Explorer. Login to CDF UI Navigate to Data Explorer screen. Click on the Charts tab in menu bar Click on New Chart button. Search Time series name for e.g: FQI02005_M.TOTALIZERA.PV Click on the Time series button below the search field Select the check box of the time series FQI02005_M.TOTALIZERA.PV Click on the Events button on right side of the penal Click on Add Filter button Select the Asset ‘02-V-0203’ from Asset filter. Check Events under the Types filter. Expected Results: User should be able to see & select Events like ‘Failure’, Workorder', ‘MTBE’ etc events for Asset id 02-V-0203Actual Results: Alarm & Failure events not listed under types filter

Create assignment list of Assignees with Discipline Area while assigning checklist to user.

Doing the ‘hands-on’ for Data Engineer Basics - “Learn to Use the Cognite Python SDK “ Course."I am down to adding events to CDF from  events.csv.I noted that the dataframe df has some entries :NaN” wherever the csv has a blank.Then,However, creating events in CDF fails:the error is: Next, I replace all the csv blank entries with text “blank”, and read into a dataframe. Now the latter does not have any “NaN” values. This throws the same exception when creating events in CDF.If someone can kindly assist, I would be very grateful.Thank you,Doug   

Hi All.I want to deploy multiple PI Extractors on a VM with different configurations and the possibility to start and stop them separately. How can I achieve that? Or do I need to have multiple VMs? Thanks a lot in advance!

How can you with the opc-ua extractor read from the server only some specific tags with some parameter in the YML configuration file?So far with this extractor all tags are sent to CDF.

On behalf of Celanese, I’d like to understand if adding more than one Security Category to a single file or timeseries is supported by the CDF platform and APIs. Also, can it be confirmed that if a certain file is under two categories, only users that are capable of seeing both categories will be able to see it? Thanks!

Is there a way to query metadata of TimeSeries from a particular dataset in CDF Transformations?Something like this, but this query isn’t workingselect  cast(`externalId` as STRING) as externalId,  cast(`dataSetId` as STRING) as eidfrom  `_cdf`.`timeseries`where dataSetId == <data_set_id>;

HiFor a use case I am working on I need to retrieve information about the raw tables in our environment. What I need to do is that i need to retrieve the name of each of the  columns and the datatypes of the columns for every single raw table we have in our environment. I have looked through the python SDK docs, but have not been able to find out how to do this. I noticed that it is possible to do a preview of a transformation through the SDK and get a schema out this way, however this feels a bit too “hacky” and is also very time consuming and inefficient. Does anyone have any idea of how I can get what I need?ThanksSebastian

Here are some issues we are facing with TimeSeriesUploadQueue after migrating to lastest version :Unable to upload rows, though it says it has been uploaded in latest versionIt says uploader uploaded x datapoints even though it doesnt (checked in ui and through api) , and uploaded rows is None even though there are datapoints to upload. Same code works fine in version 6.This is our post upload function: Wrong date range is uploaded in version 7.  (happens on a random basis)The target timeseries didnt exist before we run the extractor. The date range we were trying to upload in the first batch is October 25, 2022 11:38:38.553 PM - December 27, 2022 11:03:47.055 AM and in the second batch is December 27, 2022 7:03:47.055 PM to  January 1, 2023 11:03:47.055 AM( all GMT times)Both batch's upload failed according to sdk (error during callback, rows is NoneType), but somehow 50 datapoints in a completely different date range is written as observed through cognite ui and through sdkWe also fa

(Please forgive the erroneous posting of this under Academy Discussions)Doing the ‘hands-on’ for Data Engineer Basics - “Learn to Use the Cognite Python SDK “ Course."I have done the following:Make a dataframe from reading from a csv file: One of the columns in the csv file is ‘region’. The 5 different values in the region column are  When the above code is run, the  following appears on the screen: Q1. Does this mean pandas has interpreted the region “None” as “nan”? If so that would explain why the following code throws “ValueError: Out of range float values are not JSON compliant. Make sure your data does not contain NaN(s) or +/- Inf!”  I would value your guidance as I have not worked with pandas() much at all.Thank you,Doug  pandas  

Hi all,I'm trying to increment my view version.To do this, I'm also incrementing my data model version as well.My original is```type Test @view(space: "test_space", version: "1_0"){    name: String!,    description: String,}```and I try to go to```type Test @view(space: "test_space", version: "1_1"){    name: String!,    description: String,    test_write: String}```I've also tried ```type Test @view(space: "test_space", version: "1_2"){    name: String!,    description: String,    test_write: String,    required_test_write: String!}```I get this error: {  "title": "Error: could not update data model",  "message": "An error has occured. Data model was not published.",  "extra": {    "type": "div",    "key": "errors",    "ref": null,    "props": {      "style": {        "display": "block",        "overflowX": "hidden",        "overflowY": "auto",        "maxHeight": "150px"      },      "children": {        "type": "ul",        "key": null,        "ref": null,        "props": {         

Hey everyone ! Welcome back to our data modeling adventure in CDF! In my first post, I tried to explain my understanding of the core concepts - spaces, containers, views, and the elusive knowledge graph. We learned how data models act as the foundation for unlocking the power of Cognite Data Fusion for your industrial data.This time, let's delve deeper into the world of views and containers - the essential ingredients that bring your data models to life! Beyond the Fundamentals: Unveiling Views and ContainersThink of a data model as a recipe. It doesn't contain the actual ingredients (data) itself, but it tells you exactly what pre-made dishes (views) and fresh ingredients (containers) to use. Views: The Pre-Assembled Data: Imagine views as pre-prepared dishes – Views are essentially pre-defined data selections curated from specific containers. These containers hold the raw data (think sensor readings or equipment properties). A single view, akin to a pre-made sauce, can be referenced

I am facing this error in the data science course on “creating cognite functions” with cognite SDK. In previous courses I had fixed this error by replacing the “datapoints” keyword with “time_series”. However, I would like to know if I am probably not using the write packages; OR not know if the commands are deprecated and have new function names in newer versions. Kindly let me know - I am trying to finish these courses before my local boot camp next week.Thanks,Lavanya