Solved

Hi,In the documentation it is mentioned that 10,000 timeseries is the limit in each subscription. Is this the hard limit or it can be changed based on use cases? We are using CDF workflow and in that our first function to read data points subscriptions to get the timeseries and datapoints. Based on our use cases, 10,000 number for timeseries in subscription is too small. We are considering 10,000 wellbores and 200 properties. (10,000 * 200 = 2 Million timeseries).  Any recommendations?     

I am creating a transformation where I am joining data from two different views/containers, where table B has a node reference to table A. I have tried to find documentation for this, but I have not found any so far.  Through friends and trial and error I have found two options, and neither seems to be performing well. Example:Type A {    Name: String}Type B{   Name: String   A_ref: A}What I have found as possible solutions are to go through cdf_data_models and picking the externalId from the node-reference:from cdf_data models(<spc>, <mod>,<ver>, “A”) as A join cdf_… as B on A.external_id = B.A_ref.externalIdSame as above, but join on a as a nodereference: on B.A_ref = node_reference(<spc>, A)   Neither of these options seems to be documented anywhere, and I can’t find any other ways documented. The performance when reading when using these joins seems slow, even though I have set up a few indexes which should cover the different joins. This is also slower then

We are a bit unclear on the difference in meaning between the "Uploaded at" vs. "Last Updated"  times for Files in CDF.For example, we have seen un-intuitive examples where the "Uploaded at" time is newer than the "Last Updated" time - we would expect that would never be the case.Can you define the logic for these two fields, and update the documentation here? https://cognite-sdk-python.readthedocs-hosted.com/en/latest/files.html#module-cognite.client.data_classes.filesThank you.

Hello everyone, I’m facing a difficulty, and perhaps someone has already encountered this… I’m using the SDK to extract data using Python, but I’m having trouble finding the information I need. To access the data, I go to ‘Data Management,’ ‘Explore,’ ‘Data Models.’ I select a Data Model, click on ‘Data Management,’ and on the left side of Data Management, I need data from three tables (which I believe are views) that appear below the Filter. When I try to use cognite_client.data_modeling.view.list(), I can’t select one of these specific views; I can only filter parts of them, not the entire view. Does anyone have any guidance or tips on how to select the entire ‘table’ that appears in Data Management?

Hi Team, I work with Celanese and we are trying to work on creating Power BI dashboards for streaming Data (Timeseries).  I am following below solution for doing the same. Streaming data from Cognite Data Fusion to Power BI [Cognite Official]I am facing same “timeout” error while creating Subscriptions. I am using below code. my_filter = f.Prefix(    property=p.external_id,    value="EVE")sub = DataPointSubscriptionCreate(    external_id="powerbi-subscription-test",    name="PowerBI Subscription Test",    description="Subscription for PowerBI",    partition_count=1,    filter=my_filter)client.time_series.subscriptions.create(sub)

 I am simplifying my query.How can I upload a Python library that I have modified to support a function I am deploying to CDF?********************************************************************************** I am receiving the below error when executing a function I have created in cdf.  If I am understanding the error correctly the suod library is attempting to write to a read-only directory.  I have not found the suod library to allow for setting an alternate path.   I did locate the dump command in the cost_predictor.py file, in which I placed commands to write in the /tmp directory.  However, I could use some guidance on how to get the altered suod library loaded into cdf with my function?  I have attached both the original and updated cost_predictor.py files with code to redirect the dump to the system temp directory and would appreciate any guidance on whether I am on the right path here or not.  Thanks in advance! Error text:2024-05-16 04:15 Function started2024-05-16 04:15 : T

I am unable to use indsl library here in Streamlit.Getting the below error when I include “indsl” in Installed Packages list. Can someone suggest a workaround? Error during booting upTraceback (most recent call last): File "/lib/python3.11/site-packages/micropip/_commands/install.py", line 146, in install raise ValueError(ValueError: Can't find a pure Python 3 wheel for: 'pandas<2.3.0,>=2.2.0'See: https://pyodide.org/en/stable/usage/faq.html#why-can-t-micropip-find-a-pure-python-wheel-for-a-package 

How does Cognite handle data encryption at rest? Is there any documentation available regarding this requirement? Additionally, concerning data encryption in transit, are there alternative approaches to TLS or MTLS?

When I look at event data, I mostly see***  ( i think this is like NULL or NaN - not filled)see some worktask, rule_broken. Condition, etc.I am new to open industrial data. Thinking of using it for a Thesis, etc. Is there a way to get the different event “types” - i tried scrolling, api is not working well for me. Any advice on this front would be greatly appreciated. Thank you very much. 

Hi, while connecting to Power Bi service via http://app.powerbi.com/ it doesn’t open and showing some organization doesn’t allow users like that. Can you please provide the solution for this ASAP to continue my learning journey. 

HI:How can I configure that a user has access to only a specific dataset?

HiThere are some bugs when doing contextualization in the fusion GUI. It should be possible to “select all” when i do a search query in the interactive engineering diagrams contextualization workflow. 

Hello!I tried to setup a simple cogex extractor, but get an error that is not letting me proceed following the course. Please help.SyntaxWarning: invalid escape sequence '\e' """csv_extractor_2/__main__.py:13: error: Argument "run_handle" to "Extractor" hasincompatible type"Callable[[CogniteClient, AbstractStateStore, Config, Event], None]"; expected"Callable[[CogniteClient, AbstractStateStore, Config, CancellationToken], None] | None" [arg-type] run_handle=run_extractor, ^~~~~~~~~~~~~Found 1 error in 1 file (checked 4 source files) 

I'm experiencing significant delays while using the menu bar on Cognite Notebooks. Specifically, when I try to reopen menus like "File," "Edit," and "View," they take an unusually long time to respond. Additionally, I have a folder named "Notebooks" with several subfolders, and it takes a long time for all the subfolders to display when I try to access them.Has anyone else encountered similar issues? Is there any way to solve these problems?Thanks!

Create assignment list of Assignees with Discipline Area while assigning checklist to user.

Hi, I am taking tha “Working With CDF: Contextualize” . On “Contextualize P&IDs” its asking me to upload a file through the explore data → files tab. However, it is not allowing me to do so. The option appears grey and I cant continue. Please advice how to proceed. Thanks, Sabrina Vivar

Doing the ‘hands-on’ for Data Engineer Basics - “Learn to Use the Cognite Python SDK “ Course."I am down to adding events to CDF from  events.csv.I noted that the dataframe df has some entries :NaN” wherever the csv has a blank.Then,However, creating events in CDF fails:the error is: Next, I replace all the csv blank entries with text “blank”, and read into a dataframe. Now the latter does not have any “NaN” values. This throws the same exception when creating events in CDF.If someone can kindly assist, I would be very grateful.Thank you,Doug   

Hi All.I want to deploy multiple PI Extractors on a VM with different configurations and the possibility to start and stop them separately. How can I achieve that? Or do I need to have multiple VMs? Thanks a lot in advance!

On behalf of Celanese, I’d like to understand if adding more than one Security Category to a single file or timeseries is supported by the CDF platform and APIs. Also, can it be confirmed that if a certain file is under two categories, only users that are capable of seeing both categories will be able to see it? Thanks!

Is there a way to query metadata of TimeSeries from a particular dataset in CDF Transformations?Something like this, but this query isn’t workingselect  cast(`externalId` as STRING) as externalId,  cast(`dataSetId` as STRING) as eidfrom  `_cdf`.`timeseries`where dataSetId == <data_set_id>;

HiFor a use case I am working on I need to retrieve information about the raw tables in our environment. What I need to do is that i need to retrieve the name of each of the  columns and the datatypes of the columns for every single raw table we have in our environment. I have looked through the python SDK docs, but have not been able to find out how to do this. I noticed that it is possible to do a preview of a transformation through the SDK and get a schema out this way, however this feels a bit too “hacky” and is also very time consuming and inefficient. Does anyone have any idea of how I can get what I need?ThanksSebastian

Here are some issues we are facing with TimeSeriesUploadQueue after migrating to lastest version :Unable to upload rows, though it says it has been uploaded in latest versionIt says uploader uploaded x datapoints even though it doesnt (checked in ui and through api) , and uploaded rows is None even though there are datapoints to upload. Same code works fine in version 6.This is our post upload function: Wrong date range is uploaded in version 7.  (happens on a random basis)The target timeseries didnt exist before we run the extractor. The date range we were trying to upload in the first batch is October 25, 2022 11:38:38.553 PM - December 27, 2022 11:03:47.055 AM and in the second batch is December 27, 2022 7:03:47.055 PM to  January 1, 2023 11:03:47.055 AM( all GMT times)Both batch's upload failed according to sdk (error during callback, rows is NoneType), but somehow 50 datapoints in a completely different date range is written as observed through cognite ui and through sdkWe also fa

(Please forgive the erroneous posting of this under Academy Discussions)Doing the ‘hands-on’ for Data Engineer Basics - “Learn to Use the Cognite Python SDK “ Course."I have done the following:Make a dataframe from reading from a csv file: One of the columns in the csv file is ‘region’. The 5 different values in the region column are  When the above code is run, the  following appears on the screen: Q1. Does this mean pandas has interpreted the region “None” as “nan”? If so that would explain why the following code throws “ValueError: Out of range float values are not JSON compliant. Make sure your data does not contain NaN(s) or +/- Inf!”  I would value your guidance as I have not worked with pandas() much at all.Thank you,Doug  pandas  

Hi Team,I am doing the Notebook 2 in Data Engineer Basics - Integrate course and getting this error, am I missing something here? 

Hi,We are using graphql query to get data points in CDF function. As I understand we could retrieve 1,00000 data points at a time if we provide the limit. Here is the sample query:query MyQuery {  listProductionData(    filter: {externalId: {in: ["wellbore1"]}}  ) {    items {      space      data {        Oil {          1_day {            dataPoints(end: 2240591400000, limit: 100000, start: 1672338600000) {              value              timestamp            }          }        }      }    }  }}I tried above query and I can get all the daily datapoints present in the range from  2023-01-01 to 2040-12-31.  But when I tried below query : query MyQuery {  listProductionData(    filter: {externalId: {in: ["wellbore1"]}}  ) {    items {      space      data {        Oil {          1_day {            getDataPoints(start: 1672338600000, end: 2240591400000) {              items {                timestamp                value              }            }          }        }      }    }  }}we c