Product User Community

Hei Dear CDF usersAre you a user using charts for data science purposes / tasks or an active user of python code / jupyter notebooks ? We would love to talk to you as @Lars Moastuen would like to better understand your needs and current workflows. The team is currently working on a jupyter notebooks integration with charts and would like to better understand the needs there. Please feel to comment in the thread below if you are an user using charts for these purposes.

Greetings,I would like to get a view of which files uploaded to CDF through extractors have not been completely uploaded and only partially uploaded.In order to do this, I wanted to write a python script that compares the files sizes in the RAW metadata tables with the actual file sizes in CDF. The question is, is there a way to retrieve file size directly of a file in CDF through python SDK without having to download the files locally?Thanks in advance

As of today I think the Python SDK is only accessible via pip. While I can install a pip package into a conda environment, I don’t really like this solution. Are you planning on releasing a conda package for the Python SDK?

Hi, I'm Iñaki and I've been in the digital industry for more than a decade learning and helping customers in their Digital Transformation journey.For industries like Oil and Gas and Manufacturing it feels like I’m embarking on an adventure with every customer having its own unique complexities. But it's the constant mix of challenges, opportunities and excitement that keeps us all on our toes and motivates me. These industries are all about growth and staying in the game, and they know that embracing the digital era is the real deal.Over at Cognite, we're all about guiding organizations through this wild digital journey. Our expertise? Well, it's a combo of what we've learned from our customers and our deep dive into industry best practices. It’s like putting together a puzzle when it comes to integrating all kinds of data into these massive data lakes. Is it complicated? Yes, but it’s worth it.To really unlock the full potential of digital transformation, industries need to dig deep t

Hello CDF developers and users,Following feedback about the best practice examples provided in the documentation for how to use Parallel Retrieval / Partitions, Cognite has updated its documentation to make more explicit the limits in place for how many partitions that can be used in a request.  The document now makes explicit that a maximum of 10 partitions is supported.This guidance is found in the Pagination section of the Developer GuideIn conjunction with the updated guidance, limit enforcement will be put in place on the Assets, Events and Files APIs, to ensure predictability of performance with these APIs, effective from 1st February 2023.  Requests calling for more than 10 partitions will return a HTTP 422 ‘Unprocessable_Entity’ error message.  Similar limits will be rolled out across all CDF backend APIs, and details of these limits will be provided in their respective resource type descriptions.For any existing client applications that are calling more than 10 partitions, the

When I upload a file into Classic data model, how do I associate that file object to Flexible Data Model (FDM) object and retrieve the file object data using Graph API from FDM.   

I am looking for information related to 3d models. I would like to explore does reveal/cognite supports programmatic change of animation on 3d models which are uploaded to cdf. What i am looking for is, i have 3d model of pump and would like to change the animation speed depending on the speed i get from my api (basically real time speed which i get from my api). Does it possible ? If so could you guide me to example code to how to do that. Also the uploaded 3d model in cdf is not displaying like how the original model that was uploaded. After uploading into cdf its not displaying with colors and animations, could you tell me why it is like that ? Thanks 

Hello! Was looking around and cleaning some data, and came upon the realization that I can’t find out of you can access Cognite resources that are not contained in a dataset. That is, is there an ability to find/fetch/list Cognite resources that are “floating free”.I have tried setting  data_set_ids  And data_set_external_ids  To None, but this is the same as not having specified it. 

Hi, I’m trying to add more fields to Dataset’s property, and would like to display them on the UI. Beside the existing fields (Labels, Owners, external ID, etc...), is it possible to display custom fields on the UI ( similar to metadata’s consoleLabels, consoleOwners). A good example would be how metadata displayed in details of file.

Looking at API documentationhttps://pr-411.docs.preview.cogniteapp.com/api/v1/it seems one can not build an automated pipeline to create and update 3D model only using python SDKs?I aim to make a pipeline using cognite function and python sdk for nightly update reading files from SharePoint and upload or update 3d models in cdf.If its possible, where I can find the guiding document?

I have provided the essential credentials within the config.yml file in the OpcUaExtractor config folder, however when run it get this error. How can I fix this?

Hello Team,I am working on creating POC on PROSPER Connector I checked documentation of Cognite Prosper Connector. Connector is provided by Cognite, but where can I get simulator for POC purpose?Also in connector configuration, where to provide simulator details or simulator name?  

If there are large number of instances in a view, wont that load in the fusion UI? Can’t this be fixed with trimming with some max limit and still display?  

Hi team, I’m working on OPC UA Extractor. I have configured metadata-targets and configured metadata-mapping.I’m not able to see the metadata along with timeseries data.Please find the configuration in attachment and screen shot in CDF how timeseries data looks like. please let me know if any additional configurations need to be done to see the metadata along with timeseries data. 

Hello, is it possible to test the  CogniteAuthError using monkeypatch context manager  ?Regards ,Hakim Arezki 

Does CDF support the direct ingestion of timeseries with non-numeric values ( enums).  If the workaround is to convert enums to integers to ingest, this is unnecessary overhead and a limitation. Also have to remember to convert the values back for visualization. 

I want to create a new time series in CDF based on a calculation on another time series. This can be done by saving the calculation in a schedule. But I would like to run a calculation on the full input signal (which may span multiple years back in time), but it seems like the scheduling limit is 30 days (can anyone verify?). Is it possible to run a single calculation in Charts (spanning the entire period) and save the result to a Time Series object without going by a schedule? Or do I need to use the Python SDK for this purpose?Thanks in advance!Vetle.

I am trying to create a time series subscription and  receiving the error below:"Must have access to WRITE time series subscription.My question is, if the subscription is a listener, why does it need WRITE access?  

Ensuring the security of PI credentials is critical in the Cognite PI extractor.In the context of Azure Vault, the requirement involves implementing robust measures to safeguard PI access credentials. This entails storing sensitive information, such as usernames and passwords, securely in Azure Vault. The system should be configured to read these credentials from the vault when needed, providing a secure and centralized method for managing and accessing PI authentication details. This approach enhances overall data security by minimizing the exposure of sensitive information and adhering to best practices for credential management in cloud environments. we have implemented in other custom extractors. can you share the documentation to implement in Cognite PI extractor

I'm trying to use a graphql query in my python notebook. And I'm using this code snippet given in the sdk docs. from cognite.client import CogniteClient>>> c = CogniteClient()>>> res = c.data_modeling.graphql.query(... id=("mySpace", "myDataModel", "v1"),... query="listThings { items { thingProperty } }",... ) I dont see data_modeling.graphql.query() method available. I see the below error message. AttributeError: 'DataModelingGraphQLAPI' object has no attribute 'query' I'm using sdk version 7.5.1. How do I run my grapghql query?

Are the calculations provided in Charts (originating from `indsl` python library) available for all CDF projects? I’m wondering if it’s possible to contribute with new calculations to Charts that are written in `indsl` but only deployed to the specific CDF project you’re working on (i.e., not accessible for people outside this project)?I want to write new calculations using indsl that SMEs in my team can use in Charts for specific time series analysis, but I think it would be best to keep them isolated within our CDF project to not “overflow” the global Charts with potentially lots of new calculations that may mostly be relevant for my team/company.Any response is appreciated, thanks :)

In Charts you can import your own calculations, but I can’t find any documentation regarding requirements to this end. It seems like the required format is a JSON file, but how should this JSON be set up. If anyone has any examples of imported calculations, sharing them would be very much appreciated.Thank you.

I am trying to configure an OpcUA extractor to push a NodeSet2.xml file to CDF. I have it basically setup and if I run it, there are no obvious errors, but I don’t see any kinds of assets being imported.  Am I expecting too much? Is the functionality in place to import an OpcUA Nodeset as Assets into my CDF project. If anyone has this working I would really appreciate a copy of the config file you are usingThanksAdrian

Hi! We’re aiming to monitor all of our CDF operations in the solution we have for monitoring other systems and data flows (Splunk). This would involve monitoring of extractors/extraction pipelines, cognite functions, and general platform availability. I wonder if any other Cognite customers have done this, and if you would be willing to share your experience / architecture for extracting logs from cognite functions etc. into Splunk or a similar service? Cheers,Kristian 

I am trying to create a synthetic time series query that looks are two other time series and if those values meet a certain condition, is outputs a 1 or 0 as the synthetic time series but I keep getting a syntax error that I can’t solve. Below is a code sample. temp_id_list = [3308928194658464]flow_id_list = [1256034258207391, 3564715377369546]for temperature in temp_id_list:    temp_expression = f"TS{{id:{temperature}}} < 200"    flow_expression = " + ".join([f"(TS{{id:{flowrate}}})" for flowrate in flow_id_list])    final_expression = f"if({temp_expression} and {flow_expression} > 0, 1, 0)"    cv_query = client.time_series.data.synthetic.query(expressions=final_expression, start="1d-ago", end="now")