Solved

I am new to learning how to utilize Cognite Data Fusion. I apologize if this question has already been answered; if it has, please inform me!Currently, I plan to use Cognite to establish a connection with a digital twin and utilize the Python SDK to import and extract data using custom-built models. However, I have a question regarding connecting the SDK to a private project. In the case of Open Industrial Data, we were provided with a Tenant ID, Client ID, and Base_URL.Hence, I would like to inquire whether there are any specific steps or requirements to connect to a private access project using the Python SDK. I would greatly appreciate any assistance you can provide. Thank you!

Hi! I want to display the latest time when new data come in to a time-series and color it based on the following rule:-Latest value within 48 hours, shown latest time in green-Latest value more than 48 hours, shown latest time in red(With that rule, the numbers should be in green, green and red in my picture) I struggle to find the correct thresholds to make this 48 hours rule work. It seems to be related to unix time. Have thought about calculate the time difference between current time and latest updated time, but didn’t make it work in time series custom query. Any suggestion would be appreciated. :)

I have many thousand timeseries where I need to find the date of the first datapoints in each series. For each timeseries, I have no idea if the first datapoint is from this year, or from 20 years ago. Fetching data for several decades is not effective.  Any ideas how to get the first datapoint? Getting the last datapoint would also be great.  Thanks!

On Behalf of Charts super users at Clear Lake:I would like the ability to incorporate “If/Else” statements as a function in Charts similar to what is capable in Excel. There are some calculations that rely on certain conditional parameters to be met in order to define which mathematical approach must be taken.

hello Community,can anyone help me understand how to upload P&ID diagram files to CDF, Using Python SDK.

hello Community,Can someone please share the approach (along with code) for extracting files from sharepoint online (xls , with multiple worksheets) and extract the content and load them as RAW tables in CDF.  Is there a direct feature available in Sharepoint file extractor that does this job? Should we use SDK to extend the file extraction and then read the content and insert into tables?.  If we have a large set of files and each containing multiple sheets, it can be hard to process all of them dynamically.  Please advise.

Hello,I am quite new on usinf RestAPI. My company has the license to use CDF. I also inderstood that Cognite has developed dotNet RestApi SDK.I searched a bit but I could not find an example of how we can use this SDK for data retrieval especially for time-series data. How could I get a snippet of code showing an example how to use this?Thanks. 

I created a test data model in a test space. I finished testing and deleted the data model, but can not find a way to delete the space (which no longer contains any data models)?

hello community, can anyone tell me is there any way to upload .csv files to CDF using Python SDK.

How can I filter assets by their geolocation using the python SDK?from cognite.client.data_classes import GeoLocationFilter, GeometryFiltermygeofilter = GeoLocationFilter( relation="within", shape=GeometryFilter( type="Polygon", coordinates=[[[7, 61], [13, 61], [10, 55], [7, 61]]] ))client.assets.list(geo_location=mygeofilter)This approach works for files, but for assets I get:CogniteAPIError: Unexpected value 'within' | code: 400 | X-Request-ID: fd1c5a73-a3d3-9ec1-bd97-039b4b1e0051

Hi Team,I am facing one challenge in creating Asset hierarchy in Power BI. Format of data is not as per the required format for hierarchy creation i.e. i do not get parent-child relation in different columns. However i see all nodes appear in single column. I do have ParentID but unaware how this will help me to form hierarchy. Any inputs will be appreciated. Thanks!Regards,Arati

(RAW Table : As above which has total 179 columns #41 contains numeric data 138 contains text data)I have ingested data in raw table….now I want to get only data of  41 columns which has number data type ?how this can be done in the transformation?similar query I want to run for remained 138 columns which has “Text” data type?

How to unpivot any existing raw table?I want to transpose columns to rowshere I am aware about stack can be used, but i dont want to give hard coded columns names... how this can be done run time (Without passing any hardcoded value of column name in stack command?)How to get run time columns count & how this columns can be passed in stack? Table1:id p1 p2 p3 1 2.0 3.0 4.0 2 10.0 15.0 20.0 select id,   stack(3, 'p1', p1, 'p2', p2, 'p3', p3) as (property,value)from `db1`.`Table1`

Hi,In course "Cognite Data Fusion for Domain Experts", Chapter ‘Working with the data’, minute 3:33, shows adding a ‘Differentiation’ function to a calculation. Such block in the video has 2 options: Granularity and Frequency. However, conducting that in the current system version, such block only has ‘Frequency’.In the video the ‘Granularity’ option is modified, but because such option is no longer available, is not clear the implications.What is that ‘Granularity’ for? IS it the rolling window for the differentiation of the samples, or something else? If a Window, what type of ‘aggregation/Selection is done? What would be the equivalent way to define that option? Could you review the video and adjust it to the current options in the platform?Thanks

Executing transform from Raw/Staging to Dataset Events. Codeselect cast(`uniqueid` as BIGINT) as id, cast(`Start Time` as TIMESTAMP) as startTime, cast(`End Time` as TIMESTAMP) as endTime, 1626362640169782 as dataSetId, concat("Chem-Batch", "-", Unit, "-", `Batch ID`) as description, 'Process' as type, 'Batch' as subtype from `Chem-Batch`.`Batch-Unit`where `Start Time` > '2023-06-13'Preview shows expected 3 row results: Run yields this error:Request with id 90f5d941-7f0e-9553-9ca5-317d784434d1 to https://az-eastus-1.cognitedata.com/api/v1/projects/ra-istc-sandbox/events/update failed with status 400: Event id not found. Missing ids: [48, 49].It seems all columns data in Raw rows has appropriate data.Any ideas are welcome.Chris  

Hello Community,we have a option scheduling in cognite functions to run those functions periodically. But is there any way to trigger Cognite function when a particular event occur.thank you

A few quick questions to help with a potential client engagement focusing on generating insights from unstructured docs in file systems:Can we go beyond the 1MB limit to allow OCR, index and search of any free text within the documents. Is this configurable?   LLM/NLP Search: What level of fuzzy or NLP searches are supported on the indexed content of a document. For example could one search for a phrase that isn’t verbatim in the file, but close enough in meaning or spread out within a couple of places within the document.   Automation: I understand we can auto-extract file/folder names and even text from the initial portion of a document to create metadata. Can this metadata be used in an automated entity matching service to automatically relate (contextualize) a new document to the parent field, well, facility etc. Can the same automation work by purely relying on the text within the OCRed document to avoid the human having to categorize into folders and ensuring naming standards f

Hi all - I’m new to CDF.I’d like to call CDF from JavaScript running in a browser using a bearer token as authentication.This request works fine when made from a tool such as Postman, but when the same call is made from JavaScript running in a browser using the same URL and bearer token, the browser’s CORS policy blocks the request because CDF has not responded to the preflight OPTIONS request with the HTTP header Access-Control-Allow-Credentials: trueApart from this, CDF is correctly sending out all the other HTTP headers needed to satisfy the browser’s CORS policy such asAccess-Control-Allow-HeadersAccess-Control-Allow-MethodsAccess-Control-Allow-OriginAccess-Control-Expose-HeadersAccess-Control-Max-AgeWhere do I configure CDF to respond with this additional HTTP header?Thanks  

---------------------------------------------------------------------------NameError Traceback (most recent call last)Cell In[97], line 1----> 1 c.time_series.data.retrieve_dataframe(id=239507005016003, 2 end='1000w-ago', 3 aggregates=["average","sum"], 4 granularity="1h")File c:\Users\Sudil\OneDrive - Creative Technology Solutions (Pvt) Ltd\Desktop\DataEngBasics\using-cognite-python-sdk\.venv\lib\site-packages\cognite\client\_api\datapoints.py:975, in DatapointsAPI.retrieve_dataframe(self, id, external_id, start, end, aggregates, granularity, limit, include_outside_points, ignore_unknown_ids, uniform_index, include_aggregate_name, include_granularity_name, column_names) 973 fetcher = select_dps_fetch_strategy(self, user_query=query) 974 if not uniform_index:--> 975 return fetcher.fetch_all_datapoints_numpy().to_pandas( 976 column_names, include_aggregat

Hiwhile attempting to run SELECTworkpackage_desc AS description,to_timestamp(completion_time/1000) AS endTime,to_timestamp(start_time/1000) AS startTime,type,subtype,concat('FirstnameBirthyear:',key) AS externalId, 1234567890 AS dataSetId FROM IFSDB.maintenanceWHERE to_timestamp(completion_time/1000)>to_timestamp(start_time/1000) I get this error Verify that the 'IFSDB.maintenance' relation exists | code: 400 | X-Request-ID: 019f535a-a30f-9184-b3d3-966184e9d36b Note that:I substituted my Name and birthyear changed the dataset idMy assumption: sure I have a IFSDB.maintenance RAW (not sure if I skipped something in the lesson...)

I have to build two 2 types of extractors.1. PI extractor to connect to the PI server and fetch the data and ingest into CDF2. SharePoint online - Extract data from files present in SharePoint online and ingest into CDF. I wanted to know the construct in building the extractors. Mainly wanted to account for scenarios where the PI server is not available and PI extractor is unable to fetch the data from the pipeline. How to handle these kinds of situations and incorporate them in the code while building the extractor. Also, how to handle monitoring while performing extractor. Are there some sample code repos that can be referenced for getting complete idea for building extractors.    

Is it possible to gain access to the Github repo for the InDSL? I will use Charts in my work, and would like to be able to contribute to the development.

Hi Team,Does bootstrap-cli supports space creation? If yes, can I get sample config format for space creation.Also , we noticed that using bootstrap-cli, w can create groups related to rawDbs or datasets based on specified namespace and nodes. Is there a way we can create custom groups or granular groups which can be linked to spaces and not related to datasets or raw DBS? Thanks,Snehal.

We have a unique use case where there are data points collected from PI server for refinery plant and alongside, we have other refinery data like Crude assays, Diet, Mass Balance. All these data points (in tabular format) are collected and then some formula is applied across to get properties (like swing cut %, CBLISS, Vol%, etc.) and some derived tables are created. Then some input feed is made from the actual data sent to a Petro-Sim tool (math simulation tool/modeling) and then output from that tool is collected and stored. All these data wrangling is done and finally charts are finally made for some 50+ crude product variants to measure yield tracking (Actual data, non-linear model data, linear model data). As per design, we are planning to use the CDF raw tables and then do all the computations and create derived raw tables to fulfil the purpose. Then use Petro-Sim connector and then store the data output from the model tool as well in raw tables. So, we don't tend to see the typi

Do we have any api in cognite which will help to show preview data of transformations?