Community Discussions

Hi ,  I’m trying to deploy an Azure function on Azure function app. But when I Included Cognite related libraries which I need to read and write data to Cognite data model. It was not working  even though I mentioned to include cognite in requirments.txt still not working. Has anybody else faced same issue ? Have you use azure function to connect to cognite (not the cognite functions)/

Hello I noticed that data type for table import thru CSV file is by default as string, how can I change it to other data type like boolean, array and etc?  Regards

We are using the online version of the Jupyter notebook from CDF portal for a client project - DEV and able to get the clientconfig/ client object and create and retrieve assets, run transformations, create datasets etc. Client IT team has created an app and registered in Azure and also shared the tenant ID, Client ID / name and secrets as well. When we use these parameters shared for this app and run the same code locally in a notebook, it is not able to perform certain tasks (such as data set creation etc.). Basically, the online version has all the IAM groups as {data engineer, data scientist Data Analyst, OIDC-Admin.}But when we set the configuration parameters client-ID, Tenant and secrets etc., we don't get the groups entirely as above but only comes as “Data Integration”.  This “Data-integration” has limited scope and doesn't allow to create datasets etc.  So how do we understand this part of roles and access management in CDF construct and applications registered in Azure AD? 

I have a time series data identified with TAGS and that can contain around 1500 to 5000+ records generated per day. I would have to perform a time weighted average and calculate the time-weighted value for the time-series data for the given times. How do I proceed to recreate the computation in Cognite since I got the PI data already sitting within CDF. Basically, got to recreate this function of OSI PI inside CDFPIAdvCalcDat(tagname, stime, etime, interval, mode, calcbasis, minpctgood, cfactor, outcode, PIServer) 

Hi team, In Hess team came up with one request from Documentum Extractor, please refer below context for the request. Currently we have Cognite connected to Documentum via the raw folder, which pulls in the raw file format from EDMS. We actually need to connect to Documentum's rendition folder where the PDF versions of all the files are saved. Cognite can only effectively contextualize PDF's, so we need to connect to the render folder directly. We contacted the documentum team, however they've said that only people on the Documentum team can connect to that folder. We just need the Cognite extractor to have access to that Rendition repository. Please let me know if you need more information. project - hess-dev, hess-us

I have a lot of timeseries objects in CDF datasets. I have a particular set of timeseries tags out of the innumerable list of timeseries objects (16 of them) and for each tag, there are a bunch of sub-tags (4 of them). So, in total, I will need to maintain a hierarchy of 16 tags and each having 4 tags and the overall total of 64 tags. I need to go and retrieve the datapoints for each of those 64 tags. So how do I store my desired list of timeseries tags along with their child tags within CDF. Where do I store them and maintain them. This list may be edited and needs flexibility to be edited based on business users need. IT is completely the enterprise choice.  Please share complete steps simulate them in CDF. This is actually to be done for yield-tracking analytics and all these tags corresponding to the yield groups/products in a refinery.  

I have csv files with asset information, asset hierarchy, time series objects and timeseries datapoints. I would like to load these to CDF and link to a dataset. Could someone walk me through this or refer me to some help files? 

i need support for the course Python SDK Transformations.Im running the comands from notebook that was given in git and a stoped on:result = client.transformations.run(asset_transformation.id, wait=False)The error resulted is :CogniteAPIError: Invalid source/destination credentials: Could not authenticate with the OIDC credentials. Please check your credentials. | code: 403 | X-Request-ID: 78e0e54a-a3ca-9bc4-b2f5-e303ed6a7207iv checked the authentication process and i can perform all task like search list add datasets assets and everything but i cant run the transformation.Any one knows how to solve it ?i have the same problen in the UI  

I have many thousand timeseries where I need to find the date of the first datapoints in each series. For each timeseries, I have no idea if the first datapoint is from this year, or from 20 years ago. Fetching data for several decades is not effective.  Any ideas how to get the first datapoint? Getting the last datapoint would also be great.  Thanks!

Executing transform from Raw/Staging to Dataset Events. Codeselect cast(`uniqueid` as BIGINT) as id, cast(`Start Time` as TIMESTAMP) as startTime, cast(`End Time` as TIMESTAMP) as endTime, 1626362640169782 as dataSetId, concat("Chem-Batch", "-", Unit, "-", `Batch ID`) as description, 'Process' as type, 'Batch' as subtype from `Chem-Batch`.`Batch-Unit`where `Start Time` > '2023-06-13'Preview shows expected 3 row results: Run yields this error:Request with id 90f5d941-7f0e-9553-9ca5-317d784434d1 to https://az-eastus-1.cognitedata.com/api/v1/projects/ra-istc-sandbox/events/update failed with status 400: Event id not found. Missing ids: [48, 49].It seems all columns data in Raw rows has appropriate data.Any ideas are welcome.Chris  

Hello Community,we have a option scheduling in cognite functions to run those functions periodically. But is there any way to trigger Cognite function when a particular event occur.thank you

A few quick questions to help with a potential client engagement focusing on generating insights from unstructured docs in file systems:Can we go beyond the 1MB limit to allow OCR, index and search of any free text within the documents. Is this configurable?   LLM/NLP Search: What level of fuzzy or NLP searches are supported on the indexed content of a document. For example could one search for a phrase that isn’t verbatim in the file, but close enough in meaning or spread out within a couple of places within the document.   Automation: I understand we can auto-extract file/folder names and even text from the initial portion of a document to create metadata. Can this metadata be used in an automated entity matching service to automatically relate (contextualize) a new document to the parent field, well, facility etc. Can the same automation work by purely relying on the text within the OCRed document to avoid the human having to categorize into folders and ensuring naming standards f

Hi all - I’m new to CDF.I’d like to call CDF from JavaScript running in a browser using a bearer token as authentication.This request works fine when made from a tool such as Postman, but when the same call is made from JavaScript running in a browser using the same URL and bearer token, the browser’s CORS policy blocks the request because CDF has not responded to the preflight OPTIONS request with the HTTP header Access-Control-Allow-Credentials: trueApart from this, CDF is correctly sending out all the other HTTP headers needed to satisfy the browser’s CORS policy such asAccess-Control-Allow-HeadersAccess-Control-Allow-MethodsAccess-Control-Allow-OriginAccess-Control-Expose-HeadersAccess-Control-Max-AgeWhere do I configure CDF to respond with this additional HTTP header?Thanks  

I have to build two 2 types of extractors.1. PI extractor to connect to the PI server and fetch the data and ingest into CDF2. SharePoint online - Extract data from files present in SharePoint online and ingest into CDF. I wanted to know the construct in building the extractors. Mainly wanted to account for scenarios where the PI server is not available and PI extractor is unable to fetch the data from the pipeline. How to handle these kinds of situations and incorporate them in the code while building the extractor. Also, how to handle monitoring while performing extractor. Are there some sample code repos that can be referenced for getting complete idea for building extractors.    

Is it possible to gain access to the Github repo for the InDSL? I will use Charts in my work, and would like to be able to contribute to the development.

We have a unique use case where there are data points collected from PI server for refinery plant and alongside, we have other refinery data like Crude assays, Diet, Mass Balance. All these data points (in tabular format) are collected and then some formula is applied across to get properties (like swing cut %, CBLISS, Vol%, etc.) and some derived tables are created. Then some input feed is made from the actual data sent to a Petro-Sim tool (math simulation tool/modeling) and then output from that tool is collected and stored. All these data wrangling is done and finally charts are finally made for some 50+ crude product variants to measure yield tracking (Actual data, non-linear model data, linear model data). As per design, we are planning to use the CDF raw tables and then do all the computations and create derived raw tables to fulfil the purpose. Then use Petro-Sim connector and then store the data output from the model tool as well in raw tables. So, we don't tend to see the typi

Do we have any api in cognite which will help to show preview data of transformations?

I am currently working through “Learn to Use the Cognite Python SDK”. I am unsure where the workspace/code is provided so that I am able to take the final the test and succeed in this course. I was originally using a colab research google file that includes prompts. But the questions on the final test did not corelate with this file. Can you please instruct me on how I find the correct files/workspace.  Thank you in advance. 

Hi all, I ran into an error when running a transform: instances failed with status 400: Request had 37 constraint violations. Please fix the request and try again. [properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 a

Hello May I know if inventor 3D model is supported in CDF? 

I noticed that calling a pre-existing Cognite Function requires the functionsAcl:WRITE capability. Essentially this means that I cannot make a function available to users/dashboards/applications without simultaneously giving them permission to delete functions. What is the reccommended pattern for ACL when making Cognite Functions that are to be called by others?https://docs.cognite.com/api/v1/#tag/Function-calls

Hi, I am observing below error(in bold) in extractor log for timeseries query: 2023-01-24 03:31:03.345 UTC [INFO    ] QueryExecutor_0 - Starting extraction of avocet-timeseries2023-01-24 03:31:03.345 UTC [DEBUG   ] QueryExecutor_0 - Query: 'SELECT ITEM_ID + PROPERTY_TYPE+'Avocet' as "externalId", START_DATETIME as timestamp, PROPERTY_VALUE as value FROM ITEM_PROPERTY1 WHERE START_DATETIME is not null and PROPERTY_VALUE is not null and LAST_UPDT_DATE is not null ORDER BY LAST_UPDT_DATE ASC'2023-01-24 03:31:03.612 UTC [INFO    ] QueryExecutor_0 - No more rows for avocet-timeseries. 2 rows extracted in 0.267 seconds2023-01-24 03:31:03.873 UTC [DEBUG   ] ThreadPoolExecutor-9_0 - https://westeurope-1.cognitedata.com:443 "POST /api/v1/projects/slb-pdf/timeseries/data HTTP/1.1" 200 222023-01-24 03:31:03.875 UTC [DEBUG   ] ThreadPoolExecutor-9_0 - HTTP/1.1 POST https://westeurope-1.cognitedata.com/api/v1/projects/slb-pdf/timeseries/data 2002023-01-24 03:31:03.877 UTC [INFO    ] QueryExecutor_0

hello Community,While logging into cognite infield, there is a option to sign in with project name.so that project name is the project created in CDF?in documentation, we can see Infield runs on CDF, Which means CDF project is only way to get data into infield? or any other ways we can get data into infield?is there way to access infield from python sdk?Thank you

We multiple are seeing 408 response code from graphql query api. There are multiple combinations of filters which are not working. For eg the below one returns 408, i think the problem is with the array length of filter entity.entityName. If the array length is 2 it works else it is not working.query MyQuery {          listTimeSeriesRef(filter:{and:[{entity:{entityType:{in:["NAVIGATOR","SCREEN_CFG_REF"]}}},{property:{in:["TUBING_TEMP"]}},{entity:{entityName:{in:["Process.ReAllocation","Analysis Point by Desks","Downtime.GroupDowntime.DateTime.Subsystem"]}}}]}) {            edges {              node {                property        entity{        lastUpdated        entityType        entityName        }              }            }          }        }

HI All, I am looking to help in order to display timeseries and events co-relation in Power BI. I want to show when the event occurred in timeseries chart on specific event time.Any inputs would be appreciated! Regards,Arati