Product User Community

I have a lot of timeseries objects in CDF datasets. I have a particular set of timeseries tags out of the innumerable list of timeseries objects (16 of them) and for each tag, there are a bunch of sub-tags (4 of them). So, in total, I will need to maintain a hierarchy of 16 tags and each having 4 tags and the overall total of 64 tags. I need to go and retrieve the datapoints for each of those 64 tags. So how do I store my desired list of timeseries tags along with their child tags within CDF. Where do I store them and maintain them. This list may be edited and needs flexibility to be edited based on business users need. IT is completely the enterprise choice.  Please share complete steps simulate them in CDF. This is actually to be done for yield-tracking analytics and all these tags corresponding to the yield groups/products in a refinery.  

i need support for the course Python SDK Transformations.Im running the comands from notebook that was given in git and a stoped on:result = client.transformations.run(asset_transformation.id, wait=False)The error resulted is :CogniteAPIError: Invalid source/destination credentials: Could not authenticate with the OIDC credentials. Please check your credentials. | code: 403 | X-Request-ID: 78e0e54a-a3ca-9bc4-b2f5-e303ed6a7207iv checked the authentication process and i can perform all task like search list add datasets assets and everything but i cant run the transformation.Any one knows how to solve it ?i have the same problen in the UI  

I have many thousand timeseries where I need to find the date of the first datapoints in each series. For each timeseries, I have no idea if the first datapoint is from this year, or from 20 years ago. Fetching data for several decades is not effective.  Any ideas how to get the first datapoint? Getting the last datapoint would also be great.  Thanks!

Executing transform from Raw/Staging to Dataset Events. Codeselect cast(`uniqueid` as BIGINT) as id, cast(`Start Time` as TIMESTAMP) as startTime, cast(`End Time` as TIMESTAMP) as endTime, 1626362640169782 as dataSetId, concat("Chem-Batch", "-", Unit, "-", `Batch ID`) as description, 'Process' as type, 'Batch' as subtype from `Chem-Batch`.`Batch-Unit`where `Start Time` > '2023-06-13'Preview shows expected 3 row results: Run yields this error:Request with id 90f5d941-7f0e-9553-9ca5-317d784434d1 to https://az-eastus-1.cognitedata.com/api/v1/projects/ra-istc-sandbox/events/update failed with status 400: Event id not found. Missing ids: [48, 49].It seems all columns data in Raw rows has appropriate data.Any ideas are welcome.Chris  

Hello Community,we have a option scheduling in cognite functions to run those functions periodically. But is there any way to trigger Cognite function when a particular event occur.thank you

A few quick questions to help with a potential client engagement focusing on generating insights from unstructured docs in file systems:Can we go beyond the 1MB limit to allow OCR, index and search of any free text within the documents. Is this configurable?   LLM/NLP Search: What level of fuzzy or NLP searches are supported on the indexed content of a document. For example could one search for a phrase that isn’t verbatim in the file, but close enough in meaning or spread out within a couple of places within the document.   Automation: I understand we can auto-extract file/folder names and even text from the initial portion of a document to create metadata. Can this metadata be used in an automated entity matching service to automatically relate (contextualize) a new document to the parent field, well, facility etc. Can the same automation work by purely relying on the text within the OCRed document to avoid the human having to categorize into folders and ensuring naming standards f

Hi all - I’m new to CDF.I’d like to call CDF from JavaScript running in a browser using a bearer token as authentication.This request works fine when made from a tool such as Postman, but when the same call is made from JavaScript running in a browser using the same URL and bearer token, the browser’s CORS policy blocks the request because CDF has not responded to the preflight OPTIONS request with the HTTP header Access-Control-Allow-Credentials: trueApart from this, CDF is correctly sending out all the other HTTP headers needed to satisfy the browser’s CORS policy such asAccess-Control-Allow-HeadersAccess-Control-Allow-MethodsAccess-Control-Allow-OriginAccess-Control-Expose-HeadersAccess-Control-Max-AgeWhere do I configure CDF to respond with this additional HTTP header?Thanks  

 Below we have outlined several frequently asked questions and their corresponding answers.Don’t see the answer to your question? Post as a reply in this thread and we’ll be sure to answer and/or add it to the FAQ list below!Protip: Use [cmd+f] or [cntrl+f] to search for keywords related to your question. FAQs How do I access the documentation for monitoring in CDF?You can access the documentation for the new monitoring solution in CDF here: https://docs.cognite.com/cdf/charts/#monitoring.   Where do I go to access monitoring and how do I use it ?You can find the instructions by watching this short video here:   

Have a feature request or idea for a new and improved functionality?Then we’d love to hear all about it! We’re constantly working to improve the monitoring product experience.You can choose to either create a dedicated post (topic) in this group by clicking the Create topic button or simply post a reply below in this thread. Remember to say whether your feature request is Nice to have, Important, or Critical to you and why. Screenshots, sketches, or explanatory videos are also encouraged.

When creating Labels, the “external_id” and “name” fields are switched. I’ve previously reported this for C#. It turns out the error is also found in the Python SDK:Repro stepsReplicating the bug is trivial. Consider the following code in Python:label = LabelDefinition(external_id=”label_x”, name=”x”, data_set_id=DATASET_ID)client.labels.create(label)Use the label on an asset, and CDF will display “label_x” as the label name. The two fields are somehow swithced.Persistance or display issue?Ok, so is CDF just displaying the wrong field? It’s hard to tell due to other issues around labels, but consider this: As a fix, I chose to align the “external_id” and “name“ fields, landing on the something like this.:label = LabelDefinition(external_id=”x”, name=”x”, data_set_id=DATASET_ID)client.labels.create(label)Resulting in an errorCogniteDuplicatedError: Duplicated: [{'externalId': 'x'}]The API Failed to process some items.

Need to work on POC where cognite data fusion timeseries can be added as dataset/data source in Azure MLopsIs there any way if this is possible

 Industrial Canvas is the digital workspace for data-driven planning, collaborative data analysis, troubleshooting, support for root cause analysis, operational insights, work pack preparation and even collaborative maintenance planning. It gives industrial teams simple access to complex industrial data, in their language and on their terms. This first-of-its-kind experience for industry allows experts to go from cumbersome manual workflows to a visual, collaborative interface powered by contextualized data and artificial intelligence.With Industrial Canvas, Cognite Data Fusion provides a blank canvas for subject matter experts to creatively think, build, and work with industrial data from all sources. Here are a few examples of what you can solve in a canvas by working collaboratively across several data types: Pulling in all the relevant data when performing a root cause analysis on an anomaly such as loss of containment in a compressor.  I got a well failure, now I can extracted all

Simply ask your Cognite Representative to set it up for you and Industrial Canvas will appear in the Cognite Data Fusion menu.   

I have to build two 2 types of extractors.1. PI extractor to connect to the PI server and fetch the data and ingest into CDF2. SharePoint online - Extract data from files present in SharePoint online and ingest into CDF. I wanted to know the construct in building the extractors. Mainly wanted to account for scenarios where the PI server is not available and PI extractor is unable to fetch the data from the pipeline. How to handle these kinds of situations and incorporate them in the code while building the extractor. Also, how to handle monitoring while performing extractor. Are there some sample code repos that can be referenced for getting complete idea for building extractors.    

Is it possible to gain access to the Github repo for the InDSL? I will use Charts in my work, and would like to be able to contribute to the development.

We are happy to announce the release of our groundbreaking Industrial Canvas in Cognite Data Fusion where you can easily:Explore and access any type of data in one compostable environment. Work with several data types side-by-side and get all the context that you need for your data analysis.  Collaborate - annotate, share insights with seamless integration into no-code analytics (Charts). Working together, in the same canvas, with your fellow colleagues to solve problems and iterate. Create - work in a canvas like experience, get documents summarization, flexibility on how you are managing the space and find solutions based on data. By having a collaborative workspace, you can do visual data exploration to efficiently analyse a problem or understanding something about the physical asset and the data it is generating. You can perform data analysis, troubleshooting, support for root cause analysis, understand your asset health, do work packs preparation, support for maintenance planning

Dear Cognite Hub community: We are very happy to announce that our Cognite SAP Extractor is now generally available to CDF users!The extractor connects to OData V2.0 endpoints in the SAP NetWeaver Gateway, making use of many pre-built integrations available in S/4HANA and saving considerable implementation time, while also natively connecting to the SAP data you need in a standardised manner.To get started,  download the SAP Extractor from the “Extract Data” page directly from CDF. The documentation, including Server Requirements and how to set up your SAP extractor is available here.We have also prepared a short demo (less than 4 minutes long) showing the steps needed to setup a data extraction from SAP S/4HANA OnPremise to CDF from scratch, including how to find the standard service from SAP, enable it in S/4HANA, configure and run the extractor and then see the SAP data in CDF.   Any feedback is very welcome, after testing the extractor and/or watching the quick demo please make sur

Subscribe to webhookhttps://status.cognite.com reports the health of Cognite's services and products. You can sign up to get email and SMS notifications for status changes and upcoming maintenance for specific products and clusters. You can also subscribe to webhook notifications to integrate with your monitoring systems. You will receive notifications for all components and clusters and can filter the information to fit your needs. To subscribe to webhooks, select "Subscribe to updates" and then the webhook option (<>). Specify the URL we should send the webhooks to and provide an email address if your endpoint fails. The table below lists the product IDs you can use to filter the notifications. For details about the format of the notifications, see https://support.atlassian.com/statuspage/docs/enable-webhook-notifications/ . If you don't know which cluster your CDF project is on, contact Cognite Support or Customer Success. Cluster names and product IDsIf you're subscribing to

We have a unique use case where there are data points collected from PI server for refinery plant and alongside, we have other refinery data like Crude assays, Diet, Mass Balance. All these data points (in tabular format) are collected and then some formula is applied across to get properties (like swing cut %, CBLISS, Vol%, etc.) and some derived tables are created. Then some input feed is made from the actual data sent to a Petro-Sim tool (math simulation tool/modeling) and then output from that tool is collected and stored. All these data wrangling is done and finally charts are finally made for some 50+ crude product variants to measure yield tracking (Actual data, non-linear model data, linear model data). As per design, we are planning to use the CDF raw tables and then do all the computations and create derived raw tables to fulfil the purpose. Then use Petro-Sim connector and then store the data output from the model tool as well in raw tables. So, we don't tend to see the typi

Do we have any api in cognite which will help to show preview data of transformations?

I am currently working through “Learn to Use the Cognite Python SDK”. I am unsure where the workspace/code is provided so that I am able to take the final the test and succeed in this course. I was originally using a colab research google file that includes prompts. But the questions on the final test did not corelate with this file. Can you please instruct me on how I find the correct files/workspace.  Thank you in advance. 

Hi all, I ran into an error when running a transform: instances failed with status 400: Request had 37 constraint violations. Please fix the request and try again. [properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 a

Hello Community,We are thrilled to announce the launch of Cognite AI, a comprehensive suite of Generative AI capabilities within our core Industrial DataOps platform, Cognite Data Fusion®.Cognite AI is a first-of-its-kind, hallucination-free, data-leakage-free Generative AI solution that accelerates time-to-value from Generative AI for energy, manufacturing, and power and renewables customers. And the best part is that it is fully open to all partners to create tailored industrial solutions.Cognite Data Fusion® with Cognite AI improves operations by rapidly accelerating cloud adoption and increasing the efficiency of industrial workflows by 10 times.Read the full press release here to learn how we harness the power of Generative AI for industry:https://www.cognite.com/en/press-release/introducing-cognite-ai

Hello Community,We are thrilled to announce the launch of Cognite AI, a comprehensive suite of Generative AI capabilities within our core Industrial DataOps platform, Cognite Data Fusion®.Cognite AI is a first-of-its-kind, hallucination-free, data-leakage-free Generative AI solution that accelerates time-to-value from Generative AI for energy, manufacturing, and power and renewables customers. And the best part is that it is fully open to all partners to create tailored industrial solutions.Cognite Data Fusion® with Cognite AI improves operations by rapidly accelerating cloud adoption and increasing the efficiency of industrial workflows by 10 times. Read the full press release here to learn how we harness the power of Generative AI for industry:https://www.cognite.com/en/press-release/introducing-cognite-ai

Hello May I know if inventor 3D model is supported in CDF?