Product User Community

Exploring Cognite CDF

I am trying to trigger multiple workflow through function. I have a function(function name = "wk-func") that will trigger workflow instances(workflow name = ra-wkflw'), it has for loop , number of times workflow instances to be created, keeping in mind instances limit to be 50, still it is giving error for run on even 2 isntances, Function has following handle: def handle(client,handle):      for chunk in chunks(list,2):            workflow_input = {            "abc":data['value']        }        run = client.workflows.executions.trigger(            workflow_external_id='ra-wkflw', version=1,input=workflow_input        ) Its working if I run at my local IDE with passing the client details and trigger function handle. It triggers multiple workflows without any error.However, On running function using SDK,input_data = { ‘abc’:’hey’}client.functions.call(external_id ="wk-func", data = input_data)Function is completed, however, workflow instance is not being triggered and following error i

I have a calculation on a chart that was working well for quite a while, Then there was a network issue that stopped the data source from streaming data (this is the big triangular shape in the image below). Even though the data streaming got restored a short while after that, the issue I have is that the calculated value (the brown line) never got back to working. There was a short blip of time where it looked like it was working but that was just random values for a while. Does anyone know where I can see any logs associated with this calculation? I know you can’t edit the calculation - you have to delete it and create a new one - I guess I will likely do that but would also like to find out what the reason is for this calculation just stopping and not restarting properly?  

Hi. For some reason my events retreived via the CDF data source for Grafana come with time stamps in epoch format:In the examples given in the documentation, events are returned with a human-readable time format. Any idea what I am doing wrong here?

December 15th 2022 - SLB Offices @ Pune, IndiaOn the week of Dec 12th to Dec 16th, Maureen Byrne (Software Engineer), Maria Fonseca (Technical Support Engineer) and me (Data Engineer) travelled to Pune, India, to deliver the first Cognite Data Fusion Bootcamp for eighteen participants from SLB and Infosys. This training delivery marks a milestone for customer and partners of Cognite: this is the first training where Cognite instructors guide them through an end-to-end deployment of Cognite Data Fusion, including data integrations and solution-building.The bootcamp is an intensive 5-day training program that focuses on a complete deployment, bringing the different steps together with DevOps best practices from CDF bootstrapping to solution deployment, monitoring, and operations. Congratulations to the participants of the first bootcamp for gaining their Cognite Data Fusion Bootcamp Certificate!The three of us were very impressed by how fast the participants adopted DataOps tools and pra

Doing the ‘hands-on’ for Data Engineer Basics - “Learn to Use the Cognite Python SDK “ Course."The instructions said “Make sure that the data set is write-protected”. So I had under Step 1:I then ran without error:That was YESTERDAY.TODAY, the 2nd block of commands threw an error: “CogniteAPIError: Resource not found. This may also be due to insufficient access rights. | code: 403 | X-Request-ID: f9083e61-8310-9462-9fb6-69f8da1299f3”So, after trying this and that, I changed the generated data_set to write protected = False in the 1st block of code above. --- >  The 2nd block of commands now works, just like YESTERDAY. Q1. Why did  ‘write protected = True’ work YESTERDAY, but not TODAY, giving Error 403?Q2. Why does ‘write protected = False’ work, but not ‘write protected = True’ , TODAY, that is?From where does this inconsistency come? Someone?Thank you!Douglas  

Hello! I am trying to follow along the Data Engineer Learn module. There are hands on exercises that needs me to install jupyter notebook - i used pip to do that. In the notebook 1_Authentication.ipynb, the package cognite is needed:from cognite.client.credentials import OAuthInteractivefrom cognite.client import CogniteClient, ClientConfigreturns the error---------------------------------------------------------------------------ModuleNotFoundError Traceback (most recent call last)Cell In[5], line 10 1 ## !pip3 install cognite 2 ## !pip3 show cognite-sdk 3 ## !pip3 show cognite-sdk (...) 8 #import cognite.client 9 #from cognite.client import CogniteClient---> 10 from cognite.client.credentials import OAuthInteractive 11 from cognite.client import CogniteClient, ClientConfigModuleNotFoundError: No module named 'cognite.client' I am able to install cognite using pip to version 0.04. However poetry add cognite in the ‘using-python-s

Hi All,In C# SDK Upload link description says it provide link to upload file in GKS. Does it work if CDF is hosted on Azure as well.  

1. Field ‘name’ is required during creating data model in CDF.  But it is not required if create through SDK:data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1")] c.data_modeling.data_models.apply(data_models) 2.  For data models have values in ‘name’ and ‘description’ fields these fields would be cleared up if these parameters are not specified in DataModelApply. These code will clear name and description values (if ‘myDataModel’ had them):data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1")] c.data_modeling.data_models.apply(data_models)These code won’t clear name and description values (if ‘myDataModel’ had them):data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1", name=”myDataModel”, description=”My Description”)]c.data_modeling.data_models.apply(data_models)To fix make changes in cognite-sdk:Set ‘name’ as required for DataModelApply. Fix clearing values from name and description in D

I notice that i have three Tenant ID in my AAD count.I think i should use the Cognite Hub Tenant ID,It’s that right?when I try to create a new application,  Azure told me I have no access to create a application.Am I doing it right?  Which Org should I apply the permission to create an app under this tenant, RA or Cognite Hub? 

My colleague sent me a pic, it’s from a demo project named “essc-sandbox-44”, we need the project to show to the customer to win this opportunity, But we don’t know who is the owner in this project, how can  i contract the owner and join this project?the project maybe in this domain.https://ftdatamosaix.fusion.cognite.comthank you 

I want to purchase the Cognite credits for me and my team for completing the certification. Unfortunately, I am not able to click on the purchase button.Am I missing something, can you please guide me.   

Hi,I’m using the Charts function “Statistics/Outlier Removal” and noticed that the option “Remove zeros” (aka del_zero_val) does the exact opposite of what one would expect.  Example of a data stream filtered without “Removes zeros” Example of a data stream filtered with “Removes zeros”Is this a bug or the intended behaviour? If the latter then I think the naming/documentation is misleading.

Hi all!The Cognite Data Modelling product team are looking to make an improvement to how properties from views selected in data modelling graph queries are included in the result data set.The documented and desired behaviour is that only view properties that are explicitly selected in the query will be included in the data output. However, there is a known issue with property selection where in some cases a query would return more properties per view than initially selected.The issue manifests such that properties selected on one view will also be included in the result properties of another view in the query. This behaviour only appears in specific cases: the selection should be in the same table expression, the selection should use two or more views that share some container properties, and one or more shared properties (that is, properties mapped to the same container property) should be selected in one of the views but not in the other.As such, the issue does not cause a data leak

Hi everyone, I'm loading sequences from a file that has 11 million rows, and I would like to load it in batches, where each batch is a dataframe. As I load by batch, the rows that the sequence already had are being deleted, leaving only the last batch. How can I load each batch without deleting the previous one? This is the code I use to read the file in batches and load rows into the sequence. It is assumed that the sequence is already created. Regards,Karina Saylema@Aditya Kotiyal  @HanishSharma  @Jason Dressel  @Jairo Salaya @Liliana Sierra    

Hi All,I am trying to update data in RAW table. I am using below code but after executing it either column values are not modified or sometimes all the columns shrink under one columns as ({} columns) and column data is also not updated in that case. var row = confModel.RawRow as RawRow<Dictionary<string, JsonElement>>;if (row == null){    return;}var currentDate = DateTime.Now;var utcDate = currentDate.ToUniversalTime().ToString("u").Replace(" ", "T");row.Columns[UpdatedBy] = GetJsonElement(JsonValue.Create("SYSTEM"));row.Columns[SimulationStatus] = GetJsonElement(JsonValue.Create(status.ToString()));row.Columns[UpdatedDate] = GetJsonElement(JsonValue.Create(utcDate));var rawRowCreateColl = new List<RawRowCreate<RawRow<Dictionary<string, JsonElement>>>>();var rawRowCreate = new RawRowCreate<RawRow<Dictionary<string, JsonElement>>>();rawRowCreate.Key = confModel.RowKey;rawRowCreate.Columns = row;rawRowCreateColl.Add(rawRowCreate);tr

When displaying many similar time series together in Charts, it is useful to select “Merge unit” to reduce the number of Y axes. This functionality does not follow the chart when inserted in a canvas. Have I missed something here?

We are pleased to announce that cognite-pygen is available in beta. What does Pygen enable? It enables you to write python-code using the concepts in your data model. The code you can write enables you to query CDF and work with the data in your data model. How? Pygen generates a Python-SDK tailored for your data model. Want to know more? https://cognite-pygen.readthedocs-hosted.com/en/latest/what_is_pygen.htmlDisclaimer! In the beta period, we ask you to be careful when using the pygen generated SDK on a live production project.We would love to get feedback on how to improve the usability and robustness of the pygen. Toward General Availability, we will focus on robustifying the generation process.

Hi, everyoneI'm trying to load a CSV file using db-extractor. This is the configuration I'm placing in the .yaml file : but I'm encountering the following error: It seems that the error might be that the query section doesn't recognize the sheet name. I checked that the sheet name matches by opening the file in Excel format, but the error persists. I also loaded the same file in .xlsx format and it loaded without any problem.  How should I specify in the query so that it takes the correct name in CSV format? Regards,Karina Saylema@Aditya Kotiyal  @HanishSharma  @Jason Dressel  @Jairo Salaya @Liliana Sierra   

I want to read data from Snowflake and load it to CDF RAW. Could someone suggest what can be the best solution to implement this? Are there any specific extractors for doing it ? 

Hi everyone,We have great news for you. Our team was working hard to make this happen for this release. We have created a smooth integration and transition between Industrial Canvas and Charts.From now on you can bring your charts to your canvases. You can do it in 2 ways: While in Industrial Canvas, click 'Add data' to open the resource selector and select 'Charts' tab as the fifth option from the tabs. Here you can filter and search your charts, select the ones you want in your canvas like any other data type and shazam! your charts appear in your canvas. While navigating through Charts, select your favorite chart and click the 'Actions' button, then locate Industrial Canvas beneath 'Open In' section. Follow the steps by selecting one of your existing canvases or initiate a new one to add your chart to. With this feature you can fully interact with your Charts from the Industrial Canvas:You can update axis ranges Slide left or right to update time window Use shift to select a speci

I am developing a custom app for performing semantic search using Cognite FDM GraphQL endpoint and LLM and done some research using ChatGPT 3.5 to generate GraphQL query from natural language.To my understanding Cognite copilot feature find under data model UX  is using Azure OpenAI that runs in the Cognite subscription.Want to know how to make use of Azure OpenAI that runs in the Cognite subscription for Custom App deveopment?

Greetings,I'm currently involved in a research project where we are considering the integration of B2MML (Business To Manufacturing Markup Language) data with Cognite Data Fusion (CDF). Our goal is to enhance our data analytics capabilities in a manufacturing context.I am reaching out to this knowledgeable community to gather insights and experiences regarding the following: B2MML Data Extraction: Have any of you worked on extracting data from B2MML-formatted sources? What challenges and best practices have you encountered in this process? B2MML Data Ingestion into CDF: Has anyone successfully configured B2MML data ingestion into Cognite Data Fusion? Could you share any specific strategies or tools you used for this integration? What were the major hurdles, and how did you overcome them? Any detailed experiences, technical insights, or even pointing towards relevant resources or case studies would be immensely helpful.Thank you in advance for your valuable input! Best regards, Art

Hi my blog collegus,can some one let me know the following info,please let me know how to login through my company, do subscription from market place to cognite is mandatory, I need to do a demo projectRegardsDev

Hello, I have a chart I have already created with multiple time series. Is it possible to link that chart to a canvas? Thank you.