Product User Community

Doing the ‘hands-on’ for Data Engineer Basics - “Learn to Use the Cognite Python SDK “ Course."The instructions said “Make sure that the data set is write-protected”. So I had under Step 1:I then ran without error:That was YESTERDAY.TODAY, the 2nd block of commands threw an error: “CogniteAPIError: Resource not found. This may also be due to insufficient access rights. | code: 403 | X-Request-ID: f9083e61-8310-9462-9fb6-69f8da1299f3”So, after trying this and that, I changed the generated data_set to write protected = False in the 1st block of code above. --- >  The 2nd block of commands now works, just like YESTERDAY. Q1. Why did  ‘write protected = True’ work YESTERDAY, but not TODAY, giving Error 403?Q2. Why does ‘write protected = False’ work, but not ‘write protected = True’ , TODAY, that is?From where does this inconsistency come? Someone?Thank you!Douglas  

Hello! I am trying to follow along the Data Engineer Learn module. There are hands on exercises that needs me to install jupyter notebook - i used pip to do that. In the notebook 1_Authentication.ipynb, the package cognite is needed:from cognite.client.credentials import OAuthInteractivefrom cognite.client import CogniteClient, ClientConfigreturns the error---------------------------------------------------------------------------ModuleNotFoundError Traceback (most recent call last)Cell In[5], line 10 1 ## !pip3 install cognite 2 ## !pip3 show cognite-sdk 3 ## !pip3 show cognite-sdk (...) 8 #import cognite.client 9 #from cognite.client import CogniteClient---> 10 from cognite.client.credentials import OAuthInteractive 11 from cognite.client import CogniteClient, ClientConfigModuleNotFoundError: No module named 'cognite.client' I am able to install cognite using pip to version 0.04. However poetry add cognite in the ‘using-python-s

Hi All,In C# SDK Upload link description says it provide link to upload file in GKS. Does it work if CDF is hosted on Azure as well.  

1. Field ‘name’ is required during creating data model in CDF.  But it is not required if create through SDK:data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1")] c.data_modeling.data_models.apply(data_models) 2.  For data models have values in ‘name’ and ‘description’ fields these fields would be cleared up if these parameters are not specified in DataModelApply. These code will clear name and description values (if ‘myDataModel’ had them):data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1")] c.data_modeling.data_models.apply(data_models)These code won’t clear name and description values (if ‘myDataModel’ had them):data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1", name=”myDataModel”, description=”My Description”)]c.data_modeling.data_models.apply(data_models)To fix make changes in cognite-sdk:Set ‘name’ as required for DataModelApply. Fix clearing values from name and description in D

I notice that i have three Tenant ID in my AAD count.I think i should use the Cognite Hub Tenant ID,It’s that right?when I try to create a new application,  Azure told me I have no access to create a application.Am I doing it right?  Which Org should I apply the permission to create an app under this tenant, RA or Cognite Hub? 

My colleague sent me a pic, it’s from a demo project named “essc-sandbox-44”, we need the project to show to the customer to win this opportunity, But we don’t know who is the owner in this project, how can  i contract the owner and join this project?the project maybe in this domain.https://ftdatamosaix.fusion.cognite.comthank you 

I want to purchase the Cognite credits for me and my team for completing the certification. Unfortunately, I am not able to click on the purchase button.Am I missing something, can you please guide me.   

Hi,I’m using the Charts function “Statistics/Outlier Removal” and noticed that the option “Remove zeros” (aka del_zero_val) does the exact opposite of what one would expect.  Example of a data stream filtered without “Removes zeros” Example of a data stream filtered with “Removes zeros”Is this a bug or the intended behaviour? If the latter then I think the naming/documentation is misleading.

Hi all!The Cognite Data Modelling product team are looking to make an improvement to how properties from views selected in data modelling graph queries are included in the result data set.The documented and desired behaviour is that only view properties that are explicitly selected in the query will be included in the data output. However, there is a known issue with property selection where in some cases a query would return more properties per view than initially selected.The issue manifests such that properties selected on one view will also be included in the result properties of another view in the query. This behaviour only appears in specific cases: the selection should be in the same table expression, the selection should use two or more views that share some container properties, and one or more shared properties (that is, properties mapped to the same container property) should be selected in one of the views but not in the other.As such, the issue does not cause a data leak

Hi everyone, I'm loading sequences from a file that has 11 million rows, and I would like to load it in batches, where each batch is a dataframe. As I load by batch, the rows that the sequence already had are being deleted, leaving only the last batch. How can I load each batch without deleting the previous one? This is the code I use to read the file in batches and load rows into the sequence. It is assumed that the sequence is already created. Regards,Karina Saylema@Aditya Kotiyal  @HanishSharma  @Jason Dressel  @Jairo Salaya @Liliana Sierra    

Hi All,I am trying to update data in RAW table. I am using below code but after executing it either column values are not modified or sometimes all the columns shrink under one columns as ({} columns) and column data is also not updated in that case. var row = confModel.RawRow as RawRow<Dictionary<string, JsonElement>>;if (row == null){    return;}var currentDate = DateTime.Now;var utcDate = currentDate.ToUniversalTime().ToString("u").Replace(" ", "T");row.Columns[UpdatedBy] = GetJsonElement(JsonValue.Create("SYSTEM"));row.Columns[SimulationStatus] = GetJsonElement(JsonValue.Create(status.ToString()));row.Columns[UpdatedDate] = GetJsonElement(JsonValue.Create(utcDate));var rawRowCreateColl = new List<RawRowCreate<RawRow<Dictionary<string, JsonElement>>>>();var rawRowCreate = new RawRowCreate<RawRow<Dictionary<string, JsonElement>>>();rawRowCreate.Key = confModel.RowKey;rawRowCreate.Columns = row;rawRowCreateColl.Add(rawRowCreate);tr

When displaying many similar time series together in Charts, it is useful to select “Merge unit” to reduce the number of Y axes. This functionality does not follow the chart when inserted in a canvas. Have I missed something here?

We are pleased to announce that cognite-pygen is available in beta. What does Pygen enable? It enables you to write python-code using the concepts in your data model. The code you can write enables you to query CDF and work with the data in your data model. How? Pygen generates a Python-SDK tailored for your data model. Want to know more? https://cognite-pygen.readthedocs-hosted.com/en/latest/what_is_pygen.htmlDisclaimer! In the beta period, we ask you to be careful when using the pygen generated SDK on a live production project.We would love to get feedback on how to improve the usability and robustness of the pygen. Toward General Availability, we will focus on robustifying the generation process.

Hi, everyoneI'm trying to load a CSV file using db-extractor. This is the configuration I'm placing in the .yaml file : but I'm encountering the following error: It seems that the error might be that the query section doesn't recognize the sheet name. I checked that the sheet name matches by opening the file in Excel format, but the error persists. I also loaded the same file in .xlsx format and it loaded without any problem.  How should I specify in the query so that it takes the correct name in CSV format? Regards,Karina Saylema@Aditya Kotiyal  @HanishSharma  @Jason Dressel  @Jairo Salaya @Liliana Sierra   

I want to read data from Snowflake and load it to CDF RAW. Could someone suggest what can be the best solution to implement this? Are there any specific extractors for doing it ? 

Hi everyone,We have great news for you. Our team was working hard to make this happen for this release. We have created a smooth integration and transition between Industrial Canvas and Charts.From now on you can bring your charts to your canvases. You can do it in 2 ways: While in Industrial Canvas, click 'Add data' to open the resource selector and select 'Charts' tab as the fifth option from the tabs. Here you can filter and search your charts, select the ones you want in your canvas like any other data type and shazam! your charts appear in your canvas. While navigating through Charts, select your favorite chart and click the 'Actions' button, then locate Industrial Canvas beneath 'Open In' section. Follow the steps by selecting one of your existing canvases or initiate a new one to add your chart to. With this feature you can fully interact with your Charts from the Industrial Canvas:You can update axis ranges Slide left or right to update time window Use shift to select a speci

I am developing a custom app for performing semantic search using Cognite FDM GraphQL endpoint and LLM and done some research using ChatGPT 3.5 to generate GraphQL query from natural language.To my understanding Cognite copilot feature find under data model UX  is using Azure OpenAI that runs in the Cognite subscription.Want to know how to make use of Azure OpenAI that runs in the Cognite subscription for Custom App deveopment?

Greetings,I'm currently involved in a research project where we are considering the integration of B2MML (Business To Manufacturing Markup Language) data with Cognite Data Fusion (CDF). Our goal is to enhance our data analytics capabilities in a manufacturing context.I am reaching out to this knowledgeable community to gather insights and experiences regarding the following: B2MML Data Extraction: Have any of you worked on extracting data from B2MML-formatted sources? What challenges and best practices have you encountered in this process? B2MML Data Ingestion into CDF: Has anyone successfully configured B2MML data ingestion into Cognite Data Fusion? Could you share any specific strategies or tools you used for this integration? What were the major hurdles, and how did you overcome them? Any detailed experiences, technical insights, or even pointing towards relevant resources or case studies would be immensely helpful.Thank you in advance for your valuable input! Best regards, Art

Hi my blog collegus,can some one let me know the following info,please let me know how to login through my company, do subscription from market place to cognite is mandatory, I need to do a demo projectRegardsDev

Hello, I have a chart I have already created with multiple time series. Is it possible to link that chart to a canvas? Thank you.

Hello We would like to explore the possibilities of registering the “Cognite Sales Enablement Basics” for our sales team.Can someone please share the details for this course.

Hi, I can’t seem to contextualize my assets to my time series in the exercise. I have followed all the steps before.  

I was trying to create a flow to refresh all views in one of my solution model in a project. All my transformations are running individually without failing. But as soon as I run the Flow, only first transformation runs, the second one fails with an unclear message “Something went wrong”. I understand this is an EA features as of now, but I see a lot of application of this feature in one of our projects hence I am trying to setup some flows in it. Could you please help in checking if I am doing something wrong here?Task ID - 1dfb440d-c678-43a4-8c67-0d98467694e8 Flow Definition:[  {    "externalId": "tr-tr-SDM-WellStatus-Entity",    "type": "transformation",    "name": "1706783603193",    "parameters": {      "transformation": {        "externalId": "tr-tr-SDM-WellStatus-Entity",        "concurrencyPolicy": "fail"      }    },    "onFailure": "abortWorkflow",    "dependsOn": []  },  {    "externalId": "tr-tr-SDM-Well-Status-Hierarchy",    "type": "transformation",    "name": "1706783606

Hi All,I am trying to retrieve the data from Raw table using C# Sdk. I am using the ListRowsAsync and it is giving me the error that project limit reached although there is one row in the Raw table. Also, there is one column which contains the JSON data. I am able to read the same data using Python SDK. Does anybody have example for C# SDK.

Hey, anyone here are facing difficulties trying to open Canvas created on the last version?I created a Canvas with the las version. When I try to open this canvas on the actual version, the canvas is empty. I go to “Version history” and click to open the last version, the system asks to restore the last version. When I do, nothing happens, and I still can not see the Canvas that I created.