Product User Community

Hi, everyoneI'm trying to load sequences using Python SDK by inserting dataframes. In the dataframe, I have some columns with NaN and numeric values. Dataframe:  and when loading NaN values, they are uploaded as 'null'. I've tried replacing them with empty strings, but due to the column definitions, if I have numeric values, the column's data type must be Double or Long, and conflicts arise when encountering empty strings.This is the code to load a sequence: Results in CDF using Python SDK: However, when loading the sequence via DB-Extractor, empty strings are uploaded as such and not as 'null' Is there any way to load via SDK so that NaN values are uploaded as empty and not 'null'?  Regards,Karina Saylema@Aditya Kotiyal  @HanishSharma  @Jason Dressel  @Jairo Salaya @Liliana Sierra  

@Ragnhild Byrkjeland, @perolssoen, and @Christopher Tannum After using the new scene functionality in CDF, there are several things that I like about the application but also am experiencing some challenges that I believe need to be addressed before we can get end users to leverage the application:the asset layer seems to take a while to load on the backend. Not sure if there’s a way to set this up to load faster? once assets are loaded, the pop-up window that shows the contextualized information is very glitchy - rendering it almost un-useable In general it doesn’t seem like the asset overlay is very reactive to a click of the mouse, but more of a hover over which seems less intuitive for end users It would be great to have a speed slider - like the one that was present in remote - to fine-tune the navigation. This will be particularly helpful when we bring in our subsea models into the scene It would be great if we could set certain attributes to default to be toggled “off” when firs

Hi, EveryoneHow can sum several time series? For example:Times series # 1Times series #2How can sum these time series if the filter just taking one id ts{id=001}Regards, Liliana Sierra@Aditya Kotiyal  @HanishSharma  @Jason Dressel  @Jairo Salaya 

Exploring Cognite CDF

Hello Community Members,I am delighted to announce that from today, the Cognite Python SDK now has support for Time Series Data Quality Status codes.Using the SDK, you may retrieve data points including their status codes, and filter on status codes if desired. You may also insert data points with status codes.For a full description of all the methods and functionality, please refer to the Python SDK Documentation and our Developer DocumentationWhilst this functionality remains in Beta maturity, we are targeting the upcoming June release for General Availability. Cognite relies on customer feedback as key part of its product maturation process, and customers are warmly encouraged to begin implementation of support for data quality status codes and to provide the valuable feedback necessary to allow us to make this feature Generally Available.Thank you for your continued support! Glen

I am trying to trigger multiple workflow through function. I have a function(function name = "wk-func") that will trigger workflow instances(workflow name = ra-wkflw'), it has for loop , number of times workflow instances to be created, keeping in mind instances limit to be 50, still it is giving error for run on even 2 isntances, Function has following handle: def handle(client,handle):      for chunk in chunks(list,2):            workflow_input = {            "abc":data['value']        }        run = client.workflows.executions.trigger(            workflow_external_id='ra-wkflw', version=1,input=workflow_input        ) Its working if I run at my local IDE with passing the client details and trigger function handle. It triggers multiple workflows without any error.However, On running function using SDK,input_data = { ‘abc’:’hey’}client.functions.call(external_id ="wk-func", data = input_data)Function is completed, however, workflow instance is not being triggered and following error i

I have a calculation on a chart that was working well for quite a while, Then there was a network issue that stopped the data source from streaming data (this is the big triangular shape in the image below). Even though the data streaming got restored a short while after that, the issue I have is that the calculated value (the brown line) never got back to working. There was a short blip of time where it looked like it was working but that was just random values for a while. Does anyone know where I can see any logs associated with this calculation? I know you can’t edit the calculation - you have to delete it and create a new one - I guess I will likely do that but would also like to find out what the reason is for this calculation just stopping and not restarting properly?  

Hi. For some reason my events retreived via the CDF data source for Grafana come with time stamps in epoch format:In the examples given in the documentation, events are returned with a human-readable time format. Any idea what I am doing wrong here?

December 15th 2022 - SLB Offices @ Pune, IndiaOn the week of Dec 12th to Dec 16th, Maureen Byrne (Software Engineer), Maria Fonseca (Technical Support Engineer) and me (Data Engineer) travelled to Pune, India, to deliver the first Cognite Data Fusion Bootcamp for eighteen participants from SLB and Infosys. This training delivery marks a milestone for customer and partners of Cognite: this is the first training where Cognite instructors guide them through an end-to-end deployment of Cognite Data Fusion, including data integrations and solution-building.The bootcamp is an intensive 5-day training program that focuses on a complete deployment, bringing the different steps together with DevOps best practices from CDF bootstrapping to solution deployment, monitoring, and operations. Congratulations to the participants of the first bootcamp for gaining their Cognite Data Fusion Bootcamp Certificate!The three of us were very impressed by how fast the participants adopted DataOps tools and pra

Doing the ‘hands-on’ for Data Engineer Basics - “Learn to Use the Cognite Python SDK “ Course."The instructions said “Make sure that the data set is write-protected”. So I had under Step 1:I then ran without error:That was YESTERDAY.TODAY, the 2nd block of commands threw an error: “CogniteAPIError: Resource not found. This may also be due to insufficient access rights. | code: 403 | X-Request-ID: f9083e61-8310-9462-9fb6-69f8da1299f3”So, after trying this and that, I changed the generated data_set to write protected = False in the 1st block of code above. --- >  The 2nd block of commands now works, just like YESTERDAY. Q1. Why did  ‘write protected = True’ work YESTERDAY, but not TODAY, giving Error 403?Q2. Why does ‘write protected = False’ work, but not ‘write protected = True’ , TODAY, that is?From where does this inconsistency come? Someone?Thank you!Douglas  

Hello! I am trying to follow along the Data Engineer Learn module. There are hands on exercises that needs me to install jupyter notebook - i used pip to do that. In the notebook 1_Authentication.ipynb, the package cognite is needed:from cognite.client.credentials import OAuthInteractivefrom cognite.client import CogniteClient, ClientConfigreturns the error---------------------------------------------------------------------------ModuleNotFoundError Traceback (most recent call last)Cell In[5], line 10 1 ## !pip3 install cognite 2 ## !pip3 show cognite-sdk 3 ## !pip3 show cognite-sdk (...) 8 #import cognite.client 9 #from cognite.client import CogniteClient---> 10 from cognite.client.credentials import OAuthInteractive 11 from cognite.client import CogniteClient, ClientConfigModuleNotFoundError: No module named 'cognite.client' I am able to install cognite using pip to version 0.04. However poetry add cognite in the ‘using-python-s

Hi All,In C# SDK Upload link description says it provide link to upload file in GKS. Does it work if CDF is hosted on Azure as well.  

1. Field ‘name’ is required during creating data model in CDF.  But it is not required if create through SDK:data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1")] c.data_modeling.data_models.apply(data_models) 2.  For data models have values in ‘name’ and ‘description’ fields these fields would be cleared up if these parameters are not specified in DataModelApply. These code will clear name and description values (if ‘myDataModel’ had them):data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1")] c.data_modeling.data_models.apply(data_models)These code won’t clear name and description values (if ‘myDataModel’ had them):data_models = [DataModelApply(space="mySpace",external_id="myDataModel",version="v1", name=”myDataModel”, description=”My Description”)]c.data_modeling.data_models.apply(data_models)To fix make changes in cognite-sdk:Set ‘name’ as required for DataModelApply. Fix clearing values from name and description in D

I notice that i have three Tenant ID in my AAD count.I think i should use the Cognite Hub Tenant ID,It’s that right?when I try to create a new application,  Azure told me I have no access to create a application.Am I doing it right?  Which Org should I apply the permission to create an app under this tenant, RA or Cognite Hub? 

My colleague sent me a pic, it’s from a demo project named “essc-sandbox-44”, we need the project to show to the customer to win this opportunity, But we don’t know who is the owner in this project, how can  i contract the owner and join this project?the project maybe in this domain.https://ftdatamosaix.fusion.cognite.comthank you 

I want to purchase the Cognite credits for me and my team for completing the certification. Unfortunately, I am not able to click on the purchase button.Am I missing something, can you please guide me.   

Hi,I’m using the Charts function “Statistics/Outlier Removal” and noticed that the option “Remove zeros” (aka del_zero_val) does the exact opposite of what one would expect.  Example of a data stream filtered without “Removes zeros” Example of a data stream filtered with “Removes zeros”Is this a bug or the intended behaviour? If the latter then I think the naming/documentation is misleading.

Hi all!The Cognite Data Modelling product team are looking to make an improvement to how properties from views selected in data modelling graph queries are included in the result data set.The documented and desired behaviour is that only view properties that are explicitly selected in the query will be included in the data output. However, there is a known issue with property selection where in some cases a query would return more properties per view than initially selected.The issue manifests such that properties selected on one view will also be included in the result properties of another view in the query. This behaviour only appears in specific cases: the selection should be in the same table expression, the selection should use two or more views that share some container properties, and one or more shared properties (that is, properties mapped to the same container property) should be selected in one of the views but not in the other.As such, the issue does not cause a data leak

Hi everyone, I'm loading sequences from a file that has 11 million rows, and I would like to load it in batches, where each batch is a dataframe. As I load by batch, the rows that the sequence already had are being deleted, leaving only the last batch. How can I load each batch without deleting the previous one? This is the code I use to read the file in batches and load rows into the sequence. It is assumed that the sequence is already created. Regards,Karina Saylema@Aditya Kotiyal  @HanishSharma  @Jason Dressel  @Jairo Salaya @Liliana Sierra    

Hi All,I am trying to update data in RAW table. I am using below code but after executing it either column values are not modified or sometimes all the columns shrink under one columns as ({} columns) and column data is also not updated in that case. var row = confModel.RawRow as RawRow<Dictionary<string, JsonElement>>;if (row == null){    return;}var currentDate = DateTime.Now;var utcDate = currentDate.ToUniversalTime().ToString("u").Replace(" ", "T");row.Columns[UpdatedBy] = GetJsonElement(JsonValue.Create("SYSTEM"));row.Columns[SimulationStatus] = GetJsonElement(JsonValue.Create(status.ToString()));row.Columns[UpdatedDate] = GetJsonElement(JsonValue.Create(utcDate));var rawRowCreateColl = new List<RawRowCreate<RawRow<Dictionary<string, JsonElement>>>>();var rawRowCreate = new RawRowCreate<RawRow<Dictionary<string, JsonElement>>>();rawRowCreate.Key = confModel.RowKey;rawRowCreate.Columns = row;rawRowCreateColl.Add(rawRowCreate);tr

When displaying many similar time series together in Charts, it is useful to select “Merge unit” to reduce the number of Y axes. This functionality does not follow the chart when inserted in a canvas. Have I missed something here?

We are pleased to announce that cognite-pygen is available in beta. What does Pygen enable? It enables you to write python-code using the concepts in your data model. The code you can write enables you to query CDF and work with the data in your data model. How? Pygen generates a Python-SDK tailored for your data model. Want to know more? https://cognite-pygen.readthedocs-hosted.com/en/latest/what_is_pygen.htmlDisclaimer! In the beta period, we ask you to be careful when using the pygen generated SDK on a live production project.We would love to get feedback on how to improve the usability and robustness of the pygen. Toward General Availability, we will focus on robustifying the generation process.

Hi, everyoneI'm trying to load a CSV file using db-extractor. This is the configuration I'm placing in the .yaml file : but I'm encountering the following error: It seems that the error might be that the query section doesn't recognize the sheet name. I checked that the sheet name matches by opening the file in Excel format, but the error persists. I also loaded the same file in .xlsx format and it loaded without any problem.  How should I specify in the query so that it takes the correct name in CSV format? Regards,Karina Saylema@Aditya Kotiyal  @HanishSharma  @Jason Dressel  @Jairo Salaya @Liliana Sierra   

I want to read data from Snowflake and load it to CDF RAW. Could someone suggest what can be the best solution to implement this? Are there any specific extractors for doing it ? 

Hi everyone,We have great news for you. Our team was working hard to make this happen for this release. We have created a smooth integration and transition between Industrial Canvas and Charts.From now on you can bring your charts to your canvases. You can do it in 2 ways: While in Industrial Canvas, click 'Add data' to open the resource selector and select 'Charts' tab as the fifth option from the tabs. Here you can filter and search your charts, select the ones you want in your canvas like any other data type and shazam! your charts appear in your canvas. While navigating through Charts, select your favorite chart and click the 'Actions' button, then locate Industrial Canvas beneath 'Open In' section. Follow the steps by selecting one of your existing canvases or initiate a new one to add your chart to. With this feature you can fully interact with your Charts from the Industrial Canvas:You can update axis ranges Slide left or right to update time window Use shift to select a speci