Community Discussions

On behalf of Celanese, I’d like to know if there is any possibility on blocking download of single files on the CDF UI, if it is in a security category or a specified dataset. Thanks!

Hi,I see this error in UI when I open the data workflow in slb-forum project. In access-info, below permissions are listed:{            "workflowOrchestrationAcl": {                "actions": [                    "READ",                    "WRITE"                ],                "scope": {                    "all": {}                }            },            "projectScope": {                "projects": [                    "slb-forum"                ]            }        } Can you please check if anything is missing?

While Loading Data to Power BI , it is taking huge time for loading transformed data.

Thus far, we have successfully loaded tables containing few million records from Delta Lake to CDF raw. However, we are encountering data skipping issues when we attempt to load more than ten million records from Delta Lake to CDF.I've just found the cause of all the records' failure to load.We are generating a sha2 key in our ETL process using the delta lake table primary keys. We don't have any problems with the sha2 key for small tables, but as we hit above 10 million records, we start to get key collisions, which causes some data to skip loading.In that instance, I made a new index field with incremental numbers like 1, 2, 3, and so on,. I then tried loading the data using the new index, and it now loads flawlessly. I was able to load 60 million records in CDF using this new method.

As per documentation, it is mentioned that 10,000 timeseries is the limit in each subscription. I see issue with count while adding timeseries using SDK.I have created timeseries subscription through SDK, it took more than 10000 timeseries. Is there any change in limit under subscription ?  

Hello,I’ve been working on developing a Power BI dashboard that pulls the APM Data Model for InField to visualize our progress on checklists, however I’m running in to some road blocks. Currently for me to pull checklists, checklist items and measurements in power BI, I have to expand the related table columns within power BI rather than just being able to load each table individually and relate them to each other. Ideally I’d like to have the relationships to other tables as part of the model pull without needing to expand related tables as that’s creating significant folding in the data pull.Example:Loading the checklist table and expanding the checklistitems table and then the measurements table takes roughly 45 minutes to load due to the folding that occurs in the data load If I load these 3 tables separately, it takes under 1 minute - however I then don’t have any way to relate the values from each table to each other. The checklist items table does not have the checklist external

HiI am looking into using the is_new functionality in my transformations, but was wondering whether it will work in transformations where is use joins. If so, how would I write the query?In addition, I heard that you are working on releasing functionality to use is_new when reading from data models. When will this feature be ready?Thank you!Sebastian

Hello! Is there a way to push multiple timeseries in CDF timeseries within one single query in the DB extractor config.yml file? Or do we need multiple queries?Also, if my incremental field is a timestamp datetime format, is it working or not as I'm receving an error related to it. Regards,Raluca

Notify an instructor and ask them to give required consent to the application in the AAD (requires admin privileges): Share the link of your Grafana instance (https://<NAME OF DOMAIN>.grafana.net/) with the instructor The instructor will navigate to the link and click the box next to "Consent on behalf of your organization" and "Accept" Once the required permissions are granted sign in to https://<NAME OF DOMAIN>.grafana.net/ in a new session (e.g. incognito mode) and choose Sign in with MicrosoftPlease assign me required privileges.https://parthsinha.grafana.net/

Datapoints can have three main status codes: Good, Uncertain and Bad. https://developer.cognite.com/dev/concepts/reference/status_codesIs it possible to define a user defined status code? In our case, that would be Replaced. (I’m aware of the the sub category GoodEntryReplaced under Good, but it would be great to have Replaced as a main status code)

Good afternoon, I have to create a variable of type "query" in grafana, I have a data model called "DM_ALL_ASSET_QUALITY_PASSPORT"" with the "Asset_Quality_ListaPropiedades" view, which contains 3 columns that are: "Asset", which is the type of assets, "Header" which tells me if it is General or Metadata, and there is the "Property" column. which contains the properties that each type of assets belongs to, my problem is when I try to call the "Properties" depending on the assets, but I always get this type of error: "Parser: Syntax error: assets{metadata={Type='Manifold'}} | select {Property}" , I try to run the query "assets{metadata={Type='${Asset}'}} | select {Property}" I have tried in different ways but I have not been able to find someone who can help me, attached image. Thanks a lot @Aditya Kotiyal @HanishSharma @David Alvarez 

Hello Team,We are trying to identify event type from data_modeling.data_models.list sdk method.as for sequences we get a response something like{    "container": {        "space": "pgnig_space",        "external_id": "SimulationResultSequences"    },    "container_property_identifier": "data",    "type": {        "list": false,        "type": "sequence"    },    "nullable": true,    "auto_increment": false,    "name": "data"}So here we can identify sequnce by type.type= sequence for event type we get something like:{    "type": {        "space": "slb-pdm-dm-governed",        "external_id": "Event.entities"    },    "source": {        "space": "slb-pdm-dm-governed",        "external_id": "Event",        "version": "1_7",        "type": "view"    },    "name": "events",    "direction": "inwards",    "connection_type": "multi_edge_connection"} so here we don't get a type event. It refer s to a view and even if we go inside the view we cannot see any type specified as event.The only differ

Hi,From what I can tell from the documentation and what I can see from the datapoints we have in CDF the datapoints seem to be using milliseconds. My question is if CDF is currently able to handle microsecond timestamps or if this is functionality that would require additional development and whether or not this is on the current roadmap. Markus Pettersen

Hi:In a cognite video I saw that they talked about image and video contextualization, where CDF can recognize and identify patterns in images, is this possible?.I would be very interested in offering this service to my clients. 

I have observed that there is a limitation on search within the pdf documents beyond 100 pages. Earlier the limit was mere 50 pages. We have a commercial project where most of the document are 100 plus pages and I would like to check if this is a product limitation or something else.We would like to be able to search across the entire document without any limit.  

The Assets / Timeseries filter field in Charts shows blank with “recently viewed” list. How to get the full list?Is there any wild card character to show the full list like a * or something ?Also the timeseries filter seems to only work when the filter field has more than 3 characters specified. Is that the expected behaviour?  

I am trying to install some python packages that do not appear to have a wheel which turns into a problem because , as far as I know, pyodide is not able to install packages without a wheel. Here is an example of an error I am receiving  - “Can't find a pure Python 3 wheel for 'psutil==5.9.5'.”-How can I address this issue in Jupyter Notebook and streamlit? Is there a workaround? Is there a way to use a different kernel instead of pyodide?I am not facing this issue with CDF functions. How does CDF functions environment differ from Jupyter Notebook and streamlit?

Hello, I’m using Postman v11.6.0 (the client desktop as well as the lightweight app). I’m to follow instruction of the course “Introduction to API v1 using Postman”. When doing the “import Postman collection”, I’m getting a “failed to import Cognite collection API” with no more detail about what is failing.I have also tried to wdownload the swagger locally, then import it into Postman, but same error.Could you help me please ?

I have to learn this technology and want to know working of CDF so that I can understand how this technology work for a Manufacturing Execution system (MES) ? How to develop and test this technology for MES?

Hello everyone:I have a problem starting the DBExtractor service, it gives me the following error:Services: Event Viewer windows: but the folder and file if it exists: my operating system (it was also tested on windows server 2012 giving the same error):  

Our dev environment (slb-wcdf-dev) has the following limits setContainers 1,000Views 10,000We are getting close to the limit of containers. Can we get the limit on containers set to 10,000 also.

Hello everyone,I'm encountering an issue while working with Data model and SQL Transformation. I have a data model where I use a composite type to represent measurements. Here's a detailed description of my situation and the problem I'm facing.ContextI want to model a type Metrics that includes two attributes, temperature and humidity. Each of these attributes is a composite type Measure, containing two sub-attributes: value and unit. Here is what my schema looks like in GraphQL:enum Unit {  Celsius  Percent}type Measure {  value: Float!  unit: Unit!}type Metrics {  temperature: Measure!  humidity: Measure!}ProblemAlthough this model is syntactically correct in GraphQL, I am having difficulties loading this model using Cognite Data Fusion's SQL transformation. I haven't found a way to cast the unit and value fields into a Struct of type Measure.Attempted SQL TransformationI've tried several approaches to write the SQL transformation, but I can't seem to get the correct format. Here is

Hi!I have a question about how a redeployment of a Cognite Function works. Lets say we have the following scenario:A python backend fetches data from CDF in a pre-defined time window, cleans, and transforms it. Then calculates KPI timeseries. A deployed Cognite Function runs the backend on a schedule every 10 minutes. The calculated KPI time series is appended to an existing Time Series object in CDF. I.e., the Time Series is updated with KPIs for the last 10 minutes every 10 minutes. A frontend reads data from the regularly updated Time Series in CDF and visualizes it in various ways.This workflow goes on normally for quite some time, until we have developed new functionality in our backend. We want to redeploy the Cognite Function with the new functionality. What happens now? Do we have to delete the old function before creating the new one? This may lead to downtime if the deployment for some reason takes so long that we move into the next time window for the the data fetch. Our Tim

There seems to be a bug in Fusion when it comes to rounding up numbers.The shortened numbers in the below examples should not have a + at the end, since that would implicit a higher number than 137K, but the actual number is lower than 137K  

Hello team, I was trying to trigger a workflow by passing the workflow input tasks and setting the onFailure to skipTask, as I did not want my workflow to be aborted if some task fails.Despite of triggering the workflow by sdk and passing the workflow input.,I can see that the workflow has been trigerred but with onFailure to be abortWorkflowCould you please help me with solving this. code for triggering workflow:workflow_input = {    "tasks": [  {    "externalId": "gb-test-func-1",    "type": "function",    "name": "1710479974441",    "parameters": {      "function": {        "externalId": "gb-test-func-1",        "data": {}      }    },    "onFailure": "skipTask",    "dependsOn": []  },  {    "externalId": "gb-test-func-2",    "type": "function",    "name": "1710482066717",    "parameters": {      "function": {        "externalId": "gb-test-func-2",        "data": {}      }    },    "onFailure": "skipTask",    "dependsOn": [      {        "externalId": "gb-multiplication-by-2"      }