Solved

Is there any way like extraction pipeline apis to configure for Cognite MQTT Extractor?

Hi Team,I am trying to get details of broken files uploaded in CDF . Is there any way to query actual file size from CDF using python sdk without downloading the file? Please add a feature to query file size using python sdk to get the corrupted/broken files. Thanks in advance.

What occurs if the data is not appropriately transformed?

I was trying to create a flow to refresh all views in one of my solution model in a project. All my transformations are running individually without failing. But as soon as I run the Flow, only first transformation runs, the second one fails with an unclear message “Something went wrong”. I understand this is an EA features as of now, but I see a lot of application of this feature in one of our projects hence I am trying to setup some flows in it. Could you please help in checking if I am doing something wrong here?Task ID - 1dfb440d-c678-43a4-8c67-0d98467694e8 Flow Definition:[  {    "externalId": "tr-tr-SDM-WellStatus-Entity",    "type": "transformation",    "name": "1706783603193",    "parameters": {      "transformation": {        "externalId": "tr-tr-SDM-WellStatus-Entity",        "concurrencyPolicy": "fail"      }    },    "onFailure": "abortWorkflow",    "dependsOn": []  },  {    "externalId": "tr-tr-SDM-Well-Status-Hierarchy",    "type": "transformation",    "name": "1706783606

The transforamtion is pointing for missing isstring colomns 

I am developing a outlier detection model. The model will be accessed by users through a Streamlit app. At the moment I am assessing whether deploying the model through the Streamlit page in CDF would be a good option. My issue is that I am not sure what the most efficient way to access and import the dataset into the app is. Would it be a good approach to create a data model and import the data from there, or extract the data straight from raw? Another idea I had was setting up a scheduled Cognite Function to download the data as a csv and letting the app access that. I need the data to be updated a few times a week and have the “import” time in the app to be fairly quick for the user experience in the app to be good.My dataset is around 1 million rows with three numeric and two non-numeric columns. For now, I have the data as a raw table in CDF.Thanks!

How can I use Machine Learning Models inside Cognite data fusion?

Hello, I am following the Learning path tutorial for CDF transformations.I’m in the step that I’m supposed to upload the csv data files to the RAW Database I’ve just created. After I select the file for upload the UI simply does nothing, poking around in DevTools I find out the upload request for the files I’m trying to upload is returning error 405 (Method Not Allowed).I am using the mocked files provided by the learning path tutorial: https://learn.cognite.com/path/data-engineer-basics-transform-and-contextualize/cdf-transformations-course/1196833 Am I doing something wrong, or is this a bug?

I have 3 Tablestime series timeseries2asset assetfor asset, i am using this sql query SELECT-- CAST(a.`tag` AS STRING) AS name,-- CAST(a.`description` AS STRING) AS description,-- CAST(a.`sourceDb` AS STRING) AS source,CAST(a.`externalId` AS STRING) AS externalId,-- MAP(-- 'key', CAST(a.`key` AS STRING),-- 'updatedDate', CAST(a.`updatedDate` AS STRING),-- 'createdDate', CAST(a.`createdDate` AS STRING),-- 'isCriticalLine', CAST(a.`isCriticalLine` AS STRING),-- 'areaId', CAST(a.`areaId` AS STRING),-- 'isActive', CAST(a.`isActive` AS STRING)-- ) AS metadata,-- CAST(NULL AS LONG) AS parentId,CAST(a.`parentExternalId` AS STRING) AS parentExternalId-- 7470047 AS dataSetId,-- ARRAY(NULL) AS labelsFROM `CognitePOC`.`assets` afor timeseries i am using this query select   cast(`external_id` as STRING) as externalId,   cast(`name` as STRING) as name,   cast(`is_string` as BOOLEAN) as isString,   cast(`unit` as STRING) as unit,   cast(`is_step` as BOOLEAN) as isStep,   cast(`description` as STRING

I am doing asset transformation asset Source Target key   categoryId   sourceDb source parentExternalId parentExternalId updatedDate   createdDate   externalId externalId isCriticalLine   description description tag   areaId   isActive   I don't have all the columns for mapping to target schemaThese are the rest target columns what to do if the mapping column is not there? and where should i add the rest additional columns from source? parentId metadata name dataSetId labels

Hi community,I have noticed a large discrepancy in runtime when running my handle function as a single Cognite Function call and when I run the handle function locally. And yes, this is the runtime of the actual CALL, not the creation/deployment of the Cognite Function. The handle function is doing some calculations on a time series with around 500 000 datapoints. Locally, it runs under 1 minute, while through Cognite Function call it takes around 9 minutes. Do you have any idea what could cause the large discrepancy?Thanks!

Hi all. I’ve been trying your tutorial on How to Connect CDF to Power BI, to no avail.I am not using SUbscriptions since I do not have the permissions to write one right now. So, I was just trying to execute via Time Series API or even submit a post via curl.But the problem is with the Power BI API’s URL. Eventhough I try to make a POST, by using curl, it’ll return response 401. Can anyone give me a hand here?Do I need an admin to give me write permissions?

Hi team,I have the following questions,How does CDF handle unit of measurement. Is there a concept of storage unit system and display units system Eg; If a certain time series dataset have Celsius scale and other have Fahrenheit and kelvin scale. How does CDF store these in dataset and does it offer functionality for conversion.  If I want to build a chart with multiple time series have data with different units, does CDF offer unit conversion on the fly so that I can have everything displayed in a different units? I would like to have a comprehensive documentation for it.

Hi,I was wondering where I can find information about how to set up the permissions for a file extractor reading only files from a few sites in SharePoint, i.e., not giving the extractor access to all sites. I have solved it using the GraphAPI, but this is quite cumbersome, so I was wondering if we have documentation on how this can be set up. I’ll post my solution below for clarity on how I solved the issue:_______________________________________________________________________________You will need to create two applications. One that is used in the file extractor and one to give access to the file extractor.Register the File Extractor App: Go to the Azure Active Directory portal. Click on "Azure Active Directory" then click on "App registrations". Click on "New registration" to register a new app. Grant API Permissions: Once your app is registered, click on the app's name to go to its dashboard. Click on "API permissions" in the left panel. Click "Add a permission". Choose "Mic

When I use the search function in Data Explorer it shows information from other locations that I am not interested in.  How can I search and show results only for my location?  Thank you.  

Hi There, We have multiple CDF transformations running on schedule for every 15 minutes. Sometimes these jobs are taking more than 15 minutes and leading to Transformation failure with an error - ‘A job already runs for this transform ’. Is there any provision for us in CDF to not run a job/transformation while it is running already. 

I have one question related to 3d models. I would like to explore does reveal/cognite supports programmatic change of animation on 3d model. What i am looking for is, i have 3d model of pump and would like to change the animation speed depending on the speed i set from javascript code (basically real time speed which i get from my api). Does it possible ? If so could you guide me to example code how to do that. Thanks

Hi,I’m trying to search for signals where I know some keywords in the name string. I’m not interested in any fuzzy matches but rather just like to see only results which contain a certain phrase. This seems not to be possible unless I activate fuzzy (which then gives to many results). Is there a way to activate “partial match” but without having fuzzy search activated?

I am reporting the following issue: Steps to reproduce:Login to cognite (I used non prod / QA environment) Go to transform data Create a transformation by providing all required fields Transformation is created but is very slowSometimes at the end of point 2 the cognite web page becomes un-responsiveAlso in general it is observed degraded performance for testing the groups and capabilities in manage access.The page is becoming unresponsive. Please find attached a screenshot of this.

Hi,Is it possible to display stepwise connection between datapoints in Charts rather than the standard linear interpolation?Thanks!

Greetings,I would like to get a view of which files uploaded to CDF through extractors have not been completely uploaded and only partially uploaded.In order to do this, I wanted to write a python script that compares the files sizes in the RAW metadata tables with the actual file sizes in CDF. The question is, is there a way to retrieve file size directly of a file in CDF through python SDK without having to download the files locally?Thanks in advance

As of today I think the Python SDK is only accessible via pip. While I can install a pip package into a conda environment, I don’t really like this solution. Are you planning on releasing a conda package for the Python SDK?

Hi, I got error while submitting my 3rd attempt. It gives error when I submitted my answers. Kindly help to resolve this issue. Thank you,Amol

When I upload a file into Classic data model, how do I associate that file object to Flexible Data Model (FDM) object and retrieve the file object data using Graph API from FDM.