Join the conversations to shape a safer, more efficient, and sustainable industrial future!
Recently active
I was trying to create a flow to refresh all views in one of my solution model in a project. All my transformations are running individually without failing. But as soon as I run the Flow, only first transformation runs, the second one fails with an unclear message “Something went wrong”. I understand this is an EA features as of now, but I see a lot of application of this feature in one of our projects hence I am trying to setup some flows in it. Could you please help in checking if I am doing something wrong here?Task ID - 1dfb440d-c678-43a4-8c67-0d98467694e8 Flow Definition:[ { "externalId": "tr-tr-SDM-WellStatus-Entity", "type": "transformation", "name": "1706783603193", "parameters": { "transformation": { "externalId": "tr-tr-SDM-WellStatus-Entity", "concurrencyPolicy": "fail" } }, "onFailure": "abortWorkflow", "dependsOn": [] }, { "externalId": "tr-tr-SDM-Well-Status-Hierarchy", "type": "transformation", "name": "1706783606
I am developing a outlier detection model. The model will be accessed by users through a Streamlit app. At the moment I am assessing whether deploying the model through the Streamlit page in CDF would be a good option. My issue is that I am not sure what the most efficient way to access and import the dataset into the app is. Would it be a good approach to create a data model and import the data from there, or extract the data straight from raw? Another idea I had was setting up a scheduled Cognite Function to download the data as a csv and letting the app access that. I need the data to be updated a few times a week and have the “import” time in the app to be fairly quick for the user experience in the app to be good.My dataset is around 1 million rows with three numeric and two non-numeric columns. For now, I have the data as a raw table in CDF.Thanks!
How can I use Machine Learning Models inside Cognite data fusion?
Hello, I am following the Learning path tutorial for CDF transformations.I’m in the step that I’m supposed to upload the csv data files to the RAW Database I’ve just created. After I select the file for upload the UI simply does nothing, poking around in DevTools I find out the upload request for the files I’m trying to upload is returning error 405 (Method Not Allowed).I am using the mocked files provided by the learning path tutorial: https://learn.cognite.com/path/data-engineer-basics-transform-and-contextualize/cdf-transformations-course/1196833 Am I doing something wrong, or is this a bug?
I am doing asset transformation asset Source Target key categoryId sourceDb source parentExternalId parentExternalId updatedDate createdDate externalId externalId isCriticalLine description description tag areaId isActive I don't have all the columns for mapping to target schemaThese are the rest target columns what to do if the mapping column is not there? and where should i add the rest additional columns from source? parentId metadata name dataSetId labels
Hi community,I have noticed a large discrepancy in runtime when running my handle function as a single Cognite Function call and when I run the handle function locally. And yes, this is the runtime of the actual CALL, not the creation/deployment of the Cognite Function. The handle function is doing some calculations on a time series with around 500 000 datapoints. Locally, it runs under 1 minute, while through Cognite Function call it takes around 9 minutes. Do you have any idea what could cause the large discrepancy?Thanks!
Hi all. I’ve been trying your tutorial on How to Connect CDF to Power BI, to no avail.I am not using SUbscriptions since I do not have the permissions to write one right now. So, I was just trying to execute via Time Series API or even submit a post via curl.But the problem is with the Power BI API’s URL. Eventhough I try to make a POST, by using curl, it’ll return response 401. Can anyone give me a hand here?Do I need an admin to give me write permissions?
Hi team,I have the following questions,How does CDF handle unit of measurement. Is there a concept of storage unit system and display units system Eg; If a certain time series dataset have Celsius scale and other have Fahrenheit and kelvin scale. How does CDF store these in dataset and does it offer functionality for conversion. If I want to build a chart with multiple time series have data with different units, does CDF offer unit conversion on the fly so that I can have everything displayed in a different units? I would like to have a comprehensive documentation for it.
Hi,I was wondering where I can find information about how to set up the permissions for a file extractor reading only files from a few sites in SharePoint, i.e., not giving the extractor access to all sites. I have solved it using the GraphAPI, but this is quite cumbersome, so I was wondering if we have documentation on how this can be set up. I’ll post my solution below for clarity on how I solved the issue:_______________________________________________________________________________You will need to create two applications. One that is used in the file extractor and one to give access to the file extractor.Register the File Extractor App: Go to the Azure Active Directory portal. Click on "Azure Active Directory" then click on "App registrations". Click on "New registration" to register a new app. Grant API Permissions: Once your app is registered, click on the app's name to go to its dashboard. Click on "API permissions" in the left panel. Click "Add a permission". Choose "Mic
When I use the search function in Data Explorer it shows information from other locations that I am not interested in. How can I search and show results only for my location? Thank you.
Hi There, We have multiple CDF transformations running on schedule for every 15 minutes. Sometimes these jobs are taking more than 15 minutes and leading to Transformation failure with an error - ‘A job already runs for this transform ’. Is there any provision for us in CDF to not run a job/transformation while it is running already.
Hi,I’m trying to search for signals where I know some keywords in the name string. I’m not interested in any fuzzy matches but rather just like to see only results which contain a certain phrase. This seems not to be possible unless I activate fuzzy (which then gives to many results). Is there a way to activate “partial match” but without having fuzzy search activated?
Hi,Is it possible to display stepwise connection between datapoints in Charts rather than the standard linear interpolation?Thanks!
Greetings,I would like to get a view of which files uploaded to CDF through extractors have not been completely uploaded and only partially uploaded.In order to do this, I wanted to write a python script that compares the files sizes in the RAW metadata tables with the actual file sizes in CDF. The question is, is there a way to retrieve file size directly of a file in CDF through python SDK without having to download the files locally?Thanks in advance
As of today I think the Python SDK is only accessible via pip. While I can install a pip package into a conda environment, I don’t really like this solution. Are you planning on releasing a conda package for the Python SDK?
When I upload a file into Classic data model, how do I associate that file object to Flexible Data Model (FDM) object and retrieve the file object data using Graph API from FDM.
I am looking for information related to 3d models. I would like to explore does reveal/cognite supports programmatic change of animation on 3d models which are uploaded to cdf. What i am looking for is, i have 3d model of pump and would like to change the animation speed depending on the speed i get from my api (basically real time speed which i get from my api). Does it possible ? If so could you guide me to example code to how to do that. Also the uploaded 3d model in cdf is not displaying like how the original model that was uploaded. After uploading into cdf its not displaying with colors and animations, could you tell me why it is like that ? Thanks
Hello! Was looking around and cleaning some data, and came upon the realization that I can’t find out of you can access Cognite resources that are not contained in a dataset. That is, is there an ability to find/fetch/list Cognite resources that are “floating free”.I have tried setting data_set_ids And data_set_external_ids To None, but this is the same as not having specified it.
Hi, I’m trying to add more fields to Dataset’s property, and would like to display them on the UI. Beside the existing fields (Labels, Owners, external ID, etc...), is it possible to display custom fields on the UI ( similar to metadata’s consoleLabels, consoleOwners). A good example would be how metadata displayed in details of file.
Looking at API documentationhttps://pr-411.docs.preview.cogniteapp.com/api/v1/it seems one can not build an automated pipeline to create and update 3D model only using python SDKs?I aim to make a pipeline using cognite function and python sdk for nightly update reading files from SharePoint and upload or update 3d models in cdf.If its possible, where I can find the guiding document?
I have provided the essential credentials within the config.yml file in the OpcUaExtractor config folder, however when run it get this error. How can I fix this?
Hello Team,I am working on creating POC on PROSPER Connector I checked documentation of Cognite Prosper Connector. Connector is provided by Cognite, but where can I get simulator for POC purpose?Also in connector configuration, where to provide simulator details or simulator name?
If there are large number of instances in a view, wont that load in the fusion UI? Can’t this be fixed with trimming with some max limit and still display?
Hi team, I’m working on OPC UA Extractor. I have configured metadata-targets and configured metadata-mapping.I’m not able to see the metadata along with timeseries data.Please find the configuration in attachment and screen shot in CDF how timeseries data looks like. please let me know if any additional configurations need to be done to see the metadata along with timeseries data.
Hello,What are the best practices around setting the max-workers for a sdk. If I do not set the Global Config all the default values for workers and retries would be picked correct ? Can you give any reference on how we can set GlobalConfig, I mean I did not see any way to pass the GlobalConfig to ClientConfig ?