Skip to main content

Product Ideas Pipeline

1170 Ideas

P
Committed
PalakshaCommitted

Rendering word document increases pages in CDF UIClosed

When .docx file ingested into Cognite Data Fusion UI, document pages increases while user viewed in CDF.This creates confusion for user to navigate any particular page number to check the documents details.For example, a word document pages in source is 51 but its page counts increase to 69 when same document is ingested & viewed in CDF,

1
Arun Arunachalam
Forum|Forum|1 year ago
Anders Brakestad
Seasoned
Anders BrakestadSeasoned

Power BI Connector: Cannot filter on external id when using push-down filtering to load Sequences into CDFNew

We use push-down filtering to get our relevant data from CDF into Power BI. We filter on the external ID property, since this is constant across our environments in CDF. Here is an example of that this looks like: Source = Cognite.Contents(cdf_env & "/Timeseries/?$filter=ExternalId eq 'an_external_id'", null) This works great for Time Series, but doing the same thing for Sequemces leads to an error:DataSource.Error: Microsoft.Mashup.Engine1.Library.Resources.HttpResource: Request failed: OData Version: 3 and 4, Error: The remote server returned an error: (400) Bad Request. (The provided filter was invalid.)OData Version: 4, Error: The remote server returned an error: (400) Bad Request. (The provided filter was invalid.)OData Version: 3, Error: The remote server returned an error: (400) Bad Request. (The provided filter was invalid.)Details: DataSourceKind=Cognite DataSourcePath={"project":"akerbp-dev\/Sequences?$filter=ExternalId eq 'val_alarms_top_10_weekly'"} Push-down filtering on the external id seems to be supported based on the information here; Am I doing something wrong? Is there maybe a bug somewhere? Filtering on the Name attribute does work, and it keeps us going for the moment, but I don’t like that the Name is not a unique identifier of the object. Thanks for any help and advice! :) 

4
Isha Thapliyal
Forum|Forum|1 year ago
V
Practitioner
Viet LePractitioner

Cognite Data Fusion: Explore Assets search and hierarchy view suggestionsImplemented

Search results in the hierarchy view of Explore Assets is difficult to use. It’s almost impossible to find what you are looking for in a very large/deep hierarchy. We are almost always resorting to the list view and disregarding the hierarchy view entirely since even after searching, one finds themselves scrolling and scrolling to find yellow matches. Because the hierarchy view also shows close matches, the view is littered non-exact matches.After finding the asset, you can only view children. There is no way to navigate to the parent from the asset view. It is quite useful for us to find an asset and be able to view the ancestry tree to the root and its children.The ONLY way for us to get the ancestry view of a particular asset goes like: Explore Data → Assets Search Skip Hierarchy view, use List View instead View Details of the Asset, copy the External ID Open Filters Put External ID in filter Finally have a hierarchy view with only the ancestry of a particular Asset I have some suggestions that may help bring some usability into search.  An option to show exact matches only… for times I know exactly what I am looking for. (99% of the time) Similar to Find in a document search, there needs to be a Next and Previous button that auto-focus on the next match. There needs to be a way to navigate up and down the ancestry tree. One can only descend from Asset to Children. It is impossible to navigate from Asset to Parent. Instead of a Children tab, perhaps just show the Lineage/Ancestry of all Assets in this family tree? Perhaps give the option to show how many degrees up and down from the current asset, in case there are hundreds or more in a family. We are not able to search by ID, this would help allow us to find the exact search. Search box results should not reset, such as the user’s position or search text, via actions in an expanded sheet on the right. EX: Have a very large hierarchy. Search for an Asset via text in Hierarchy view (no filters), something that required scroll down to middle of search results, click on it. Its details are expanded in a sheet on the right. Click any Tab in the sheet. (Children, Asset, …) Search text and position in the search results are fully reset.

14
Sofie Svartdal Berge
Forum|Forum|1 year ago
B
Active
BobKingActive

Cognite Data Fusion - Data Sets filterImplemented

For our site, I know how to filter our site data sets to narrow selection of data.  Instead of selecting multiple data sets to search only within our site, would it be possible to use wildcards or another filter to limit the search to our site?

3
Sofie Svartdal Berge
Forum|Forum|1 year ago
J
Seasoned
Jesse JenkenSeasoned

Hosted Extractors Require Alerts when going offlineClosed

We have more than once now discovered our Time Series data which is currently being extracted using the Event Hub Hosted Extractor within the platform, has stopped extracting data for reasons we cannot determine. To make hosted extractors production-worthy they must be able to notify platform owners when they fail, which they currently do not, and instead keep polling with bad session or connection info. Here’s what this looks like in the logs provided by the hosted extractor Insight view:For starters, this shouldn’t have 0 datapoints per hour.  That’s a potential opportunity for threshold alerting.Expanding the details, these repeated failures are nondescript and do not indicate why things failed.  Discovering these issues reactively after platform users have asked why data is not trustable (things are missing), will present challenges for platform trust.  We are not yet into production with our platform and must find a solution to this before the data can be used by our teams.  

1
T
Forum|Forum|1 year ago
L
Committed
Lucas Rosa AlvesCommitted

Data Model/Data instances capabilities enhancementsGathering Interest

Currently, the data model and data model instance actions are limited to read and write capabilities.To enhance clarity and delineate responsibilities within CDF groups more effectively, I propose dividing the existing configuration into distinct categories: read, write/update, and delete.Another enhancement is to disallow the deletion of containers that have associated views. The same principle applies to views; they cannot be deleted if other components (views or data models) are referencing them. 

4
L
Forum|Forum|1 year ago
S
Committed
shubha k vCommitted

New feature for SAP/DB extarctorClosed

Hi,Is it feasible to incorporate a new feature into the SAP extractor that facilitates reporting? For instance, scheduling the SAP extractor on a daily basis to append data to the raw database, even if the primary key remains the same for subsequent days, and ensuring that it does not overwrite existing data.Presently, we've implemented a workaround by including a date field in the key and utilizing our own extractor to accomplish this. Can this functionality be achieved using the Cognite SAP extractor?Also same for DB extractor  Support ticket raised is https://cognite.zendesk.com/hc/en-us/requests/10724?page=1. Thanks,Shubha

8
T
Forum|Forum|1 year ago
H
Committed
Harshita SaiCommitted

SAP Cognite Extractor - Dynamic fields addition in keyClosed

Hi Team,In SAP Cognite Extractor, Till now we were able to use multiple existing columns in the key. Now, the requirement is like I want add some dynamic field in the key Like Usecase:Key : [Key1, Key2]Proposed Idea: I want append the date for all the keys so that I can keep track of all the records changes in every day.Key: [Key1, Key2, <Currentdatetime>] Thanks in advance,Sai Harshita   

3
T
Forum|Forum|1 year ago
M
Committed
MatiasRamslandCommitted

Suggestion to Run Docker Extractor Images as Non-Root UserParked

Hi,I noticed that the current setup with the Dockerfile cognite/db-extractor-base runs the extractor as the root user within the container.In our use case, we have to heavily modify the Dockerfile to change the setup so that it runs as a non-root user. It would be highly beneficial if the Docker image either accepted an argument to run as a non-root user or, preferably, ran the script as a non-root user by default. Running containers as the root user is not best practice for containerized development and is often restricted in organizational environments.I'm not sure if there is an intentional reason for running as root, or if this aspect hasn't been considered yet at Cognite.If you are open to changing this, I can assist and provide our current solution. I believe this adjustment would improve security and compatibility for multiple users.Best regards,Matias Ramsland,matias.ramsland@akerbp.com

5
T
Forum|Forum|1 year ago
ibrahim.alsyed
Seasoned
ibrahim.alsyedSeasoned

Cognite FDM: Need Help on QueriesClosed

It is not possible to aggregate edges, making it impossible to create queries such as: How many reporting units are at the Reporting Site CLK? The aggregation API of Cognite has several limitations; we cannot group by date. More complex filters do not work either. Aggregations are limited to primitive fields in the GraphQL API. Using the GraphQL API, we cannot filter an object type based on its edge. For example, querying the reporting sites associated with a specific reporting unit is not possible. Pagination parameters are unstable. For instance, the "has previous page" parameter does not work. The limit of 10,000 items for subqueries in the SDK Query method makes pagination extremely costly. We believe this limit should only apply to the select output. It should be possible to filter and sort by the createdTime and lastUpdatedTime columns in FDM. There is a lack of search capabilities using wildcards or case-insensitive searches with multiple parameters. The Cognite API lacks transaction capabilities. FDM documentation should have more examples.

3
Elka Sierra
Forum|Forum|1 year ago
Jay Vansickle
Practitioner
Jay VansicklePractitioner

Cognite FDM 8 (on behalf of Celanese)Implemented

The Cognite API lacks transaction capabilities.

1
Elka Sierra
Forum|Forum|1 year ago
Jay Vansickle
Practitioner
Jay VansicklePractitioner

Cognite FDM 7 (on behalf of Celanese)Gathering Interest

There is a lack of search capabilities using wildcards or case-insensitive searches with multiple parameters.

1
Elka Sierra
Forum|Forum|1 year ago
Jay Vansickle
Practitioner
Jay VansicklePractitioner

Cognite FDM 6 (on behalf of Celanese)Implemented

It should be possible to filter and sort by the createdTime and lastUpdatedTime columns in FDM.

1
Elka Sierra
Forum|Forum|1 year ago
Jay Vansickle
Practitioner
Jay VansicklePractitioner

Cognite FDM 5 (on behalf of Celanese)Closed

The limit of 10,000 items for subqueries in the SDK Query method makes pagination extremely costly. We believe this limit should only apply to the select output.

1
Elka Sierra
Forum|Forum|1 year ago
Jay Vansickle
Practitioner
Jay VansicklePractitioner

Cognite FDM 4 (on behalf of Celanese)Gathering Interest

Pagination parameters are unstable. For instance, the "has previous page" parameter does not work.

1
Elka Sierra
Forum|Forum|1 year ago
Jay Vansickle
Practitioner
Jay VansicklePractitioner

Cognite FDM 2 (on behalf of Celanese)Planned for development

The aggregation API of Cognite has several limitations; we cannot group by date. More complex filters do not work either. Aggregations are limited to primitive fields in the GraphQL API.

1
Elka Sierra
Forum|Forum|1 year ago
Jay Vansickle
Practitioner
Jay VansicklePractitioner

Cognite FDM 1 (on behalf of Celanese)Implemented

It is not possible to aggregate edges, making it impossible to create queries such as: How many reporting units are at the Reporting Site CLK?

1
Elka Sierra
Forum|Forum|1 year ago
R
Committed
robert.rillCommitted

Entity matching features option on Interactive Diagrams screenParked

When creating interactive engineering diagrams on the Cognite web UI, we have the option to select between standard and advanced model.It would be beneficial to have the possibility to combine this with customized entity matching and be able to choose from available feature types (such as "simple", "bigram" etc.).This option would be just as, if not more, useful as the advanced detection model.

4
R
Forum|Forum|1 year ago
O
Committed
oivindhoivikCommitted

Add support for datetime index for sequencesClosed

We use CDF to store model result that in essence is a dataframe with datetime index and multiple columns for each scenario/attribute/timeseries. This could be a weather forecast model or a hydropower optimization model etc. We wish to store the model results as a sequence as the values are related to the same model run and would require a significant amount of timeseries (given that the models are run several times a day and produce thousands of timeseries for each run). We would therefore appriciate if sequences would support datetime index, and not just int. This would reduce the code we need to wrap around the cdf client in order to store our dataframes.  

5
Glen Sykes
Forum|Forum|1 year ago
Markus Pettersen
MVP
Markus PettersenMVP

Convert PDF to SVGClosed

I have quite a few engineering diagrams that have been annotated in CDF and now we need to convert them to SVGs in order for some third party application to read them. The API supports this, but the Python SDK does not, or at least not directly. It is possible to force the behavior, but it requires a cumbersome workaround to “trick” the SDK.The SDK seems to expect that the convert job is the next after detect, in theory this makes some sense, however in reality this is not how it will be done. The process will be to detect annotations, then get them approved, then generate the SVG file. The middle step is a manual and the convert job will be run as a separate pipeline.As shown below, the API supports this by having the feature that we can send in the file and the annotations, the input for the SDK is the output of detect. It is possible to replicate the required input, but it is cumbersome. Is there a way to more simply use the files and the annotations through the SDK to convert the files after the fact?Ideally I would want to do something like this:files = client.files.list(data_set_external_ids=docDataSetExtId)ext_ids = [f.external_id for f in files]flt = AnnotationFilter(annotated_resource_type="file", annotated_resource_ids=[{"externalId": ext_id} for ext_id in ext_ids])annotations = client.annotations.list(flt, limit=-1)# Thisclient.diagrams.convert(files, annotations)# or like thisfor file in files: flt = AnnotationFilter(annotated_resource_type="file", annotated_resource_ids=[{"externalId": file.external_id}]) annotations = client.annotations.list(flt, limit=-1) client.diagrams.convert(file, annotations)# Or even just having the SDK handle all of it in the background (best option for me)# And then the SDK or CDF itself just retrieves all annotations linked to the fileclient.diagrams.convert(external_id=file.external_id) https://cognite-sdk-python.readthedocs-hosted.com/en/latest/contextualization.html#convert-to-an-interactive-svg-where-the-provided-annotations-are-highlightedhttps://api-docs.cognite.com/20230101/tag/Engineering-diagrams/operation/diagramConvert 

5
Que Tran
Forum|Forum|1 year ago
A
Active
asahafActive

Enhancing the Data Explorer to Filter 3D Images by DatasetClosed

Currently, the data explorer functionality does not allow filtering of 3D images based on the dataset they belong to. Since those 3D images are scoped or associated with specific datasets, the data explorer should provide the ability to filter the 3D images by the dataset they are part of."

3
A
Forum|Forum|1 year ago
L
Seasoned
Liliana SierraSeasoned

Load several sequences using same file/queryParked

Oil and gas Industry handle different kind of curves, one of them IPR that curve correspond in CDF to sequence. we must load 500 IPR curves one by every well, but I have found a stopper, when we use ODBC extractor in the sequence destination, must put in external_Id directly  in the yaml configuration file (image belove) , every time that we load an IPR curve.  It will be possible that external_id works like time series, taking data from column? And loading all the sequences with the same file or query, happen the same for oracle queries from database and excel files.@Sebastian Wolter @Aditya Kotiyal 

5
T
Forum|Forum|1 year ago
M
Committed
Malcolm LeaCommitted

Enable use of standard logging library in python for Cognite FunctionsGathering Interest

Hi, sure this has been raised before, but would it be too much to ask to enable standard logging calls in Python when using Cognite Functions. While I am fully aware that it works to use print statements instead, it is very contrary to expectations for most developers that logging would not work, also for your own consultants (various Cognite consultants on our projects have themselves converted print statements to logger.info calls in the name of “best practice”, only to be surprised that nothing gets printed out). Moreover it gives the impression that the product is not quite “working” or that there is “something weird going on”. I would consider it similar to a cosmetic UX defect which is easy to work around: sometimes hard to prioritise, but affects the overall impression of the product when things do not work as expected. Maybe it is time to give it some TLC.

3
M
Forum|Forum|1 year ago
Carlos.Herrera
Practitioner
Carlos.HerreraPractitioner

Automatically suggest threshold values for a checklist item based on historical dataParked

Oxy is requesting for the ability to link Charts to a Infield in a way that based on the historical data available in a time series in charts, the product is capable of making the threshold recommendation for a measurement in Infield. E.g., based on the engine’s measured temperatures over the last year in Charts, the normalized expected temperature is between 90 and 110 °C. So 90 will automatically populate as the lower limit in Infield and 110 as the maximum limit for this motor.

2
Arun Arunachalam
Forum|Forum|1 year ago
B
Active
BobKingActive

Canvas : Selection not visible in windowPlanned for development

When selecting information in Canvas you must move the Canvas to allow visibility of the additional information.  It appears the information always appears to the right of the object selected.  The user has to move the Canvas to enable viewing information.  Would it be possible to display information with respect to the visible window?

2
Andreea Oprea
Forum|Forum|1 year ago

Filter by Topic

  • All Topics
  • 3D
  • Academy Trainings
  • API and SDKs
  • Atlas AI
  • Authentication and Access Management
  • Charts
  • Contextualization
  • Data Modeling
  • Data Quality
  • Data Workflows
  • Developer Tools
  • Drilling and Wells
  • Extractors
  • Functions
  • Industrial Canvas
  • InField
  • InRobot
  • Jupyter Notebooks
  • Maintain
  • Other
  • Product Releases
  • Product Roadmap
  • Public Beta
  • Search and Data Exploration
  • Streamlit
  • Toolkit
  • Pygen
  • Security Updates
  • Simulator Integration
  • Transformations and RAW
Terms & ConditionsCookie SettingsAccessibility statement