Skip to main content

Product Ideas Pipeline

Filter by Idea Status

Filter by Topic

1336 Ideas

Gunnar AndreasSeasoned ⭐️⭐️

Full API access to inspect and update instances in ChartsGathering Interest

Today there is limited to no API access to Charts, creating several issues.One obvious issue is that we cannot automate the setup of Charts. Eg, when an anomaly detection method detects an issue, we would like to be able to auto-create the Charts with the necessary timeseries, timerange, calculations and overlay anomaly insight (CogniteActivity extension). This is not possible today (only pre-build url with instances and range).But another issue is around the maintainability of Charts. Due to the limit on the number or Views/revisions, we need to deprecate and delete old revisions on a regular basis (in particular in periods with heavy data model development). As far as I have seen, Atlas, Canvas and Chart lock the View version to the latest version (or maybe based on the location filter) during config. For Atlas agents and Canvas’ we can find the View versions via the API, allowing us to identify users depending on models that are deprecated, and also auto-duplicate with the updated versions/views. However, with Charts this is not possible. If Charts is supposed to only be a do-my-analysis-and-then-throw-it-away tool, that is ok, but if it is intended to be used for more long term analysis (it does offer functionality for this like calculations and threshold monitoring) we need a way to monitor status and update the views/instances in the Charts on an enterprise level (via API) 

tainabouzanPractitioner ⭐️⭐️⭐️

Ability to configure the PI Extractor to include ptsecurity and datasecurity attributes in the extracted metadataGathering Interest

 As a CDF Platform Administrator,I want the ability to configure the PI Extractor to include ptsecurity and datasecurity attributes in the extracted metadata,So that I can use these source-level access control lists (ACLs) to automate and enforce data access security for groups of users in Cognite Data Fusion.  Configuration OptionsGIVEN a standard PI Extractor installation,WHEN looking at the extractor configuration file (e.g., config.yml),THEN there must be a new, optional configuration parameter (e.g., include-internal-security-metadata: true/false or an override setting).GIVEN the configuration parameter is omitted or set to false,WHEN the extractor runs,THEN it must continue to exclude ptsecurity and datasecurity metadata as it currently does (default secure behavior). Extraction BehaviorGIVEN the configuration parameter is set to true,WHEN the extractor performs discovery and extracts Time Series metadata from PI,THEN the ptsecurity and datasecurity attributes must be successfully captured and populated as key-value pairs in the CDF Time Series metadata block.GIVEN the configuration parameter is set to true,WHEN a source PI point has empty or null values for these security fields,THEN the extractor should gracefully skip writing those specific keys to CDF metadata without throwing errors or halting the extraction process.

tainabouzanPractitioner ⭐️⭐️⭐️

Configurability to arrange the categories to be multilevel (tree) for SearchGathering Interest

As I solution architect I would like to arrange persistently all my categories in my landing “Search page”, in a multilevel (tree) format, with minimal 2 levels, so the “Search page” is not convoluted/big and users still have access to all their categories with minimal clicks. As of today, I see that the only categories that allow multiple levels are the ones that were “inherited” from the old resource types, such as asset, files, time series, activity. Everything else added in the data model will be available view bullets.For PBF we have several data models within the same project, what causes the search page to be very extensive and not user friendly. As a workaround, we created a solution data model and configured a new location to expose a simplified “search page”, but for that we are omitting several of the categories that users would like to see. So if the user wants to access data that is not in this simplified view he/she needs to select the “full” location that has all the data, what is a bad user experience in terms of multiple clicks.. on the other hand if we keep everything exposed it is very hard to find a category and the search page gets convoluted. In the work around we implemented, user can still change location go from the “full” location to the “simplified” location, but it requires multiple clicks, what is not desirable. A better solution would be to allow multilevel configuration for categories (parent/child relationship), so we could groups categories that are related to each other. Also the data would be more organized and friendly from the user point of view. Note: The following it is just and example to show the desirable outcome for a “look & feel” in terms of arranging data, please ignore the “material” reference, once it is not relevant.- Material  - Material Group  - Material Type  - Material Status  

Luciana Velasco MedaniPractitioner ⭐️⭐️⭐️

Feature Request: Remove or Increase Azure AD Group Membership Limit for Service PrincipalsGathering Interest

 Cognite Data Fusion (CDF) appears to enforce a limit of approximately 200 Azure AD group memberships when resolving permissions for Service Principals. This limitation does not exist in Microsoft Graph, which supports retrieval of all group memberships associated with a user or Service Principal.As organizations scale their authorization models using Azure AD groups, this restriction can prevent access inheritance from functioning as expected and requires manual workarounds that increase operational overhead and governance complexity.Business ContextMany enterprise deployments use Azure AD groups to manage access to assets, plants, data products, and other resources within CDF.A common architecture relies on: Azure AD groups representing access domains. Group Object IDs mapped to corresponding Source IDs in CDF. Service Principals inheriting permissions through group membership. However, when the number of group memberships exceeds the current supported threshold, some memberships are not considered during authorization, resulting in incomplete permission resolution.Current WorkaroundThe current workaround consists of adding Service Principals directly to individual access groups instead of relying on inherited permissions through the existing group structure.While functional, this approach presents several challenges: It does not scale as the number of groups and data products grows. It increases administrative effort and maintenance activities. It complicates access governance and auditing processes. It introduces a higher risk of configuration errors and permission inconsistencies. Problem StatementThe current behavior creates a gap between Microsoft Entra ID (Azure AD) authorization capabilities and CDF authorization behavior.Since Microsoft Graph supports retrieval of all group memberships, the limitation appears to stem from the current implementation within CDF rather than from the underlying identity provider.This can impact organizations that rely on group-based authorization models to manage access at scale.Business ImpactOperational Impact Increased administrative effort for access management. Additional maintenance when new groups, assets, plants, or data products are introduced. Reduced efficiency of centralized identity management practices. Governance Impact Increased complexity in maintaining access-control policies. Reduced effectiveness of group-based authorization strategies. Greater effort required for auditing and access reviews. Security and Compliance Impact Increased reliance on manual permission assignments. Higher risk of access inconsistencies. Potential compliance concerns resulting from non-standard authorization processes. Scalability Impact Reduced scalability of Azure AD group-based authorization models. Growing operational burden as enterprise environments expand. Limitations on adoption of best-practice identity and access management patterns. Requested EnhancementEnhance CDF authorization to support all Azure AD group memberships associated with a Service Principal, or significantly increase the current limit, ensuring alignment with Microsoft Graph capabilities.Possible implementation options include: Removing the current membership limit. Supporting pagination when retrieving group memberships from Microsoft Graph. Supporting complete transitive group membership resolution. Providing configurable limits for enterprise deployments where required. Expected Benefits Improved scalability of enterprise authorization models. Elimination of manual access-management workarounds. Better alignment with Microsoft Entra ID / Azure AD capabilities. Reduced operational, governance, and compliance risks. Simplified lifecycle management for users, groups, and Service Principals.

Lucas Rosa AlvesSeasoned ⭐️⭐️

Storage for Intermediate Workflow tasksGathering Interest

SummaryWhen building workflows in Cognite Data Fusion to populate views in Data Models, there is often a need for intermediate, curated datasets between raw source data and the final target data model.Today, this intermediate data can be stored in RAW tables, but that requires customers to manage temporary tables, cleanup logic, naming conventions, and lifecycle handling manually. A native, workflow-managed temporary storage layer would make workflow development cleaner, reduce repetitive transformation logic, and simplify the overall implementation.  Business ContextWe are using CDF workflows to populate an Asset Hierarchy data model.The source data comes from multiple systems:SAP Functional locations Equipment AVEVA PI Tag metadata The target asset hierarchy data model contains the following views:Site Area Line Equipment System Subsystem TagThe source metadata arrives without the required treatment, standardization, or contextualization. Before writing to the final data model, the data needs to be cleaned, normalized, enriched, and structured according to the target hierarchy.Current ChallengeIn practice, the workflow needs several intermediate transformation steps before writing to the final views.For example, the workflow may need to transform SAP functional locations into a cleaned and standardized structure before deriving sites, areas, and lines.Example flow for Site: tb_functionalLocation  -> tb_functionalLocation_curated  -> tb_site_curated  -> Site view Example flow for Area: tb_functionalLocation  -> tb_functionalLocation_curated  -> tb_area_curated     uses tb_site_curated for contextualization  -> Area view Example flow for Line: tb_functionalLocation  -> tb_functionalLocation_curated  -> tb_line_curated     uses tb_area_curated for contextualization  -> Line view Example flow for Equipment: tb_equipment  -> tb_equipment_curated  -> tb_equipment_contextualized     uses tb_line_curated / tb_area_curated for hierarchy mapping  -> Equipment view Example flow for System and Subsystem: tb_functionalLocation + tb_equipment  -> curated functional location and equipment tables  -> tb_system_curated  -> System view tb_functionalLocation + tb_equipment  -> curated functional location and equipment tables  -> tb_subsystem_curated  -> Subsystem view Example flow for Tag: tb_tag  -> tb_tag_curated  -> tb_tag_contextualized     uses equipment/system/subsystem curated data  -> Tag view These intermediate curated tables are useful because they allow the workflow to:Reuse cleaning and standardization logic across multiple transformations. Avoid duplicating the same transformation logic in every step. Avoid using the final data model views as inputs to transformation logic. Keep the workflow logic easier to understand and maintain. Separate raw source data, intermediate workflow state, and final modeled data.However, this intermediate data can be transient. It is only needed while the workflow is running. After the workflow finishes successfully, the data can be deleted. There is also value to optionally allow users to view this intermediate datasets to analyze/debug the quality of the contextualization. Today, we can use RAW tables as intermediate storage, but this creates additional responsibilities for the customer:Creating and maintaining temporary RAW tables. Cleaning intermediate tables before or after each workflow run. Preventing stale intermediate data from being reused accidentally. Managing naming conventions for temporary workflow data. Adding cleanup steps to the workflow. Handling failed workflow runs where temporary data may be left behind. Writing additional code that is not part of the actual business transformation. Product IdeaIntroduce a native workflow-managed temporary storage capability in CDF.This could work as an internal temporary storage layer for workflows and transformations, where intermediate datasets can be written and read by different workflow steps, but their lifecycle is managed by the workflow execution itself.Ideally, this temporary storage would be:Scoped to a workflow or workflow run Usable by transformation steps Automatically cleaned up after successful execution, while still allowing end users to later review intermediate datasets for debugging. Temporarily retained for debugging and/or review Separated from RAW and from the final Data Modeling views Managed by CDF instead of customer-maintained cleanup logic Expected BenefitsThis capability would make workflow-based data modeling pipelines much cleaner and easier to maintain.The main benefits would be:Reduced amount of customer-managed code. Less duplication of transformation logic. Cleaner separation between raw data, temporary workflow state, and final modeled data. Reduced risk of stale intermediate data impacting future workflow runs. Easier debugging and monitoring of workflow execution. More straightforward workflow design for complex contextualization processes. Better support for multi-step data preparation before writing to Data Modeling views.