Product User Community

Hi Developers! :)I have a use case where I need to retrieve a large number of Time Series data points from CDF. We are a final DataFrame with a shape of approximately (1000, 400000).  So a total of 4 billion data points + the index. I also want the data retrieve to be fast…. :)  So instead of retrieving everything in a single call to `client.time_series.data.retrieve_dataframe`, I thought to use multithreading to start the retrieves in an approximately parallel fashion, and then concatenate the resulting dataframaes at huge runtime gains! However, I observe that the results from multithreading do not equal the results from the single call. :( Specifically:I split the data retrieval on Time Series IDs, and concatenate along axis=1. I observe that data from the “first two” threads have a lot of missing data, while data from the last two threads are 100% correct. I have also tried to split the DatetimeIndex and multithread along this dimension, but I see exactly the same result in that so

I would like to know if Cognite visualization has the same features as the one found in Power BI and Tableau.The reason is simply because we need to have Decision Support and Visualization module as part of our overall setup.

Hello,I’m trying to pull energy usage data from a Rockwell power monitor that supports OPC-DA but not OPC-UA. I configured the OPC-DA server (rslinx classic in this case) and I’m able to see the live data using an OPC-DA client (Kepserver). Next I try running the extractor, and it sees the project structure and creates assets, but never creates any time series data. I’m seeing very little in the logs. I did notice that “contious: False” shows up, but I don’t see any way to change that via configuration. I will get a keep alive message as you can see in the second image, but no data. Any suggestions would be greatly appreciated! Thank you.  

Hello everyone,I have a problem viewing 3D. It tells me that I don't have any scenes created, but I do have some. I understand that the error message is because I have to configure the location in the scenes. How do I do that? I don't see the option to add the location.  

Hi Cognite Team,I'm curious about the specific rules you follow for versioning views, particularly with the versioning format like "@view(version: 'v4')". I’ve noticed that the last number is the only one that changes, and I wanted to understand the rationale behind this.In my experience, I typically use the X.Y.Z format, where:Major versions indicate significant changes or potential backward-incompatible updates. Minor versions introduce new features or enhancements. Patch versions address bug fixes or minor improvements.While I understand that tools like DVC are more suited for tracking actual data changes, we are focusing on versioning the views and models. Is this approach aligned with your guidelines?If there aren’t any formal rules, that’s perfectly fine; we’re just trying to establish our own conventions and best practices. Versioning is an important aspect for us, and any insights you could share would be greatly appreciated.

In a hypothetical scenario where your company has more than 100 sites across different countries, each containing multiple units, it's important to organize data in a way that ensures scalability, flexibility, and ease of maintenance.We have our own perspective on the matter, but we would like to hear from other specialists, especially those experienced in data modeling approaches, like yourself. Example 01: Managing Employee Information Inside CogniteQuestion: Should we separate SPACEs for each site? Example Structure in Cognite Data Fusion:You can structure the SPACEs for your company’s sites and units as follows: Top Level: Country Create a SPACE for each country to organize data regionally.Example: US, BR, IN (for the United States, Brazil, and India). Mid Level: Site For each country, create separate SPACEs for each site within that country.Example: US_COR, BR_SAO, IN_BOM (COR for Corpus Christi, SAO for São Paulo, BOM for Mumbai). Low Level: Unit Inside each site’s SPACE, cre

Hi.I would like to experiment with using more of the advanced functionality in data modeling. For instance, everything related to importing views and mapping properties between data models. However, I feel like the documentation (https://docs.cognite.com/cdf/dm/dm_graphql/dm_data_modeling_language#specification-of-directives) is a bit lacking of examples of how to use the functionality. Are there any end-to-end (both basic and advanced) examples or other training material of how to reference data in other data models using all the different directives specified. For example examples of best practices when referencing between a source model and a domain model, and when referencing between a domain model and a solution model.Thank you!Sebastian

When I am creating calculations within Charts I often have to click an object twice before it is selected.  For example, adding a Function.  When I select Operators the list resets and I have to click Operators again.  This time it provides the new window.  I’ll scroll down and select Round (doesn’t matter what I select).  The list resets back to the top and I scroll back down and select Round again.  This happens every time independent of browser (Chrome or Edge).  Is this common for others or a unique issue for me?  

Hello, We are trying to delete a unit on a container attribute using CDF toolkit. CDF toolkit identifies that there is a container change. However, this change is not reflected on the container and view schema after the deployment. No error raised.Note: Adding and modifying container attribute unit works well.Any ideas ? Thanks,

Is it possible to get Cognite Data Fusion APIs from Minitab application? If does, how does it work the connection?

BackgorundWe have an ongoing project where we need to deploy Cognite Functions and other resources (TimeSeries and Sequences) regularly, both during development/debugging and when publishing new versions of our product.The way we have solved this today is this:We maintain a “deployment template” YAML file that defines all the “stuff” that needs to be deleted/created during a redeployment. This includes Cognite Functions, TimeSeries, and Sequences. Each entry in the YAML contains all necessary data for creating the relevant resource. We have written some Python classes that perform resource specific deployment (CogniteFunctionDeployer, TimeSeriesDeployer, SequenceDeployer). These behave quite similarly, with methods that backup data, delete, and recreate the resource. These classes are instantiated in our “deploy.py” script, which just itereates over all the resources defined in the template (step 1), and calls the “.deploy” method on each resource deployer class. The deploy script is c

Hi,I was testing annotating P&ID documents towards nodes from a data model. It worked and the annotations are available through the API, but is not showing in the preview of the file. When the annotations are towards assets or files (from the asset-centric model) then it shows as expected, but when towards a node it isn’t. I am not sure if this is a bug or a future feature yet to be implemented.To be clear, I am annotating a File (not a CogniteFile from core data model). And the annotation is created and connected to the file and points to specific instances in a data model, but I see no way to visualize this is in Fusion. Regards,Markus PettersenAker BP - Data Delivery

Hi everyone!  🔔 Just a quick reminder that our comprehensive, self-paced, and on-demand courses are available at Cognite Academy. Whether you're looking to enhance your skills or explore new areas, we've got something for you! Upon completing a course, you’ll earn a certificate that will be added to your community profile and can also be added to your LinkedIn Certifications, helping you showcase your achievements to a wider network.Looking for more hands-on learning? We also offer 5-day intensive in-person trainings for those wanting a deeper dive.Unlock your next learning journey today!🚀

Hello everyone,I am using cognite client and wondering if I can write simple graphQL queries and run it through. Example. Select all assests.But it seems, it only provides option using one of the data models. Newbie to CDF. 

Hii everyone, I have created a data model and in that model I have one parent view and then a nested view. So I made cursorable true for parent and cursorable true for nested view in the indexes field(@container) so only limited rows of nested columns are coming into dataset( used a plugin to fetch dataset from cdf using dataiku) but if I do cursorable false for the nested view then all the rows are coming for it. Just for FYI in our code of plugin we have set limit of 1000 rows so when cursorable false then all the rows are coming and when cursorable true for nested view then only 1000 rows are coming. And when parent view’s cursorable is false it says it does not exist.Is this correct behaviour of the cursorable feature? if yes can you please explain why?

Hey Everyone!Curious about how to boost your rank and unlock some amazing new abilities in the community? 🚀 If you haven’t checked it out yet, we’ve just shared an exciting update about the perks awaiting you when you reach Level 4 (Practitioner). From marking correct answers to unlimited post editing, these benefits are designed to empower you as a community leader.👉 Check out the full details here!👈Ready to take your engagement to the next level? Head over to the original post for all the details and start leveling up today!

Hello !  I am new to this community but would like to ask the following:   Has anybody any experience extracting a list of DCS Process Alerts to Operators or Operator Overrides on an Hourly or Daily basis into CDF ?   This data resides in the OT and is sometimes extracted and made available in reports in the IT domain, e.g., by Yokogawa.   As I see it, this is an important indicator for stable and well managed production operations, and also a good predictor of upcoming threats to production.

The buttons have disappeared in the search after one of the releases. It is still usable, but you have to guess the functionalities. 

It was requested by @ibrahim.alsyed  from Celanese that we increase the limit of the raw datapoints for the endpoint /timeseries/data/list (Retrieve data points) to 1 million. Currently, the non-aggregated data points returned is limited to 100000.For the drill-down views with more than 7 days, the server-to-client data transfer maximum size is reached due to the number of datapoints (some timeseries have more than 1 datapoint per minute). The solution they have implemented is that for ranges higher than 7 days, they are displaying an interpolated trend using the maximum absolute values for 30-minute aggregation. Once the user selects a smaller date range, they are unable to display all the values. Hence a increase in the limitation was requested.

dear all I was attempting to perform data aggregation based on the date. I am retrieving online data into CDF, which is updated every 2-3 minutes. I am trying to aggregate the data so that the date is updated every 24 hours instead of every 2-4 minutes.I used this code to obtain the list of columns in my data frame.# Check the structure of the DataFrame, including column names and the first few rowsprint(dp.columns)  # This will show all column namesdp.head()          # This will show the first few rows of the DataFrame however, I got only this after running the code I tried to use another code again the first column is not date column.  

HiSince the release of nested workflows I have been looking at suitable use cases for it in our environment. I have sketched up some possible flows, but there are some cases I don`t know how to handle in the best way.Consider this scenario where we have two source systems (source X and Y) where each system has a source model that is populated via transformations. The transformations are divided into multiple workflows based on what project it gets data from. I have two solution models (model 1 and 2) that gets data from the source systems. Model 2 gets data from both source models, while model 1 only gets data from source X. My issue is that the data from the source systems are ingested into CDF raw tables once every morning and the data arrive at different times. If data from source X is in CDF before data from source Y, I want the workflow tasks relevant to solution model 1 to run, but not solution model 2, because the source Y data is not ready yet, however if both sources have inge

Hi Team,Please help me to find the mistakes in my code. Let me showcase the dummy codemain code:def main() -> None:    """    Main entrypoint    """    BASE_DIR = os.path.dirname(os.path.dirname(os.path.abspath(__file__)))    config_values_vault.set_vara()    with Extractor(        name="SAP_Extractor",        description="An extractor to extract asset hierarchy from SAP based on root node",        config_class=SapConfig,        # version=__version__,        # debugger        version="1.0.0",        run_handle=run,        metrics=metrics,        config_file_path= os.path.join(BASE_DIR, 'config.yaml'),    ) as extractor:        extractor.run() I have build code unittest for above code: def test_main():    with patch('os.path') as path_mock:        with patch.object(path_mock, 'abspath') as mock_abspath:            with patch.object(path_mock, 'dirname') as mock_dirname:                with patch.object(path_mock,'join') as mock_join:                    mock_abspath.return_value = '/p

Hi, I would like to get more information regarding the Cognite 3D & Scene module. I have tried building the scene and added 3D model and object but facing some blocker to proceed. Below are my question and hope someone able to help to answer it.Question:How to upload & publish 3D model using SDK or API? How to add 3D model to the Sceme using SDK or API? In CDF UI, only one 3D object instance allow to be added in the scene? Is there a way to have multiple instance of the same 3D object in one scene? 

Recently the user interface in Charts has changed. I’m not seeing the ability to add timeseries via a PID in a contextualized PDF file. See the image below. Is that capability not available any more?You can see the PDF from the Industrial Canvas UI: 

The date field “Last updated” and “Created time” when viewing files linked to assets does not reflect any information I find in the file itself. Where do these fields originate. 2017 is long before our CDF instance was created so it is a bit strange.These are the datetimes from the file header:{ "name": "SKA-AK-ER300-P-XB-0003-001.pdf", "sourceModifiedTime": 2021-01-25 01:30:44, "uploadedTime": 2024-10-02 06:07:37, "createdTime": 2024-05-01 02:46:45, "lastUpdatedTime": 2024-10-11 09:00:04, "uploaded": true}