Product User Community

We have a unique use case where there are data points collected from PI server for refinery plant and alongside, we have other refinery data like Crude assays, Diet, Mass Balance. All these data points (in tabular format) are collected and then some formula is applied across to get properties (like swing cut %, CBLISS, Vol%, etc.) and some derived tables are created. Then some input feed is made from the actual data sent to a Petro-Sim tool (math simulation tool/modeling) and then output from that tool is collected and stored. All these data wrangling is done and finally charts are finally made for some 50+ crude product variants to measure yield tracking (Actual data, non-linear model data, linear model data). As per design, we are planning to use the CDF raw tables and then do all the computations and create derived raw tables to fulfil the purpose. Then use Petro-Sim connector and then store the data output from the model tool as well in raw tables. So, we don't tend to see the typi

Hello! I have 3 quick questions that come to mind:From your perspective, what is the 1 sentence value statement of CDF?How can we justify all the manual work required to prepare the data to ingest into the platform?How do our customers save money by using CDF?

Hi there!I have a usecase where a file is uploaded by a user to an API. The API then uploads the file to CDF Files. We want to avoid having to have the full file in memory at the same time, and therefore must stream the file contents from the request handler directly into CDF Files.There are two ways of achieving this:Stream the request body from the request handler directly into CDF Files’ upload URL Chunk the request body and upload each chunk as separate requests.The first option may be achievable, but I don’t believe the second option is possible.Do you have any insight whether it is possible to chunk a file upload like this in CDF Files?

I am currently working through “Learn to Use the Cognite Python SDK”. I am unsure where the workspace/code is provided so that I am able to take the final the test and succeed in this course. I was originally using a colab research google file that includes prompts. But the questions on the final test did not corelate with this file. Can you please instruct me on how I find the correct files/workspace.  Thank you in advance. 

Hello Community,We are thrilled to announce the launch of Cognite AI, a comprehensive suite of Generative AI capabilities within our core Industrial DataOps platform, Cognite Data Fusion®.Cognite AI is a first-of-its-kind, hallucination-free, data-leakage-free Generative AI solution that accelerates time-to-value from Generative AI for energy, manufacturing, and power and renewables customers. And the best part is that it is fully open to all partners to create tailored industrial solutions.Cognite Data Fusion® with Cognite AI improves operations by rapidly accelerating cloud adoption and increasing the efficiency of industrial workflows by 10 times.Read the full press release here to learn how we harness the power of Generative AI for industry:https://www.cognite.com/en/press-release/introducing-cognite-ai

Hello Community,We are thrilled to announce the launch of Cognite AI, a comprehensive suite of Generative AI capabilities within our core Industrial DataOps platform, Cognite Data Fusion®.Cognite AI is a first-of-its-kind, hallucination-free, data-leakage-free Generative AI solution that accelerates time-to-value from Generative AI for energy, manufacturing, and power and renewables customers. And the best part is that it is fully open to all partners to create tailored industrial solutions.Cognite Data Fusion® with Cognite AI improves operations by rapidly accelerating cloud adoption and increasing the efficiency of industrial workflows by 10 times. Read the full press release here to learn how we harness the power of Generative AI for industry:https://www.cognite.com/en/press-release/introducing-cognite-ai

Executing transform from Raw/Staging to Dataset Events. Codeselect cast(`uniqueid` as BIGINT) as id, cast(`Start Time` as TIMESTAMP) as startTime, cast(`End Time` as TIMESTAMP) as endTime, 1626362640169782 as dataSetId, concat("Chem-Batch", "-", Unit, "-", `Batch ID`) as description, 'Process' as type, 'Batch' as subtype from `Chem-Batch`.`Batch-Unit`where `Start Time` > '2023-06-13'Preview shows expected 3 row results: Run yields this error:Request with id 90f5d941-7f0e-9553-9ca5-317d784434d1 to https://az-eastus-1.cognitedata.com/api/v1/projects/ra-istc-sandbox/events/update failed with status 400: Event id not found. Missing ids: [48, 49].It seems all columns data in Raw rows has appropriate data.Any ideas are welcome.Chris  

Hi Team,In GraphQL there is no (known) option to filter null values of FDM View’s direct properties which refer to another view(s).For example: Consider the snapshot of the views.Here if we want to filter all MyTypeWrapper instances which has ‘myType’ property as null.How could it be achieved using GraphQL?-Mohit

Hello May I know if inventor 3D model is supported in CDF? 

Hello Community,we have a option scheduling in cognite functions to run those functions periodically. But is there any way to trigger Cognite function when a particular event occur.thank you

Hello Community👋, Are you tired of the time-consuming and complicated process of turnaround (TAR) planning? In our latest blog post, we delve into the revolutionary potential of Generative AI in TAR planning. Discover how this advanced technology can reduce timelines, boost production capacity, and unlock untapped revenue opportunities.Generative AI holds the key to saving months of planning and improving operational efficiency. Traditional TAR planning faces challenges such as long-term cycles, budget constraints, preventive maintenance practices, limited collaboration, and post-turnaround equipment failures. These issues stem from manual data aggregation, isolated solutions, and the lack of comprehensive approaches.Find our how Generative AI can revolutionize TAR planning cycle!

Hi. I’m trying to understand why no alert has been triggered for the following monitoring job.Am I right to understand that this monitoring job should trigger an alert when the time series is above the specified threshold? (I am a bit confused by the text “alert when the threshold is”. Is this perhaps not monitoring the time series itself, but a threshold specified on the threshold tab?) 

Hi, We like to use Cognite AIR in one of our project .We got to know that it is getting decommissioned by end of 2023.Kindly confirm on that whether we should explore AIR now or we should not as it will not be available after this year. Thanks,  

hello Community,While logging into cognite infield, there is a option to sign in with project name.so that project name is the project created in CDF?in documentation, we can see Infield runs on CDF, Which means CDF project is only way to get data into infield? or any other ways we can get data into infield?is there way to access infield from python sdk?Thank you

Hi Team, I am trying to use bootstrap-cli to create raw DB, CDF groups and datasets. As per the documentation, I am executing “bootstrap-cli prepare” command before applying “bootstrap-cli deploy”. However I am encountering “AttributeError” .  Could you please help me what can be done to fix this? Following are the few details of the issue that is encountered. Command that I used to run the bootstrap-cli prepare.poetry run bootstrap-cli prepare --idp-source-id f2e5b1ef-e601-46ec-87ec-25f62810ad1fError Snippet:Prepare CDF Project ...Traceback (most recent call last):  File "<string>", line 1, in <module>  File "C:\Users\BMandal2\bootstrap\inso-bootstrap-cli\incubator\bootstrap_cli\__main__.py", line 2365, in main    bootstrap_cli()  File "C:\Users\BMandal2\AppData\Local\pypoetry\Cache\virtualenvs\inso-bootstrap-cli-Jo_B4J-G-py3.10\lib\site-packages\click\core.py", line 1128, in __call__    return self.main(*args, **kwargs)  File "C:\Users\BMandal2\AppData\Local\pypoetry\Cach

Have been having issues with Cognite Charts since it’s been merged into CDF. Whenever I try to go to charts, I have to clear the cache in my browser for it to work, otherwise it doesn’t load. This is a small nuisance that can prevent people from adopting the use of Charts as their daily tool.

[TL;DR]Cognite introduces user profile functionality to collect user information such as name, email, and job title for all CDF users to improve search and sharing capabilities. Administrators can, of course, disable the automatic collection of user information. The functionality will enable us to provide you with granular access controls, collaboration features, and much more in the future. Initially, we support user profiles for projects using Azure AD for authentication. We will add other identity providers later. For more information about how we handle your data, refer to our privacy policy at https://www.cognite.com/en/policy.- Cognite Product TeamAt Cognite, we strive to provide a seamless and efficient user experience for all our users. To achieve this, we have rolled out user profile functionality and started collecting user information, such as name, email, and job title, for all Cognite Data Fusion (CDF) users. This will enable Cognite, 1st-party, and 3rd-party application b

Hi all, I ran into an error when running a transform: instances failed with status 400: Request had 37 constraint violations. Please fix the request and try again. [properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 and 2147483647, properties size must be between 1 a

hello community,I need to work Cognite File Extractor, But found very limited resource on documentation. can anyone please provide any available resources regarding that like knowing completly how to use it, it’s configuration etcThank you

Executing a SQL Transform joining 2 tables from Raw and writing results to a 3rd Raw table.Perhaps there is a syntax issue? Not sure if it matters but I noticed the error msg omits some backticks like here:'ChemPlant.`Alarms-2-INActive`.EventAssociationID' there is no backtick before Event… Thank you.SELECT `ChemPlant`.`Alarms-2-INActive`.`EventID`, `ChemPlant`.`Alarms-2-INActive`.`SourceName`, `ChemPlant`.`Alarms-1-Active`.`EventTimeStamp`, `ChemPlant`.`Alarms-2-INActive`.`EventTimeStamp` AS AlarmOffTime, `ChemPlant`.`Alarms-2-INActive`.`Message`, `ChemPlant`.`Alarms-2-INActive`.`Active`, `ChemPlant`.`Alarms-2-INActive`.`EventAssociationID` as key, `ChemPlant`.`Alarms-2-INActive`.`EventAssociationID`FROM `ChemPlant`.`Alarms-2-INActive` INNER JOIN `ChemPlant`.`Alarms-1-Active` ON `ChemPlant`.`Alarms-2-INActive`.`EventAssociationID` = `ChemPlant`.`Alarms-1-Active`.`EventAssociationID`Error Message:Cannot resolve 'ChemPlant.`Alarm

Hi Team, We are working on a POC , where we need to create unit test cases where we are facing different issues .For reference we are using code from Cognite HubBelow attaching our code and output expectations .Please help with the approach to resolve this issue ts_retrieved = [    TimeSeries(    id= 3973245479016710,    external_id= "Brazil:3W:Well-Bore-19B_target_throughput",    name= "Brazil:3W:Well-Bore-19B_target_throughput",    is_string= False,    metadata= {},    unit= "Barrel",    asset_id= 3332326574821917,    is_step= False,    description= "target volume for a oil well bore",    security_categories= [],    data_set_id= 8739280581150161,    created_time= "2023-05-02 09:37:04.944000",    last_updated_time= "2023-05-02 09:37:04.944000")]@pytest.fixturedef cognite_client_mock():    with monkeypatch_cognite_client() as client:          client.assets.retrieve().time_series().get().return_value = ts_retrieved        return client   Method code          ts_data = c.assets.retrieve(

Are ANSI escape sequences planned to be added to the Cognite Function logs? For now, it seems to be impossible to make the text bold or change the color of the text inside the function logs. 

 Exciting News!  We are thrilled to announce the launch of a remarkable customer story featuring Aker BioMarine and their incredible journey with Cognite Data Fusion. We invite you to dive in and take a look at the incredible results they achieved! In a nutshell, here are some impressive highlights from their collaboration: 3 million data points were contextualized, unlocking valuable insights and driving informed decision-making 56% reduction in unit cost of operation within just two years, demonstrating the power of optimized processes and data-driven strategies A remarkable 73% reduction in downtime due to improved operations, ensuring maximum productivity and minimizing disruptions2x increase in output with the implementation of cutting-edge machinery, taking their operations to new heights!Want to explore this inspiring success story in detail? Don't miss out on the opportunity to learn more. Simply visit the link below to access the full story:  Link to the Customer Story: Aker B

I have to build two 2 types of extractors.1. PI extractor to connect to the PI server and fetch the data and ingest into CDF2. SharePoint online - Extract data from files present in SharePoint online and ingest into CDF. I wanted to know the construct in building the extractors. Mainly wanted to account for scenarios where the PI server is not available and PI extractor is unable to fetch the data from the pipeline. How to handle these kinds of situations and incorporate them in the code while building the extractor. Also, how to handle monitoring while performing extractor. Are there some sample code repos that can be referenced for getting complete idea for building extractors.    

 Appears to be an obvious question, may have been asked before. Just wondering if there is an extractor available to read the spreadsheet files and load it into raw/staged data. The Excel can contain multiple spread sheet and perhaps with configuration each of that spreadsheet and its columns can be mapped to the staged tables/columns?