Skip to main content
Question

Cognite Functions: the function files are stored in the dataset along with regular files

  • September 1, 2025
  • 3 replies
  • 53 views

Markus Pettersen
MVP

When creating a Cognite Function you specify the dataset it belongs to, as an example lets say D2 LCI, then the files of the function is stored as files in that dataset. However, as D2 LCI is a dataset for file storage for engineering documents these function files cause noise, not much but still. If you were to list out all files for the dataset these “internal” CDF files would simply show as regular files and would have to be filtered out.

Now, as we (AkerBP) are moving away from the asset-centric and over to data modelling this might not be an issue given how data models and spaces are. But in the future when datasets are a thing of the past, how will function and the like work, where will those files be stored. Storing the file used for compute with the data they compute might be a simple implementation, but not ideal as it does cause some noise.

 

Note: this does not only apply to Cognite Functions, but to all CDF features where “internal” files are stored alongside the regular data.

3 replies

Mithila Jayalath
Seasoned Practitioner
Forum|alt.badge.img+8
  • Seasoned Practitioner
  • September 2, 2025

@Markus Pettersen I’ll check on this with the engineering team and get back to you with an update.


Anders Brakestad
Seasoned

<rant>

(sorry to piggy back on this issue, but why are function files stored in a dataset, but the function itself can not be retrieved via a dataset id? This has annoyed me quite a bit, because it makes it very hard to automatically clean up our functions without knowing the exact id or external id)

</rant>


Everton Colling
Seasoned Practitioner
Forum|alt.badge.img
  • Seasoned Practitioner
  • September 5, 2025

Hi ​@Markus Pettersen and ​@Anders Brakestad!

That’s a really relevant topic you are raising, and it’s something we are aware of. We're currently developing new governance capabilities for Data Processes, like Functions, Transformations, Workflows, Simulations, and Contextualization tasks which will provide better tooling to solve this problem. This will enable better organization, discovery, and lifecycle management of these resources.

We'll share more details about these capabilities in H1 2026 as development progresses. In the meantime, I'll ensure your feedback is shared internally in Cognite.