Solved

Cognite functions for long running workloads

  • 16 January 2023
  • 1 reply
  • 43 views

Badge +1

In bootcamp documentation there were some guiding principles:

https://docs-bootcamp.app.cogniteapp.com/content/chapter_0/#the-ice-cream-factory-data

One of them was for Cognite functions:

  • Cognite Functions for running and scheduling simple and short workloads in Python (< 10 min. execution time)

Can we use Cognite functions for long running and scheduling workloads typically of duration 10-12 hours. 

 

icon

Best answer by Jason Dressel 16 January 2023, 18:17

View original

1 reply

Userlevel 4
Badge

Ardash,
Yes, Cognite Functions have a finite runtime so the short answer is No.  Workloads requiring execution resources (memory, cpu, runtime) larger than what Cognite Functions were designed for, it’s common to leverage native CSP infrastructure (ie. VM’s, K8s).  These resources can be hosted in the same cloud region as your CDF project to minimize network latency. (ie. https://azure.microsoft.com/en-us/explore/global-infrastructure/geographies/#overview)

Jason

Reply