Skip to main content
Solved

Cognite functions for long running workloads

  • 16 January 2023
  • 1 reply
  • 45 views

Forum|alt.badge.img+1

In bootcamp documentation there were some guiding principles:

https://docs-bootcamp.app.cogniteapp.com/content/chapter_0/#the-ice-cream-factory-data

One of them was for Cognite functions:

  • Cognite Functions for running and scheduling simple and short workloads in Python (< 10 min. execution time)

Can we use Cognite functions for long running and scheduling workloads typically of duration 10-12 hours. 

 

Best answer by Jason Dressel

Ardash,
Yes, Cognite Functions have a finite runtime so the short answer is No.  Workloads requiring execution resources (memory, cpu, runtime) larger than what Cognite Functions were designed for, it’s common to leverage native CSP infrastructure (ie. VM’s, K8s).  These resources can be hosted in the same cloud region as your CDF project to minimize network latency. (ie. https://azure.microsoft.com/en-us/explore/global-infrastructure/geographies/#overview)

Jason

View original
Did this topic help you find an answer to your question?

1 reply

Forum|alt.badge.img
  • Seasoned Practitioner
  • 282 replies
  • Answer
  • January 16, 2023

Ardash,
Yes, Cognite Functions have a finite runtime so the short answer is No.  Workloads requiring execution resources (memory, cpu, runtime) larger than what Cognite Functions were designed for, it’s common to leverage native CSP infrastructure (ie. VM’s, K8s).  These resources can be hosted in the same cloud region as your CDF project to minimize network latency. (ie. https://azure.microsoft.com/en-us/explore/global-infrastructure/geographies/#overview)

Jason


Reply


Cookie Policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie Settings