how can we deploy cdf functions from azure devops using toolkit

Hi, this is a simple example of a pipeline file. A more thorough writeup will be forthcoming, but I hope this can help you get started: 

 

trigger:
- main

pool:
  vmImage: 'ubuntu-latest'

jobs:
- job: BuildAndDeploy
  displayName: 'Build and Deploy Modules'
  steps:
  - checkout: self
  - task: UsePythonVersion@0
    inputs:
      versionSpec: '3.11'
  - script: |
      curl -sSL https://install.python-poetry.org | python3.11 -
    displayName: 'Install Poetry'
  - script: |
      poetry install
    displayName: 'Install Dependencies'
  - script: |
      poetry run cdf-tk build --env=dev --clean
    displayName: 'Build the Package'
    workingDirectory: './new-project'
    env: 
      CDF_CLUSTER: '<cluster>'
      CDF_PROJECT: '<project>'
      IDP_CLIENT_ID: '<client-id>'
      IDP_CLIENT_SECRET: $(IDP_CLIENT_SECRET_MASTER)
      IDP_TOKEN_URL: 'https://login.microsoftonline.com/<tenant-id>/oauth2/v2.0/token'
      TRANSFORMATIONS_CLIENT_ID: '<transformations-client-id>'
      TRANSFORMATIONS_CLIENT_SECRET: $(TRANSFORMATIONS_CLIENT_SECRET_MASTER)
      FUNCTIONS_CLIENT_ID: '<function-client-id>'
      FUNCTIONS_CLIENT_SECRET: $(FUNCTIONS_CLIENT_SECRET_MASTER)
  - script: |
      poetry run cdf-tk deploy --drop --env=dev
    displayName: 'Deploy the Package'
    workingDirectory: './new-project'
    env:
      CDF_CLUSTER: '<cluster>'
      CDF_PROJECT: '<project>'
      IDP_CLIENT_ID: '<client-id>'
      IDP_CLIENT_SECRET: $(IDP_CLIENT_SECRET_MASTER)
      IDP_TOKEN_URL: 'https://login.microsoftonline.com/<tenant-id>/oauth2/v2.0/token'
      TRANSFORMATIONS_CLIENT_ID: '<transformations-client-id>'
      TRANSFORMATIONS_CLIENT_SECRET: $(TRANSFORMATIONS_CLIENT_SECRET_MASTER)
      FUNCTIONS_CLIENT_ID: '<function-client-id>'
      FUNCTIONS_CLIENT_SECRET: $(FUNCTIONS_CLIENT_SECRET_MASTER)

Hi @N G Nidhi , I think I understand your question better now. 

The Toolkit treats functions as any other resource type, hence they need to be added to a folder like this:

modules
    my_module
        auth
        functions
        .... 

and be selected in the config.dev.yaml:

selected:
   modules/my_module

The in the pipeline above, the workingDirectory: './new-project' simply has to point to the parent directory of modules/ and config.dev.yaml. 

The required format for functions is described here: https://docs.cognite.com/cdf/deploy/cdf_toolkit/references/configs#functions 

You will see that you need a yaml file, an optional schedule yaml file and a subdirectory for the function code itself. 

As of now, development and testing support for functions is a bit limited in the Toolkit. We hope to improve that in future versions.