Skip to main content
Question

file extracgtor recursive mode toggle

  • August 26, 2025
  • 3 replies
  • 31 views

Forum|alt.badge.img+1

Working with file extractor for sharepoint files givers you and option to set recursive mode on/off which does not recurse over subfolders (when set to false) according to your needs.

But when i set that option for simple files, it does not works, also the documentation does not mention the keyword recurvisive for files.

It wpuld be great the file extractor also has the recursive keyword so you dont need to have specific filders for files to upload.

 

thank you

 

sw

 

 

3 replies

Forum|alt.badge.img

Not sure I follow what you’re telling me here, sorry(!): 

But when i set that option for simple files, it does not works, also the documentation does not mention the keyword recurvisive for files.

 

See https://docs.cognite.com/cdf/integration/guides/extraction/configuration/file-extractor#files.file-provider.sharepoint_online.paths

I.e. in the config.yml file, for the sharepoint provider of the file extractor, it should be:

extractor:
files:
file-provider:
type: sharepoint_online
paths:
- url: <url to sharepoint site>
recursive: false # This setting is "true" by default, so only reason to include it
# in the config.yml file is if you want to disable recursive
# traversal from the location specified by the paths.url
# location (URI).

  


Forum|alt.badge.img+1

Not sure I follow what you’re telling me here, sorry(!): 

But when i set that option for simple files, it does not works, also the documentation does not mention the keyword recurvisive for files.

 

See https://docs.cognite.com/cdf/integration/guides/extraction/configuration/file-extractor#files.file-provider.sharepoint_online.paths

I.e. in the config.yml file, for the sharepoint provider of the file extractor, it should be:

extractor:
files:
file-provider:
type: sharepoint_online
paths:
- url: <url to sharepoint site>
recursive: false # This setting is "true" by default, so only reason to include it
# in the config.yml file is if you want to disable recursive
# traversal from the location specified by the paths.url
# location (URI).

  

Correct, thats what it mean, the recursive mode works for sharepoint only but its not implemented for simple files from e.g. a local file folder. Im telling it should be great to have the recursive toggle also implemented for normal regular local files as well!.

 

thank you.

 

sw

 

 


Forum|alt.badge.img

Oh, I see. 

It has been a very explicit choice thus far to _not_ recurse from the destination for the other providers (better control and easier setup from a security perspective if user needs to exclude certain aspects of the subtree).