Skip to main content
Seasoned ⭐️⭐️
Mar 5, 2026 3:17 PM UTC
Solved

how to create a custom config file apart from config.[env].yaml

In addition to using config.[env].yaml, is it possible to create a custom file for configuring variables and then reference those placeholders in data models, transformations, workflows, etc ?

For instance, I have several common SQL blocks that I would like to share across different transformations. While I could define them as variables in config.[env].yaml, I prefer to keep SQL-related variables separate from others in order to maintain clarity.

Anders  Albert
Expert ⭐️⭐️⭐️⭐️
Mar 17, 2026 1:37 PM UTC

Sorry, no that is not supported. There is currently a feature request on this issue that is being followed upon. But no conclusion is reached thus far. I will link this post in that feature request.

5 replies

Anders  Albert
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
Mar 6, 2026 7:20 PM UTC

The only place you can define variables is in the config.[env].yaml file. 

I don’t think I follow here, can you describe a bit more what you mean. If you have an example that would be great.

DSTDFAuthor
Seasoned ⭐️⭐️
Mar 12, 2026 10:58 AM UTC

Hello ​@Anders Albert,

We have several SQL CTE tables that need to be shared across different transformations. The most effective approach is to use placeholders within these transformations, which will then be replaced during the build phase. However, we would prefer not to define the CTE tables in the config.[env].yaml file.
 

For example: 

{{my_cmt}} is a common table that we prefer not to include in the config.[env].yaml file, but rather in a separate file that can be customized as needed.

externalId: tr-example
name: example
query: |-
{{my_cmt}},
SELECT
t.space,
t.id AS externalId,
...
FROM
table t
JOIN cmt ON t.id= cmt.parent_id
destination:
dataModel:
space: {{my_space}}
externalId: {{my_model}}
version: "{{my_version}}"
destinationType:
type: instances
ignoreNullFields: false
isPublic: true
conflictMode: upsert
dataSetExternalId: {{my_dataset}}

 

DSTDFAuthor
Seasoned ⭐️⭐️
Mar 16, 2026 9:45 AM UTC

​@Anders Albert Any new updates on this topic?

Anders  Albert
Expert ⭐️⭐️⭐️⭐️
Expert ⭐️⭐️⭐️⭐️
Mar 17, 2026 1:37 PM UTC

Sorry, no that is not supported. There is currently a feature request on this issue that is being followed upon. But no conclusion is reached thus far. I will link this post in that feature request.

DSTDFAuthor
Seasoned ⭐️⭐️
Mar 17, 2026 1:40 PM UTC

thanks for the update.

Please keep me informed if there are any new developments.