Impact 2024: The Industrial Data and AI Conference for and by Users | Nominate Speakers Now for a Ch...
No, and I see the sentence is bad. It was just a wish for a dedicated extension for the Spark SQL dialect. I see now that the community has landed on just .sql and the problems it causes in editors and IDEs. In short, all our transformation queries are full of red squiggles in VS Code.
If you see my last comment I have some updates to this (since the quoted issue). Not sure if you use a separate .schedule file or not?
Note that when it comes to transformation schedules, the documentation at https://developer.cognite.com/sdks/toolkit/references/configs#transformations-dir-transformations seem to be wrong. It points to an indented schedule config in the transformation yaml. However, the examples that follow the last version puts the schedules in a separate .schedule.yaml file. The separate file works. The documented solution does not.
Thanks for the update.When it comes to multiple tables for raw, this is from the docs:RAW configurations can be found in the module's raw/ directory. You need a yaml file per table you want to load.I cannot see a way to add multiple tables according to the docs. The API also has DBs and tables as separate actions, so that may be the reason.As for the active flag for transformation schedules, it is correct that I mean the isPaused attribute. If we change it and redeploy it doesn’t seem to affect the target state.Also, is it possible to have a shared config (for all environments)? I cannot see if it is described in the docs. This will be used for values that are shared across the environments, e.g. tenant ID/URL.Lastly, is it possible to have a “init new project” with just a bare minimum of needed artifacts? This way we do not need to clean it up / remove things after.
Already have an account? Login
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
Sorry, we're still checking this file's contents to make sure it's safe to download. Please try again in a few minutes.
Sorry, our virus scanner detected that this file isn't safe to download.