Hello,
Is there a way that users can define their user defined function in CDF so they can be used in transformations?
We duplicate the same logic in different transformation and we would like to centralize it in one function. (Similar to what you are doing with `is_new` or `cdf_assetSubtree` function internally)
Thanks,
MT
+8You could try running cdp-spark-datasource on your own Spark/Databricks cluster and possibly extend it. However, be aware that it's not well-documented, may not be compatible with the latest library versions, and lacks feature parity with the Transformation service (such as schedules and other functionalities it provides beyond just connecting CDF as a Spark datasource).
If you would like to have this feature in the future, I can convert this into a product idea. Please let me know on how to proceed.
Hi
+8Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.
Check the
documentation
Ask the
Community
Take a look
at
Academy
Cognite
Status
Page
Contact
Cognite Support