Skip to main content

Hi

We are testing out a new deletion transformation for a view in data modeling. The transformation looks something like this:

select
externalId
from
cdf_data_models(...)
where
project in ("ProjectA","ProjectB")

This transformation always times out and returns a “Graph query time out” error message. However, when changing the transformation to this the transformation just runs fine:

select
externalId
from
cdf_data_models(...)
where
project = "ProjectA"

union

select
externalId
from
cdf_data_models(...)
where
project = "ProjectB"

For context, the project column here is indexed and the view has around 10 properties and about 1.7 million rows. The transformations all query the same view.

We are therefore wondering how the filtering in transformations handles filtering in data modeling and why these transformations are performing different. Learning more about this would benefit us greatly when working with transformations and data modeling in the future :)

Thanks in advance!

Sebastian

@sebastianheibo.akso in order to further troubleshoot this issue, can you please let me know the cluster of the project, run and config ids for this transformation


Reply