Skip to main content
Solved

Duplicate nodes in transformation (FDM)

A
Committed

I had run transformation giving me error for Duplicate node externalIds for space 'PDM' 

even after deleting all the data from the model for space PDM still giving the same error, I also verified by api still there is no data still giving the error for Duplicate node externalIds for space 'PDM' .

 

Best answer by Anders Hafreager

You can ingest with the same external id, so this should not be caused by that. This is very likely to be duplicate externalIds in the transformation, which is easy to do by mistake. Can you run the same transformation to RAW and verify that all the data is there without any duplications?

If you are certain there are no duplicates, it would be great to get more information about which transformation it is, so we can investigate with the team.

View original
Did this topic help you find an answer to your question?

6 replies

Anders Hafreager
Practitioner

Duplicate node externalIds only occurs if the same transformation tries to ingest the same node twice in the same API request. Can you please check your data source to ensure that you don’t use the same externalId twice? Let us know how it goes:)

A
Committed
  • Amit Rane
  • Author
  • Committed
  • 7 replies
  • June 21, 2023

Hi @Anders Hafreager is there any way we can ingest this data with same externalId, As have deleted the data from the model with transformation?

And also we are not using same extrenalId twice in the transformation.

Anders Hafreager
Practitioner

You can ingest with the same external id, so this should not be caused by that. This is very likely to be duplicate externalIds in the transformation, which is easy to do by mistake. Can you run the same transformation to RAW and verify that all the data is there without any duplications?

If you are certain there are no duplicates, it would be great to get more information about which transformation it is, so we can investigate with the team.

Dilini Fernando
Seasoned Practitioner
Forum|alt.badge.img+2

Hi @Amit Rane,

If the question is still valid, please share the information requested by Anders. 

Best regards,
Dilini

 

A
Committed
  • Amit Rane
  • Author
  • Committed
  • 7 replies
  • July 6, 2023

@Dilini Fernando we have removed the duplicates externalIds from the transformation as suggested by @Anders Hafreager and the transformations are running smoothly.

Sofie Haug
Dilini Fernando
2 people like this
  • Sofie Haug
    Sofie Haug
  • Dilini Fernando
    Dilini Fernando
W
Seasoned
Forum|alt.badge.img+5
  • Wei Wu
  • Seasoned
  • 6 replies
  • September 5, 2023

I ran into the same duplicated externalIds error during a transformation

How did you remove the duplicates externalIds from the transformation? Is there a query example that you can share? Thanks.

@Anders Hafreager @Dilini Fernando  @Amit Rane 

Reply


Terms & ConditionsCookie Settings

Cookie Policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie Settings