Skip to main content
Question

Data Upload Plugin not working as shown on documentation

  • May 29, 2026
  • 5 replies
  • 54 views

Forum|alt.badge.img+3

 

Trying to upload assets and asset hierarchy following the documentation available online is not working as shown.

Trying to upload an ndjson with assets and hierarchy with the following files:

myHierarchy.Manifest.yaml

kind: Assets
type: dataSet
dataSetExternalId: compressor_demo_dataset

myHierarchy.Assets.yaml

{"externalId": "Compressor_Demo", "name": "Compressor Demo", "depth": 0}
{"externalId": "Compressor_Demo_Geonosis","name": "Geonosis", "parentExternalId": "Compressor_Demo", "depth": 1}
{"externalId": "Compressor_Demo_Geonosis_Central-Utilities","name": "Central Utilities", "parentExternalId": "Compressor_Demo_Geonosis", "depth": 2}
{"externalId": "Central-UtilitiesCompressedAir_Cell","name": "Compressed Air", "parentExternalId": "Compressor_Demo_Geonosis_Central-Utilities", "depth": 3}
{"externalId": "AirCompressor1_Central-UtilitiesCompressedAir_Cell", "name": "Air Compressor 1", "parentExternalId": "Central-UtilitiesCompressedAir_Cell", "depth": 4}
{"externalId": "AirCompressor2_Central-UtilitiesCompressedAir_Cell", "name": "Air Compressor 2", "parentExternalId": "Central-UtilitiesCompressedAir_Cell", "depth": 4}
{"externalId": "IngersollRand_42", "name": "IngersollRand_42", "parentExternalId": "AirCompressor1_Central-UtilitiesCompressedAir_Cell", "depth": 5}
{"externalId": "KaeserKompressoren_23", "name": "KaeserKompressoren_23", "parentExternalId": "AirCompressor2_Central-UtilitiesCompressedAir_Cell", "depth": 5}
{"externalId": "IngersollRand_42", "name": "IngersollRand_42", "parentExternalId": "AirCompressor1_Central-UtilitiesCompressedAir_Cell", "depth": 5}
{"externalId": "KaeserKompressoren_23", "name": "KaeserKompressoren_23", "parentExternalId": "AirCompressor2_Central-UtilitiesCompressedAir_Cell", "depth": 5}
{"externalId": "IngersollRand_42", "name": "IngersollRand_42", "parentExternalId": "AirCompressor1_Central-UtilitiesCompressedAir_Cell", "depth": 5}
{"externalId": "KaeserKompressoren_23", "name": "KaeserKompressoren_23", "parentExternalId": "AirCompressor2_Central-UtilitiesCompressedAir_Cell", "depth": 5}
{"externalId": "IngersollRand_42", "name": "IngersollRand_42", "parentExternalId": "AirCompressor1_Central-UtilitiesCompressedAir_Cell", "depth": 5}
{"externalId": "KaeserKompressoren_23", "name": "KaeserKompressoren_23", "parentExternalId": "AirCompressor2_Central-UtilitiesCompressedAir_Cell", "depth": 5}

dataset.Manifest.yaml

kind: Assets
type: dataSet
dataSetExternalId: compressor_demo_dataset

when running the upload command as described on the documentation an error message (full message attached as txt file) appears:

 cdf data upload dir "kalypso-16/input_directory/" --verbose

error:

  ERROR (ToolkitRuntimeError): An error occurred during execution: ValidationError 1 validation error for tagged-union[NodeRequest,EdgeRequest]
Unable to extract tag using discriminator 'instance_type' | 'instanceType' [type=union_tag_not_found, input_value={'externalId': 'Compresso...rnalId': '', 'depth': 1},
input_type=dict]
For further information visit https://errors.pydantic.dev/2.13/v/union_tag_not_found

 

5 replies

Forum|alt.badge.img+3
  • Author
  • Practitioner ⭐️
  • May 29, 2026

Using CDF-Toolkit version: 0.7.240.


Ali Tahir
Committed ⭐️⭐️⭐️
Forum|alt.badge.img+6
  • Committed ⭐️⭐️⭐️
  • June 1, 2026

Hi ​@Gerardo Chapa 
I think the toolkit is trying to upload Data Model nodes instead of classic Assets. 

Look at this line: "Uploading nodes in compressor_demo_instance_space...ISATimeSeries view"

That's all Data Model terminology. For classic Assets, you shouldn't see "nodes", "instance space", or "views" mentioned.

Check your manifest files - somewhere the toolkit found Data Model configuration instead of Assets config.


Forum|alt.badge.img+3
  • Author
  • Practitioner ⭐️
  • June 1, 2026

Manifest file is included on the post, I do have another manifest file with a different name, does the data plugin not support several kinds of uploads simultaneously? (assets, instances, time series, datapoints)


Forum|alt.badge.img+3
  • Author
  • Practitioner ⭐️
  • June 2, 2026

Fixed the issue by moving the other manifest files to a different folder, and uploading one by one. I’m now trying to upload Datapoints and can only upload five at a time, is there a configuration that I’m missing? Please find attached both the csv and yaml file (renamed into txt)

 


Ali Tahir
Committed ⭐️⭐️⭐️
Forum|alt.badge.img+6
  • Committed ⭐️⭐️⭐️
  • June 2, 2026

You have 1000 rows and 50 columns defined, but only 5 datapoints uploaded.

Few things to check:

1. Do all 50 instances exist in your instance space? The toolkit might skip uploading to instances that don't exist yet.

2. Check what actually got uploaded in CDF, which 5 worked? That'll tell you if it's an instance issue or batch limit.

3. i will first try `--dry-run` first to see what the toolkit plans to do before actually uploading.

If instances exist and this is still happening, then it might be a toolkit limitation. then it can be raised as a ticket