Welcome to the CDF Fundamentals Discussion!
This discussion is dedicated to help learners of the Cognite Data Fusion Fundamentals learning path succeed. If you’re struggling with the exercises in this learning path, try the tips & tricks below or post a comment with the challenge you’re facing. You can also post your own tips and respond to fellow learners’ questions. Cognite Academy’s instructors are also here to help.
I’ve uploaded assets.csv into a dataset and trying to run the SQL script to create the assets but am getting the error Request with id 87b97f14-7c9b-94b9-9e1f-129e2ed18250 to https://api.cognitedata.com/api/v1/projects/cdf-fundamentals/assets failed with status 400: Reference to unknown parent with externalId Salma:23-PT-92535.
The query runs fine in Preview mode but fails to run. Funny thing is it processes a different amount of rows each time it runs.
Here’s the query I’m using:
SELECT
concat('Salma:',loc) as externalId,
IF(parent_loc='' OR parent_loc IS NULL, '', concat('Salma:',parent_loc)) AS parentExternalId,
CAST(lastUpdatedTime AS STRING) AS name,
to_metadata(*) AS metadata,
description AS description,
6295592107437051 AS dataSetId
FROM `Salma`.assets
Any ideas what’s going wrong?
Hello,
I´m having trouble finding my data set in the “Select Entities” tab during the “Match Entities” module. I have already created a new IFSDB data set, but I can´t find either of them in the search.
I do have the same issue, please guide us
Hi @Mayara Chinaglia
This is a known issue that we are experiencing with the training project and I am sorry that you are experiencing this issue.
Entity matching can filter a limited number of datasets. Since we have a lot of datasets (currently, there are 1921 datasets in the project), the matcher is not able to go through all the existing datasets.
We have reported the issue to our engineering team. Unfortunately, you will need to skip this part or build your dataset from scratch.
Could you please also mention the name of your dataset so that we can report it to our engineering team as well?
Best regards,
Dilini
+1
Hi all!!
I'm running a model and task 3 is 20% for the last 2 hs. After several page refresh it's the same. Any other work around to advance with teh CDF fundamentela trainig? Thanks in advance!!
Same for diagram models
Hi,
I am going through the Working With CDF: Integrate module, and have transformed the data and it looks like the 36 assets have been created based on this output:
But I cannot see the assets in the Data Catalogue:
Do you know what’s wrong?
Hi @
I’m Viraj here from Cognite Support and I'm sorry to inform you that currently we are facing a Major Incident impacting Contextualization Service (Entity matching and Engineering diagram) and it is very likely be the root cause of your issue.
As the engineering team is working to solve the issue, I will follow up and update you with the latest information when available.
Sorry for the all inconvenience made via this Incident.
Best regards,
Viraj
Actually, I found the mistake from a previous post.
The transformation was wrong in the first place - dataSetId was supposed to be the actual number ID that was recorded down earlier :D
Hi @
It’s Viraj here again and the engineering team has made a fix to the Major Incident.
Can you please try again and let us know whether it works for you or not?
Make sure to relog after clearing cache in the browser to remove any impact from cache.
Best regards,
Viraj
+6
I’m glad you found out
Hi,
I am going through the module Working With CDF: Contextualize, and I have loaded the P&ID. Now I am trying to link it to my Aveva assets. But I cannot find my dataset in the Data set drop down menu.
I have checked in the Data Catalog and the data set does exist in CDF.
How do I fix this?
Hi!
I am in Fundamental course and I am working on the exercise “Working With CDF: Contextualize”. The challenge I face is in the part “Contextualize P&IDs”.
My dataset with my assets does not show up in the drop-down - what could be the mistake I have made? (I have done my best to follow the training material)
Best regards,
Bjarte
Thanks for sharing these great tips,
Previewing the transformation is a best practice we strongly recommend. However, as you’re saying: if there’s a network issue, don’t worry. You can skip the preview step and continue with the course.
Good luck with the rest of the path and the assessment!
Enikő
+1
I am running into issues in trying to create an interactive engineering diagram. When I look for the assets data set, I cannot search for it. I can’t type into the search near the magnifying glass and when I read through all of the options, my data set was not there. Even with “select all” - only 303 data sets come through and mine is not one of them.
+5
Hi
I am sorry that you are experiencing the issue. I have reported the problem, and our Cognite Support will reach out to you regarding the issue.
Best regards,
Madina
Hi
I’m creating a ticket for Support out of this, it looks like we can reproduce the same issue, and we’ll need to look into this further.
Best,
Carin
Datasets I create cannot be searched or found. Therefore I’m unable to build the transform as I cannot find the dataset to look for it’s dataset ID. I’ve tested this various ways, creating and deleting various data sets. They are uanble to found in the general search and do not show up in drop downs like are available when creating a Transform. Kind of stuck at this point.
Hi Jason,
Thanks for reaching out, I’ve created a Support ticket for this to further investigate, since I think we’ll need some more details from you.
Best,
Carin
Hi I’m getting the following error: Cannot resolve 'Matt1996' given input columns:
Followed by a much longer error message. I’ve followed the instructions as stated, but I’m still getting an error. Any ideas?
Query:
SELECT
concat('Matt1996:',loc) as externalId,
IF(parent_loc='' OR parent_loc IS NULL, '', concat('Matt1996:',parent_loc)) AS parentExternalId,
CAST(lastUpdatedTime AS STRING) AS name,
to_metadata(*) AS metadata,
description AS description,
Matt1996-AvevaNet AS dataSetId
FROM `Matt1996`.assets
Screenshot:
+2
Hello,
For the Data points step “Transform RAW to Data points” I received the error “Query returned no results. The query is syntactically correct, but returned 0 rows of data.”
It seems the query does not filter for dataSetId and returns no matches. I changed the query to solve the issue on my end, here are the changes:
SELECT
concat('FirstnameBirthyear:',dp.sensor) AS externalId,
cast(time_stamp/1000 as timestamp) AS timestamp,
cast(value AS double)
FROM IFSDB.values AS dp
JOIN _cdf.timeseries AS ts
ON CONCAT('FirstnameBirthyear:', dp.sensor) = ts.externalId
AND ts.dataSetId = '1234567890'
Hey
here is the full query:
Check the
documentation
Ask the
Community
Take a look
at
Academy
Cognite
Status
Page
Contact
Cognite Support
SELECT
concat('FirstnameBirthyear:', dp.sensor) AS externalId,
cast(time_stamp / 1000 as timestamp) AS timestamp,
cast(value AS double)
FROM
IFSDB.values AS dp,
--selecting from _cdf.timeseries means we select from the timeseries we ingested to CDF earlier. We do this to make sure all the time series we try to add data points to actually exist
_cdf.timeseries AS ts
WHERE
concat('FirstnameBirthyear:', dp.sensor) = ts.externalId
and ts.dataSetId = '1234567890'
+1
Hello all,
SQL statement for Events did not find records since all completion_time=start_time in maintenance table of IFSDB, so I modified ‘>’ to ‘>=’ in the WHERE clause but only get 8 records instead of the 18. Will this be a problem for my Contextualization and later modules?
Hello all,
SQL statement for Events did not find records since all completion_time=start_time in maintenance table of IFSDB, so I modified ‘>’ to ‘>=’ in the WHERE clause but only get 8 records instead of the 18. Will this be a problem for my Contextualization and later modules?
I experienced the same issue and also made the same changes to the query.
I am not able to see all events transform data in my data set. The query change which
Hi! I’m working through the CDF Fundamentals learning path and came across a bug with the bonus time series transformation exercise in the Working With CDF: Contextualize course. I used the SQL statement as it was provided and the preview resulted in 984 rows, but it correctly saved only 12 records when I ran the transformation. The issue I noticed is when I followed the entity matching for the time series records and got a message that it was going to overwrite all the asset ids for the 12 records.
After further review, it looks like the transformation query ran the metadata function for everyone’s test data in the system (the HashMap function shows externalIds for several/all users test data), and the asset id that was saved did not correspond to my data.
I was able to add a where clause to resolve the transformation and get the correct asset id’s in the result. Screenshots of each dataset attached for reference.
+6
Hi
Wow, amazing work! Thank you so much, we’ll update the course.
Sofie
Hello All,
I was going through the training yesterday and got all the way to the end of Working with CDF: Contextualize and the system got stuck trying to create the interactive PID. Fast forward to this morning and I re-did creating the interactive engineering diagram and it worked.
I then moved on to the next course Working with CDF: Consume and while I was trying to find my timeseries I noticed that my Kyle1995-IFSDB data catalog no longer had any time series associated with it (see below). I then tried to do the data transform for the timeseries data and it tells me that it has updated 12 timeseries but I still cannot find those timeseries in my data catalog anywhere(see below).
I should also note that I did do the optional contextualization exercise of linking the timeseries to assets. I then also ran the contextualization using the entity matchers.
What can I do to get my timeseries data back so that I can continue on with the training?
Enter your username or e-mail address. We'll send you an e-mail with instructions to reset your password.