Skip to main content

CDF Fundamentals Discussion

  • October 29, 2021
  • 169 replies
  • 5338 views

Show first post

169 replies

Mithila Jayalath
Seasoned Practitioner
Forum|alt.badge.img+8

@Rodrigo Cezar Leão can you please let me know the browser that you are using? I checked using Google Chrome and I was able to upload the CSV without any issues.


Sofie Haug
Seasoned Practitioner
Forum|alt.badge.img+13
  • Cognite Academy Instructor
  • January 2, 2025

Hi ​@Rodrigo Cezar Leão! If you still have the same issue, just please continue and use the pre-uploaded table available for you. Going forward, you will just do 

“IFSDB.assets” for the CDF transformation 


Forum|alt.badge.img+2

 

@Rodrigo Cezar Leão can you please let me know the browser that you are using? I checked using Google Chrome and I was able to upload the CSV without any issues.

I could do the upload changing Firefox for Chrome. 

 

 

Hi ​@Rodrigo Cezar Leão! If you still have the same issue, just please continue and use the pre-uploaded table available for you. Going forward, you will just do 

“IFSDB.assets” for the CDF transformation 

This information confused me a little. The spreadsheet that must be upload contains the assets data, like the tags names and is called AvevaNet. Later on, we use the IFSDB table to generate the timeseries and fill with the datapoints. So if I understand right what you said, I am suposed to get the spreadsheet AvevaNet data from the IFSDB.assets table?


Sofie Haug
Seasoned Practitioner
Forum|alt.badge.img+13
  • Cognite Academy Instructor
  • January 2, 2025

@Rodrigo Cezar Leão, I’m sorry for the confusion. There is an extra (backup) in the IFSDB db, with the assets table as well. In case you can’t upload the CSV file. You can continue and read from this table when generating the assets. 


Forum|alt.badge.img+4

Hello,
I am redoing this course from two years ago, 
and I am at the moment in (Working With CDF: Integrate) step: (Complete data set documentation)
And I noticed an issue I didn’t face before when selecting ( document Data Extraction) for my Data Catalog
I am unable to select the DataBase / Table
I even tried with anew data base, and other users databases, I tried both google chrome & Microsoft Edge
but to no avail, the box won’t tick:
 


I sometimes notice this message too when opening Document Extraction : ( Something went wrong: [object object] )
 

Is it something I missed ? I tried refresh many times and different browsers (new logins)


Mithila Jayalath
Seasoned Practitioner
Forum|alt.badge.img+8

@Maryam Al-Anssari I checked from my end and I was able to reproduce the same issue. It looks like a bug, I’ll create a support ticket for this. The support team will get back to you with an update.


Forum|alt.badge.img+4

Additionally, in working with CDF : Integrate 
in Data points section,
I copied the code and adjusted it as instructed below:

-------------------------------------

SELECT 
concat('Maryam1998:',dp.sensor) AS externalId,
cast(time_stamp/1000 as timestamp) AS timestamp,
cast(value AS double)

FROM IFSDB.values AS dp,

--selecting from _cdf.timeseries means we select from the timeseries we ingested to CDF earlier. We do this to make sure all the time series we try to add data points to actually exist

_cdf.timeseries AS ts WHERE CONCAT('Maryam1998:',dp.sensor) = ts.externalId
---------------------------------------
I still get empty timeseries ( no data points) in my dataset:
 

Kindly, could you please advise on what might the mistake be


Forum|alt.badge.img+4

@Maryam Al-Anssari I checked from my end and I was able to reproduce the same issue. It looks like a bug, I’ll create a support ticket for this. The support team will get back to you with an update.

Hello Mithila,
Sounds good, thank you for your help! :)


Thiago dos Santos Rodrigues
Active
Forum|alt.badge.img+1

Hello,
I am facing the same issue mentioned here. Is there a solution that can be applied? 

Thanks in advance for your help! 

 

Additionally, in working with CDF : Integrate 
in Data points section,
I copied the code and adjusted it as instructed below:

-------------------------------------

SELECT 
concat('Maryam1998:',dp.sensor) AS externalId,
cast(time_stamp/1000 as timestamp) AS timestamp,
cast(value AS double)

FROM IFSDB.values AS dp,

--selecting from _cdf.timeseries means we select from the timeseries we ingested to CDF earlier. We do this to make sure all the time series we try to add data points to actually exist

_cdf.timeseries AS ts WHERE CONCAT('Maryam1998:',dp.sensor) = ts.externalId
---------------------------------------
I still get empty timeseries ( no data points) in my dataset:
 

Kindly, could you please advise on what might the mistake be

 


Sofie Haug
Seasoned Practitioner
Forum|alt.badge.img+13
  • Cognite Academy Instructor
  • February 24, 2025

Hi ​@Thiago dos Santos Rodrigues 

For a start, I see that the external id of your time series is “Maryam198” and not “Maryam1998”
 

If you make it match, you should get your datapoint added to your time series!

 

Best regards, Sofie


Hi Team, 

I have this error, maybe someone know about this issue? 

Thank You! 


Sofie Haug
Seasoned Practitioner
Forum|alt.badge.img+13
  • Cognite Academy Instructor
  • March 27, 2025

Hi ​@LEIDY JOHANNA CAMPOS QUESADA 

According to the error message, it is complaining about the Data Set Id. 
If I go into Data Catalog and search for your data set, I find it with ID 3665583308625309. Which is not the same ID as you used in the SQL Query. I think if you replace it, it will work!

Link to your data set:  https://cognite-learn.fusion.cognite.com/cdf-fundamentals/data-catalog/data-set/3665583308625309?cluster=api.cognitedata.com&workspace=data-management

 

Best regards, 


Forum|alt.badge.img+1

I am facing the same issue with time series data points being empty as a few others mentioned. 

I used this query to get data points into my time series, but when i click preview, i see the query returned 0 points. 

 

SELECT 
concat('Dinakar1990:',dp.sensor) AS externalId,
cast(time_stamp/1000 as timestamp) AS timestamp,
cast(value AS double)
FROM IFSDB.values AS dp,

--selecting from _cdf.timeseries means we select from the timeseries we ingested to CDF earlier. We do this to make sure all the time series we try to add data points to actually exist

_cdf.timeseries AS ts WHERE CONCAT('Dinakar1990:',dp.sensor) = ts.externalId

 


How can i fix this?


Sofie Haug
Seasoned Practitioner
Forum|alt.badge.img+13
  • Cognite Academy Instructor
  • April 4, 2025

Hi ​@Dinakar Gollapinni 

Your transformations was successful and you have your datapoint written to your time series.

The preview will not show anything for datapoints since we don’t really do anything to the data, we just make sure we place them into the correct time series.  If you look at the graph on your successful run in the “Run history” tab, you can see that datapoint were written. 

I see that I need to update the datapoint data a bit, that the data it writes in goes back to 2020 (I think something it mentioned about this in the course??) 

Best regards, 


Forum|alt.badge.img+1

I don’ see any data in my time series. 
 


I also tried to view in charts, i can’t see any data.
 

Also, when I go to a different tab and come back to my charts tab, my filters are reset and i have to search for my data again. 


Sofie Haug
Seasoned Practitioner
Forum|alt.badge.img+13
  • Cognite Academy Instructor
  • April 4, 2025

As mentioned, the data is only in 2020 (which I need to update). I found it when I went in to your time series.

 

Best regards, 


Sofie Haug
Seasoned Practitioner
Forum|alt.badge.img+13
  • Cognite Academy Instructor
  • April 4, 2025

You mentioned, ​@Dinakar Gollapinni, that the filtering disappears, is that inside of charts? 


Forum|alt.badge.img+1

Ohh you are right. Sorry, I did not understand before. I scrolled to 2020 and i can see my data now. 
 


And yes, In charts, when i click Add Data and choose time series, and apply filter on ExternalID, when i change tabs in my browser and come back to the charts tab, the external Id filter i applied is gone, and i have apply the filter again. 
 


Sofie Haug
Seasoned Practitioner
Forum|alt.badge.img+13
  • Cognite Academy Instructor
  • April 4, 2025

@Dinakar Gollapinni Thank you for your feedback, I will take it back to the Charts team and let them know!

 

Have a nice weekend!


  • New
  • April 18, 2025

Hi Bbauri,

Thanks for providing the console snap short of browser.
I have investigate deeply and found out all is working fine with the fusion. In the console , you have problem with failed to load resource:net::ERR_CERT_AUTHORITY_INVALID, which is related to your network connection and SSL certificate.

I recommend you to check your network connection and SSL certificate in your browser.

Help link 1 and Help link 2

Regards
Kumar
 

I found the helpful resource article for the error ERR_CERT_AUTHORITY_INVALID and it can occur due to when a browser cannot verify an SSL certificate for a particular website. You can check out the solution guide in detail and maybe it will be helpful, also to get rid of the error.

I hope it helps!


Forum|alt.badge.img
  • Active
  • May 15, 2025

Hello.  I have moved on to the data point transformation in learning path.  I have created transformation for data points , but when i check time series ID there is no data appear.

thanks in advance


Sofie Haug
Seasoned Practitioner
Forum|alt.badge.img+13
  • Cognite Academy Instructor
  • May 15, 2025

Hi ​@Mohamed Ali 

When I go into your data set to investigate your data I find you have used 2 different prefixes with the external ids.

For you assets, you have used; concat('mohamed1992:',loc)
for time series, you have used; concat('mohamed1992-IFSDB',tag)

this results in 2 things: 

  • you are not able to link your time series and assets
  • you are not able to add your datapoints when referencing to concat('Mohamed1992',dp.sensor

Sofie Haug
Seasoned Practitioner
Forum|alt.badge.img+13
  • Cognite Academy Instructor
  • May 15, 2025

When trying to link assets and time series, you are trying to match:
mohamed1992-asset with mohamed1992-IFSDB-timeseries. 

The way the written code works in the current state of the time serie transformation is written, it will not find a match on this. 

Secondly, trying to write the datapoints, you are trying to create datapoints, say that you want to add the datapoints to the time series with external id = mohamed1992:timeseriesname, while the current external id of the time series = mohamed1992-IFSDBtimeseriesname

 

I hope you understand what I’m trying to explain here ​@Mohamed Ali ?


Sofie Haug
Seasoned Practitioner
Forum|alt.badge.img+13
  • Cognite Academy Instructor
  • May 15, 2025

However, the solution is: 
 

  • Go back to the time series transformation (the one without the assets linking), and re-run it with the correct prefix. this will update the existing time series. Make sure you are consistent in the prefix you are adding, just by using ‘mohamed1992: vs ‘mohamed1992 can also cause issues. 
  • Then continue the steps from there. 

    Please let me know if there are anything I can help out with. I can also go in and change the external ids for you if want me to?
     

Best regards, 


Forum|alt.badge.img
  • Active
  • May 18, 2025

However, the solution is: 
 

  • Go back to the time series transformation (the one without the assets linking), and re-run it with the correct prefix. this will update the existing time series. Make sure you are consistent in the prefix you are adding, just by using ‘mohamed1992: vs ‘mohamed1992 can also cause issues. 
  • Then continue the steps from there. 

    Please let me know if there are anything I can help out with. I can also go in and change the external ids for you if want me to?
     

Best regards, 

Thank you ​@Sofie Haug 
everything is working well now. I really appreciate the support.