Skip to main content
Maritsa Sarri
Expert ⭐️⭐️⭐️⭐️
Cognite Academy Instructor
March 25, 2022

Data Engineer Basics - Integrations

  • March 25, 2022
  • 59 replies
  • 1488 views

Welcome to the Data Engineer Basics - Integrations!

This discussion is dedicated to help learners of the Data Engineer Basics – Integrations learning path succeed. If you’re struggling any of the courses in this learning path, post a comment with the challenge you’re facing. You can also post your own tips and respond to fellow learners’ questions. Cognite Academy’s instructors are also here to help.

59 replies

Active ⭐️⭐️⭐️
April 3, 2022

Hi ,

 

I completed all section of the course (Data Engineer Basics - Integrations) but still completion status showing 84 % and PostgreSQL section showing pending. I am unable to take assessment test of Data Engineer Basics - Integrations!

 

Kindly resolve my issue to complete  Data Engineer Basics – Integrations learning path 

Regards

Mirtunjay 

Maritsa Sarri
Expert ⭐️⭐️⭐️⭐️
Cognite Academy Instructor
April 4, 2022

Hi @Mirtunjay Kumar,

Can you try again now? The assessment should be unlocked now and the PostegreSQL course completed. 

Let us know if you have any more questions. 

 

Best regards,

Maritsa

Maritsa | Cognite Academy
Seasoned ⭐️⭐️
August 25, 2022

Hello @Maritsa Sarri,

I am new to Cognite and started the Data Engineer training after the foundation training. 

I need help on the data extraction part. From the online self paced training, the source was defined but the destination was left out. How do I go about it? 

Thanks

Isaac

Cognite Academy Instructor
August 25, 2022

Hi @ikequarsh ,
I’m Enikö from Cognite Academy. First, congratulations on your Cognite Date Fusion Fundamentals certificate!

I see you’re working through the Extractor-utils Library for Cognite Python SDK course. I suggest you watch the Defining a Code Schema video that talks about defining the destination.

Let me know if the video has answered your question!
Happy learning!

Enikö

Enikő from Cognite Academy
Seasoned ⭐️⭐️
August 25, 2022

Hello @Eniko Farkas

Thanks for your quick response to my enquiry. Please can you share the link to the Defining a Code Schema video? Below is all I see in the Data Engineering training.

 

Nimesh  Madandas
Practitioner ⭐️⭐️⭐️
Practitioner ⭐️⭐️⭐️
August 25, 2022

Hi @ikequarsh,

You will find the ‘Defining a Code Schema’ video in the ‘Extractor-utils Library for Cognite Python SDK’ course. As you are inside the course, you can go to the ‘Build Your Own Python-based Extractor - Part (1 of 2)’ lesson, where you need to click on the ‘Defining a Code Schema' tab; on doing so, it will take you to the video. 🙂
 


Please find the link below for easy navigation:
https://learn.cognite.com/path/data-engineer-basics-integrations/extractor-utils-library-for-cognite-python-sdk/114686

Let us know if you have any queries. Happy learning!
Nimesh Madandas

Seasoned ⭐️⭐️
August 25, 2022

I think I did that earlier. I am sure there is something wrong with my PyCharm and need to reconfigure the setup again. It is not able to see some if not all the Objects like “RawDestinationConfig” and others. Can someone help? 

August 25, 2022

Hi @ikequarsh 


After you

pip install cognite-extractor-manager

and initialize the extractor project

cogex init

During this process poetry sets up a virtual environment and installs python modules into the venv. But you need to set / activate that virtual environment in your IDE, if it happens automatically or not I'm not sure. But just check that the python interpreter for your IDE’s project is set to: “your-extractor-directory”/venv/bin/python 

more native Poetry support was added to Pycharm last year(2021) so there can be some differences there now than what the video from what the course says; if it is pycharm you are using, but I'm not that familiar with Pycharm, cause I mainly use VS code or Spyder, But it should be simmilar. 

Then I hope you can find and import all modules and objects inside your pycharm project, that poetry installed in to the venv during the “cogex init” process. 

If you are not familiar with poetry I suggest looking it up. because it can be seen as the npm of python. that both sets up virtual environments (isolation) and handles package/module installing and versioning (dependency resolver). which previous needed several applications like venv or virtualenv and  pip. but poetry does all this service. 

Hope this helps you solve your issue. 

Seasoned ⭐️⭐️
August 25, 2022

Hello @Stig Harald Gustavsen,

Thanks for your response. I can use VS Code and is it possible to guide on how to setup with Cogex? 

I think your training materials need to be revisited since it expects user to have knowledge with Cogex.

Let me hear from you. 

Isaac

Seasoned ⭐️⭐️
August 25, 2022

@Stig Harald Gustavsen

I want to clean up my machine and reinstall the Cognite, is there any good way of doing since pip uninstall couldn’t get it done.