Hi Team,Im, going through Cognite Data Engineering-Basic Integration course and while working on Extractor-Utils Library for Cognite Python SDK, I am getting some errors.when I run Cogex Init command it is asking “Which template should be loaded?” (basic\rest\mqtt)As of now I tried with selecting basic. and it ended up as below screenshot When i execute poetry run csvextractor command im getting below errorYour help is very much appreciated.Thank you.

Cognite Hub

+2

Shravan Kumar Rama
Author
Committed
6 replies
6 months ago
16 October 2023
Answer

Hi Team,

I Managed to resolve above error by replace below two lines in config file

state_store: StateStoreConfig = StateStoreConfig() with state_store: StateStoreConfig = field(default_factory=StateStoreConfig)

and

extractor: ExtractorConfig = ExtractorConfig() with field(default_factory=StateStoreConfig).

With this changes i can able to run “poetry run csvextractor example_config.yaml” which give “Hellow world” as output.

C

Userlevel 3

Carin Meems
Seasoned Practitioner
222 replies
6 months ago
16 October 2023

Hi @Shravan Kumar Rama thanks for your update!

S

+2

Shravan Kumar Rama
Author
Committed
6 replies
6 months ago
16 October 2023

Hi Team,

When i updated extractor.py file to upoad excel data into CDF and execute poetry run csvextractor example_config.yaml commanad im getting below error

File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable

Below is the complete error:

PS C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor> poetry run csvextractor example_config.yaml
No config type specified, default to local
2023-10-16 04:56:27.050 UTC [INFO ] MainThread - No .env file found
2023-10-16 04:56:27.051 UTC [WARNING ] MainThread - No config type specified, default to local
2023-10-16 04:56:27.051 UTC [INFO ] MainThread - Loaded local config file
2023-10-16 04:56:27.052 UTC [INFO ] MainThread - No extraction pipeline configured
2023-10-16 04:56:27.054 UTC [ERROR ] MainThread - Unexpected error during extraction
Traceback (most recent call last):
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 24, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 24, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
PS C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor> poetry run csvextractor example_config.yaml
No config type specified, default to local
2023-10-16 05:01:18.771 UTC [INFO ] MainThread - No .env file found
2023-10-16 05:01:18.775 UTC [WARNING ] MainThread - No config type specified, default to local
2023-10-16 05:01:18.775 UTC [INFO ] MainThread - Loaded local config file
2023-10-16 05:01:18.775 UTC [INFO ] MainThread - No extraction pipeline configured
2023-10-16 05:01:18.775 UTC [INFO ] MainThread - Extracting {file.path}
2023-10-16 05:01:18.778 UTC [ERROR ] MainThread - Unexpected error during extraction
Traceback (most recent call last):
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 27, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 27, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
PS C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor>

C

Userlevel 3

Carin Meems
Seasoned Practitioner
222 replies
6 months ago
17 October 2023

Hi @Shravan Kumar Rama,

Since you’re doing the course, are you following the steps as described in the course? At which step are you getting errors?

If not, just glancing over this it looks like you are missing some essentials in setting up your extractor. In that case please check the documentation as here: https://cognite-extractor-utils.readthedocs-hosted.com/en/latest/.

S

+2

Shravan Kumar Rama
Author
Committed
6 replies
6 months ago
17 October 2023

Hi @Carin Meems ,

I’m getting this error in the last step when i run “poetry run csvextractor example_config.yaml “ command.

I was following the course videos and documentation. I even followed the link that you provided its the same.

I have one doubt in example_config.yaml file do we need to update cognite section? Because i dont have below details in my environment variables.

From where i need to get these details or pass this details?

C

Userlevel 3

Carin Meems
Seasoned Practitioner
222 replies
6 months ago
18 October 2023

Hi @Shravan Kumar Rama,

Yes, you’ll have to update this section with your own project details etc. You’ll have to set up these environment variables in your own environment. If you don’t know how to go about that, you can do a quick Google search for help.

Best,

Carin

Getting error when executing poetry run csvextractor

6 replies

Reply

Reply

Sign up

Log in to the community

Scanning file for viruses.

This file cannot be downloaded