Hi Team,Im, going through Cognite Data Engineering-Basic Integration course and while working on Extractor-Utils Library for Cognite Python SDK, I am getting some errors.when I run Cogex Init command it is asking “Which template should be loaded?” (basic\rest\mqtt)As of now I tried with selecting basic. and it ended up as below screenshot When i execute poetry run csvextractor command im getting below errorYour help is very much appreciated.Thank you.

Solved

Getting error when executing poetry run csvextractor

1 year ago
October 16, 2023
6 replies
100 views

Shravan Kumar Rama
Committed
6 replies

Hi Team,

Im, going through Cognite Data Engineering-Basic Integration course and while working on Extractor-Utils Library for Cognite Python SDK, I am getting some errors.

when I run Cogex Init command it is asking “Which template should be loaded?” (basic\rest\mqtt)

As of now I tried with selecting basic. and it ended up as below screenshot

When i execute poetry run csvextractor command im getting below error

Your help is very much appreciated.

Thank you.

Best answer by Shravan Kumar Rama

Hi Team,

I Managed to resolve above error by replace below two lines in config file

state_store: StateStoreConfig = StateStoreConfig() with state_store: StateStoreConfig = field(default_factory=StateStoreConfig)

and

extractor: ExtractorConfig = ExtractorConfig() with field(default_factory=StateStoreConfig).

With this changes i can able to run “poetry run csvextractor example_config.yaml” which give “Hellow world” as output.

View original

Did this topic help you find an answer to your question?

Shravan Kumar Rama
Author
Committed
6 replies
Answer
1 year ago
October 16, 2023

Hi Team,

I Managed to resolve above error by replace below two lines in config file

state_store: StateStoreConfig = StateStoreConfig() with state_store: StateStoreConfig = field(default_factory=StateStoreConfig)

and

extractor: ExtractorConfig = ExtractorConfig() with field(default_factory=StateStoreConfig).

With this changes i can able to run “poetry run csvextractor example_config.yaml” which give “Hellow world” as output.

Carin Meems
Seasoned Practitioner
223 replies
1 year ago
October 16, 2023

Hi @Shravan Kumar Rama thanks for your update!

Shravan Kumar Rama
Author
Committed
6 replies
1 year ago
October 16, 2023

Hi Team,

When i updated extractor.py file to upoad excel data into CDF and execute poetry run csvextractor example_config.yaml commanad im getting below error

File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable

Below is the complete error:

PS C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor> poetry run csvextractor example_config.yaml
No config type specified, default to local
2023-10-16 04:56:27.050 UTC [INFO ] MainThread - No .env file found
2023-10-16 04:56:27.051 UTC [WARNING ] MainThread - No config type specified, default to local
2023-10-16 04:56:27.051 UTC [INFO ] MainThread - Loaded local config file
2023-10-16 04:56:27.052 UTC [INFO ] MainThread - No extraction pipeline configured
2023-10-16 04:56:27.054 UTC [ERROR ] MainThread - Unexpected error during extraction
Traceback (most recent call last):
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 24, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 24, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
PS C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor> poetry run csvextractor example_config.yaml
No config type specified, default to local
2023-10-16 05:01:18.771 UTC [INFO ] MainThread - No .env file found
2023-10-16 05:01:18.775 UTC [WARNING ] MainThread - No config type specified, default to local
2023-10-16 05:01:18.775 UTC [INFO ] MainThread - Loaded local config file
2023-10-16 05:01:18.775 UTC [INFO ] MainThread - No extraction pipeline configured
2023-10-16 05:01:18.775 UTC [INFO ] MainThread - Extracting {file.path}
2023-10-16 05:01:18.778 UTC [ERROR ] MainThread - Unexpected error during extraction
Traceback (most recent call last):
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 27, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 27, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
PS C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor>

Carin Meems
Seasoned Practitioner
223 replies
1 year ago
October 17, 2023

Hi @Shravan Kumar Rama,

Since you’re doing the course, are you following the steps as described in the course? At which step are you getting errors?

If not, just glancing over this it looks like you are missing some essentials in setting up your extractor. In that case please check the documentation as here: https://cognite-extractor-utils.readthedocs-hosted.com/en/latest/.

Shravan Kumar Rama
Author
Committed
6 replies
1 year ago
October 17, 2023

Hi @Carin Meems ,

I’m getting this error in the last step when i run “poetry run csvextractor example_config.yaml “ command.

I was following the course videos and documentation. I even followed the link that you provided its the same.

I have one doubt in example_config.yaml file do we need to update cognite section? Because i dont have below details in my environment variables.

From where i need to get these details or pass this details?

Carin Meems
Seasoned Practitioner
223 replies
1 year ago
October 18, 2023

Hi @Shravan Kumar Rama,

Yes, you’ll have to update this section with your own project details etc. You’ll have to set up these environment variables in your own environment. If you don’t know how to go about that, you can do a quick Google search for help.

Best,

Carin

Reply

Cookie Policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

Cookie settings

We use 3 different kinds of cookies. You can choose which cookies you want to accept. We need basic cookies to make this site work, therefore these are the minimum you can select. Learn more about our cookies.

Basic
Functional

Normal
Functional + analytics

Complete
Functional + analytics + social media + embedded videos

Reply

Related topics

Getting AttributeError while using "bootstrap-cli prepare" commandicon

Error while setting up environment for "Extractor-utils Library for Cognite Python SDK"icon

Getting " error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio\\2022\\BuildTools\\VC\\Tools\\MSVC\\14.38.33130\\bin\\HostX86\\x64\\cl.exe' failed with exit code 2" when run poetry add pandasicon

Uploading InsertDatapoints via REST extractor - Getting a CogniteAPIError code 405 Not Allowed Erroricon

Error running the Cognite replicator with Option 5

Sign up

Log in to the community

Scanning file for viruses.

This file cannot be downloaded

Cookie Policy

Cookie settings