Hi Team,Im, going through Cognite Data Engineering-Basic Integration course and while working on Extractor-Utils Library for Cognite Python SDK, I am getting some errors.when I run Cogex Init command it is asking “Which template should be loaded?” (basic\rest\mqtt)As of now I tried with selecting basic. and it ended up as below screenshot When i execute poetry run csvextractor command im getting below errorYour help is very much appreciated.Thank you.

Solved

Getting error when executing poetry run csvextractor

1 year ago
October 16, 2023
6 replies
116 views

Shravan Kumar Rama
Committed
6 replies

Hi Team,

Im, going through Cognite Data Engineering-Basic Integration course and while working on Extractor-Utils Library for Cognite Python SDK, I am getting some errors.

when I run Cogex Init command it is asking “Which template should be loaded?” (basic\rest\mqtt)

As of now I tried with selecting basic. and it ended up as below screenshot

When i execute poetry run csvextractor command im getting below error

Your help is very much appreciated.

Thank you.

Best answer by Shravan Kumar Rama

Hi Team,

I Managed to resolve above error by replace below two lines in config file

state_store: StateStoreConfig = StateStoreConfig() with state_store: StateStoreConfig = field(default_factory=StateStoreConfig)

and

extractor: ExtractorConfig = ExtractorConfig() with field(default_factory=StateStoreConfig).

With this changes i can able to run “poetry run csvextractor example_config.yaml” which give “Hellow world” as output.

View original

Did this topic help you find an answer to your question?

Shravan Kumar Rama
Author
Committed
6 replies
Answer
1 year ago
October 16, 2023

Hi Team,

I Managed to resolve above error by replace below two lines in config file

state_store: StateStoreConfig = StateStoreConfig() with state_store: StateStoreConfig = field(default_factory=StateStoreConfig)

and

extractor: ExtractorConfig = ExtractorConfig() with field(default_factory=StateStoreConfig).

With this changes i can able to run “poetry run csvextractor example_config.yaml” which give “Hellow world” as output.

Carin Meems
Seasoned Practitioner
223 replies
1 year ago
October 16, 2023

Hi @Shravan Kumar Rama thanks for your update!

Shravan Kumar Rama
Author
Committed
6 replies
1 year ago
October 16, 2023

Hi Team,

When i updated extractor.py file to upoad excel data into CDF and execute poetry run csvextractor example_config.yaml commanad im getting below error

File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable

Below is the complete error:

PS C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor> poetry run csvextractor example_config.yaml
No config type specified, default to local
2023-10-16 04:56:27.050 UTC [INFO ] MainThread - No .env file found
2023-10-16 04:56:27.051 UTC [WARNING ] MainThread - No config type specified, default to local
2023-10-16 04:56:27.051 UTC [INFO ] MainThread - Loaded local config file
2023-10-16 04:56:27.052 UTC [INFO ] MainThread - No extraction pipeline configured
2023-10-16 04:56:27.054 UTC [ERROR ] MainThread - Unexpected error during extraction
Traceback (most recent call last):
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 24, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 24, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
PS C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor> poetry run csvextractor example_config.yaml
No config type specified, default to local
2023-10-16 05:01:18.771 UTC [INFO ] MainThread - No .env file found
2023-10-16 05:01:18.775 UTC [WARNING ] MainThread - No config type specified, default to local
2023-10-16 05:01:18.775 UTC [INFO ] MainThread - Loaded local config file
2023-10-16 05:01:18.775 UTC [INFO ] MainThread - No extraction pipeline configured
2023-10-16 05:01:18.775 UTC [INFO ] MainThread - Extracting {file.path}
2023-10-16 05:01:18.778 UTC [ERROR ] MainThread - Unexpected error during extraction
Traceback (most recent call last):
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 27, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
Traceback (most recent call last):
File "<string>", line 1, in <module>
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\__main__.py", line 17, in main
extractor.run()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\base.py", line 359, in run
self.run_handle(self.cognite_client, self.state_store, self.config, self.cancellation_token)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\csvextractor\extractor.py", line 27, in run_extractor
with RawUploadQueue(cdf_client=cognite, max_queue_size=100_000) as queue:
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 175, in __exit__
self.stop()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\_base.py", line 133, in stop
self.upload()
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 128, in upload
self._upload_batch(database=database, table=table, patch=list(patch.values()))
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\decorator.py", line 232, in fun
return caller(func, *(extras + args), **kw)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 399, in retry_decorator
return _retry_internal(
^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\util.py", line 344, in _retry_internal
return f()
^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\extractorutils\uploader\raw.py", line 152, in _upload_batch
self.cdf_client.raw.rows.insert(db_name=database, table_name=table, row=patch, ensure_parent=True)
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api\raw.py", line 393, in insert
summary.raise_compound_exception_if_failed_tasks(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 72, in raise_compound_exception_if_failed_tasks
collect_exc_info_and_raise(
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 120, in collect_exc_info_and_raise
raise unknown_exc
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\utils\_concurrency.py", line 269, in execute_tasks
res = f.result()
^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 449, in result
return self.__get_result()
^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\_base.py", line 401, in __get_result
raise self._exception
File "C:\Users\srama2\AppData\Local\Programs\Python\Python311\Lib\concurrent\futures\thread.py", line 58, in run
result = self.fn(*self.args, **self.kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 152, in _post
return self._do_request(
^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 175, in _do_request
is_retryable, full_url = self._resolve_url(method, url_path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 247, in _resolve_url
is_retryable = self._is_retryable(method, full_url)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 262, in _is_retryable
return method in ["GET", "PUT", "PATCH"] or method == "POST" and self._url_is_retryable(path)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor\.venv\Lib\site-packages\cognite\client\_api_client.py", line 272, in _url_is_retryable
raise ValueError(f"URL {url} is not valid. Cannot resolve whether or not it is retryable")
ValueError: URL /api/v1/projects/${COGNITE_PROJECT}/raw/dbs/my-db/tables/my-table/rows is not valid. Cannot resolve whether or not it is retryable
PS C:\Users\srama2\Documents\Shravan\Training\Cognite\csvextractor>

Carin Meems
Seasoned Practitioner
223 replies
1 year ago
October 17, 2023

Hi @Shravan Kumar Rama,

Since you’re doing the course, are you following the steps as described in the course? At which step are you getting errors?

If not, just glancing over this it looks like you are missing some essentials in setting up your extractor. In that case please check the documentation as here: https://cognite-extractor-utils.readthedocs-hosted.com/en/latest/.

Shravan Kumar Rama
Author
Committed
6 replies
1 year ago
October 17, 2023

Hi @Carin Meems ,

I’m getting this error in the last step when i run “poetry run csvextractor example_config.yaml “ command.

I was following the course videos and documentation. I even followed the link that you provided its the same.

I have one doubt in example_config.yaml file do we need to update cognite section? Because i dont have below details in my environment variables.

From where i need to get these details or pass this details?

Carin Meems
Seasoned Practitioner
223 replies
1 year ago
October 18, 2023

Hi @Shravan Kumar Rama,

Yes, you’ll have to update this section with your own project details etc. You’ll have to set up these environment variables in your own environment. If you don’t know how to go about that, you can do a quick Google search for help.

Best,

Carin

Hi Team,

Im, going through Cognite Data Engineering-Basic Integration course and while working on Extractor-Utils Library for Cognite Python SDK, I am getting some errors.

when I run Cogex Init command it is asking “Which template should be loaded?” (basic\rest\mqtt)

As of now I tried with selecting basic. and it ended up as below screenshot

When i execute poetry run csvextractor command im getting below error

Your help is very much appreciated.

Thank you.

Page 1 / 1

Hi Team,

I Managed to resolve above error by replace below two lines in config file

state_store: StateStoreConfig = StateStoreConfig() with state_store: StateStoreConfig = field(default_factory=StateStoreConfig)

and

extractor: ExtractorConfig = ExtractorConfig() with field(default_factory=StateStoreConfig).

With this changes i can able to run “poetry run csvextractor example_config.yaml” which give “Hellow world” as output.

Hi @Shravan Kumar Rama thanks for your update!

Hi Team,

When i updated extractor.py file to upoad excel data into CDF and execute poetry run csvextractor example_config.yaml commanad im getting below error

Below is the complete error:

Hi @Shravan Kumar Rama,

Since you’re doing the course, are you following the steps as described in the course? At which step are you getting errors?

Hi @Carin Meems ,

I’m getting this error in the last step when i run “poetry run csvextractor example_config.yaml “ command.

I was following the course videos and documentation. I even followed the link that you provided its the same.

I have one doubt in example_config.yaml file do we need to update cognite section? Because i dont have below details in my environment variables.

From where i need to get these details or pass this details?

Hi @Shravan Kumar Rama,

Best,

Carin

Reply

Cookie Policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

Cookie settings

We use 3 different kinds of cookies. You can choose which cookies you want to accept. We need basic cookies to make this site work, therefore these are the minimum you can select. Learn more about our cookies.

Basic
Functional

Normal
Functional + analytics

Complete
Functional + analytics + social media + embedded videos + marketing

Reply

Related topics

nom de domaineicon

Quel avenir pour l'hébergement et pour la gestion des boîtes mail après la fin du sercice "Nom de Domaine"icon

Supprimer le nom de domaineicon

Suppression nom de domaineicon

Comment supprimer son nom de domaine ???icon

Sign up

Log in to the community

Scanning file for viruses.

This file cannot be downloaded

Cookie Policy

Cookie settings