Skip to main content
N
Seasoned ⭐️⭐️⭐️
Niranjan Madhukar Karvekar
Seasoned ⭐️⭐️⭐️
March 7, 2023
Solved

DB Extractor - Too many concurrent requests in pod

  • March 7, 2023
  • 1 reply
  • 76 views

Hi,

 

I see this error in extractor log, I hope even if this happens , it will be retried and there will not be the data loss. Please correct if I am wrong or if there are ways to change any configuration in extractor to avoid this. 

 

2023-03-07 05:42:04.233 UTC [WARNING ] QueryExecutor_3 - Too many concurrent requests in pod | code: 503

Best answer by mathialo

This is a response from the CDF API that usually means the RAW service itself is overloaded. It is something that generally should not happen, and is usually only an intermittent error when it does.

The DB extractor will retry failing requests towards CDF a number of times, that’s why this is a warning log and not an error log (at least not yet), since the extractor will retry the request again several times. If it eventually gave up you will see a log line in the `ERROR` channel telling you so. If that happens, the extractor could be picking up that data again next time it runs, depending on how you have configured state stores and incremental fields in your configuration file.

1 reply

M
Practitioner ⭐️⭐️⭐️
mathialoAnswer
Practitioner ⭐️⭐️⭐️
March 7, 2023

This is a response from the CDF API that usually means the RAW service itself is overloaded. It is something that generally should not happen, and is usually only an intermittent error when it does.

The DB extractor will retry failing requests towards CDF a number of times, that’s why this is a warning log and not an error log (at least not yet), since the extractor will retry the request again several times. If it eventually gave up you will see a log line in the `ERROR` channel telling you so. If that happens, the extractor could be picking up that data again next time it runs, depending on how you have configured state stores and incremental fields in your configuration file.

Terms & ConditionsAccessibility statement