Skip to main content
Solved

RAW table update issue

  • January 16, 2025
  • 1 reply
  • 34 views

Forum|alt.badge.img

Hello team, we are facing issue in updating the state table with DB extractor. The windows service that runs for DB extractor is working fine. However, with the python script, when we try to update the state table, it is not working as expected. Attached is the config file for reference.

Context:
We have a configuration YAML file with 10 queries (attached here as .docx), which operates in continuous mode and includes cron schedules. The DB extractor is running as a Windows service. Additionally, we've written a Python script that is scheduled to run once a day and attempts to change the 'high' value for certain rows in the state table. When we run the Python script, it executes successfully, and the rows are modified as expected. However, the continuously running Windows service appears to modify the state rows as well. Could you please confirm if the data in the state table is being cached? Or is it not acceptable for two processes (the Windows service and the Python script) to update the same raw table simultaneously?

Best answer by Einar Omang

The state table is cached in the extractor, so you cannot do this. It is generally assumed that the extractor “owns” the state table. Manually modifying it like this is not supported.

View original
Did this topic help you find an answer to your question?

1 reply

  • Practitioner
  • 75 replies
  • Answer
  • January 16, 2025

The state table is cached in the extractor, so you cannot do this. It is generally assumed that the extractor “owns” the state table. Manually modifying it like this is not supported.


Reply


Cookie Policy

We use cookies to enhance and personalize your experience. If you accept you agree to our full cookie policy. Learn more about our cookies.

 
Cookie Settings