Hello team, we are facing issue in updating the state table with DB extractor. The windows service that runs for DB extractor is working fine. However, with the python script, when we try to update the state table, it is not working as expected. Attached is the config file for reference.
Context:
We have a configuration YAML file with 10 queries (attached here as .docx), which operates in continuous mode and includes cron schedules. The DB extractor is running as a Windows service. Additionally, we've written a Python script that is scheduled to run once a day and attempts to change the 'high' value for certain rows in the state table. When we run the Python script, it executes successfully, and the rows are modified as expected. However, the continuously running Windows service appears to modify the state rows as well. Could you please confirm if the data in the state table is being cached? Or is it not acceptable for two processes (the Windows service and the Python script) to update the same raw table simultaneously?
Solved
RAW table update issue
Best answer by Einar Omang
The state table is cached in the extractor, so you cannot do this. It is generally assumed that the extractor “owns” the state table. Manually modifying it like this is not supported.
Reply
Enter your E-mail address. We'll send you an e-mail with instructions to reset your password.