Skip to main content
Answer

RAW table update issue

  • January 16, 2025
  • 1 reply
  • 53 views
M
Active
Forum|alt.badge.img

Hello team, we are facing issue in updating the state table with DB extractor. The windows service that runs for DB extractor is working fine. However, with the python script, when we try to update the state table, it is not working as expected. Attached is the config file for reference.

Context:
We have a configuration YAML file with 10 queries (attached here as .docx), which operates in continuous mode and includes cron schedules. The DB extractor is running as a Windows service. Additionally, we've written a Python script that is scheduled to run once a day and attempts to change the 'high' value for certain rows in the state table. When we run the Python script, it executes successfully, and the rows are modified as expected. However, the continuously running Windows service appears to modify the state rows as well. Could you please confirm if the data in the state table is being cached? Or is it not acceptable for two processes (the Windows service and the Python script) to update the same raw table simultaneously?

Best answer by Einar Omang

The state table is cached in the extractor, so you cannot do this. It is generally assumed that the extractor “owns” the state table. Manually modifying it like this is not supported.

1 Attachments
    Mithila Jayalath

    1 reply

    E
    Practitioner
    • Einar Omang
    • Practitioner
    • Answer
    • January 16, 2025

    The state table is cached in the extractor, so you cannot do this. It is generally assumed that the extractor “owns” the state table. Manually modifying it like this is not supported.

    Mithila Jayalath
    R
    Terms & ConditionsCookie SettingsAccessibility statement