matt/recon
1
0
Fork 0
mirror of https://github.com/zvx-echo6/recon.git synced 2026-05-20 06:34:40 +02:00
Code Issues Projects Releases Packages Wiki Activity

Fix progress regex and SIGHUP/scan_zims race condition

Browse source 
- Parse Browsertrix "crawled":N JSON format instead of "N pages"
- Add 3s delay between SIGHUP to kiwix-serve and scan_zims() call
  so the OPDS catalog is reloaded before we query it for linking

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
Matt 2026-04-19 19:35:42 +00:00
commit 5f5bcedab9
1 changed files with 3 additions and 0 deletions
Download patch file Download diff file Expand all files Collapse all files

3
lib/scraper_runner.py
View file

@ -339,6 +339,9 @@ def _process_job(job, config, stop_event):
except Exception as e: except Exception as e:
logger.warning(f"Job {job_id}: failed to signal kiwix-serve: {e}") logger.warning(f"Job {job_id}: failed to signal kiwix-serve: {e}")
# Wait for kiwix-serve to reload its catalog after SIGHUP
time.sleep(3)
zim_source_id = None zim_source_id = None
try: try:
from .zim_monitor import scan_zims from .zim_monitor import scan_zims