matt/recon
1
0
Fork 0
mirror of https://github.com/zvx-echo6/recon.git synced 2026-05-20 06:34:40 +02:00
Code Issues Projects Releases Packages Wiki Activity

Replace wget/SingleFile/Playwright backends with Zimit

Browse source 
- Zimit Docker container handles all site types (static, SPA, JS redirects)
- Removed: _detect_crawl_mode, _crawl_wget, _crawl_singlefile, preflight logic
- Added: _crawl_zimit() with Docker lifecycle management
- Simplified pipeline: submit → Zimit crawl → kiwix-manage register → done
- No more zimwriterfs step — Zimit produces ZIM directly
- Dashboard UI simplified: removed crawl mode dropdown
- Config simplified: removed reject patterns, preflight, singlefile sections

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
Matt 2026-04-19 14:06:23 +00:00
commit 8945c82e3f
5 changed files with 212 additions and 606 deletions
Download patch file Download diff file Expand all files Collapse all files

14
templates/kiwix/scraper.html
View file

@ -17,7 +17,7 @@
style="width:100%;padding:8px 12px;background:var(--bg-secondary);border:1px solid var(--border);color:var(--text-primary);border-radius:var(--radius);font-family:inherit;font-size:13px;">
</div>
</div>
<div style="display:grid;grid-template-columns:1fr 1fr 1fr auto;gap:12px;align-items:end;">
<div style="display:grid;grid-template-columns:1fr 1fr auto;gap:12px;align-items:end;">
<div>
<label class="text-small text-muted" style="display:block;margin-bottom:4px;">Language</label>
<select id="sf-lang"
@ -38,15 +38,6 @@
<input type="text" id="sf-category" placeholder="Optional"
style="width:100%;padding:8px 12px;background:var(--bg-secondary);border:1px solid var(--border);color:var(--text-primary);border-radius:var(--radius);font-family:inherit;font-size:13px;">
</div>
<div>
<label class="text-small text-muted" style="display:block;margin-bottom:4px;">Crawl Mode</label>
<select id="sf-mode"
style="width:100%;padding:8px 12px;background:var(--bg-secondary);border:1px solid var(--border);color:var(--text-primary);border-radius:var(--radius);font-family:inherit;font-size:13px;">
<option value="" selected>Auto-detect</option>
<option value="static">Static (wget)</option>
<option value="browser">Browser (SingleFile)</option>
</select>
</div>
<div>
<button type="submit" class="btn" id="sf-submit-btn">Submit</button>
</div>
@ -75,7 +66,6 @@
<th>ID</th>
<th>URL</th>
<th>Title</th>
<th>Mode</th>
<th>Pages</th>
<th>Status</th>
<th>ZIM</th>
@ -83,7 +73,7 @@
</tr>
</thead>
<tbody id="sc-table-body">
<tr><td colspan="8" class="text-muted">Loading...</td></tr>
<tr><td colspan="7" class="text-muted">Loading...</td></tr>
</tbody>
</table>
</div>