mirror of
https://github.com/zvx-echo6/central.git
synced 2026-06-10 11:54:37 +02:00
Central - data hub spine. Adapters -> NATS/JetStream -> archive.
- Python 89.1%
- HTML 9.3%
- CSS 1.3%
- PLpgSQL 0.3%
Castle Rock caps each DataTables page at 100 rows regardless of `length`, so the single-request fetcher silently dropped rows on any layer over 100 (confirmed live: Construction recordsFiltered=114, returned 100 -> 14 rows invisible). Backports the v0.9.6 cameras pagination loop into _fetch_details. - _LIST_PAGE_LENGTH 1000 -> 100; new _list_body(start) builder; new @retry _fetch_page(base_url, layer, start). - _fetch_details loops start+=100 until recordsFiltered collected or an empty page, with a _MAX_PAGES=50 ceiling that warns+breaks. Mid-pagination failure returns rows-so-far (retried next poll). - Incidents (1) / Closures (29) are under 100 today but pagination applies uniformly; future-proof. central-supervisor restart only (no stream, migration, template, or dep change). Full suite: 833 passed, 1 skipped (central and unprivileged zvx, 3x each). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com> |
||
|---|---|---|
| docs | ||
| etc-templates | ||
| scripts | ||
| sql | ||
| src/central | ||
| systemd | ||
| tests | ||
| .gitattributes | ||
| .gitignore | ||
| .python-version | ||
| CHANGELOG.md | ||
| LICENSE | ||
| pyproject.toml | ||
| README.md | ||
| uv.lock | ||
Central
Central is the data hub spine for the infrastructure. Adapters normalize upstream sources into a canonical event shape, publish CloudEvents to NATS/JetStream, and archive to TimescaleDB for historical query. Single-LXC deployment.
Status
Phase 0 — scaffold. Not yet operational.
Architecture
- Python 3.12 (uv-managed)
- NATS + JetStream for live event bus
- TimescaleDB + PostGIS for archive and geospatial query
- One supervisor process managing adapter lifecycle
- One archive consumer process persisting events to TimescaleDB
- Both processes systemd-managed
Testing
See docs/test-database.md for test database setup.
License
MIT. See LICENSE.