mirror of
https://github.com/zvx-echo6/central.git
synced 2026-08-26 09:21:36 +00:00
Central - data hub spine. Adapters -> NATS/JetStream -> archive.
- Python 88.6%
- HTML 9.4%
- CSS 1.2%
- Shell 0.6%
- PLpgSQL 0.2%
malice
a38eaaa4fd* gui: add consumers admin page (view + delete JetStream consumers)
Adds GET /consumers (list all stream consumers grouped by stream) and
POST /consumers/{stream}/{consumer}/delete. Archive-* consumers are
protected in both the template (no delete button rendered) and the POST
handler (hard refuse before touching NATS). CSRF validated, audit
logged via CONSUMER_DELETE action, DB conn acquired same pattern as
api_keys_delete.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* gui: fix consumers_info coroutine usage + list-returning test mock + None-guard counts
- routes.py: change `async for ci in js.consumers_info(stream_name)` to
`for ci in await js.consumers_info(stream_name)` — nats-py 2.14.0
consumers_info() is a plain coroutine returning list[ConsumerInfo], not
an async iterable; the old form threw TypeError silently (swallowed by
except), causing every stream to show "unavailable" and zero consumers.
- test_consumers.py: replace async-generator mock with AsyncMock returning
a list, matching the real API; also fix inline consumers_info_raising in
the error test (remove dead yield); add explicit regression guard asserting
consumer names appear in the template context.
- consumers_list.html: guard num_pending/num_ack_pending/num_redelivered/
num_waiting with `… if … is not none else '—'` to prevent "None" in cells.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* gui: make consumers_delete guards DB-independent + add rendered-HTML tests
Builds on the consumers_info coroutine fix:
- consumers_delete: acquire the DB pool only when actually writing the
audit (after the CSRF / archive-guard / NATS-unavailable early exits)
and use a local `get_js` import. Previously `pool = get_pool()` ran at
the top, so the CSRF-reject, archive-refuse and NATS-down paths all
needed an initialized DB pool, and the module-level get_js bound at
import time ignored test patches of central.gui.nats.get_js. Mirrors
the local-import pattern the streams routes already use.
- tests: add TestConsumersListHtmlRender — renders consumers_list.html
through the real Jinja2 environment and asserts the consumer NAME
reaches the HTML body, the central-owned label gates on `protected`,
and None counts render an em dash rather than the literal "None".
Stronger than the context-dict checks; the coroutine/None regressions
cannot return. All 4 delete-route tests now pass (were failing on an
uninitialized-pool RuntimeError).
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
---------
Co-authored-by: Ubuntu <zvx@cortex.echo6.co>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
|
||
|---|---|---|
| docs | ||
| etc-templates | ||
| scripts | ||
| sql | ||
| src/central | ||
| systemd | ||
| tests | ||
| .gitattributes | ||
| .gitignore | ||
| .python-version | ||
| CHANGELOG.md | ||
| LICENSE | ||
| pyproject.toml | ||
| README.md | ||
| uv.lock | ||
Central
Central is the data hub spine for the Echo6 infrastructure. Adapters normalize upstream sources into a canonical event shape, publish CloudEvents to NATS/JetStream, and archive to TimescaleDB for historical query. Single-LXC deployment.
Status
Operational (v0.14.6) — deployed on utility CT 104 (central.echo6.mesh).
~22 adapters live across traffic, wildfire, weather, space-weather, hydrology, earthquakes, avalanche, disasters, and satellite. CloudEvents published to NATS/JetStream, archived to TimescaleDB/PostGIS. FastAPI + HTMX GUI/API on :8000.
Three systemd units on a single LXC:
central-supervisor— adapter lifecycle managercentral-archive— NATS consumer persisting events to TimescaleDBcentral-gui— FastAPI + HTMX web interface / API (:8000)
Architecture
- Python 3.12 (uv-managed)
- NATS + JetStream for live event bus
- TimescaleDB + PostGIS for archive and geospatial query
- One supervisor process managing adapter lifecycle
- One archive consumer process persisting events to TimescaleDB
- Both processes systemd-managed
Testing
See docs/test-database.md for test database setup.
License
MIT. See LICENSE.