matt/central
1
0
Fork 0
mirror of https://github.com/zvx-echo6/central.git synced 2026-08-26 17:31:39 +00:00
Code Issues Projects Releases Packages Wiki Activity
Central - data hub spine. Adapters -> NATS/JetStream -> archive.
261 commits 18 branches 77 tags 5.4 MiB
  • Python 88.6%
  • HTML 9.4%
  • CSS 1.2%
  • Shell 0.6%
  • PLpgSQL 0.2%
Find a file
malice 6f82ca68f4 v0.14.3: propagate WFIGS incident updates (dedup key includes ModifiedOnDateTime_dt) 
The wfigs_incidents dedup key was the bare IrwinID, so a fire published once
on first observation and every later acreage/containment update was silently
deduped at the supervisor's published_ids gate. The adapter re-yields all
active incidents every poll (300s), but only new IrwinIDs / fall-offs ever
produced events. This defeated the apparent intent (meshAI's last_per_subject
subscription on central.fire.incident.id.>; the v0.10.4 effort to surface
upstream-modified fires).

Fix (one line, adapter.py:326): id = f"{irwin_id}:{ModifiedOnDateTime_dt}".
Each genuine upstream modification now mints a new id and republishes;
identical re-polls (same modified time) still dedup. ModifiedOnDateTime_dt is
already fetched (recency filter) and already in event.data -- no new field, no
new event type, no subject change, no migration.

Tests (extend tests/test_wfigs.py):
- unchanged record dedups across polls (regression guard)
- modified record republishes with a distinct id (the load-bearing fix proof)
- subject_for unchanged -> central.fire.incident.<state>.<county>
- None ModifiedOnDateTime_dt yields deterministic ':None', no crash
Updated 2 existing incident id assertions for the new key shape; the
wfigs_perimeters assertion is deliberately untouched (same pattern, deferred).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
2026-06-13 15:19:55 -06:00
docs v0.13.0: sat_orbits adapter (forward-orbit-track per satellite) + antimeridian splitter 2026-06-09 18:50:47 -06:00
etc-templates scaffold: initial repository structure 2026-05-15 19:16:24 +00:00
scripts scaffold: initial repository structure 2026-05-15 19:16:24 +00:00
sql v0.14.0: multi-bbox monitoring areas (config.monitoring_areas set-union filter) 2026-06-11 13:17:54 -06:00
src/central v0.14.3: propagate WFIGS incident updates (dedup key includes ModifiedOnDateTime_dt) 2026-06-13 15:19:55 -06:00
systemd feat(gui): add auth core, setup gate, and first-run operator creation 2026-05-17 05:30:49 +00:00
tests v0.14.3: propagate WFIGS incident updates (dedup key includes ModifiedOnDateTime_dt) 2026-06-13 15:19:55 -06:00
.gitattributes chore: normalize line endings to LF 2026-05-16 22:26:12 +00:00
.gitignore feat(gui): add auth core, setup gate, and first-run operator creation 2026-05-17 05:30:49 +00:00
.python-version foundation: models, adapter ABC, config, CE wire, schema 2026-05-15 21:08:56 +00:00
CHANGELOG.md docs: add v0.3.0 changelog entry and network bindings reference (#29) 2026-05-18 14:26:09 -06:00
LICENSE scaffold: initial repository structure 2026-05-15 19:16:24 +00:00
pyproject.toml v0.11.1: satpass_predict adapter (server-side pass alerts for fixed observers) (#101) 2026-06-09 01:16:43 -06:00
README.md docs: add test database setup, restore geom to test fixture 2026-05-17 18:26:48 +00:00
uv.lock v0.11.1: satpass_predict adapter (server-side pass alerts for fixed observers) (#101) 2026-06-09 01:16:43 -06:00

README.md

Central

Central is the data hub spine for the infrastructure. Adapters normalize upstream sources into a canonical event shape, publish CloudEvents to NATS/JetStream, and archive to TimescaleDB for historical query. Single-LXC deployment.

Status

Phase 0 — scaffold. Not yet operational.

Architecture

  • Python 3.12 (uv-managed)
  • NATS + JetStream for live event bus
  • TimescaleDB + PostGIS for archive and geospatial query
  • One supervisor process managing adapter lifecycle
  • One archive consumer process persisting events to TimescaleDB
  • Both processes systemd-managed

Testing

See docs/test-database.md for test database setup.

License

MIT. See LICENSE.