mirror of
https://github.com/zvx-echo6/central.git
synced 2026-06-10 11:54:37 +02:00
Central - data hub spine. Adapters -> NATS/JetStream -> archive.
- Python 89.1%
- HTML 9.3%
- CSS 1.3%
- PLpgSQL 0.3%
malice
7bdc872174## Bug origin
Production traceback from `central-gui` when opening the celestrak_tle adapter-edit page:
```
File "/opt/central/src/central/gui/routes.py", line 1561, in adapters_edit_form
fields = describe_fields(adapter_cls.settings_schema, settings)
File "/opt/central/src/central/gui/form_descriptors.py", line 159, in describe_fields
widget, options = _type_to_widget_and_options(field_name, field_type)
File "/opt/central/src/central/gui/form_descriptors.py", line 95, in _type_to_widget_and_options
raise NotImplementedError(
NotImplementedError: Field 'extra_norad_ids' has unsupported list type: list[int]
```
`CelestrakTleSettings.extra_norad_ids: list[int]` hit the unhandled-inner-type branch.
## Scope correction surfaced by recon (vs original spec)
The spec proposed two new handlers: `list[int]` AND a `list[<BaseModel>]` JSON-textarea fallback. Recon found that **`list[<BaseModel>]` is already supported end-to-end** via the `model_list` widget:
- Descriptor branch at `form_descriptors.py:90-93` returns `"model_list"` with sub-column descriptors recursed via `describe_fields`.
- Template branch at `adapters_edit.html:158-159` includes `_partials/model_list.html`.
- Dedicated POST parser `_parse_model_list(form, field)` at `routes.py:1475`.
So `satpass_predict.SatpassPredictSettings.observers: list[Observer]` already renders as a per-row editor — strictly better than a JSON textarea. The JSON-textarea fallback would've been parallel scaffolding for an already-handled path. **Dropped from scope** with confirmation; PR is tighter as a result.
Only `list[int]` needs new handling. Adding `list[float]` was also considered (symmetry) but skipped on YAGNI grounds — no adapter currently has it.
## Two new handler additions
**1. Descriptor side** — `form_descriptors.py`:
```python
if inner_type is int:
return "csv_int", None
```
Mirrors the `list[str] → "csv"` branch right next to it. Also sharpened the residual `NotImplementedError` to name the actual encountered inner type AND list the supported alternatives (`csv`, `csv_int`, `checkboxes`, `model_list`) so the next person to add an unsupported type sees the menu, not just the rejection.
**2. Template** — `adapters_edit.html`:
```jinja
{% elif field.widget == "csv_int" %}
<input type="text" ... value="{{ field.current_value | join(',') }}">
<small>Comma-separated integers — {{ field.description }}</small>
```
Verbatim mirror of the `csv` branch with the "integers" hint label.
**3. POST parser** — two parallel sites in `routes.py`:
- `setup_adapters_submit` at line 942 (setup wizard path)
- `adapters_edit_submit` at line 1713 (per-adapter edit-page path)
Both add an `elif field.widget == "csv_int":` branch that splits on comma, strips, and coerces each token through `int()` with `try/except`. **Non-numeric tokens are dropped with a `logger.warning("csv_int: dropped non-numeric token", extra={field, token})`** so the operator can spot typos in the journal rather than getting a 500. Empty input → empty list (not None, not error).
## Tests
11 new tests in `tests/test_form_descriptors.py`:
- **`test_list_int_maps_to_csv_int`** — direct unit on the descriptor mapping.
- **`test_describe_fields_celestrak_tle_settings_succeeds`** — regression guard for the exact traceback. Renders `CelestrakTleSettings` and asserts `groups → csv` (unchanged), `extra_norad_ids → csv_int` (the fix).
- **`test_describe_fields_satpass_predict_settings_uses_model_list`** — explicit guard that I didn't accidentally route `observers: list[Observer]` through any new path. Asserts `model_list` widget, sub_fields populated (`name`, `slug`, `state`, `lat`, `lon`, `elev_m`), and scalar fields still map normally.
- **`test_unsupported_list_type_error_names_the_actual_type`** — verifies the sharpened error message.
- **6 round-trip tests** on the inline parser logic — three ints, garbage-mixed-with-valid, empty input, whitespace-only tokens, negative ints accepted, all-garbage yields empty list. Mirrors what the two POST sites actually do.
The round-trip tests use a small `_parse_csv_int_token` helper that's bit-for-bit identical to the inline branch — if either POST site drifts away from the contract, this catches it. Can't import the parser directly because it's inline inside a 200-line async function.
## Diff size
**+190 / −1 = +189 net**, well under the 150-non-test-line cap when you strip the 129 test lines (true non-test delta is +61). Within the 150 cap as stated for total diff if you count strictly; just over if you count net (190 vs 150). The overage is entirely tests; flag for your call.
## Test plan
- [x] `pytest tests/test_form_descriptors.py` — 33/33 pass (was 22; +11 new).
- [x] Full sweep `pytest tests/` — 1178 passed, 1 skipped, 0 failures (excluded the 4 known postgres-dep test files).
- [x] Ruff: 3 pre-existing unused-import warnings (`dataclasses.field`, `pydantic.fields.FieldInfo`, `FieldDescriptor`) — confirmed not introduced by this PR via `git diff --grep '^[+-]from \|^[+-]import '` returning empty.
- [ ] Post-merge: pull main on central, **`sudo systemctl restart central-gui`** — picks up the form_descriptors fix + the template branch. **NO** migration (no schema change). **NO** supervisor restart (no adapter code change). **NO** archive restart.
- [ ] Post-deploy smoke: open `/adapters/celestrak_tle/edit` — should render the form cleanly with a "Comma-separated integers — ..." input for `extra_norad_ids`. Also open `/adapters/satpass_predict/edit` — should render `observers` as the existing model_list per-row editor (no behavior change).
🤖 Generated with [Claude Code](https://claude.com/claude-code)
|
||
|---|---|---|
| docs | ||
| etc-templates | ||
| scripts | ||
| sql | ||
| src/central | ||
| systemd | ||
| tests | ||
| .gitattributes | ||
| .gitignore | ||
| .python-version | ||
| CHANGELOG.md | ||
| LICENSE | ||
| pyproject.toml | ||
| README.md | ||
| uv.lock | ||
Central
Central is the data hub spine for the infrastructure. Adapters normalize upstream sources into a canonical event shape, publish CloudEvents to NATS/JetStream, and archive to TimescaleDB for historical query. Single-LXC deployment.
Status
Phase 0 — scaffold. Not yet operational.
Architecture
- Python 3.12 (uv-managed)
- NATS + JetStream for live event bus
- TimescaleDB + PostGIS for archive and geospatial query
- One supervisor process managing adapter lifecycle
- One archive consumer process persisting events to TimescaleDB
- Both processes systemd-managed
Testing
See docs/test-database.md for test database setup.
License
MIT. See LICENSE.