homelab-codex-ws/hosts/piha/runtime
Oskar Kapala c255a021d1 fix(observer): quarantine malformed event files to prevent processing wedge
Was: malformed event (bad JSON / truncated / corrupted bytes) wedged the
node's checkpoint forever — every cycle re-tried, logged, never advanced
past the bad file; all subsequent good events for that node lost.

Now: first parse failure -> atomic os.replace to STATE_DIR/observer_failed_events/<node>/
with collision handling. Checkpoint advances, downstream events flow.
Move failures themselves are logged but don't crash the loop.

Complementary to yesterday's atomic_write_json fix (state files);
this addresses the same race-pattern on event files instead.

Regression test asserts: bad event quarantined to failed_events dir,
removed from hot path, subsequent good event processed (node online),
checkpoint moves to good event.
2026-06-12 11:22:56 +02:00
..
agent-system Fix Copy for AI: materializer fetches from control-plane API instead of Redis 2026-05-27 16:07:51 +02:00
brain-watchdog feat(piha): brain-watchdog — external watchdog for control-plane 2026-06-01 17:54:36 +02:00
node-agent fix(node-agent): correct VPS_EVENTS_HOST to actual VPS Tailscale IP 2026-05-27 14:07:27 +02:00
stability-agent Roll out stability agent to homelab nodes 2026-05-17 15:54:19 +02:00