4658089e21
126 plikow (md, yaml, sh, py) odwolywalo sie do sciezek sprzed migracji.
15 markdown-linkow [..](..) -> policzona sciezka WZGLEDNA wobec pliku
odsylajacego (wczesniej czesc z nich byla repo-root-relative i nie
rozwiazywala sie z katalogu, w ktorym lezala)
200 odwolan tekstowych (backticki, proza, yaml, importy w kodzie)
-> nowa sciezka repo-root-relative, zgodnie z konwencja repo
5 linkow rodzenstwa (gole nazwy plikow, np. "](DEPLOY.md)") — dzialaly
tylko w starym katalogu; przeliczone recznie
Objete m.in.: CLAUDE.md (scripts/onboard/README.md -> kb/runbooks/
node-onboarding-tool.md, docs/backlog.md -> kb/phases/backlog.md),
README.md, .claude/skills/, 20 session logow, kod jobow.
Ostatnie 5 odwolan pochodzi z tresci wciagnietej rebasem z origin/master
(session log 2026-07-31, override node-agenta na SOLARII, dwie pozycje
backlogu) — wskazywaly na docs/incidents/, docs/kb/modules/ i
services/narty27/README.md sprzed migracji.
Dodany wzajemny link miedzy kb/services/control-plane.md (stub kodu)
a kb/subsystems/control-plane.md (opis, deprecated) — dwa dokumenty o tym
samym systemie, latwe do pomylenia.
Weryfikacja na 790 plikach: 0 odwolan do starych sciezek,
0 martwych linkow markdown. Lint OKF: 190/190 plikow ZGODNE.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
39 lines
2.1 KiB
YAML
39 lines
2.1 KiB
YAML
# fleet-prometheus kb-ingest rules — module 5 phase 3 step 5
|
|
# (kb/phases/kb-m5-faza3.md §7.2).
|
|
#
|
|
# Same delivery convention as liveness.yml: no Alertmanager, these rules only make alerts
|
|
# FIRING (visible at GET /api/v1/alerts on this Prometheus instance); brain-watchdog@PIHA
|
|
# polls that API and forwards to Telegram. Do NOT add Alertmanager config here.
|
|
#
|
|
# Metrics come from documents-ingest-cyclic's Prometheus textfile-collector output
|
|
# (jobs/documents-ingest/systemd, `/opt/homelab/state/node-exporter/kb-ingest.prom`),
|
|
# scraped via node_exporter's textfile collector on PIHA — every series from that target
|
|
# already carries `node="piha"` (fleet-node job's static_configs label), same as liveness.yml.
|
|
|
|
groups:
|
|
- name: kb-ingest
|
|
rules:
|
|
- alert: KbIngestStale
|
|
# 2 missed daily runs (OnCalendar=*-*-* 03:30) — the timer itself down, or every
|
|
# run since has hard-failed (Ollama-down alone never blocks this: the wrapper only
|
|
# skips its two embed stages then, still updating last_success_timestamp).
|
|
expr: time() - kb_ingest_last_success_timestamp{node="piha"} > 172800
|
|
for: 5m
|
|
labels:
|
|
severity: critical
|
|
annotations:
|
|
summary: "kb-ingest stale on {{ $labels.node }}"
|
|
description: "kb-ingest.timer has not completed a successful run in over 48h on {{ $labels.node }} — check `journalctl -u kb-ingest.service` and the latest /opt/homelab/logs/kb-ingest/run-*.log."
|
|
|
|
- alert: KbEmbedBacklogGrowing
|
|
# SOLARIA/Ollama has been unreachable (or embedding has been failing) for 3 straight
|
|
# days of ticks — the backlog itself isn't an incident (Ollama sleeps by design,
|
|
# plan §1.3), sustained non-zero for this long is.
|
|
expr: kb_ingest_embed_backlog{node="piha"} > 0
|
|
for: 72h
|
|
labels:
|
|
severity: warning
|
|
annotations:
|
|
summary: "kb-ingest embed backlog growing on {{ $labels.node }}"
|
|
description: "kb_ingest_embed_backlog on {{ $labels.node }} has been > 0 for 72h straight — Ollama@SOLARIA may not have come back up in that window, or chunk/summary embedding has been failing on live Ollama."
|