Commit graph

13 commits

Author SHA1 Message Date
oskar fb77793c83 docs(ollama): GPU benchmark 207ms/embed vs 790ms CPU (~3.8x sequential) — RTX 4070 Ti SUPER, batching pozostaje dźwignią 2026-07-16 15:02:07 +02:00
oskar 5e920dd7c1 fix(ollama): restore GPU reservation on SOLARIA, close 07-15 cutover docs
Driver fixed 2026-07-16 (nvidia-driver-595-open from distro repo, old
graphics-drivers PPA for jammy disabled) — RTX 4070 Ti SUPER 16GB, CUDA
13.2, nvidia-container-toolkit already present from the 07-15 cutover
prerequisite install. Uncomments deploy.resources.reservations (nvidia
gpu) in services/ollama/docker-compose.yml, restoring clean formatting.

Docs close out the loose ends from the 07-15 declarative cutover:
- ollama-solaria-cutover runbook gets a "Wykonanie" section documenting
  what actually happened (mv instead of rsync for the model store, the
  missing nvidia-container-toolkit prerequisite, the driver-missing
  discovery, CPU-only cutover, then the 07-16 GPU fix) plus a note on
  the container disappearing after the 07-15 evening reboot (one-off,
  boots fine now, root cause not established).
- hosts/solaria/services.yaml: ollama role comment now reflects actual
  GPU-backed state instead of the previously-aspirational wording.
- hosts/solaria/README.md: drop stale Open WebUI mention (not in repo).
- docs/backlog.md: close the NVIDIA driver item; leave two follow-ups
  (Ollama call batching before the mail phase, UNIQUE(envelope_id,
  chunk_index) schema change for multi-model embeddings at phase 3).
- jobs/documents-ingest/README.md: timing section gets a GPU placeholder
  line next to the existing 0.79s/chunk CPU baseline, to be filled in
  after the live GPU benchmark.

Live recreate + GPU-vs-CPU embedding benchmark deliberately left for the
operator to run from the main checkout after merge, per worktree-aware
discipline — this worktree only owns the declarative fix and the docs.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-07-16 14:43:29 +02:00
oskar 542bba4693 docs(infra): recon lustro event=dead prom=up 1507 mismatchy 2026-07-16 14:28:04 +02:00
oskar 38cb204a64 fix(ollama): declare service on SOLARIA, restrict bind, add cutover runbook
Ollama's service.yaml/docker-compose.yml declared owner_node: solaria but
was never added to hosts/solaria/services.yaml, the manifest deploy-node.sh
actually reads — so it stayed running manually/natively instead of via the
declarative pipeline. Add the missing entry.

Also switch the port publish from 0.0.0.0 to loopback + TAILSCALE_BIND_IP
(same convention as llm-gateway@PIHA), since this is a private service and
llm-gateway@PIHA is the only consumer beyond the host itself.

Live cutover (relocating the existing native model store, disabling the
systemd unit, bringing up the container, verifying bge-m3 embeddings +
GPU use) is documented in docs/infra/ollama-solaria-cutover-2026-07-15.md
but not executed here — no SSH access to SOLARIA from this worktree.

Co-Authored-By: Claude Sonnet 5 <noreply@anthropic.com>
2026-07-15 16:09:08 +02:00
oskar 8fec62d509 docs(infra): shadow-run etap 2 — analiza 165 mismatchy solaria/lustro
Wszystkie mismatche = detection-lag przy planowych power-offach (prom szybszy
o ~9.5 min od TTL eventowego); zero fałszywych prom=down. vps/piha 100% zgodne.
Rekomendacja: GO dla etapu 3 per-node, mapping timestamp(up)->compute_liveness.

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-15 14:54:27 +02:00
oskar 31e30b04d1 docs(infra): monitoring coverage recon — co biega vs co monitorowane + plan domknięcia
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-14 19:25:51 +02:00
oskar 237df1cd2e docs(infra): migracja okit.pl 42.pl->Cloudflare — faza 0 done+zweryfikowana, split-horizon Pi-hole, plan faz 1-2 2026-07-07 20:46:57 +02:00
oskar d94bb38e69 docs(infra): prometheus cutover recon — mapa starego toru liveności + plan etapowy
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-06 15:17:05 +02:00
Oskar Kapala 5cfb45227f fix(capabilities): saturn RAM 16->14 (usable, konwencja free -g) + errata audytu: SATURN arm64->x86_64
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-03 14:58:21 +02:00
oskar 6b35afd2ea docs(infra): egzekucja odchudzania PIHA — ES+diskover ubite (+1.0Gi), llm-gateway/immich zostają
Faza 2 modułu 0 po review Oskara: elasticsearch+diskover usunięte (compose down,
dane esdata zostawione na dysku), available 2.8Gi -> 3.8Gi, kryterium >=1.5Gi
spełnione. llm-gateway udokumentowany (własny router LLM -> Ollama@SOLARIA,
źródło tylko w /opt/llm-gateway — archiwizacja w backlogu); immich zostaje na
PIHA na stałe (24/7, SOLARIA sesyjna).

Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-02 16:44:57 +02:00
oskar f1e302d19b docs(infra): audyt odchudzania PIHA — 917Mi bezpieczne (ES+diskover+llm-gateway), immich->SOLARIA kandydat 2026-07-02 16:11:41 +02:00
oskar 57a6dffc5e docs(infra): weryfikacja inwentaryzacji 2026-06-30 — stan na 2026-07-02
Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
2026-07-02 15:26:18 +02:00
Oskar Kapala 229f85bd9b docs(infra): inwentaryzacja floty 2026-06-30 — 23 rozjazdy repo↔rzeczywistość 2026-06-30 19:40:50 +02:00