feat(kb): przenosiny type=service do kb/services/ (13 plikow, bez SPLIT)
Serwisy o jednorodnej tresci (bez wydzielonej sekcji deploy/runbook):
kb-postgres, stability-agent, llm-gateway, vikunja, zigbee2mqtt, npm,
forgejo, ollama, ir-ac-ha-integration, chelsty-stability-agent.
Deprecated: mosquitto (NOT DEPLOYED/LEGACY), home-assistant-ken-legacy
(archiwum importu), joplin (stub z 2026-04-15, brak katalogu services/joplin/).
git mv + frontmatter, tresc nietknieta.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-04 14:59:24 +02:00
---
okf: "0.1"
type: service
visibility: private
status: active
updated: 2026-06-22
links: []
---
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
# kb-postgres
2026-06-22 19:59:58 +02:00
Postgres 16 + pgvector — KB spine on **PIHA** (Raspberry Pi 5, always-on). Stores the frozen envelope schema shared by all KB pillars (mails, documents, photos, transactions).
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
2026-06-22 19:59:58 +02:00
Runs here because the KB store must answer queries 24/7; SOLARIA (GPU/compute) is powered down intermittently. Embeddings/models still run on SOLARIA's GPU — only the Postgres+pgvector store lives on PIHA. The `pgvector/pgvector:pg16` image is multi-arch and runs natively on arm64 (the Pi 5).
Port: **5433** on PIHA (Tailscale-accessible to other nodes).
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
## Standard deploy (from SATURN)
```bash
2026-06-22 19:59:58 +02:00
# On SATURN — pushes to master, then deploy.sh SSHes to PIHA and runs deploy-node.sh
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
git push origin master
2026-06-22 19:59:58 +02:00
scripts/deploy/deploy.sh piha
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
```
2026-06-22 19:59:58 +02:00
`deploy-node.sh` on PIHA automatically picks up the per-host override:
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
```
docker compose \
-f services/kb-postgres/docker-compose.yml \
2026-06-22 19:59:58 +02:00
-f hosts/piha/runtime/kb-postgres/docker-compose.override.yml \
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
up -d --remove-orphans
```
2026-06-22 19:59:58 +02:00
The PIHA override caps memory (`mem_limit: 1g`) and tunes Postgres for a tight,
HA-shared RAM budget. Data lives in the `kb_postgres_data` named volume, which
**must** land on the NVMe (Docker data-root on `/home` ), never the SD card —
verify before first deploy (see the override file's DATA PLACEMENT note):
```bash
# On PIHA
docker info -f '{{.DockerRootDir}}' # expect an NVMe path
df -h "$(docker info -f '{{.DockerRootDir}}')" # confirm it's the NVMe
```
## First-time setup on PIHA (before first deploy)
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
2026-06-22 19:59:58 +02:00
The `.env` file must exist at `services/kb-postgres/.env` in the PIHA repo checkout
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
(alongside the compose file — that's where `env_file: .env` resolves to):
```bash
2026-06-22 19:59:58 +02:00
# On PIHA
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
cd ~/homelab-codex-ws
cp services/kb-postgres/env.example services/kb-postgres/.env
# Edit .env: set POSTGRES_PASSWORD to something strong
```
`.env` is gitignored (`*.env` rule in root `.gitignore` ) — it will never be committed.
## Manual one-off (debugging / first boot)
```bash
2026-06-22 19:59:58 +02:00
# On PIHA, from repo root
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
docker compose \
-f services/kb-postgres/docker-compose.yml \
2026-06-22 19:59:58 +02:00
-f hosts/piha/runtime/kb-postgres/docker-compose.override.yml \
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
up -d
```
## Verify after first boot
```bash
# Host-side healthcheck
./services/kb-postgres/healthcheck.sh
# Inside the container
docker exec kb-postgres psql -U kb -d kb -c '\d envelope'
docker exec kb-postgres psql -U kb -d kb \
-c "SELECT extname FROM pg_extension WHERE extname = 'vector';"
```
Expected `\d envelope` output:
```
Table "public.envelope"
Column | Type | Nullable | Default
----------+--------------------------+----------+-----------
id | text | not null |
source | text | not null |
ts | timestamp with time zone | not null |
geo | jsonb | |
raw_ref | text | not null |
entities | jsonb | not null | '[]'::jsonb
Indexes:
"envelope_pkey" PRIMARY KEY, btree (id)
"envelope_source_idx" btree (source)
"envelope_ts_idx" btree (ts)
```
## Schema contract
fix(kb): przepiecie wszystkich odwolan wewnetrznych po migracji
126 plikow (md, yaml, sh, py) odwolywalo sie do sciezek sprzed migracji.
15 markdown-linkow [..](..) -> policzona sciezka WZGLEDNA wobec pliku
odsylajacego (wczesniej czesc z nich byla repo-root-relative i nie
rozwiazywala sie z katalogu, w ktorym lezala)
200 odwolan tekstowych (backticki, proza, yaml, importy w kodzie)
-> nowa sciezka repo-root-relative, zgodnie z konwencja repo
5 linkow rodzenstwa (gole nazwy plikow, np. "](DEPLOY.md)") — dzialaly
tylko w starym katalogu; przeliczone recznie
Objete m.in.: CLAUDE.md (scripts/onboard/README.md -> kb/runbooks/
node-onboarding-tool.md, docs/backlog.md -> kb/phases/backlog.md),
README.md, .claude/skills/, 20 session logow, kod jobow.
Ostatnie 5 odwolan pochodzi z tresci wciagnietej rebasem z origin/master
(session log 2026-07-31, override node-agenta na SOLARII, dwie pozycje
backlogu) — wskazywaly na docs/incidents/, docs/kb/modules/ i
services/narty27/README.md sprzed migracji.
Dodany wzajemny link miedzy kb/services/control-plane.md (stub kodu)
a kb/subsystems/control-plane.md (opis, deprecated) — dwa dokumenty o tym
samym systemie, latwe do pomylenia.
Weryfikacja na 790 plikach: 0 odwolan do starych sciezek,
0 martwych linkow markdown. Lint OKF: 190/190 plikow ZGODNE.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
2026-08-04 15:12:24 +02:00
The `envelope` table is the frozen cross-source envelope (see `kb/subsystems/kb-overview.md` §Zasady przekrojowe). Adding columns is OK; removing or renaming existing ones is NOT.
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
Future migrations go in `init/` as `002_*.sql` , `003_*.sql` , …. Postgres runs `initdb` scripts only on a fresh volume — for existing instances apply migrations with `psql` directly.
## Connection string
```
2026-06-22 19:59:58 +02:00
postgresql://kb:< POSTGRES_PASSWORD > @piha:5433/kb
feat(kb-mail): fundament — pgvector spine, koperta, archiwum, pakiet domeny
- services/kb-postgres: pgvector/pgvector:pg16 na SOLARIA (:5433), named
volume, init/001_envelope.sql (CREATE EXTENSION vector + zamrożona tabela
envelope: id/source/ts/geo/raw_ref/entities), service.yaml, healthcheck,
README z poprawnym mechanizmem deploy (deploy-node.sh składa dwa -f)
- hosts/solaria/runtime/kb-postgres/docker-compose.override.yml: mem_limit 4g
- inventory/topology.yaml + hosts/solaria/services.yaml: kb-postgres wpisany
- packages/kb-mail: nowa konwencja shared lib (pip install /repo/packages/<lib>/)
envelope.py — @dataclass Envelope, walidacja tz-aware ts
db.py — insert_envelope / get_envelope (asyncpg, ON CONFLICT DO NOTHING)
archive.py — save_eml append-only (asyncio.to_thread, FileExistsError na dup)
tests: 15 unit pass + 5 integration (@pytest.mark.integration, wymaga KB_TEST_DSN)
Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-06-17 21:50:49 +02:00
```
2026-06-22 19:59:58 +02:00
Set `KB_TEST_DSN` to this value when running integration tests from `packages/kb-mail/`
(host = `piha` over Tailscale).