Homelab: A Self-Hosted Platform for This Site and Its LLMs
Moved this site's API off Google Cloud Run and its Postgres off Neon onto one laptop running k3s, and added self-hosted monitoring and two language models. Everything in the cluster is managed through Git with Argo CD. One 8 GB RTX 4060 Laptop GPU serves both the note autocomplete (Qwen3.5-0.8B) and the visitor-facing Ask chat (Qwen3.5-4B, 4-bit), with measured memory budgets, time-slicing, and priority classes that let batch jobs take the whole card and hand it back. Postgres runs under CloudNativePG with continuous WAL archiving to Cloudflare R2, verified by a restore drill; secrets live in Git as SealedSecrets; the site is reached through Cloudflare Tunnel with no ports open to the internet; and Prometheus, Loki and two outside monitors email me when anything breaks.
2 LLMs on one 8 GB GPU · 182 ms median API latency, down from 428 ms · 0 ports open to the internet