Series
Home lab server
Running the workstation that doubles as the home server: the two-GPU split, Ubuntu, Docker, Pi-hole and the monitoring.
13 parts, in reading order
- 01ThinkStation P920 ServerPart 1: a dual Xeon workstation that became the home server, the disk split, and the three choices that shaped everything that follows.
- 02Two GPUs, two jobsThe 3090 for LLM work and the 3060 for display and gaming: the 24 GiB and 12 GiB split, the role split, and why the 3090 stays headless.
- 03The 12 GiB card, the 24 GiB card, and the indexPart 3: the measured LM Studio split, model size versus context memory, and why an app's device index can pick the wrong card.
- 04Ubuntu 24.04 on server hardwarePart 4: a kernel update is also an NVIDIA module update, the three retained kernels, and why I checked DKMS before rebooting.
- 05Docker became the default home for servicesPart 5: forty Compose folders, a smaller running set, and why a port map and a clear boundary matter more than another dashboard.
- 06When nvidia-smi stops answeringPart 6: the 12-second timeout, the clean-looking kernel log, and two GPU exporters spinning at 100 percent after resume.
- 07The suspend that never returnedPart 7: an NVIDIA lock held through suspend, a compositor stuck in the display path, and the cold-suspend mitigation that finally woke cleanly.
- 08Adding a third GPU moved the targetPart 8: the Quadro P400 changed PCI addresses and indices, and one stale GGML_VK_VISIBLE_DEVICES setting quietly moved transcription onto the wrong card.
- 09Docker and GPUs do not mix by accidentPart 9: a metrics container bound /dev/nvidia-uvm directly, held a module reference, and made the suspend guard's job harder.
- 10Why the Tesla P40 stayed out of this buildPart 10: 24 GiB is not the whole story; Pascal lacks tensor cores, modern inference stacks draw a compute-capability line, and the driver branches conflict.
- 11Pi-hole became the DNS backbonePart 11: a Raspberry Pi at 10.0.0.42 filters DNS for the workstation, until one noisy client hit the per-client query limit.
- 12DNS failed while Wi-Fi was still connectedPart 12: systemd-resolved fell back from EDNS0, Pi-hole refused a noisy client's queries, and the router kept resolving without filtering.
- 13Watching the server without drowning in itPart 13: Prometheus, node and GPU exporters, Glance and cAdvisor, and choosing the one GPU signal that stayed useful during a freeze.