Why sovereign infrastructure matters
Every packet that leaves your network is a dependency. Every cloud service is a single point of failure. We built BlackRoad OS to eliminate both — a fully distributed system that runs on hardware you physically control.
The best infrastructure is the kind you can hold in your hand and reflash in five minutes.
The architecture
Our mesh connects five Raspberry Pi 5 nodes across a local network, each serving a specific role in the cluster. WireGuard provides encrypted tunnels between all nodes, and Cloudflare tunnels handle external routing.
# WireGuard mesh topology
alice 10.8.0.6 # Gateway, Pi-hole, PostgreSQL
cecilia 10.8.0.3 # AI inference, TTS, MinIO
octavia 10.8.0.4 # Gitea, NVMe storage, Docker Swarm
aria 10.8.0.7 # Portainer, Headscale
lucidia 10.8.0.5 # APIs, web apps, DNS
Self-healing with autonomy scripts
Each node runs heartbeat checks every minute and healing scripts every five minutes. If a critical service goes down, the node restarts it automatically and logs the event.
Hardware acceleration
Two nodes carry Hailo-8 AI accelerators, providing 52 TOPS of neural network inference at the edge. This powers local LLM inference, computer vision, and TTS without any cloud dependency.
- Cecilia: Hailo-8 (26 TOPS) + 16 Ollama models
- Octavia: Hailo-8 (26 TOPS) + 1TB NVMe storage
- Alice: Gateway routing for all 48+ domains
What we learned
Power management is everything on Pi hardware. We implemented CPU governor tuning, swap optimization, and thermal monitoring across the fleet. The result: stable temperatures under 60°C even under sustained AI inference loads.