Just published
Simplify setting up your private distributed infrastructure using @npub1wr5a...jeva, Pulumi, K3s and Longhorn.
The cluster works even on a single laptop node but it's a great way to use spare CPU cycles and storage on other Linux machines you have available.
Once initial setup is done, you can run Ollama, Open-WebUI and stable diffusion image generation with:
pulumi config set orangelab:nvidia-gpu-operator true
pulumi config set orangelab:ollama true
pulumi config set orangelab:open-webui true
pulumi config set orangelab:automatic1111 true
pulumi up
This will create endpoints that anyone on your Tailnet can access, all wired up and ready to go.
GitHub
GitHub - QC-Labs/orange-lab: Private infrastructure on consumer hardware based on K3s, Tailscale, Pulumi and Longhorn
Private infrastructure on consumer hardware based on K3s, Tailscale, Pulumi and Longhorn - QC-Labs/orange-lab