Thread

Introducing LlamaGPT — a self-hosted, offline and private AI chatbot, powered by Llama 2, with absolutely no data leaving your device. 🔐 Yes, an entire LLM. ✨ Your Umbrel Home, Raspberry Pi (8GB) Umbrel, or custom umbrelOS server can run it with just 5GB of RAM! Word generation benchmarks: Umbrel Home: ~3 words/sec Raspberry Pi (8GB RAM): ~1 word/sec → Watch the demo: → Install on umbrelOS:
LlamaGPT | Umbrel App Store
Discover LlamaGPT for your umbrelOS home server. Learn more, see screenshots, and discover other self-hosted AI apps available for umbrelOS.
 → GitHub:
GitHub
GitHub - getumbrel/llama-gpt: A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support!
A self-hosted, offline, ChatGPT-like chatbot. Powered by Llama 2. 100% private, with no data leaving your device. New: Code Llama support! - getumb...

Replies (5)

Great idea, I was eagerly waiting for it. I installed it overnight on my Pi 8 GB, but was very disappointed when I started it this morning. It was VERY slow and could not answer my first two questions (first was relating historic exchange rates and second regarding stoic philosophy). Llama via nostrnet.work from @iefan 🕊️ answered both questions quickly. Also, the other apps on my Pi became slower. So I deinstalled the app ... No offence to @Umbrel ☂️, you did a great job in offering this one click install app, but anyone has to be realistic ... You cannot run a fully functional and competitive LLama on a Raspi Pi ...