The local AI ecosystem is exploding. In the past two years, we’ve gone from needing a data center to run a language model to chatting with 70-billion-parameter models on a laptop. Ollama made it one command. LM Studio gave it a GUI. Open WebUI made it collaborative. llama.cpp made it possible in the first place.
But here’s the problem: the information is scattered. Tool documentation lives in GitHub READMEs. Comparisons live in Reddit threads that get buried. Hardware advice gets outdated in weeks. And most “guides” are thinly disguised product pitches for a single tool.
We’re building the MDN of local AI
local-llm.net is a community-driven, comprehensive guide to the entire local AI ecosystem. We cover 73+ tools across 14 categories — inference engines, desktop apps, web UIs, developer frameworks, fine-tuning tools, vector databases, voice AI, image generation, and more.
We are not a vendor site. We cover Ollama, LM Studio, vLLM, and every other tool with the same depth and honesty. Yes, we build our own tools too — Mullama, Llamafu, and ZigLLM — but they sit alongside everything else in the directory, not above it.
What you’ll find here
- Learn — Understand local AI from the ground up. What it is, why it matters, how to choose models and hardware.
- Tools Directory — Every major tool in the ecosystem, reviewed and compared. Think of it as the Yellow Pages for local AI.
- Guides — Step-by-step deployment guides for every platform and use case. From “first chatbot in 5 minutes” to “enterprise Kubernetes deployment.”
- Comparisons — Side-by-side, data-driven comparisons. Ollama vs LM Studio. vLLM vs TensorRT-LLM. ChromaDB vs Qdrant. No affiliate links, no sponsored rankings.
- Developer Hub — Tutorials, SDK docs, and code examples for building applications with local AI.
- Community — Contribute guides, submit benchmarks, review tools, and connect with other local AI enthusiasts.
This is your site
We’re launching with a strong foundation, but local-llm.net is designed to grow with the community. You can:
- Write guest guides and get published with full author attribution
- Submit benchmarks from your hardware to help others choose the right setup
- Review tools you’ve used and share your experience
- Join our Discord to chat with other local AI enthusiasts
The local AI movement is about independence — running your own models, on your own hardware, with your own data. The guide to that movement should be independent too.
Welcome to local-llm.net. Let’s build this together.
— The Local LLM Team, Srushta Media Limited