Open WebUI
Large language models get a polished front end that can run fully offline: Open WebUI is the
self-hosted front end of choice. It talks to local model runners, primarily Ollama, and to any
OpenAI-compatible API, so LM Studio, vLLM, Groq, Mistral, OpenRouter, and cloud providers all
plug into the same chat interface and can be mixed per conversation. RAG is built in: upload
files to knowledge bases or reference them in chat with the # command, backed by a choice of
nine vector databases (ChromaDB and PGVector officially maintained) and multiple extraction
engines including Tika and Docling, with hybrid BM25-plus-vector search and cross-encoder
reranking. Web search results from providers like SearXNG, Brave, and Tavily inject directly
into conversations. Extensibility comes from Python tools and functions that run inside the
chat, a Pipelines plugin framework, and native MCP support. Multi-user features include RBAC,
SSO, and group permissions, and the instance itself exposes an OpenAI-compatible API your own
apps can call.
Deploy