Large language models get a polished front end that can run fully offline: Open WebUI is the self-hosted front end of choice. It talks to local model runners, primarily Ollama, and to any OpenAI-compatible API, so LM Studio, vLLM, Groq, Mistral, OpenRouter, and cloud providers all plug into the same chat interface and can be mixed per conversation. RAG is built in: upload files to knowledge bases or reference them in chat with the # command, backed by a choice of nine vector databases (ChromaDB and PGVector officially maintained) and multiple extraction engines including Tika and Docling, with hybrid BM25-plus-vector search and cross-encoder reranking. Web search results from providers like SearXNG, Brave, and Tavily inject directly into conversations. Extensibility comes from Python tools and functions that run inside the chat, a Pipelines plugin framework, and native MCP support. Multi-user features include RBAC, SSO, and group permissions, and the instance itself exposes an OpenAI-compatible API your own apps can call.

Every major model provider behind one ChatGPT-style interface: LibreChat spans OpenAI, Anthropic, Google, Azure, AWS Bedrock, Vertex AI, Groq, Mistral, OpenRouter, DeepSeek, and any OpenAI-compatible endpoint including local Ollama. You can switch models mid-conversation and compare providers without changing tools. Its Agents framework builds no-code custom assistants with tool access via Model Context Protocol servers, file search over uploaded documents through an optional pgvector-backed RAG service, and a sandboxed Code Interpreter that executes Python, JavaScript, Go, C++, Java, PHP, and Rust. Artifacts render React components, HTML, and Mermaid diagrams directly in chat, and image generation works through DALL-E and other configured providers. Multi-user support is enterprise-grade, with OAuth, SAML, LDAP, and two-factor authentication, per-user conversation history in MongoDB, and Meilisearch-powered search across all messages and files, plus reusable presets, forkable threads, and persistent memory across conversations. The economics favor teams: instead of a ChatGPT Plus seat per person, everyone shares one instance billed per API token, with access to every provider rather than one - and providers see individual API calls, not your accumulated organizational knowledge. Deployment is Docker Compose; API keys and endpoints are configured through .env and librechat.yaml.

A private ChatGPT built with Next.js: Lobe Chat is the open-source AI chat interface teams self-host instead. Its main advantage is provider breadth: one interface connects to 40+ model providers, including OpenAI, Anthropic Claude, Google Gemini, Mistral, Groq, AWS Bedrock, Azure, and local models served through Ollama, so you can switch models per conversation and compare outputs. It handles multi-modal work: image recognition, image generation, text-to-speech, and speech-to-text. A plugin system based on function calling and the Model Context Protocol (MCP) adds external tools like web search and code execution. Run it in standalone mode as a single container with settings in browser storage, or in database mode with PostgreSQL and S3-compatible storage for persistent history, multi-user auth, and RAG knowledge bases built from uploaded documents with pgvector retrieval. Because tools arrive through function calling and MCP rather than a proprietary plugin format, custom internal tools can be exposed to the assistant with a standard server over STDIO or HTTP. Hundreds of pre-configured assistant roles import from the community marketplace. For teams the cost model matters: provider API keys billed per token typically undercut a ChatGPT Plus seat per person, and self-hosting keeps API keys, uploaded files, embeddings, and conversation history entirely on your own server.

Self-hosting a language model is only half the job; people still need somewhere pleasant to talk to it, and Chat UI is that window, the same interface that powers HuggingChat. Point it at any OpenAI-compatible endpoint, your own Ollama or llama.cpp server, the Hugging Face router, or a hosted gateway like OpenRouter, and the models it serves appear in the picker automatically, with no per-model configuration. Conversations are saved to your database and stay browsable in the sidebar, so a thread from last week can be reopened, continued, and compared against a fresh answer from another model. Multimodal models accept image uploads right in the composer, and models that support it can call MCP tools mid-conversation to fetch data or run actions. For a shared team deployment, OpenID Connect sign-in keeps individual histories and settings separate, and per-user defaults travel with each account. Everything a consumer chatbot would keep on someone else's servers, prompts, uploaded files, and usage history, stays in the MongoDB you control on the same machine. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Your household gets one private chat front door for the models you already run, local or hosted, with voice, search, and coding agents included from the same server. Point it at Ollama, vLLM, llama.cpp, SGLang, or LM Studio, then add OpenAI, Anthropic, Gemini, DeepSeek, Bedrock, or OpenRouter beside them. Models that support tools can answer with charts, tables, forms, and follow-up buttons instead of plain paragraphs. Ask for a live conversation and speak, hear the reply, cut in mid-sentence, and keep going; Parakeet handles recognition and Kokoro speaks back on CPU or GPU. Documents open beside the chat for drafting and revising Markdown, code, web pages, SVG, and Mermaid diagrams. Attach spreadsheets, PDFs, images, Word, Excel, CSV, or source files and run Python on them in an offline sandbox that returns charts, cleaned data, or finished documents. Search the web through bundled SearXNG or Brave, read pages with inline citations, connect MCP servers, and set thinking controls per local model. Replies keep streaming after you close the tab, full-text search finds old answers, and read-only links share a conversation. Coding agents run on your machines or over SSH and stay reachable from browser, desktop, Android, or iOS. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

big-AGI is an open-source generative AI workspace that provides a unified, local-first interface for orchestrating multi-model reasoning, automated code execution, and custom persona workflows across private infrastructure. Users query multiple large language models simultaneously through the Beam scatter-gather engine, which prompts independent AI systems in parallel, compares candidate completions side by side, and merges optimal passages into a single refined response. Knowledge workers assemble tailored AI personas equipped with specialized system instructions, custom temperature settings, and predefined document context to handle domain-specific tasks ranging from architectural design reviews to legal contract analysis. The application renders rich multimedia outputs including interactive Mermaid sequence diagrams, LaTeX mathematical formulas, syntax-highlighted code blocks with live execution previews, and AI-generated image generation canvases. Teams integrate local inference servers like Ollama and LocalAI alongside commercial API endpoints to route confidential datasets strictly through internal networks while monitoring per-prompt token usage and operational latency. Users attach complex PDF documents, spreadsheets, and source code repositories for automatic parsing and semantic retrieval, while local-first storage engines ensure private chat transcripts and custom presets remain encrypted on host drives. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Thirteen-plus LLM providers, one unified client: NextChat (formerly ChatGPT-Next-Web) is an open-source AI chat interface built on Next.js that spans OpenAI GPT-4, Anthropic Claude, Google Gemini, DeepSeek, Groq, Azure endpoints, and self-hosted backends like Ollama, LocalAI, and RWKV-Runner. Its defining trait is minimalism - the first screen loads in about 100 KB, the desktop client is roughly 5 MB, and there is no database or user system to operate; chat history lives locally in the browser with optional WebDAV or UpStash Redis sync. The Mask system saves reusable prompt-template personas you can share and debug, long conversations auto-compress to fit context windows, and Markdown rendering covers LaTeX, Mermaid diagrams, and code highlighting with streaming responses. Plugins add web search and calculators, MCP support enables external tool calling, and Artifacts previews generated content in a separate pane. Ships as a web app, Docker image, and Tauri desktop builds for Windows, macOS, and Linux, translated into 20+ languages. MIT-licensed.

ENZO is a self-hosted AI workspace where you bring your own provider API keys and chat with more than 300 models from nine providers in one streaming interface with normal, thinking, research, and coding modes. You describe an agent in plain English and a two-pass builder drafts its full operating manual, picks the tools the task needs, and keeps improving from your activity through a per-agent neural layer you can inspect. Seventy-four bundled skills give agents ready-made domain playbooks, and a skill editor lets you write your own. Agents can read Gmail, check Calendar, search the web, and run a deep-research loop that writes its own queries under hard budgets so it cannot burn your key. Coding mode writes a multi-file project, boots it, and previews it live while telling you when something is broken. A unified model marketplace compares providers with live health checks, download counts, and benchmarks, and a built-in music player streams songs with a five-band equalizer. Your keys stay sealed in a passphrase-encrypted browser vault and travel only to the provider you picked, so there is no ENZO account, usage meter, or subscription taking a cut. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Whirl puts every top AI model in a single conversation and remembers what you were working on last week, so you can switch models mid-thought without losing the thread. Ask for a report, a chart, or a small interactive page and it appears as a living artifact in a side panel, still editable while you keep chatting, and shareable by link when it is ready to leave the conversation. Connect your own tools over MCP, with OAuth sign-in handled for you, or install skills that teach the app new tricks your team relies on. Long-term memory carries your preferences and project context from chat to chat, and live web search with page reading grounds answers in today's pages instead of the model's training data. Sensitive threads can be locked with a password that encrypts them on your device, where the server never sees the key and only zero-retention models may answer. Around those headline pieces sits the everyday kit: incognito mode, a message queue for when you think faster than the model replies, voice input, image generation, file attachments, folders, and sharing controls. An admin console manages the model catalog, integrations, and skills, and the interface itself switches between light and dark with your choice of accent color, installable as a mobile web app. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Bring your own API keys and work with OpenAI GPT models, Anthropic Claude, Google Gemini, Mistral, DeepSeek, Grok, Azure endpoints, and local models in one organized workspace: TypingMind is a unified chat frontend for large language models, replacing a browser tab per provider. Parallel chat sends the same prompt to multiple models and compares answers side by side, and models can be switched mid-conversation. A prompt library stores reusable, tagged prompts with variables, and the AI Agents system builds specialized assistants that bundle a base model, custom instructions, assigned plugins, and uploaded knowledge files for RAG. Plugins extend every connected model with web search, image generation (DALL-E, Stable Diffusion), Deep Research, URL reading via Firecrawl, and Zapier automation - plus MCP server integrations for Notion, Atlassian, and other external tools, and a JavaScript extension API for custom behavior. Chats store locally by default with optional sync. Self-hosting puts the interface on your own domain and, for teams, adds branding, member access limits, and shared prompt and agent libraries.

Chat with your own documents: AnythingLLM, from Mintplex Labs, wraps retrieval-augmented generation (RAG) in an open-source application anyone can run. You organize content into workspaces, each an isolated namespace with its own documents, vector embeddings, chat history, and settings, so one instance can hold several separate knowledge bases. Upload PDFs, DOCX, TXT, and other formats, or scrape web pages; the built-in collector parses and chunks them into a vector database (LanceDB by default, with Pinecone, Chroma, Qdrant, and others supported). Answers cite their source documents. It works with both cloud LLMs (OpenAI, Anthropic, Gemini) and local ones via Ollama or LM Studio, and the embedding model is separately configurable. Beyond RAG chat, it includes AI agents that can browse the web and run tools, an embeddable chat widget for your website, a developer API, and multi-user mode with admin, manager, and default roles plus per-workspace access control. Context assembly is smarter than naive RAG: pinned documents, attached files, vector search hits, and recent chat history are combined under a token budget so the model's context window is filled efficiently, and each workspace supports multiple independent conversation threads against the same knowledge base. Because the embedding model, vector store, and chat LLM are all independently swappable, you can move between providers without re-ingesting a single document. The stack is Node.js with a React frontend, MIT-licensed.

Why should your chat history live on someone else's servers? Chatpad AI - a React/TypeScript front end for the OpenAI API, built on the Mantine component library - is designed around that question. Enter your own OpenAI API key and start chatting with GPT models; every conversation, prompt, and setting is stored locally in your browser via DexieJS over IndexedDB, with no tracking, no cookies, and no backend database at all. That architecture is the point - the Docker image is just Nginx serving static files, making it one of the lightest AI deployments in the catalog, and pay-per-token API pricing typically undercuts a ChatGPT Plus subscription for moderate use. The interface earns its "premium quality" tagline with the details: a persona selector that switches communication styles per conversation, a saved-prompts library for messages you reuse constantly, organized chat history, and full data export/import so conversations move between browsers or into backups as files you control. A JSON config file customizes defaults - models, API endpoints, UI options - without rebuilding the image. AGPL-licensed, with desktop builds available upstream. For teams that want ChatGPT's utility with a self-hosted, zero-telemetry footprint, Chatpad is the minimal, sane answer.

Your prompts never have to leave the building: TextGen runs open large language models on your own hardware behind a chat interface and an API that speak fluent OpenAI. Load GGUF or Hugging Face weights through llama.cpp, ik_llama.cpp, Transformers, ExLlamaV3, or TensorRT-LLM, and switch models or backends from the interface without restarting the server. Chat mode gives you conversations with characters and system prompts, notebook mode behaves like a familiar completion editor, and both accept image attachments for vision models and documents for context. Models that support tool calling can search the web, fetch pages, and do math through single-file Python tools, and MCP servers plug in for larger tool catalogs. Start it with the API flag and the same model answers at chat, completions, and messages endpoints that mirror OpenAI and Anthropic, complete with streaming, logprobs, embeddings, and optional API key authentication. Portable builds for Linux, Windows, and macOS bundle every dependency, so the distance from download to a running model is an unzip and one shell command. Because everything is local, prompts, documents, and outputs stay on machines you control, and parallel request handling lets a single loaded model serve a whole team's tools at once. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Organizations deploying multiple large language models across departments use DEEIX Chat as their centralized AI workspace for model routing, multimodal conversations, document retrieval, MCP tool execution, and usage governance. Administrators connect upstream channels across OpenAI, Anthropic, Google Gemini, xAI, and OpenRouter protocols while configuring route priorities, traffic weights, and automatic circuit breaking from a unified control plane. Team members switch models mid-conversation, branch message threads, adjust reasoning effort, and generate images or video without managing individual API keys, or optionally bring their own provider keys under admin policy rules. Uploaded PDFs, spreadsheets, and images undergo OCR and semantic chunking so users can attach personal or shared knowledge bases directly to chat sessions with traceable retrieval evidence. Interactive responses render live HTML, SVG, Mermaid diagrams, KaTeX math, and stateful parameter sliders inside a sandboxed preview pane alongside the conversation. Built-in support for Streamable HTTP Model Context Protocol servers lets users discover and invoke external tools with per-message execution limits and full call inspection. Integrated permission groups, OIDC single sign-on, TOTP two-factor authentication, token and per-call billing ledgers, and audit logs give operators complete visibility over usage and spend. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Chat, research, and everyday chores all run through OpenAgent, a private AI assistant hosted on a server you control. Pick from more than thirty model providers, including OpenAI, Anthropic, Gemini, DeepSeek, and local Ollama models, and switch models inside a conversation. Agents can drive a real browser, search the web, run shell commands, read and write Word, Excel, and PowerPoint files, and call any MCP server. Every tool call shows its arguments and result. Upload PDFs and spreadsheets to build isolated knowledge bases with semantic search, then attach them to a chat. A drag and drop workflow builder chains steps with branches, parallel tasks, and schedules. The admin console tracks token use and cost per user and model with charts and a message heatmap, lists every tool, records audit logs, and shows live CPU, memory, and API latency. Single sign-on through OIDC, OAuth2, LDAP, or SAML and separate workspaces keep teams apart, and a REST API with Swagger docs exposes every feature. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Casibase lets organizations build AI-powered knowledge bases that answer questions from their own documents, connecting to 30+ model providers through a unified admin interface with RAG retrieval and multi-agent orchestration via MCP and A2A protocols. The platform plugs into OpenAI GPT-4o, Anthropic Claude, Meta Llama, Google Gemini, DeepSeek, Ollama local models, HuggingFace, Azure OpenAI, and additional providers, while embedding APIs from OpenAI Ada and Baidu handle vector representation of ingested documents. Document ingestion parses TXT, Markdown, DOCX, PDF, CSV, XLSX, and PPTX files with intelligent chunking strategies for optimal retrieval accuracy. The built-in chat interface provides real-time AI conversations with manual session handover for human agent escalation, and comprehensive chat session logging enables audit trails for compliance. Enterprise identity management integrates Casdoor for Single Sign-On supporting GitHub, Google, WeChat, and OIDC providers with fine-grained access control via the Casbin permission engine. The multi-tenant architecture supports isolated knowledge bases per organization with role-based user management and configurable storage, model, and embedding providers per tenant. The React frontend with Ant Design v5 provides a polished admin dashboard for managing providers, knowledge stores, chat sessions, and user access, while the Go backend with Beego framework handles API logic with MySQL or MariaDB persistence. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

A self-hosted "second brain": Khoj indexes your own files and answers questions from them, parsing Markdown (whole Obsidian vaults included), org-mode, PDF, Word, plain text, Notion pages, GitHub repositories, and images described by a vision model, then embedding everything with sentence-transformers into a vector index for semantic search and RAG with cited sources. Any LLM backend works: local models like Llama, Qwen, or Mistral via Ollama, or cloud models like GPT, Claude, and Gemini. You can build custom agents, each with its own persona, scoped knowledge base, chat model, and tools such as web search and code execution. Scheduled automations run recurring research and deliver newsletters or notifications to your inbox, and research mode performs multi-hop web searches with inline citations. Access it from a browser, the Obsidian plugin, Emacs, desktop, or WhatsApp - all clients connect to the same self-hosted instance, making Khoj one of the few AI assistants Emacs users can point at decades of org files. Semantic search means recall works without exact keywords: "that paper about forecasting with transformers" surfaces the right PDF even when you cannot remember its title. Switching LLM backends never requires re-indexing your documents, and with a local model via Ollama, even inference stays on hardware you control - journals, research, and private notes are never sent anywhere. Python/FastAPI stack, AGPL-licensed, with PostgreSQL storage.