AnythingLLM
Chat with your own documents: AnythingLLM, from Mintplex Labs, wraps retrieval-augmented
generation (RAG) in an open-source application anyone can run. You organize content into
workspaces, each an isolated namespace with its own documents, vector embeddings, chat
history, and settings, so one instance can hold several separate knowledge bases. Upload PDFs,
DOCX, TXT, and other formats, or scrape web pages; the built-in collector parses and chunks
them into a vector database (LanceDB by default, with Pinecone, Chroma, Qdrant, and others
supported). Answers cite their source documents. It works with both cloud LLMs (OpenAI,
Anthropic, Gemini) and local ones via Ollama or LM Studio, and the embedding model is
separately configurable. Beyond RAG chat, it includes AI agents that can browse the web and
run tools, an embeddable chat widget for your website, a developer API, and multi-user mode
with admin, manager, and default roles plus per-workspace access control. Context assembly is
smarter than naive RAG: pinned documents, attached files, vector search hits, and recent chat
history are combined under a token budget so the model's context window is filled efficiently,
and each workspace supports multiple independent conversation threads against the same
knowledge base. Because the embedding model, vector store, and chat LLM are all independently
swappable, you can move between providers without re-ingesting a single document. The stack is
Node.js with a React frontend, MIT-licensed.
Deploy