111 apps LLM
Omnigent screenshot thumbnail

Omnigent

Open-sourced by the Databricks AI team under Apache 2.0 and reaching over 8,500 GitHub stars within two months of launch, Omnigent introduces the meta-harness concept: a common orchestration layer that sits above existing AI coding agents and makes them interoperable parts of a governed, collaborative system. The platform wraps Claude Code, Codex, Cursor, OpenCode, Hermes, Pi, and any custom agent defined in a simple YAML configuration file into sandboxed sessions with a uniform API, then exposes each session through the terminal, a web UI, a native desktop application, mobile interfaces, and a REST API. Built-in multi-agent workflows include Polly, a coding orchestrator that delegates tasks to parallel sub-agents in separate git worktrees and routes each diff to a reviewer from a different vendor, and Deep Research, which plans sub-queries, searches the live web through MCP servers, reads full pages, and cross-checks claims across independent sources. Contextual security policies go beyond static allow/deny rules by maintaining per-session state to enforce spend caps, model routing, approval gates for destructive actions, PII blocking, and repository-scoped write restrictions across server-wide, per-agent, and per-session levels. The OS sandbox restricts filesystem and network access while intercepting egress requests to inject credentials only on approved calls. Cloud sandbox providers including Modal, Daytona, E2B, CoreWeave, Kubernetes, and Databricks launch disposable execution environments per session. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

Deploy
Vane screenshot thumbnail

Vane

Perplexity's search experience without Perplexity: Vane deploys Perplexica, an open-source AI answer engine built as the self-hosted alternative. Instead of returning a page of links, it reads your question, searches the live web through the SearxNG metasearch engine, and composes a direct answer with cited sources. Retrieval quality comes from embeddings and similarity search: fetched pages are re-ranked against the query so the model answers from the most relevant passages rather than whatever ranked first. Two query modes cover different needs - Normal mode runs a straightforward web search, while Copilot mode generates multiple reformulated queries and actively pulls content from top matches for harder questions. Focus modes specialize retrieval for academic papers, YouTube, Reddit discussions, Wolfram Alpha calculations, or the general web. The answering model is your choice: OpenAI-compatible APIs or fully local LLMs such as Llama 3 and Mixtral through Ollama, which keeps queries entirely on your infrastructure. Because SearxNG pulls live results, answers reflect current information, and no search history is tracked.

Deploy
Botpress screenshot thumbnail

Botpress

Build, deploy, and monitor chatbots and LLM-powered agents on one open-source conversational AI platform: Botpress. Its Studio is a visual development environment: a drag-and-drop canvas arranges conversation logic with nodes for messages, questions, choices, and actions, while a built-in emulator simulates conversations for debugging before anything goes live. Agents ground their answers in a knowledge base assembled from uploaded documents, ingested websites, and past conversations via retrieval-augmented generation, and the LLM layer connects to multiple model providers - GPT-4, Claude, Mistral - with a configurable model strategy. An autonomous engine handles reasoning, tool orchestration, persistent memory across sessions, and sandboxed code execution, and custom code actions in TypeScript extend agents past prebuilt workflows. Over 100 integrations deploy the same bot to WhatsApp, Telegram, Slack, Microsoft Teams, and web chat, and connect it to HubSpot, Zendesk, Zapier, and arbitrary APIs and webhooks. Human handoff, conversation analytics, and quality monitoring cover production operation. Originating in 2017 from a Montreal team, the community edition is developed openly on GitHub.

Deploy
Flowise screenshot thumbnail

Flowise

Drag nodes onto a canvas and ship an LLM app: Flowise is an open-source visual builder for AI agents and LLM applications, written in Node.js on LangChain.js and licensed Apache-2.0. You assemble flows by dragging nodes onto a canvas: models, prompts, memory, vector stores, retrievers, and tools, then wire them together and test in the built-in chat panel. Three builder types cover increasing complexity: Assistant for simple RAG chat over uploaded files, Chatflow for single-agent systems with techniques like rerankers and Graph RAG, and Agentflow for multi-agent orchestration with branching, looping, shared flow state, and human-in-the-loop checkpoints. Over 100 integrations connect data sources, vector databases, and both proprietary and open-source models, plus MCP client and server nodes for standard tool interop. Finished flows are exposed as REST APIs, embedded chat widgets, or via JS and Python SDKs - each flow gets an endpoint the moment it is saved, removing the deployment gap between a working prototype and something your application can call. Execution logs, visual step debugging, and external log streaming trace behavior, while input moderation and rate limiting act as guardrails; RBAC, SSO, and workspaces cover team deployments. Self-hosting keeps prompts, encrypted credentials, and conversation data on your own instance, which matters when flows handle internal documents or customer data - and wiring a model, prompt, memory, and vector store on the canvas replaces the boilerplate a hand-coded LangChain project would need.

Deploy
MiroFish screenshot thumbnail

MiroFish

Upload a report, ask a "what if" question in plain language, and MiroFish builds a small simulated society that plays out the answer before you commit to a decision. It reads your seed documents, whether news, policy drafts, financial signals, or a novel, and extracts entities and relationships into a GraphRAG knowledge graph. Entities from the graph become agents with a profession, a biography, and interest tags, and the app estimates simulation rounds from the simulated time span, with a custom mode for shorter runs. Agents post and react on two simulated platforms at once, a feed-style plaza and a topic community, while a live monitor tracks rounds, elapsed simulated time, and actions. A ReportAgent then plans an outline and writes the prediction report section by section with the InsightForge, PanoramaSearch, QuickSearch, and InterviewSubAgent tools. Afterward you can keep questioning the ReportAgent, chat with any individual agent, or send a survey question to a selected group and read their answers. Typical uses include rehearsing public relations responses, testing policy drafts against likely reactions, and exploring alternate endings for a story. The interface switches between English and Chinese, and you bring your own model: any OpenAI SDK compatible LLM endpoint works, Zep Cloud stores agent memory, and the project suggests starting under 40 rounds because runs consume many tokens. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Deploy
Bifrost screenshot thumbnail

Bifrost

Bifrost is an open-source AI gateway that unifies 23+ LLM providers into a single OpenAI-compatible endpoint with automatic failover, semantic caching, and built-in cost governance, so one provider going down never takes your production AI application with it. Point your existing OpenAI or Anthropic SDK at Bifrost's local endpoint and gain access to OpenAI, Anthropic, AWS Bedrock, Google Vertex, Azure, Groq, Mistral, and Ollama without changing application code. Define fallback chains that automatically switch providers when one returns errors or exceeds latency thresholds, keeping response times stable during outages. The built-in web dashboard at port 8080 lets you configure providers, create virtual API keys, monitor live request traffic, and review analytics without editing configuration files. Semantic caching combines exact hash matching with vector similarity search via Weaviate, serving cached responses for identical or paraphrased prompts in sub-millisecond time to cut costs on repetitive workloads. The MCP gateway connects AI agents to external tools like filesystems, databases, and web APIs, exposing them to clients such as Claude Desktop and Cursor with per-key allow-lists. Four-tier budget hierarchy at customer, team, virtual key, and provider levels enforces spend caps, rate limits, and model restrictions across your organization. Extend functionality through custom Go plugins for analytics, monitoring, or security middleware. Native Prometheus metrics and OpenTelemetry distributed tracing give operations teams full production observability. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

Deploy
Text Generation Web UI screenshot thumbnail

Text Generation Web UI

Your prompts never have to leave the building: TextGen runs open large language models on your own hardware behind a chat interface and an API that speak fluent OpenAI. Load GGUF or Hugging Face weights through llama.cpp, ik_llama.cpp, Transformers, ExLlamaV3, or TensorRT-LLM, and switch models or backends from the interface without restarting the server. Chat mode gives you conversations with characters and system prompts, notebook mode behaves like a familiar completion editor, and both accept image attachments for vision models and documents for context. Models that support tool calling can search the web, fetch pages, and do math through single-file Python tools, and MCP servers plug in for larger tool catalogs. Start it with the API flag and the same model answers at chat, completions, and messages endpoints that mirror OpenAI and Anthropic, complete with streaming, logprobs, embeddings, and optional API key authentication. Portable builds for Linux, Windows, and macOS bundle every dependency, so the distance from download to a running model is an unzip and one shell command. Because everything is local, prompts, documents, and outputs stay on machines you control, and parallel request handling lets a single loaded model serve a whole team's tools at once. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Deploy
OpenWiki screenshot thumbnail

OpenWiki

With over 15,900 GitHub stars and 40,000 weekly npm downloads in its first two months, OpenWiki from LangChain has rapidly become the standard for AI-generated codebase documentation. Built on the Deep Agents framework, it deploys a documentation agent that reads your repository's source code, tests, and configuration, then synthesizes a complete linked Markdown wiki with architecture overviews, integration guides, data-flow diagrams, and validated Mermaid visualizations. Two operating modes cover distinct workflows: code mode generates repository documentation in an openwiki/ folder with automatic AGENTS.md and CLAUDE.md integration for Codex, Claude Code, OpenCode, and Cursor, while personal mode builds a local knowledge base from nine connectors including Notion, Slack, Gmail, X/Twitter, Hacker News, LangSmith, Custom MCP, Web Search, and local git repositories. Thirteen model providers are supported out of the box — OpenAI, Anthropic, Gemini, AWS Bedrock, GitHub Copilot, OpenRouter, Nebius, Fireworks, Baseten, NVIDIA NIM, and any OpenAI-compatible endpoint like Ollama or LM Studio. Grounded Claims track every material assertion back to versioned source evidence, flagging stale propositions before they propagate. The interactive visualizer renders wiki pages as an explorable node graph with a side-by-side Markdown reader, exportable as a static site for GitHub Pages or MkDocs. Self-updating CI workflows via GitHub Actions, GitLab CI, or Bitbucket Pipelines open documentation PRs automatically when code changes. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
LLM Wiki v2 screenshot thumbnail

LLM Wiki v2

Instead of burying your documents in a vector index you cannot inspect, LLM Wiki v2 files them into a Markdown wiki you can read, browse, and question. Drop text, Markdown, or PDF files anywhere on the page and each one is catalogued automatically, filed into a folder that says what it holds, and linked to the notes it relates to. Ask a question and the answer cites the exact notes it used, with clickable sources you can open, verify, and correct. New documents update the note on their subject instead of piling up as disconnected chunks, so what you teach it stays taught. A small classifier routes filing and questions through the folder tree, keeping the wiki quick and cheap as it grows, and you can browse the tree, follow see-also links, move or delete notes, and watch the tokens spent by both the model and the classifier. Connect OpenRouter, OpenAI, Gemini, a local Ollama, or any compatible endpoint, and expose the same wiki to Claude Code or Codex as long-term memory they can recall from and write to. Because every note is plain Markdown in a folder you own, the whole knowledge base can live in git beside your other files. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Deploy
Argilla screenshot thumbnail

Argilla

Before a language model learns from your data, someone has to label it well; Argilla gives AI engineers and domain experts a shared workspace to label, review, and refine the datasets that fine-tune language models and train NLP pipelines. You build each dataset from the Python SDK, mixing text, chat, and image fields with the exact questions your task needs: single-label classification for intent detection, span questions for named entities, ratings for response quality, rankings for preference tuning, or free text for corrections. Annotators then work through records in a focused labeling interface where model predictions already sit attached as suggestions, turning most reviews into a fast confirm-or-correct decision instead of a blank-page exercise. Full-text search, metadata filters, and status filters slice a hundred thousand records down to the ones needing attention, while vector-based semantic search finds lookalike examples, near-duplicates, and the disagreement hotspots where guidelines need sharpening. Dataset owners watch completion progress, manage who has responded to what, and split work across workspaces with owner, admin, and annotator roles for each team or client. Finished datasets export with responses, suggestions, and metadata intact, locally or straight to the Hugging Face Hub, ready for fine-tuning and evaluation runs. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Deploy
Proval screenshot thumbnail

Proval

Proval is a self-hosted AI code review agent that reads every pull request on your GitLab, Forgejo, or GitHub server and posts a consolidated, severity-grouped review with inline comments, using a model you run yourself. When a pull request gets a meaningful push, a planning agent groups changed files into review units and dispatches specialist sub-agents in parallel, each exploring the codebase so cross-file issues surface. A writing agent merges their findings into one review, with comments on the affected lines, including multi-line ranges. Reply to any Proval comment and it reads the thread context and answers, and it works on issues too, greeting new ones and answering follow-ups on every message or only when mentioned. Choose per repository whether reviews run on first push only, every push, or not at all, skipping drafts until they are marked ready. Every review, reply, and issue comment is logged with its token usage, so each model's cost shows in the dashboard instead of hiding in an API bill. Your code is never stored; review context goes only to the LLM endpoint you configure, whether that is a cloud API or a local Ollama or llama.cpp server on your own network. Connect GitLab or Forgejo with an access token and webhooks, or GitHub through a GitHub App; Gitea and Codeberg use the same Forgejo-compatible path. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Deploy
Dialoqbase screenshot thumbnail

Dialoqbase

Retrieval-augmented chatbots on your own knowledge base - that is the whole mission of Dialoqbase, an open-source bot-building platform. Feed it content through a broad set of data loaders - web pages and full crawls, sitemaps, PDFs, DOCX, CSV, plain text, GitHub repositories, YouTube videos, and MP3/MP4 audio - and it handles the whole RAG pipeline in one self-contained app: chunking, embedding, vector storage, and LLM querying. The distinguishing architecture choice is PostgreSQL with pgvector for embedding storage and similarity search, which removes the separate vector-database dependency, and Redis-backed Bull queues for ingesting large documents without blocking the API. Model choice is wide open: OpenAI, Anthropic Claude, Google Gemini, Cohere, Fireworks, Hugging Face, local models via Ollama, and any OpenAI-compatible endpoint, with an equally broad list of embedding providers. Finished bots embed on any website with customizable styling or deploy to Telegram, Discord, and WhatsApp, and an API creates and manages bots programmatically. Multi-user support adds registration limits and per-user bot quotas. MIT-licensed and free for commercial use.

Deploy
BitRouter screenshot thumbnail

BitRouter

BitRouter is a context-aware LLM router that learns which model delivers the cheapest successful outcome per workflow step, cutting agent costs by up to 80% while maintaining 96% quality versus all-frontier baselines. Point any agent runtime at http://localhost:4356 with a one-line OPENAI_BASE_URL change and BitRouter routes to OpenAI, Anthropic, Google, Groq, DeepSeek, Mistral, Moonshot, MiniMax, Nvidia, and any OpenAI-compatible endpoint simultaneously, normalizing authentication, streaming, and cross-protocol translation between wire formats. The act-observe-evaluate-learn loop traces every hop with cost, tokens, and latency attribution, scores each decision against a versioned policy-lock.yaml, then tightens routes automatically with no LLM judge in the path. Native MCP gateway auto-discovers tools from connected servers and makes them routable and governed alongside model calls. Agent Client Protocol integration enables the TUI to manage Claude Code, Codex, OpenCode, OpenClaw, Gemini, and Copilot sessions in real time with inline tool-call approval and live streaming. Built-in guardrails inspect, redact, or block risky content before requests leave your network. Virtual keys scope API access per agent or user without exposing upstream credentials. Per-agent spend caps and loop guards contain runaway cost automatically. Multi-account failover reroutes mid-run so rate limits never re-pay completed work. Ships as a single Rust binary via npm or Cargo. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

Deploy
Typing Mind screenshot thumbnail

Typing Mind

Bring your own API keys and work with OpenAI GPT models, Anthropic Claude, Google Gemini, Mistral, DeepSeek, Grok, Azure endpoints, and local models in one organized workspace: TypingMind is a unified chat frontend for large language models, replacing a browser tab per provider. Parallel chat sends the same prompt to multiple models and compares answers side by side, and models can be switched mid-conversation. A prompt library stores reusable, tagged prompts with variables, and the AI Agents system builds specialized assistants that bundle a base model, custom instructions, assigned plugins, and uploaded knowledge files for RAG. Plugins extend every connected model with web search, image generation (DALL-E, Stable Diffusion), Deep Research, URL reading via Firecrawl, and Zapier automation - plus MCP server integrations for Notion, Atlassian, and other external tools, and a JavaScript extension API for custom behavior. Chats store locally by default with optional sync. Self-hosting puts the interface on your own domain and, for teams, adds branding, member access limits, and shared prompt and agent libraries.

Deploy
ChatChat screenshot thumbnail

ChatChat

One clean interface in front of Anthropic, OpenAI, Google Gemini, Cohere, and more: Chat Chat is a Next.js front door to the major AI providers, ending the juggling of separate subscriptions, tabs, and UIs per model. Bring your own API keys, pick a provider and model per conversation, and switch between them as the task demands: Claude for long-form reasoning, GPT for code, Gemini for multimodal work - the interface stays identical. Beyond configured presets, custom providers plug in with their own API endpoints and keys, which covers OpenAI-compatible gateways and local inference servers. The design splits into two dedicated modes: a chat interface for conversational work with customizable system prompts, and a search interface that pairs AI processing with query handling for research-style questions. The stack is modern and hackable - Next.js 14, Tailwind CSS, shadcn/ui on Radix primitives, Jotai for state - with full internationalization including English, Chinese, and Japanese. Self-hosting means your conversation history and API keys live on your instance rather than a third-party wrapper service, and pay-per-token API pricing typically beats stacking multiple monthly chat subscriptions. AGPL-licensed and deliberately simple to deploy: one container, environment variables for keys, done.

Deploy
Chatpad screenshot thumbnail

Chatpad

Why should your chat history live on someone else's servers? Chatpad AI - a React/TypeScript front end for the OpenAI API, built on the Mantine component library - is designed around that question. Enter your own OpenAI API key and start chatting with GPT models; every conversation, prompt, and setting is stored locally in your browser via DexieJS over IndexedDB, with no tracking, no cookies, and no backend database at all. That architecture is the point - the Docker image is just Nginx serving static files, making it one of the lightest AI deployments in the catalog, and pay-per-token API pricing typically undercuts a ChatGPT Plus subscription for moderate use. The interface earns its "premium quality" tagline with the details: a persona selector that switches communication styles per conversation, a saved-prompts library for messages you reuse constantly, organized chat history, and full data export/import so conversations move between browsers or into backups as files you control. A JSON config file customizes defaults - models, API endpoints, UI options - without rebuilding the image. AGPL-licensed, with desktop builds available upstream. For teams that want ChatGPT's utility with a self-hosted, zero-telemetry footprint, Chatpad is the minimal, sane answer.

Deploy
DispatchMail screenshot thumbnail

DispatchMail

DispatchMail is an SuperHuman alternative and delivers a self-hosted AI email assistant that processes your Gmail inbox through configurable OpenAI prompts without sending data to third-party cloud services beyond the LLM API itself. The Flask backend connects to Gmail via IMAP, retrieves new messages according to your schedule, and routes them through customizable whitelist rules based on sender address, subject keywords, or natural language descriptions before AI processing begins. Two distinct prompt configurations control behavior — the Reading Prompt instructs how the AI should analyze and classify incoming messages, while the Draft Prompt defines how responses should be composed, letting you maintain consistent tone and policy across all automated replies. Whitelist filtering ensures the AI only processes messages you explicitly authorize, preventing unnecessary API costs and keeping sensitive emails out of the LLM pipeline entirely. The React web interface provides inbox management with message previews, AI-generated summaries, draft editing with human-in-the-loop approval before sending, and configuration panels for prompts and rules. Automatic labeling and archival organize processed messages into categories without manual intervention. The sender research feature uses LLM-powered deep analysis to build background profiles of email contacts. All email content, credentials, and processing results persist in a local SQLite database with zero cloud storage dependencies. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Deploy
SmarterRouter screenshot thumbnail

SmarterRouter

SmarterRouter stops you from playing model roulette with your local AI setup, choosing the right model for every prompt so you never have to. Point your applications at one familiar endpoint and send the request; the router studies the prompt, weighs category and complexity against benchmark results gathered on your actual hardware, and hands the job to the model most likely to answer well. It discovers the models your backend already serves, profiles each one with standard tests the first time it meets them, and keeps learning from the feedback your usage generates. When the first choice fails, a backup model takes over without your application noticing. Repeated questions come straight back from cache instead of burning another generation. Your graphics memory is watched continuously across one card or several, and models are unloaded before an ambitious request runs the machine dry. Cloud providers can join the same routing pool when a question deserves them, while everything local stays local and free. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy