111 apps LLM
Farfalle screenshot thumbnail

Farfalle

Live web search plus an LLM of your choice: Farfalle is an open-source, self-hosted answer engine in the Perplexity mold. Queries route through one of several search providers - self-hosted SearXNG for a fully independent stack, or Tavily, Serper, and Bing APIs - and the model composes a cited answer from the retrieved results. Model flexibility is the core design: run llama3, mistral, gemma, or phi3 locally through Ollama for zero per-query cost and full privacy, use cloud models like GPT-4o or Groq-hosted Llama 3 for speed, or route to any provider via LiteLLM. An Expert Search mode uses an agent that plans a multi-step search strategy and executes it for harder questions, and chat history keeps prior research sessions available. The stack is a Next.js and shadcn/ui frontend over a FastAPI backend with Redis rate limiting, shipped as a pre-built Docker image. A browser search-engine entry pointing at your instance makes it the default search from the address bar. Paired with SearXNG and Ollama, the whole pipeline runs with no external API at all.

Deploy
WeKnora screenshot thumbnail

WeKnora

WeKnora turns scattered corporate documents into a searchable, reasoning-capable knowledge asset that your team can query in plain language and receive cited, sourced answers. Upload PDFs, Word files, web pages, Feishu wikis, Notion databases, Yuque docs, GitLab repositories, or RSS feeds into structured knowledge bases, and three distinct modes make the content actionable: RAG Quick Q&A retrieves relevant chunks and generates answers with source citations; the ReAct Agent autonomously orchestrates multi-step reasoning across knowledge retrieval, MCP tool calls, web search, and sandboxed code execution to produce comprehensive research reports; and Wiki Mode deploys LLM agents to distill raw documents into an interlinked markdown knowledge base with an interactive knowledge graph, revision history, and one-click rollback. Connect 20+ LLM providers including OpenAI, DeepSeek, Qwen, Claude, and local Ollama models without vendor lock-in, and choose from seven vector database backends (Qdrant, Milvus, Weaviate, and more) for embedding storage. Enterprise features include four-tier RBAC with per-resource ownership and per-workspace audit logs, AES-256-GCM credential encryption, scoped API keys, Langfuse observability tracing for every agent loop and tool call, and a runtime task-queue dashboard for worker-pool governance. Cross-session long-term memory preserves conversational context across interactions. The Agent Skills catalog lets teams install and share sandboxed scripts executed in Docker or E2B containers. A Chrome Extension captures web content directly into knowledge bases. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
Edict screenshot thumbnail

Edict

Edict is a multi-agent orchestrator that runs every AI request through a court-style chain: a crown prince agent triages it, a planning department drafts the work, a review department can veto the plan, and specialist ministries execute what survives. Casual chat gets a direct reply, while real commands become kanban tickets whose titles are scrubbed of file paths and metadata. A vetoed plan returns for rework; an approved one is dispatched in parallel to ministries for finance, documentation, engineering, compliance, infrastructure, and HR. Commands arrive through Feishu, Telegram, or Signal channels configured in OpenClaw. The dashboard shows cards by state with heartbeat badges and stop, cancel, and resume controls, plus a department monitor and a memorial archive that turns finished work into five-phase timelines you can copy as Markdown. Nine edict templates add parameter forms and cost estimates, an officials panel ranks agents by merit score while tracking token spend, and per-agent model switching restarts the gateway in about five seconds. Agent thinking, tool calls, and results stream live. A permission matrix limits who may message whom, illegal state jumps are rejected, and every transition lands in an audit log. Worked examples cover competitive analysis, code review, and weekly reports. Dashboard login protects the console, and a systemd unit keeps it running across reboots. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
CPA Manager Plus screenshot thumbnail

CPA Manager Plus

CPA Manager Plus is a self-hosted observability dashboard and management panel that tracks every AI request flowing through your CLI Proxy API gateway, breaking down failures, costs, and account health across providers like OpenAI, Anthropic, xAI, and Codex in one interface. When a request fails, drill into the persistent history to see status codes, affected models, latency, and redacted failure evidence without exposing raw response bodies. The cost analytics engine breaks down token consumption and estimated spend by model, provider, account, API key, project, channel, and time range while tracking input, output, reasoning, cache, and service-tier pricing semantics separately. Model prices sync automatically from models.dev with LiteLLM and OpenRouter fallbacks, and you can add local overrides for aliases or internal models. For teams running Codex or xAI accounts, the health inspector reads quota windows, reset evidence, credential state, and workspace status on a configurable schedule, routing credential failures into an action queue for review rather than letting them silently degrade throughput. Deploy the Lightweight Panel to replace your existing CPA management UI without adding another service, or run Full Mode as a single Docker container that adds the Manager Server with persistent SQLite storage for request history, historical analytics, and automated account inspections. Export or import request history as JSONL for external analysis, and back up the SQLite files alongside your encrypted management keys. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
Kodus AI screenshot thumbnail

Kodus AI

Kodus AI automates pull request code review with inline AI comments across GitHub, GitLab, Bitbucket, and Azure DevOps, supporting any LLM provider at cost with zero token markup. The multi-service TypeScript architecture deploys via Docker Compose, running an API server, background worker, webhooks service, and React dashboard backed by PostgreSQL with pgvector, MongoDB, and RabbitMQ. Integration covers both cloud platforms and their enterprise flavors (GitHub Enterprise Server, GitLab Self-Managed, Bitbucket Data Center) using standard OAuth flows and webhook signing to keep the review loop entirely inside your network. The platform is model-agnostic with Bring Your Own Key support for Claude, GPT, Gemini, Llama, and any OpenAI-compatible endpoint including locally-hosted models. Custom review rules combine your team's coding standards with requirements pulled from Jira, Linear, and Notion, automatically checking every PR against documented specifications. The CLI enables local reviews against working trees, staged diffs, branches, or specific commits, integrating into CI/CD pipelines as pre-merge gates. Source code is never stored and never used for model training, with all data encrypted in transit and at rest. 1,270+ stars and 129+ releases since March 2025. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Deploy
Hindsight screenshot thumbnail

Hindsight

Memory that survives the session: Hindsight extracts facts, entities, and timestamps from everything an AI agent retains, then lets the agent search or reason over it later. Adding it to an existing LLM client takes a two-line wrapper, and more than 60 integrations cover Claude Code, Cursor, LangGraph, CrewAI, and n8n. Every bank also exposes its own MCP endpoint. Retain sends text, images, or files through an LLM that extracts facts, timestamps, entities, and relationships. Recall runs semantic, keyword, graph, and temporal searches in parallel, merges them with reciprocal rank fusion, reranks with a cross-encoder, and trims to a token budget. Reflect reasons across memories for questions that need synthesis, shaped by per-bank skepticism, literalism, and empathy traits. In the background, related facts consolidate into observations that keep exact quotes and proof counts and are refined, never silently overwritten. Mental models and wiki-style knowledge pages hold standing answers that rewrite themselves as the bank learns. Each user, agent, or project gets an isolated bank with no cross-bank leakage, and Memory Defense redacts or blocks secrets and PII against 45 patterns. The Control Plane adds a Recall Analyzer with traces, a memory constellation graph, and a knowledge page editor. Extraction and reasoning can run on 25+ LLM providers, including local Ollama and llama.cpp. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
SQL Chat screenshot thumbnail

SQL Chat

Describe what you want in plain language and get real SQL against your real schema: SQL Chat is an open-source, chat-based SQL client from the Bytebase team. Instead of writing queries in a traditional editor, you connect a database and describe what you want in plain language; the AI reads your schema automatically, generates SQL that references real table and column names, executes it, and returns tabular results in the conversation. Follow-up messages refine the query, so exploration becomes a dialogue - narrow a result set, add a join, change an aggregation - without retyping statements. It supports MySQL, PostgreSQL, SQL Server, TiDB Cloud, and OceanBase from one interface, and covers modification as well as reads: insert, update, and delete operations phrased conversationally. Built with Next.js and TypeScript, it deploys as a single stateless Docker container in single-user mode - connection profiles live in the browser, so there is nothing server-side to maintain. A custom AI endpoint setting routes inference through any OpenAI-compatible API, including self-hosted models, and an optional database-backed mode adds accounts and quotas for offering the tool to a team. MIT-licensed.

Deploy
Hermes Workspace screenshot thumbnail

Hermes Workspace

Hermes Workspace serves as a dedicated command center for orchestrating autonomous AI agents, combining multi-model conversational flows with direct system execution in a unified web environment. Operators can execute multi-turn agent missions while observing live reasoning paths, tool dispatches, and file system mutations as they occur in real time. The built-in memory browser lets users inspect episodic recollections, search indexed agent knowledge bases, and edit persistent recall records directly from the interface. A comprehensive skill catalog provides instant activation and parameter tuning for over one hundred modular tool capabilities, ranging from web scraping to programmatic code generation. The embedded browser terminal delivers pseudoterminal sessions alongside running agents, enabling human operators to execute diagnostic commands and inspect project workspaces without switching windows. Conductor and Swarm management panels coordinate parallel sub-agent workers to break down complex research directives into asynchronous subtasks with automated status tracking. Integrated model switching allows teams to route individual execution steps dynamically between Anthropic Claude, OpenAI, OpenRouter, and self-hosted Ollama instances. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
Serviette screenshot thumbnail

Serviette

Your documents change every day, and your RAG answers should change with them: Serviette keeps a chat and REST API continuously in sync with the files you point it at, no re-indexing jobs to remember. Point it at a local folder, Google Drive, S3 or MinIO bucket, SharePoint library, or even an FTP or WebDAV share, and edits, additions, and deletions flow into the index in real time. One YAML file, or the interactive wizard, chooses among eight vector databases, from embedded DuckDB with zero setup to pgvector, Qdrant, Milvus, Chroma, Weaviate, Pinecone, or MongoDB Atlas. Text, Office files, PDFs with tables, and scanned images are parsed and answerable by default, with audio and video joining when you add the keys. Embeddings can run fully locally with no credentials, and keyless answers simply quote the retrieved passages with their sources. The indexer and the stateless server scale independently, the server shards across workers with one config line, and both a ChatGPT-style web chat and a versioned /api/v1 retrieval API answer on the same port. A free license key from Pathway activates the engine, and benchmarks cover corpora up to 50 GB of text. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
Respan Gateway screenshot thumbnail

Respan Gateway

Respan Gateway is a single-binary LLM gateway that lets the SDK you already use call any AI model from any provider, translating between OpenAI, Anthropic, and Gemini API formats on the way through. Point an OpenAI, Anthropic, or Gemini client at it and you reach chat models on sixteen providers, plus any OpenAI-compatible endpoint of your own, with streaming, tools, images, and reasoning translated. Traffic control works the way operators think: name a route, send it to the cheapest or fastest provider, retry on failure, fall back to a second vendor, or hedge a slow call by racing another provider. Models that never had tools get them anyway, because MCP servers and built-in search, browsing, code, document, and memory tools run inside ordinary chat requests behind the gateway. Realtime voice crosses vendors too, with an OpenAI Realtime client able to talk to Gemini Live, alongside images, speech, transcription, embeddings, and video through one endpoint. A live request log in the web UI shows the client key, model, provider, status, tokens, cost, and latency of every call, so runaway agents and surprise bills are visible immediately. Everything is a plugin on one public Rust API, from routing and pricing to tracing, with examples for guardrails, PII masking, and billing. One TOML file configures keys, providers, routes, and tools, validates before it starts, and reloads on signal. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Deploy
Agenta screenshot thumbnail

Agenta

Agenta delivers a comprehensive open-source LLMOps workspace that covers the full lifecycle of AI application development — from prompt engineering through production monitoring. The platform supports 15+ model providers including OpenAI, Anthropic, Google Gemini, Mistral, Groq, Together AI, Azure, AWS Bedrock, and self-hosted models via Ollama, enabling teams to switch between providers without code changes. The prompt playground allows side-by-side comparison of different configurations, while the evaluation system offers LLM-as-a-Judge assessment, 20+ pre-built evaluators covering semantic similarity, regex matching, and factual accuracy, plus custom Python evaluators for domain-specific requirements. Teams run evaluations through both the web UI for subject matter experts and the Evaluation SDK for programmatic CI/CD integration. The observability layer captures full trace visibility across complex agentic workflows, flagging quality issues like hallucinations and off-topic responses in real time. Human annotation workflows let domain experts review and annotate LLM outputs, feeding corrections back into the evaluation loop. The architecture supports Chain of Prompts, RAG pipelines, and multi-step agent workflows, integrating with frameworks like LangChain and LlamaIndex. Self-hosting deploys via Docker Compose with Traefik for routing, requiring only a clone, environment configuration, and a single docker compose command. On RepoCloud, deploy Agenta on a dedicated VPS with root SSH access, persistent storage for evaluation datasets and traces, and complete control over model provider credentials, all under the MIT license with no usage restrictions.

Deploy
OmniRoute screenshot thumbnail

OmniRoute

OmniRoute is an AI gateway, aggregating 338 LLM providers including OpenAI, Anthropic Claude, Google Gemini, DeepSeek, Kimi, MiniMax, and GLM into a single OpenAI-compatible endpoint at localhost:20128. The gateway catalogs over 1,200 models across 90 free-tier providers and 40 free-forever providers, automatically rotating through tier-1, tier-2, and tier-3 fallback chains when any provider exhausts its quota or returns errors. RTK plus Caveman stacked token compression reduces eligible context by 15 to 95 percent before forwarding requests, cutting API costs dramatically without degrading output quality. OmniRoute exposes its full routing engine through a built-in MCP server with 104 tools across 31 scopes over stdio, HTTP, and SSE transports, plus an A2A protocol server with six autonomous agent skills and JSON-RPC 2.0 streaming. The gateway integrates directly with Claude Code, Cursor, GitHub Copilot, Codex CLI, OpenCode, and Cline through standard base-URL configuration. Seventeen routing strategies include latency-optimized, cost-minimized, and auto-scoring modes that evaluate candidates on success rate, context fit, model fitness, quota state, and circuit-breaker health. The Next.js dashboard provides real-time provider status, usage analytics, combo chain configuration, and model catalog browsing via a responsive PWA. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
TradingAgents GUI screenshot thumbnail

TradingAgents GUI

Built atop the TauricResearch TradingAgents framework with nearly 100,000 GitHub stars, TradingAgents GUI transforms a CLI-only multi-agent LLM stock analysis pipeline into a polished web application accessible at localhost:5000. The system deploys twelve specialized AI agents — fundamental analysts, sentiment experts, technical analysts, bull and bear researchers, a trader, risk management team, and portfolio manager — who collaboratively debate market conditions through structured LangGraph workflows before producing a final BUY, SELL, or HOLD recommendation. The interface supports ten LLM providers including OpenAI, Anthropic, Google, OpenRouter, DeepSeek, Ollama, xAI, Qwen, GLM, and MiniMax, with a first-run wizard that auto-detects configured API keys and tests connections. A live pipeline visualization shows each agent's status with real-time progress bars, while the tabbed output area separates Live Feed, Reports preview, and Tool calls into dedicated panes. The three-pane Reports tab provides searchable indexing, table-of-contents navigation, and export to Markdown, HTML, or PDF formats. Report length control across Concise, Standard, and Comprehensive modes saves up to 50% on token costs. Multi-session chat allows pinning past reports as grounding context with live token counting and context-window warnings. Three built-in themes — Terminal, Modern, and Bloomberg — persist per browser. Docker Compose deployment maps port 5000 with persistent report storage. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

Deploy
Open Agent Builder screenshot thumbnail

Open Agent Builder

Open Agent Builder delivers a visual canvas for orchestrating AI agent workflows without writing Python scripts or managing complex codebases. The React Flow-powered drag-and-drop interface supports seven node types — Agent, Scraper, Transform, If/Else, Loop, User Approval, and MCP Tool — each configurable with provider-specific settings for Anthropic Claude (Haiku 4.5 and Sonnet 4.5), OpenAI GPT-5, Groq, or any OpenAI-compatible endpoint. The LangGraph orchestration engine handles state management, conditional routing, and human-in-the-loop approval gates while Firecrawl integration converts any website into structured, LLM-ready data through scrape, crawl, and map operations. E2B sandboxed code execution powers Transform nodes for secure data manipulation without risking host system integrity. Real-time streaming updates show execution progress node-by-node as workflows run, with Convex providing reactive database synchronization for workflow state and execution history. The TypeScript-first architecture (96.8% TypeScript) built on Next.js 16 App Router with Tailwind CSS delivers a responsive interface across devices. Clerk handles multi-user authentication with JWT integration for secure workspace isolation. Deploy via npm install and environment configuration with Firecrawl, Convex, and Clerk API keys. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
LocalAI screenshot thumbnail

LocalAI

With over 48,000 GitHub stars and monthly releases since March 2023, LocalAI is the self-hosted AI engine that replaces every OpenAI endpoint with a single Docker container running on your own infrastructure — serving chat completions, image generation, text-to-speech, speech-to-text, embeddings, vision, video generation, and function calling through identical API schemas that require zero application code changes. The composable backend architecture isolates each inference engine as a separate gRPC service running in its own OCI container, so llama.cpp, vLLM, SGLang, transformers, whisper.cpp, diffusers, MLX, Stable Diffusion, and Flux install on demand without touching the core, can run on separate machines, and a fault in one never affects others. Hardware acceleration spans NVIDIA CUDA 12 and 13, AMD ROCm, Intel oneAPI/SYCL, Apple Silicon Metal, Vulkan, and NVIDIA Jetson L4T — or runs entirely on CPU without any GPU. Built-in AI agents support autonomous tool use, retrieval-augmented generation, Model Context Protocol integration, and skill-based workflows directly in the web interface. The model gallery provides curated YAML configuration files for hundreds of models that install with a single command, while P2P federated inference distributes model shards across multiple machines for running models larger than any single node's memory. Multi-user API key authentication with quotas and role-based access enables team deployments. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
GPT Researcher screenshot thumbnail

GPT Researcher

A question goes in; a cited, long-form report comes out - GPT Researcher is an open-source autonomous research agent. A planner agent decomposes the query into sub-questions, execution agents crawl 20+ web sources in parallel with JavaScript-enabled scraping, and a publisher aggregates findings into a 2,000+ word report with inline citations, exportable to PDF, Word, and Markdown. The Deep Research mode extends this recursively: each result yields follow-up questions that are explored to configurable breadth and depth in a tree pattern, while accumulated learnings, citations, and visited URLs are shared across branches. It also researches local documents (PDF, CSV, Word) alongside the web. LLM and search providers are pluggable, including OpenAI, Anthropic, Google, DeepSeek, and Ollama for models, and Tavily, Google, Bing, DuckDuckGo, and SearXNG for retrieval. It ships as a Python package, a FastAPI server with web frontend, a Docker image, and an MCP server for use inside Claude or Cursor. MIT-licensed.

Deploy
LangWatch screenshot thumbnail

LangWatch

Every call your AI agents make becomes a searchable trace in LangWatch, and the same platform tests and scores those agents before a new prompt or model reaches users. The Trace Explorer filters by origin, user, model, cost, and evaluator, reads each run as a waterfall, flame graph, topology, or sequence diagram, and takes traces from the Python, TypeScript, and Go SDKs or any OpenTelemetry source. Agent Testing sends simulated users, in text or beta voice calls, through your agent while a judge passes or fails every criterion with its reasoning, adds multi-turn red teaming, and compares two agents side by side. The Experiments workbench scores prompts and agents on datasets with LLM judges, exact match, and RAG checks, then compares runs on cost, latency, and pass rate, while online evaluations monitor live traffic and guardrails block unsafe replies. Prompts keep version history and staging or production tags, Workflows wire prompts, Python code, and HTTP calls on a visual canvas, and annotation queues route traces to human reviewers. Alerts fire when a graph crosses a threshold, automations post to Slack, email, or webhooks, and scheduled reports go out by email or Slack. Claude Code, Codex, Copilot, Gemini CLI, and opencode report session cost, pull request cost, and terminal replays, and an MCP server exposes trace search and prompt management to coding assistants. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Deploy
Lobe Chat screenshot thumbnail

Lobe Chat

A private ChatGPT built with Next.js: Lobe Chat is the open-source AI chat interface teams self-host instead. Its main advantage is provider breadth: one interface connects to 40+ model providers, including OpenAI, Anthropic Claude, Google Gemini, Mistral, Groq, AWS Bedrock, Azure, and local models served through Ollama, so you can switch models per conversation and compare outputs. It handles multi-modal work: image recognition, image generation, text-to-speech, and speech-to-text. A plugin system based on function calling and the Model Context Protocol (MCP) adds external tools like web search and code execution. Run it in standalone mode as a single container with settings in browser storage, or in database mode with PostgreSQL and S3-compatible storage for persistent history, multi-user auth, and RAG knowledge bases built from uploaded documents with pgvector retrieval. Because tools arrive through function calling and MCP rather than a proprietary plugin format, custom internal tools can be exposed to the assistant with a standard server over STDIO or HTTP. Hundreds of pre-configured assistant roles import from the community marketplace. For teams the cost model matters: provider API keys billed per token typically undercut a ChatGPT Plus seat per person, and self-hosting keeps API keys, uploaded files, embeddings, and conversation history entirely on your own server.

Deploy