72 apps LLM
Nanobot screenshot thumbnail

Nanobot

With over 46,000 GitHub stars, nanobot is the ultra-lightweight personal AI agent framework that delivers full agentic capabilities — tools, persistent memory, multi-agent workflows, scheduled automation, and 10+ chat channel integrations — in approximately 4,000 lines of readable Python core code. The agent loop receives messages from any connected channel, builds context from session history and long-term memory files, calls the configured LLM provider, executes requested tools, and publishes replies back to the originating channel. Supported LLM providers include OpenAI, Anthropic, Google Gemini, DeepSeek, Qwen via DashScope, Moonshot/Kimi, Ollama, vLLM for local models, and any OpenAI-compatible API through OpenRouter or LiteLLM. Chat channels connect the agent to Telegram, Discord, Slack, WhatsApp, Feishu/Lark, DingTalk, Email via IMAP/SMTP, QQ, Matrix with end-to-end encryption, Mattermost, and the built-in browser WebUI served from the published Python wheel with no separate frontend build. Built-in tools include filesystem read/write/edit, shell execution with configurable sandboxing via bubblewrap, web search and fetch with SSRF protection, MCP server integration, cron scheduling, image generation, and subagent spawning for parallel task delegation. The Dream memory system consolidates session history into persistent markdown files for long-term context retention across conversations. Deployment runs as a CLI agent, a persistent gateway server, a Docker container with Docker Compose, or an OpenAI-compatible API server. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Deploy
Agenta screenshot thumbnail

Agenta

Agenta delivers a comprehensive open-source LLMOps workspace that covers the full lifecycle of AI application development — from prompt engineering through production monitoring. The platform supports 15+ model providers including OpenAI, Anthropic, Google Gemini, Mistral, Groq, Together AI, Azure, AWS Bedrock, and self-hosted models via Ollama, enabling teams to switch between providers without code changes. The prompt playground allows side-by-side comparison of different configurations, while the evaluation system offers LLM-as-a-Judge assessment, 20+ pre-built evaluators covering semantic similarity, regex matching, and factual accuracy, plus custom Python evaluators for domain-specific requirements. Teams run evaluations through both the web UI for subject matter experts and the Evaluation SDK for programmatic CI/CD integration. The observability layer captures full trace visibility across complex agentic workflows, flagging quality issues like hallucinations and off-topic responses in real time. Human annotation workflows let domain experts review and annotate LLM outputs, feeding corrections back into the evaluation loop. The architecture supports Chain of Prompts, RAG pipelines, and multi-step agent workflows, integrating with frameworks like LangChain and LlamaIndex. Self-hosting deploys via Docker Compose with Traefik for routing, requiring only a clone, environment configuration, and a single docker compose command. On RepoCloud, deploy Agenta on a dedicated VPS with root SSH access, persistent storage for evaluation datasets and traces, and complete control over model provider credentials, all under the MIT license with no usage restrictions.

Deploy
Dify screenshot thumbnail

Dify

Dify turns the notoriously complex process of building production-grade AI applications into a visual drag-and-drop experience that teams can actually ship and maintain. With over 87,000 GitHub stars and backing from prominent investors, the platform has become the go-to open-source LLMOps solution for organizations that refuse to be locked into proprietary AI stacks. The visual workflow canvas lets developers wire together LLM calls, conditional logic, iteration loops, tool invocations, and human-in-the-loop checkpoints without writing boilerplate integration code. Its RAG pipeline engine handles the full document lifecycle from ingestion of PDFs, Word documents, and HTML through configurable chunking strategies, embedding with models from OpenAI or open-source alternatives, vector storage in Weaviate, Qdrant, Pinecone, or pgvector, and hybrid semantic-plus-keyword retrieval with citation tracking. Dify integrates with hundreds of model providers including OpenAI GPT-4o, Anthropic Claude, Google Gemini, Mistral, Llama, and any OpenAI-compatible endpoint like Ollama for fully local inference. The agent framework supports both ReAct and function-calling strategies with 50-plus built-in tools spanning Google Search, DALL-E, Stable Diffusion, WolframAlpha, and custom API definitions. Published apps can be deployed as hosted web interfaces, embedded chat widgets, REST API endpoints, or MCP-compatible tools. Enterprise features include role-based access control, SSO integration, and audit logging. A built-in marketplace enables teams to share and reuse model providers, tools, and workflow templates across projects. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed with an open-source community edition.

Deploy
Farfalle screenshot thumbnail

Farfalle

Live web search plus an LLM of your choice: Farfalle is an open-source, self-hosted answer engine in the Perplexity mold. Queries route through one of several search providers - self-hosted SearXNG for a fully independent stack, or Tavily, Serper, and Bing APIs - and the model composes a cited answer from the retrieved results. Model flexibility is the core design: run llama3, mistral, gemma, or phi3 locally through Ollama for zero per-query cost and full privacy, use cloud models like GPT-4o or Groq-hosted Llama 3 for speed, or route to any provider via LiteLLM. An Expert Search mode uses an agent that plans a multi-step search strategy and executes it for harder questions, and chat history keeps prior research sessions available. The stack is a Next.js and shadcn/ui frontend over a FastAPI backend with Redis rate limiting, shipped as a pre-built Docker image. A browser search-engine entry pointing at your instance makes it the default search from the address bar. Paired with SearXNG and Ollama, the whole pipeline runs with no external API at all.

Deploy
Kortix screenshot thumbnail

Kortix

Kortix Suna is an AI management system where autonomous agents run on isolated Linux sandbox computers, producing finished deliverables that humans review through a change request workflow before anything merges. With 20,000+ stars, it positions itself against Claude Cowork and ChatGPT Work by storing every agent persona, skill, memory artifact, and connector in a git repository: versioned, diffable, and shared across an organization. Each session launches a dedicated sandbox with full terminal access, Playwright-controlled Chromium, writable filesystem, and internet connectivity. Over 3,000 app connectors are available through MCP, OpenAPI, GraphQL, and raw HTTP, with credentials brokered server-side so tokens never enter the sandbox. Skills (reusable markdown-plus-script packages encoding company workflows) load automatically into every session, compounding institutional knowledge over time. Bring-your-own-key model routing through LiteLLM connects to OpenAI, Anthropic, Google, Mistral, or local models without vendor lock-in. The deployment runs as a single Docker Compose stack bundling the Next.js frontend, FastAPI backend, Supabase, Redis, and Caddy with automatic TLS certificates. Enterprise features include SAML/OIDC SSO, SCIM provisioning, RBAC, and audit logging. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Elastic License 2.0.

Deploy
AI Researcher screenshot thumbnail

AI Researcher

Accepted as a NeurIPS 2025 Spotlight paper and rapidly approaching 6,000 GitHub stars, AI-Researcher from the Hong Kong University Data Science Lab delivers the first fully autonomous scientific research system — a multi-agent platform that takes a list of reference papers and returns a complete research contribution with working code, validated experiments, and a formatted academic manuscript. The pipeline orchestrates five distinct phases: a Resource Collector systematically gathers materials from arXiv, IEEE Xplore, ACM Digital Library, Google Scholar, GitHub, and Hugging Face; an Idea Generator performs gap analysis against semantic embeddings to produce 3-5 novel hypotheses with feasibility scores; an Algorithm Designer transforms concepts into functional implementations; a Validation Engine automates testing, performance evaluation, and iterative optimization; and a Manuscript Creator generates polished full-length papers with figures, tables, and citations. The Gradio-based web GUI provides intuitive tabs for environment configuration, example selection, and real-time monitoring of research progress, while the production deployment at novix.science offers immediate browser access without local setup. Scientist-Bench provides a standardized benchmark comprising state-of-the-art papers across diverse AI research domains for evaluating autonomous research capabilities. The system supports multiple LLM providers including OpenAI, Anthropic, Google Gemini, and OpenRouter models with per-task routing for cost optimization. Deploy via Python with pip dependencies or Docker containerization. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Deploy
Astron Agent screenshot thumbnail

Astron Agent

Recognized by the CNCF Landscape in the AI Agent – Workflow Orchestration category alongside Dify and Temporal, Astron Agent is iFLYTEK's fully open-source platform for building, deploying, and managing enterprise multi-agent systems — backed by 8,900+ GitHub stars and the production infrastructure behind one of China's largest AI companies. Unlike pip-install frameworks such as LangGraph, CrewAI, or AutoGen, Astron Agent ships as a complete microservices platform spanning 10+ services across Java, Python, Go, and TypeScript: a ReactFlow-based visual workflow builder for low-code agent orchestration, native integration with the Model Context Protocol (MCP) for tool calling, a built-in model management layer supporting iFLYTEK Spark, OpenAI, Anthropic, and on-premises MaaS deployments, and a multi-tenant Go authentication service powered by Casdoor. The standout differentiator is native RPA integration via the companion astron-rpa project (7,200+ stars), providing 300+ pre-built automation capabilities spanning browser, Office document, and enterprise system interaction — enabling agents to execute physical UI actions rather than only API calls. Infrastructure includes PostgreSQL for multi-tenant data isolation, MySQL for application metadata, Kafka for event streaming, Redis for caching, and MinIO for object storage, all orchestrated through Docker Compose with explicit health checks and dependency chains or production Kubernetes Helm charts. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

Deploy
Botpress screenshot thumbnail

Botpress

Build, deploy, and monitor chatbots and LLM-powered agents on one open-source conversational AI platform: Botpress. Its Studio is a visual development environment: a drag-and-drop canvas arranges conversation logic with nodes for messages, questions, choices, and actions, while a built-in emulator simulates conversations for debugging before anything goes live. Agents ground their answers in a knowledge base assembled from uploaded documents, ingested websites, and past conversations via retrieval-augmented generation, and the LLM layer connects to multiple model providers - GPT-4, Claude, Mistral - with a configurable model strategy. An autonomous engine handles reasoning, tool orchestration, persistent memory across sessions, and sandboxed code execution, and custom code actions in TypeScript extend agents past prebuilt workflows. Over 100 integrations deploy the same bot to WhatsApp, Telegram, Slack, Microsoft Teams, and web chat, and connect it to HubSpot, Zendesk, Zapier, and arbitrary APIs and webhooks. Human handoff, conversation analytics, and quality monitoring cover production operation. Originating in 2017 from a Montreal team, the community edition is developed openly on GitHub.

Deploy
Chatpad screenshot thumbnail

Chatpad

Why should your chat history live on someone else's servers? Chatpad AI - a React/TypeScript front end for the OpenAI API, built on the Mantine component library - is designed around that question. Enter your own OpenAI API key and start chatting with GPT models; every conversation, prompt, and setting is stored locally in your browser via DexieJS over IndexedDB, with no tracking, no cookies, and no backend database at all. That architecture is the point - the Docker image is just Nginx serving static files, making it one of the lightest AI deployments in the catalog, and pay-per-token API pricing typically undercuts a ChatGPT Plus subscription for moderate use. The interface earns its "premium quality" tagline with the details: a persona selector that switches communication styles per conversation, a saved-prompts library for messages you reuse constantly, organized chat history, and full data export/import so conversations move between browsers or into backups as files you control. A JSON config file customizes defaults - models, API endpoints, UI options - without rebuilding the image. AGPL-licensed, with desktop builds available upstream. For teams that want ChatGPT's utility with a self-hosted, zero-telemetry footprint, Chatpad is the minimal, sane answer.

Deploy
TavernAI screenshot thumbnail

TavernAI

Character-based chat and storywriting with large language models: TavernAI is the open-source frontend that leaves model choice to you. It generates no text itself; it connects to the backend of your choice - OpenAI (including GPT-4), Anthropic Claude, KoboldAI and KoboldCpp, Oobabooga's Text Generation Web UI, NovelAI, Ollama, and the crowdsourced Horde - so cost, model quality, and content policy are decided by your backend, not the interface. Characters are defined by portable card files in PNG or JSON format with personality, scenario, and example dialogue, and tens of thousands of community-made cards from sites like Chub.ai import directly. Conversations support group chats with multiple characters, a story mode for long-form writing, message swiping to branch between alternative responses, and full editing of any message. World Info injects lore into context when keywords trigger, keeping long roleplays consistent. Themes, custom backgrounds, and configurable generation settings round out the interface. It runs on Node.js, and the SillyTavern project began as a fork of it.

Deploy
Inference Gateway screenshot thumbnail

Inference Gateway

Inference Gateway puts a single OpenAI-compatible API endpoint in front of OpenAI, Anthropic, Groq, Cohere, Ollama, DeepSeek, Google, Mistral, MiniMax, Moonshot, Nvidia, and llama.cpp, so your application code never changes when you switch models or providers. The Go binary starts on port 8080 and normalizes authentication, streaming protocols, and response formats across all backends transparently. Native Model Context Protocol support auto-discovers tools from connected MCP servers and injects them into LLM requests without client-side management, enabling server-side tool execution across any provider that supports function calling. Agent-to-Agent protocol integration allows distributed agent communication through a declarative Agent Definition Language that generates production-ready Go or Rust servers from a single YAML manifest. The dedicated Kubernetes Operator manages Gateway, Agent, MCP, and Orchestrator custom resources with automatic HPA scaling, OIDC authentication, and service discovery that rebuilds MCP configurations when the discovered server set changes. Prometheus metrics and OpenTelemetry tracing provide full request-level observability across the entire inference pipeline. Middleware controls enable per-request provider selection, model routing, and fallback strategies. Official SDKs in Go, Python, TypeScript, and Rust provide typed client interfaces with streaming support. Docker Compose deployment requires only environment variables for API keys. A CNCF Sandbox applicant. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

Deploy
SQL Chat screenshot thumbnail

SQL Chat

Describe what you want in plain language and get real SQL against your real schema: SQL Chat is an open-source, chat-based SQL client from the Bytebase team. Instead of writing queries in a traditional editor, you connect a database and describe what you want in plain language; the AI reads your schema automatically, generates SQL that references real table and column names, executes it, and returns tabular results in the conversation. Follow-up messages refine the query, so exploration becomes a dialogue - narrow a result set, add a join, change an aggregation - without retyping statements. It supports MySQL, PostgreSQL, SQL Server, TiDB Cloud, and OceanBase from one interface, and covers modification as well as reads: insert, update, and delete operations phrased conversationally. Built with Next.js and TypeScript, it deploys as a single stateless Docker container in single-user mode - connection profiles live in the browser, so there is nothing server-side to maintain. A custom AI endpoint setting routes inference through any OpenAI-compatible API, including self-hosted models, and an optional database-backed mode adds accounts and quotas for offering the tool to a team. MIT-licensed.

Deploy
TradingAgents GUI screenshot thumbnail

TradingAgents GUI

Built atop the TauricResearch TradingAgents framework with nearly 100,000 GitHub stars, TradingAgents GUI transforms a CLI-only multi-agent LLM stock analysis pipeline into a polished web application accessible at localhost:5000. The system deploys twelve specialized AI agents — fundamental analysts, sentiment experts, technical analysts, bull and bear researchers, a trader, risk management team, and portfolio manager — who collaboratively debate market conditions through structured LangGraph workflows before producing a final BUY, SELL, or HOLD recommendation. The interface supports ten LLM providers including OpenAI, Anthropic, Google, OpenRouter, DeepSeek, Ollama, xAI, Qwen, GLM, and MiniMax, with a first-run wizard that auto-detects configured API keys and tests connections. A live pipeline visualization shows each agent's status with real-time progress bars, while the tabbed output area separates Live Feed, Reports preview, and Tool calls into dedicated panes. The three-pane Reports tab provides searchable indexing, table-of-contents navigation, and export to Markdown, HTML, or PDF formats. Report length control across Concise, Standard, and Comprehensive modes saves up to 50% on token costs. Multi-session chat allows pinning past reports as grounding context with live token counting and context-window warnings. Three built-in themes — Terminal, Modern, and Bloomberg — persist per browser. Docker Compose deployment maps port 5000 with persistent report storage. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

Deploy
Dialoqbase screenshot thumbnail

Dialoqbase

Retrieval-augmented chatbots on your own knowledge base - that is the whole mission of Dialoqbase, an open-source bot-building platform. Feed it content through a broad set of data loaders - web pages and full crawls, sitemaps, PDFs, DOCX, CSV, plain text, GitHub repositories, YouTube videos, and MP3/MP4 audio - and it handles the whole RAG pipeline in one self-contained app: chunking, embedding, vector storage, and LLM querying. The distinguishing architecture choice is PostgreSQL with pgvector for embedding storage and similarity search, which removes the separate vector-database dependency, and Redis-backed Bull queues for ingesting large documents without blocking the API. Model choice is wide open: OpenAI, Anthropic Claude, Google Gemini, Cohere, Fireworks, Hugging Face, local models via Ollama, and any OpenAI-compatible endpoint, with an equally broad list of embedding providers. Finished bots embed on any website with customizable styling or deploy to Telegram, Discord, and WhatsApp, and an API creates and manages bots programmatically. Multi-user support adds registration limits and per-user bot quotas. MIT-licensed and free for commercial use.

Deploy
Typing Mind screenshot thumbnail

Typing Mind

Bring your own API keys and work with OpenAI GPT models, Anthropic Claude, Google Gemini, Mistral, DeepSeek, Grok, Azure endpoints, and local models in one organized workspace: TypingMind is a unified chat frontend for large language models, replacing a browser tab per provider. Parallel chat sends the same prompt to multiple models and compares answers side by side, and models can be switched mid-conversation. A prompt library stores reusable, tagged prompts with variables, and the AI Agents system builds specialized assistants that bundle a base model, custom instructions, assigned plugins, and uploaded knowledge files for RAG. Plugins extend every connected model with web search, image generation (DALL-E, Stable Diffusion), Deep Research, URL reading via Firecrawl, and Zapier automation - plus MCP server integrations for Notion, Atlassian, and other external tools, and a JavaScript extension API for custom behavior. Chats store locally by default with optional sync. Self-hosting puts the interface on your own domain and, for teams, adds branding, member access limits, and shared prompt and agent libraries.

Deploy
LLemonStack screenshot thumbnail

LLemonStack

One CLI command deploys a complete AI development environment: n8n, Flowise, Supabase, Ollama, Qdrant, LiteLLM, Langfuse, Open WebUI, LightRAG, Browser-Use, Firecrawl, Crawl4AI, and more, all pre-wired with networking, credentials, and database connections. LLemonStack eliminates the hours of Docker Compose configuration that typically precede any local AI agent project. The llmn CLI initializes isolated project environments with auto-generated secure credentials, starts services in dependency order (databases first, then middleware, then apps), and displays a dashboard showing every service URL and access token. n8n brings 400+ workflow integrations, Flowise provides visual agent building, Ollama runs local LLMs like Llama and Mistral, Qdrant stores vectors at high performance, Open WebUI offers ChatGPT-style model interaction, and LiteLLM proxies requests to any provider with cost tracking. Langfuse automatically logs traces for every LiteLLM query, providing full observability. Each project maintains isolated Postgres schemas preventing data collision across parallel stacks. Firecrawl and Crawl4AI extract web content into LLM-ready formats for RAG pipelines feeding LightRAG or Qdrant. Dozzle streams live container logs for debugging. Import/export tooling migrates workflows between projects with automatic credential reconfiguration. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Deploy
ScribeWizard screenshot thumbnail

ScribeWizard

Audio lectures become structured, Markdown-formatted notes in about a minute with ScribeWizard (also known as GroqNotes). Upload an MP3, WAV, or M4A file - or paste a YouTube link - and the app runs a three-stage pipeline on Groq's LPU inference hardware: Whisper Large v3 transcribes the audio, a larger Llama model drafts a comprehensive outline of the material, and a faster Llama model fills each section with detailed content. This scaffolded prompting strategy is the core idea: the strong model handles structure where quality matters most, the fast model handles volume, and Groq's 1200+ tokens-per-second inference keeps the whole process near real time. Output renders as clean Markdown with support for tables and code blocks, and finished notes download as text or PDF. Model selection is configurable - swap in other Groq-hosted open models like Mixtral or Gemma to trade speed against quality or work around rate limits. Built as a single Streamlit app by Benjamin Klieger at Groq, it needs only a Groq API key to run, making it one of the simplest self-hosted AI tools to operate.

Deploy
DispatchMail screenshot thumbnail

DispatchMail

DispatchMail is an SuperHuman alternative and delivers a self-hosted AI email assistant that processes your Gmail inbox through configurable OpenAI prompts without sending data to third-party cloud services beyond the LLM API itself. The Flask backend connects to Gmail via IMAP, retrieves new messages according to your schedule, and routes them through customizable whitelist rules based on sender address, subject keywords, or natural language descriptions before AI processing begins. Two distinct prompt configurations control behavior — the Reading Prompt instructs how the AI should analyze and classify incoming messages, while the Draft Prompt defines how responses should be composed, letting you maintain consistent tone and policy across all automated replies. Whitelist filtering ensures the AI only processes messages you explicitly authorize, preventing unnecessary API costs and keeping sensitive emails out of the LLM pipeline entirely. The React web interface provides inbox management with message previews, AI-generated summaries, draft editing with human-in-the-loop approval before sending, and configuration panels for prompts and rules. Automatic labeling and archival organize processed messages into categories without manual intervention. The sender research feature uses LLM-powered deep analysis to build background profiles of email contacts. All email content, credentials, and processing results persist in a local SQLite database with zero cloud storage dependencies. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Deploy