GPUStack is a control plane that turns a pile of GPU servers into a model-serving platform, where you pick a model from a catalog and the system decides which machine, engine, and settings run it. Deploy language, embedding, reranker, speech, and image models from the Catalog page, then watch each replica move from downloading to Running on the Deployments screen. A built-in Playground offers chat, side-by-side model comparison, embedding and rerank testing, audio, and image generation and editing, so a model gets judged before it is wired into an app. Add GPU workers with a generated Docker command, register a Kubernetes cluster, or provision cloud machines, and manage several clusters from one server. Create API keys for teammates, apply access control, and read token, GPU-hour, and storage usage by user, key, or model. Auto Tune benchmarking searches for the highest throughput that still meets your latency targets. GPU Instances hand out SSH-accessible machines for fine-tuning and interactive work. Single sign-on works through OIDC or SAML. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

Your inference server should not sit mostly idle while a model crawls along at ten tokens per second, so ReadyLLM gives you a visual way to deploy, watch, and tune LLMs until the hardware is actually earning its keep. Add the machine under your desk or a remote box over SSH, let hardware detection read its GPU, VRAM, CPU, and memory, and get model recommendations that fit what you own instead of wishful downloads. A model store catalogs text, image, and video models with parameter counts, precision, resolutions, and real weight filenames, background downloads from multiple sources, and integrity checks when they land. One click starts or stops llama.cpp, vLLM, or SGLang services, installs a missing engine matched to your GPU backend, and leaves runtime parameters open for manual tweaks. Live curves track GPU utilization, memory, throughput, and latency as requests flow. When speed disappoints, two-phase auto tuning searches the knobs that matter, checks VRAM feasibility before it wastes your time, and benchmarks honestly against latency, throughput, or prefill goals; an AI tuning mode can reason through the same loop across several rounds. Beyond chat models, ComfyUI generation covers text-to-image and text-to-video, storyboards, shot-by-shot long video, and upscaling, with prompts optionally expanded first. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Training runs stop being terminal scrollback and become a board you can read at a glance. SwanLab is an open-source experiment tracking and visualization platform for AI model training that records metrics, hyperparameters, logs, and hardware signals from your training code into a modern web dashboard you can self-host. A few lines of Python start an experiment, and the dashboard follows loss curves, learning rates, and custom scalars live, with line chart configuration, smoothing, grouping, and detailed hover inspection for comparing runs. Experiments organize into projects and groups with tags, pinning, filtering, and a table view that sorts and aligns runs against a baseline with difference percentages. Media logging goes far beyond scalars: images, audio, video, text with Markdown rendering, 3D point clouds, molecular structures, and custom ECharts visualizations including PR curves, ROC curves, and confusion matrices. Hardware monitoring records GPU, CPU, memory, disk, and network behavior from NVIDIA, AMD, Ascend, and other accelerators alongside the metrics they produced. Integrations cover more than fifty frameworks, from PyTorch Lightning and Hugging Face Transformers to LLaMA Factory, veRL, and XGBoost, and existing histories migrate in through sync tools for MLflow, TensorBoard, and Weights and Biases. Teams collaborate with organizations, roles, project sharing, webhooks, and notification plugins. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Trusted by thousands of organizations with over 30 million monthly downloads and 20,000+ GitHub stars, MLflow is the largest open-source AI engineering platform providing end-to-end lifecycle management for traditional ML models, LLMs, and AI agents. The OpenTelemetry-based tracing system captures complete request flows through any LLM provider or agent framework — including OpenAI, LangChain, DSPy, Vercel AI, PydanticAI, and smolagents — with one-line auto-instrumentation that tracks inputs, outputs, token usage, and costs at every intermediate step. MLflow's evaluation engine offers 50+ built-in metrics and LLM judges for systematic quality assessment, detecting issues across correctness, latency, adherence, relevance, and safety dimensions before code reaches production. The Prompt Registry versions, tests, and deploys prompts with full lineage tracking while automated optimization algorithms improve prompt performance using evaluation feedback. The AI Gateway provides a unified API endpoint for all LLM providers, enforcing rate limits, cost controls, and access policies across the organization. MLflow 3.0 introduces the LoggedModel abstraction linking traces, metrics, and prompts to specific model versions across Python, TypeScript, Java, and R SDKs. The model registry manages deployment workflows with automated quality gates, while experiment tracking records parameters, metrics, and artifacts across training runs. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache License 2.0 licensed.

Xinference lets a team swap a hosted model API for models running on its own machines, with the same client code and a web console for managing them. The Launch Model page lists 300+ models across language, vision, embeddings, reranking, images, audio, video, and experimental world generation, and a Recommend configuration button fills in engine, size, format, and quantization for your hardware. Custom models, including traditional machine learning models, can be registered beside the built-in ones. Chat models can run on vLLM, SGLang, TRT-LLM, Transformers, llama.cpp, or MLX across CPUs, GPUs, and Apple Silicon. Workers and replicas can be added to serve one large model across several machines. Running Models shows each replica and a built-in chat window, and Performance Tests measure throughput and latency at several concurrency levels, with saved runs to compare. Endpoints speak the OpenAI and Anthropic protocols with streaming and tool calling where a model supports it. API keys, user management, and an audit center cover access control. The interface is available in five languages. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

OpenLLM serves any large language model as an OpenAI-compatible API endpoint from a single CLI command, handling model download, backend selection, quantization, and port binding automatically. It supports the full spectrum of popular models including Llama 3.3, Qwen2.5, DeepSeek, Mistral, and Phi3, choosing between vLLM and PyTorch inference backends based on hardware capabilities. When vLLM is available, continuous batching with PagedAttention achieves up to 23x throughput improvement over naive serving, while GPTQ and bitsandbytes quantization reduces memory requirements for GPU-constrained deployments. The server exposes a RESTful API on port 3000 with full OpenAI client library compatibility, enabling drop-in replacement for commercial providers in any application using the standard chat completions format. A built-in web chat UI at the /chat endpoint provides immediate interactive testing without external clients. Custom model repositories allow teams to maintain private catalogs of fine-tuned models alongside the default repository that tracks the latest releases. Deployment workflows generate production-ready Docker images automatically, with Kubernetes manifest support for orchestrated scaling. Native integration with LangChain and LlamaIndex supports RAG pipelines, Transformers Agents enables tool-calling workflows, and HuggingFace Hub handles model discovery. Server-Sent Events enable real-time token streaming across all API endpoints. Backed by BentoML's production ML infrastructure. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache 2.0 licensed.

With over 48,000 GitHub stars and monthly releases since March 2023, LocalAI is the self-hosted AI engine that replaces every OpenAI endpoint with a single Docker container running on your own infrastructure — serving chat completions, image generation, text-to-speech, speech-to-text, embeddings, vision, video generation, and function calling through identical API schemas that require zero application code changes. The composable backend architecture isolates each inference engine as a separate gRPC service running in its own OCI container, so llama.cpp, vLLM, SGLang, transformers, whisper.cpp, diffusers, MLX, Stable Diffusion, and Flux install on demand without touching the core, can run on separate machines, and a fault in one never affects others. Hardware acceleration spans NVIDIA CUDA 12 and 13, AMD ROCm, Intel oneAPI/SYCL, Apple Silicon Metal, Vulkan, and NVIDIA Jetson L4T — or runs entirely on CPU without any GPU. Built-in AI agents support autonomous tool use, retrieval-augmented generation, Model Context Protocol integration, and skill-based workflows directly in the web interface. The model gallery provides curated YAML configuration files for hundreds of models that install with a single command, while P2P federated inference distributes model shards across multiple machines for running models larger than any single node's memory. Multi-user API key authentication with quotas and role-based access enables team deployments. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Open-weight language models get a private chat service on your own server, and llama.cpp serves its browser UI the moment the server starts. Conversations appear in a sidebar with search, and each answer shows its token count, generation time, and tokens per second, so you can see how a model really performs. Code replies render in highlighted blocks with a copy button, and messages can be edited, regenerated, forked, or deleted. A Models page lists what the server can run with context sizes and load status, and Settings cover themes, system messages, display options, tools, agentic behavior, import and export, and sampling controls for temperature, top K, top P, and penalties. Remote MCP servers connect by URL, and uploads let multimodal models read files and images. Behind the UI sit OpenAI and Anthropic compatible chat endpoints, embeddings, reranking, function calling, JSON schema constrained output, parallel decoding, and continuous batching for several users at once. Quantized models run on plain CPUs, and official images cover CUDA, ROCm, Vulkan, and other accelerators. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Your prompts never have to leave the building: TextGen runs open large language models on your own hardware behind a chat interface and an API that speak fluent OpenAI. Load GGUF or Hugging Face weights through llama.cpp, ik_llama.cpp, Transformers, ExLlamaV3, or TensorRT-LLM, and switch models or backends from the interface without restarting the server. Chat mode gives you conversations with characters and system prompts, notebook mode behaves like a familiar completion editor, and both accept image attachments for vision models and documents for context. Models that support tool calling can search the web, fetch pages, and do math through single-file Python tools, and MCP servers plug in for larger tool catalogs. Start it with the API flag and the same model answers at chat, completions, and messages endpoints that mirror OpenAI and Anthropic, complete with streaming, logprobs, embeddings, and optional API key authentication. Portable builds for Linux, Windows, and macOS bundle every dependency, so the distance from download to a running model is an unzip and one shell command. Because everything is local, prompts, documents, and outputs stay on machines you control, and parallel request handling lets a single loaded model serve a whole team's tools at once. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.

Imp runs large AI chat models privately on one NVIDIA RTX 50 or RTX PRO graphics card, exposing them through OpenAI and Anthropic compatible APIs plus a built-in browser chat. Start it with a single Docker command, point it at a model, and the chat opens in your browser with saved conversations and a live readout of generation speed. Coding agents such as Claude Code and Codex connect by changing one base URL, so your editor talks to the model on your own hardware instead of a rented cloud endpoint. Tool calls, structured JSON output, streaming responses, and reasoning models all work over the wire, and requests can be protected with an API key, per-IP rate limits, and concurrency caps. Load GGUF files you already have or NVFP4 and FP8 SafeTensors checkpoints straight from Hugging Face with no conversion step before the first answer. When a model is bigger than the card, mixture-of-experts weights stay in system RAM while the busiest experts are cached on the GPU, so a 123.6 GiB model still answers from a 32 GB card. Supported models can also read images alongside text, and tokenize, health, and model listing endpoints make the server easy to wire into scripts and monitors. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Before a language model learns from your data, someone has to label it well; Argilla gives AI engineers and domain experts a shared workspace to label, review, and refine the datasets that fine-tune language models and train NLP pipelines. You build each dataset from the Python SDK, mixing text, chat, and image fields with the exact questions your task needs: single-label classification for intent detection, span questions for named entities, ratings for response quality, rankings for preference tuning, or free text for corrections. Annotators then work through records in a focused labeling interface where model predictions already sit attached as suggestions, turning most reviews into a fast confirm-or-correct decision instead of a blank-page exercise. Full-text search, metadata filters, and status filters slice a hundred thousand records down to the ones needing attention, while vector-based semantic search finds lookalike examples, near-duplicates, and the disagreement hotspots where guidelines need sharpening. Dataset owners watch completion progress, manage who has responded to what, and split work across workspaces with owner, admin, and annotator roles for each team or client. Finished datasets export with responses, suggestions, and metadata intact, locally or straight to the Hugging Face Hub, ready for fine-tuning and evaluation runs. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.

Images, text, audio, video, HTML, PDFs, and time series, labeled in one tool with a standardized output format: Label Studio is the open-source data labeling platform for building training datasets. Computer vision tasks cover classification, object detection (boxes, polygons, ellipses, keypoints), and semantic segmentation; audio work spans transcription, speaker diarization, and emotion recognition; NLP handles named entity recognition and document classification with taxonomies up to 10,000 classes; and GenAI workflows support LLM fine-tuning data and RLHF response ranking. Labeling interfaces are fully configurable with an XML-like templating language, so the UI matches the task instead of the reverse. The ML backend SDK turns any model into a connected web server for pre-annotation (model predicts, humans verify), interactive labeling (real-time predictions as annotators draw regions or highlight text), and model evaluation - cutting annotation time dramatically on large datasets. Data imports from S3, GCS, or file uploads; the Data Manager filters and explores tasks; exports convert to the format your ML library expects via label-studio-converter. Multi-user accounts tie every annotation to its author, and webhooks, a Python SDK, and REST API embed labeling into any pipeline. Self-hosting keeps proprietary training data - often a company's most sensitive asset - entirely on your infrastructure.

Doccano is a text annotation platforms for building machine learning training datasets. The web-based interface supports text classification for sentiment analysis and document categorization, sequence labeling for named entity recognition with overlapping entity support and relation extraction between labeled spans, and sequence-to-sequence annotation for text summarization and machine translation pairs. Collaborative annotation enables multiple annotators to work on the same project simultaneously with per-user progress tracking, annotation guidelines, example assignment to specific members, and filtering by assignee. Auto-labeling integrates with external machine learning model APIs through configurable request and response mapping templates, allowing pre-annotation that annotators can review and correct. Data import accepts plain text, JSONL, CoNLL, and Excel formats, while export produces JSONL and CoNLL datasets compatible with spaCy, Hugging Face Transformers, PaddleNLP, and other training frameworks through the doccano-transformer library. The Django backend with Django REST Framework exposes a complete RESTful API for programmatic project creation, dataset management, and annotation retrieval via the official doccano-client Python library. Celery handles background tasks including dataset import and export processing with Flower providing task monitoring. One-click deployment supports AWS CloudFormation and Heroku alongside Docker Compose for self-hosted environments. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

With over 126,000 GitHub stars and adoption across professional studios, research labs, and independent creators, ComfyUI has become the most widely used node-based interface for generative AI workflows — supporting image, video, audio, and 3D content creation through a single visual canvas. The graph editor natively supports Stable Diffusion 1.5, SDXL, SD3.5, Flux.1, Flux.2, HunyuanDiT, Lumina Image 2.0, HiDream, Qwen Image, and Pixart for image generation, plus Wan 2.1 and 2.2, LTX-Video, HunyuanVideo 1.5, CogVideoX, and Mochi for video, ACE-Step and Stable Audio for audio, and Hunyuan3D 2.0 for 3D models. Built-in tools handle inpainting, outpainting, ControlNet conditioning, LoRA and Hypernetwork loading, ESRGAN upscaling, area composition, model merging, and GLIGEN spatial control without writing code. The execution engine implements asynchronous queue processing with partial graph re-execution, running only changed nodes between iterations, and smart VRAM management that offloads models on GPUs with as little as 1 GB of memory. API nodes optionally connect to closed-source models through Comfy API while the core runs fully offline. Reusable subgraphs and App Mode expose complex workflows as simplified interfaces for non-technical users. The V3 custom node schema enables stateless execution with async support and process isolation. The TypeScript and Vue frontend ships as a PyPI package with stable releases every two weeks. Workflows save as JSON and embed in generated PNG, WebP, and FLAC files for reproducibility. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. GPL v3.0 licensed.

Chat with your own local language models from a clean, fast browser interface. Ollama GUI gives every model on your Ollama server a proper home: streaming replies you can stop, regenerate, or edit, with each edit saved as a version you can flip back to. Reasoning models show their thinking in a collapsible block, and you pick between thinking on, off, or an effort level. Attach images for vision models or drop in text and code files, and answers render with highlighted code, tables, and math. Pull models from a searchable catalog with live progress, check their capabilities and context length, unload them from memory, or delete them in a click. Chats are grouped by date, pinned, archived, renamed, titled automatically, and searched across every message from a command palette. System prompts and generation settings apply globally, per model, or per chat. Light and dark themes, locale-aware dates, and JSON or Markdown export round out the daily routine. Run one shared front end for a whole team or homelab, and every browser keeps its own private history. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. MIT licensed.

Large language models get a polished front end that can run fully offline: Open WebUI is the self-hosted front end of choice. It talks to local model runners, primarily Ollama, and to any OpenAI-compatible API, so LM Studio, vLLM, Groq, Mistral, OpenRouter, and cloud providers all plug into the same chat interface and can be mixed per conversation. RAG is built in: upload files to knowledge bases or reference them in chat with the # command, backed by a choice of nine vector databases (ChromaDB and PGVector officially maintained) and multiple extraction engines including Tika and Docling, with hybrid BM25-plus-vector search and cross-encoder reranking. Web search results from providers like SearXNG, Brave, and Tavily inject directly into conversations. Extensibility comes from Python tools and functions that run inside the chat, a Pipelines plugin framework, and native MCP support. Multi-user features include RBAC, SSO, and group permissions, and the instance itself exposes an OpenAI-compatible API your own apps can call.