KoboldCpp
One file runs your own language model and serves it to any browser tab. KoboldCpp loads GGUF models on CPU or GPU. A web UI opens on port 5001. OpenAI, Ollama, Anthropic, and KoboldAI style endpoints answer every app that expects a cloud API. The bundled KoboldAI Lite interface covers chat, instruct, story, and adventure modes in Classic, Messenger, Aesthetic, and Corpo themes, with memory, world info, author's notes, character cards, scenarios, and saveable sessions. A llama.cpp style chat interface and interactive API documentation share the same port. Add a vision projector and the model reads images. Load Stable Diffusion, Flux, or video models for pictures and clips, Whisper for transcription, and Kokoro or Qwen3TTS for spoken replies. Tool calling, web search, retrieval over your own documents, an MCP bridge, and a built-in agent for editing code come included. Context size, GPU layers, batch size, and samplers including DRY and XTC are set from the launcher or the command line. A no-model option points it at a remote provider instead. An API key protects the endpoint before it faces a network. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. AGPL-3.0 licensed.
Deploy