colibri
colibri lets you run huge open language models, including ones with hundreds of billions of parameters, on the computer you already own by keeping only the parts a model needs for each token in fast memory. Thirteen engines cover chat models such as GLM-5.2, DeepSeek V4 Flash, Qwen3.6, Kimi K3, and Mistral-Large-4, the Qwen-Image-2.1 picture generator, and small decision models. A one-step setup checks your RAM, disk, and graphics card, recommends a model that fits, downloads it with resume, and opens the dashboard. It runs on the CPU alone, on any Vulkan GPU, on NVIDIA cards through CUDA, and on Apple Silicon through Metal for several engines, and it reads published GGUF files as they are. One server speaks the OpenAI and Anthropic APIs, so Claude Code, coding CLIs, and SDKs connect with a base URL, and it adds tool calling, image and document input, and up to 16 simultaneous conversations. The browser dashboard has a chat with folded reasoning, an expert map, a live monitor, a profiling page, and a System One page that returns a probability for every allowed answer. A built-in MCP server lets an AI assistant detect hardware, install, start, and stop colibri. Running on a dedicated VPS on RepoCloud with guaranteed CPU, RAM, and SSD, full root SSH access, and a browser serial console. Apache-2.0 licensed.
Deploy