Logo
Deploy Now

Categories

Self-Hosted Developer Tools AI LLM API Gateway Proxy Cost Management

Stars

46,184

Forks

10,968

Watchers

147

Developer links

Last Updated: 08-25-2026 05:58 AM (UTC)

New API

New API is a Go-powered LLM gateway that funnels over 40 AI providers, from OpenAI and Anthropic to Google Gemini, Azure, AWS Bedrock, DeepSeek, and Mistral, through a single OpenAI-compatible endpoint with intelligent routing and enterprise cost controls. Bidirectional format conversion translates between OpenAI Chat Completions, Claude Messages, and Gemini GenerateContent APIs transparently, so clients call any provider using their preferred format while the gateway handles the rest. Routing logic supports weighted random channel selection, priority-based failover, and automatic retry on provider errors to maximize uptime. The React admin dashboard shows usage charts, token consumption tracking, per-model cost breakdowns, and real-time request monitoring. Multi-tenant architecture includes three role levels, token-based authentication, per-user quota management, and a three-phase billing system with tiered pricing via a custom expression language. Multimodal support covers text completion, vision, embeddings, text-to-speech, speech-to-text, image generation, and creative task providers like Midjourney-Proxy and Suno-API. The interface ships in five languages including English, Chinese, Japanese, and French. Docker deployment runs with SQLite or MySQL for persistence. 45,000+ GitHub stars. AGPL-3.0 licensed.

New API
New API
New API
New API
New API

Benefits

  • Unified Gateway for 40+ Providers
  • Single OpenAI-compatible endpoint proxies requests to OpenAI, Anthropic, Google, Azure, AWS Bedrock, DeepSeek, Mistral, and 30+ additional AI providers with automatic discovery.
  • Bidirectional Format Conversion
  • Automatically converts between OpenAI Chat Completions, Claude Messages, and Gemini GenerateContent formats so clients and providers can use any combination.
  • Intelligent Load Balancing
  • Weighted random channel selection, priority-based routing, and automatic failover across multiple provider channels ensures maximum uptime and continuous cost optimization.
  • Enterprise Cost Management
  • Three-phase billing system with tiered pricing, per-user quota tracking, detailed token consumption analytics, and granular role-based access control across multi-tenant deployments.

Features

  • Visual Analytics Dashboard
  • React-based admin console shows usage charts, token consumption, per-model cost breakdowns, channel health, and real-time request monitoring.
  • Multi-Provider Channel Management
  • Configure upstream provider channels with API keys, base URLs, model mappings, priority levels, and weight distributions from the web UI.
  • Multimodal API Support
  • Handles text, vision, embeddings, TTS, STT, image generation, and creative task providers including Midjourney-Proxy and Suno-API integrations.
  • Token-Based Authentication
  • Issue API tokens with per-token model permissions, rate limits, IP restrictions, and expiration dates for fine-grained access control.
  • Multi-Language Interface
  • Admin dashboard available in five languages including English, Simplified Chinese, Traditional Chinese, Japanese, and French.