Intelligent OpenAI API proxy router. Multi-platform load balancing, automatic circuit breaker recovery, SSE streaming, token quota management — one-line config to connect, seamless SDK compatibility.
Enterprise-grade proxy capabilities for OpenAI API, ready to use out of the box
Support any OpenAI-compatible platform with weighted load balancing and automatic failover
Full support for Chat Completions / Completions streaming and non-streaming proxy
Flexible key distribution, quota control, plan templates and usage tracking
Automatic circuit breaker recovery, platform-level RPM/TPM rate limiting for system stability
Detailed request logs, token usage statistics, audit logs and system events
Standard /v1 path, compatible with OpenAI SDK, just modify base_url to connect
Just modify base_url to connect, seamless SDK compatibility
import OpenAI from 'openai';
const client = new OpenAI({
baseURL: 'https://your-domain.com/v1',
apiKey: 'sk-your-api-key',
});
const response = await client.chat.completions.create({
model: 'gpt-4o',
messages: [{ role: 'user', content: 'Hello!' }],
stream: true,
});
for await (const chunk of response) {
process.stdout.write(chunk.choices[0]?.delta?.content || '');
}Set DATABASE_URL, JWT_SECRET, ADMIN and other environment variables
docker-compose up -d for one-click startup with automatic database initialization
Add upstream platforms and API Keys in the admin panel, modify base_url in your SDK to connect