agent-router
Developed by theagentrouter
Agent Router is an open-source control plane for AI and agent traffic, powered by Envoy. It offers application teams a consistent, OpenAI-compatible API to access diverse hosted or self-hosted AI models and tools. Platform teams can centralize management of credentials, routing, quotas, failover, and usage attribution for AI services. It employs a two-tier gateway architecture: Tier One handles authentication, global routing, and rate limiting, while Tier Two provides fine-grained control over self-hosted models and optimizes LLM inference. It supports a wide array of leading AI providers.
- Unified OpenAI-compatible API for diverse AI models and tools
- Centralized control plane for traffic, credentials, and policy management
- Envoy-powered routing, quotas, failover, and usage attribution
- Two-tier gateway architecture for global and fine-grained control
- Extensive support for leading AI service providers
desktop