New API
An open-source API gateway and quota management project used to centrally manage and forward the APIs of multiple large models, offering features such as quota control and load balancing.
Timeline (last 90 days)
In the demonstration, the New API system that Codex reproduced using natural language was roughly on par with common projects on the market, showing that it can reproduce the main architecture, but configuration details, edge-case handling, and code standards still require manual proofreading.
All Facts (8)
New API通过Docker部署，默认使用3000端口提供Web管理界面
90%UnverifiedNew API的流式响应基于HTTP的Server-Sent Events（SSE）协议实现
85%Unverified在LLM API聚合管理领域，类似New API的开源项目还有One API、Chat Nio等，已形成一个小型生态
80%UnverifiedNew API支持多租户架构，每个注册用户拥有独立的API Key、独立的额度余额和独立的使用记录
60%UnverifiedNew API支持渠道优先级和权重配置，当某个供应商出现故障或额度耗尽时可自动切换到备用渠道
60%UnverifiedThe New API small-scale operation configuration (2 CPU cores, 4 GB RAM, 40 GB hard drive with MySQL and Redis) can handle approximately 30 to 100 concurrent users and tens to hundreds of requests per minute
60%UnverifiedThe minimum self-hosted configuration requirement for New API is 1 CPU core and 1 GB of RAM
60%UnverifiedIn the demonstration, the New API system that Codex reproduced using natural language was roughly on par with common projects on the market, showing that it can reproduce the main architecture, but configuration details, edge-case handling, and code standards still require manual proofreading.
50%