Virtual Aggregation Provider
An abstraction layer built on top of multiple real model providers, exposing a unified API endpoint. It supports cross-provider model dispatching, load balancing, and strategies such as prioritizing the consumption of credits nearing expiration, enabling seamless orchestration across heterogeneous model providers through a single interface.
Timeline (last 90 days)
Open-source Hub has added a virtual aggregated Provider feature that abstracts a virtual layer on top of multiple real model providers, allowing users to schedule model resources from different providers on demand through a unified entry point.
The virtual aggregated Provider offers two working modes: AOTL Auto automatic scheduling mode and designated-model cross-provider aggregation mode.
Hub's virtual aggregated Provider is essentially a router that exposes a unified API endpoint to upstream callers while maintaining authentication information and scheduling policies for multiple real Providers on the downstream side.
All Facts (3)
The virtual aggregated Provider offers two working modes: AOTL Auto automatic scheduling mode and designated-model cross-provider aggregation mode.
50%UnverifiedHub's virtual aggregated Provider is essentially a router that exposes a unified API endpoint to upstream callers while maintaining authentication information and scheduling policies for multiple real Providers on the downstream side.
50%UnverifiedOpen-source Hub has added a virtual aggregated Provider feature that abstracts a virtual layer on top of multiple real model providers, allowing users to schedule model resources from different providers on demand through a unified entry point.
50%