Product
LLM-Blender
An open-source large language model ensemble framework that supports merging and routing across outputs from multiple LLMs, designed to optimize model selection and reduce inference costs.
Timeline (last 90 days)
Oct 12
Cost per completed task should be measured rather than cost per token, on the premise that the runtime actively performs model routing.
Unverified50%