LiteLLM is the most representative open-source project in the AI gateway space, currently supporting over 100 model providers and offering features such as semantic caching, request logging, cost tracking, and fallback retry.