LiteLLM

LiteLLM is a self-hosted AI gateway and LLM proxy that sits between your apps and model providers. You point clients at one OpenAI-compatible endpoint, an