LiteLLM 🚅

LiteLLM provides a unified interface to call hundreds of LLMs using the same Input/Output format, allowing for translation of inputs to providers' endpoints, consistent output, retry/fallback logic across multiple deployments for routing, and tracking for spending.

For more information, read the LiteLLM Groq integration documentation here.