Documentation
Deprecation
Deprecation refers to the process of retiring older models or endpoints in favor of hosting better models with better capabilities for you to leverage. When we announce that a model or endpoint is being deprecated, we will provide a shutdown date on which the model or endpoint will no longer be accessible. As such, your applications relying on Groq may need occasional updates to continue working.
Once a model is announced as deprecated, make sure to migrate usage to a recommended replacement before the shutdown date to avoid failing requests. All API deprecations along with recommended replacements are listed below.
Deprecation History
December 20, 2024: Llama 3.1 70B
On December 6, 2024, in partnership with Meta, we released llama-3.3-70b-versatile
and notified users that we would deprecate llama-3.1-70b-versatile
in favor of hosting Llama 3.3 with significant
quality improvements for a better experience.
To facilitate a smooth transition, we will maintain the current llama-3.1-70b-versatile
until December 20, 2024. At that time, requests to this model ID will automatically upgrade to llama-3.3-70b-versatile
.
While this new model delivers improved quality, it may produce different responses than its predecessor. If you need to maintain exact response patterns, we recommend migrating to explicitly using
llama-3.3-70b-versatile
before December 20, 2024, for testing.
Model ID | Shutdown Date | Action | Recommended Replacement Model ID |
---|---|---|---|
llama-3.1-70b-versatile | 12/20/24 | Auto-upgrade to 3.3 | llama-3.3-70b-versatile |
December 18, 2024: Gemma 7B
On December 11, 2024, we emailed all Gemma 7B users that we would deprecate it in favor of keeping the Gemma 9B model as it offers better performance.
Model ID | Shutdown Date | Recommended Replacement Model ID |
---|---|---|
gemma-7b-it | 12/18/24 | gemma2-9b-it |
November 25, 2024: Llama 3.2 90B Text Preview
In November 2024, we emailed all Llama 3.2 90B Text Preview users that we would deprecate it in favor of hosting the Llama 3.2 90B Vision Preview model for vision capabilities.
Model ID | Shutdown Date | Recommended Replacement Model ID |
---|---|---|
llama-3.2-90b-text-preview | 11/25/24 | llama-3.2-90b-vision-preview llama-3.1-70b-versatile (text-only workloads) |
October 18, 2024: LLaVA 1.5 7B and Llama 3.2 11B Text Preview
In September 2024, we made Meta's Llama 3.2 vision models available on GroqCloud and emailed all LLaVA 1.5 7B and Llama 3.2 11B Text Preview users that we would deprecate it in favor of hosting Llama 3.2 11B Vision for better performance and more robust vision capabilities.
Model ID | Shutdown Date | Recommended Replacement Model ID |
---|---|---|
llava-v1.5-7b-4096-preview | 10/28/24 | llama-3.2-11b-vision-preview |
llama-3.2-11b-text-preview | 10/28/24 | llama-3.2-11b-vision-preview llama-3.1-8b-instant (text-only workloads) |