Supported Models

GroqCloud currently supports the following models:

LLaMA2 70b

  • Model ID: llama2-70b-4096
  • Developer: Meta
  • Context Window: 4,096 tokens
  • Model Card:

Mixtral 8x7b

  • Model ID: mixtral-8x7b-32768
  • Developer: Mistral
  • Context Window: 32,768 tokens
  • Model Card:

Gemma 7b

  • Model ID: gemma-7b-it
  • Developer: Google
  • Context Window: 8,192 tokens
  • Model Card:

These are chat type models and are directly accessible through the GroqCloud Models API endpoint using the model IDs mentioned above.