Documentation

Supported Models

GroqCloud currently supports the following models:

LLaMA2 70b

  • Model ID: llama2-70b-4096
  • Developer: Meta
  • Context Window: 4,096 tokens
  • Model Card: https://huggingface.co/meta-llama/Llama-2-70b

Mixtral 8x7b

  • Model ID: mixtral-8x7b-32768
  • Developer: Mistral
  • Context Window: 32,768 tokens
  • Model Card: https://huggingface.co/mistralai/Mixtral-8x7B-Instruct-v0.1

Gemma 7b

  • Model ID: gemma-7b-it
  • Developer: Google
  • Context Window: 8,192 tokens
  • Model Card: https://huggingface.co/google/gemma-1.1-7b-it

These are chat type models and are directly accessible through the GroqCloud Models API endpoint using the model IDs mentioned above.