OpenAI Compatibility

Groq's APIs are designed to be compatible with OpenAI's, with the goal of making it easy to leverage Groq in applications you may have already built. However, there are some nuanced differences where support is not yet available.

Text Completion

The following fields are not supported and will result in a 400 error if they are supplied:

logprobs

logit_bias

top_logprobs

If N is supplied, it must be equal to 1.

messages[].name The name field is not supported by any of our models.

Temperature

If you set a temperature value of 0, it will be converted to 1e-8. If you run into any issues, please try setting the value to a float32 > 0 and <= 2.

Audio Transcription and Translation

response_format values vtt and srt are not supported.

timestamp_granularities[] is not supported.

URL

The base_url is https://api.groq.com/openai/v1