Documentation

OpenAI Compatibility

Groq's APIs are designed to be compatible with OpenAI's, with the goal of making it easy to leverage Groq in applications you may have already built. However, there are some nuanced differences where support is not yet available.

Text Completion

The following fields are not supported and will result in a 400 error if they are supplied:


logprobs

logit_bias

top_logprobs


If N is supplied, it must be equal to 1.

Temperature

If you set a temperature value of 0, it will be converted to 1e-8. If you run into any issues, please try setting the value to a float32 > 0 and <= 2.

URL

The base_url is https://api.groq.com/openai/v1