Compound

groq/compound

Try it in Playground

TOKEN SPEED

~450 tps

Powered bygroq

INPUT

Text

OUTPUT

Text

CAPABILITIES

Web Search, Code Execution, Visit Website, Browser Automation, Wolfram Alpha, JSON Object Mode

Groq

Groq's Compound system integrates OpenAI's GPT-OSS 120B and Llama 4 models with external tools like web search and code execution. This allows applications to access real-time data and interact with external environments, providing more accurate and current responses than standalone LLMs. Instead of managing separate tools and APIs, Compound systems offer a unified interface that handles tool integration and orchestration, letting you focus on application logic rather than infrastructure complexity.

Rate limits for groq/compound are determined by the rate limits of the individual models that comprise them.

This system should not be used by customers for processing protected health information as it is not a HIPAA Covered Cloud Service under Groq's Business Associate Addendum at this time. This system is also not available currently for use with regional / sovereign endpoints.

---

PRICING

Underlying Model Pricing (per 1M tokens)

Pricing (GPT-OSS-120B)

Input

$0.15

Output

$0.60

Pricing (Llama 4 Scout)

Input

$0.11

Output

$0.34

Built-in Tool Pricing

Basic Web Search

$5 / 1000 requests

Advanced Web Search

$8 / 1000 requests

Visit Website

$1 / 1000 requests

Code Execution

$0.18 / hour

Browser Automation

$0.08 / hour

Wolfram Alpha

Based on your API key from Wolfram, not billed by Groq

Final pricing depends on which underlying models and tools are used for your specific query. See the Pricing page for more details or the Compound page for usage breakdowns.

---

LIMITS

CONTEXT WINDOW

131,072

---

MAX OUTPUT TOKENS

8,192

---

QUANTIZATION

This uses Groq's TruePoint Numerics, which reduces precision only in areas that don't affect accuracy, preserving quality while delivering significant speedup over traditional approaches. Learn more here.

Key Technical Specifications

Best Practices

• Use system prompts to improve steerability and reduce false refusals. Compound is designed to be highly steerable with appropriate system prompts.
• Consider implementing system-level protections like Llama Guard for input filtering and response validation.
• Deploy with appropriate safeguards when working in specialized domains or with critical content.
• Compound should not be used by customers for processing protected health information. It is not a HIPAA Covered Cloud Service under Groq's Business Associate Addendum for customers at this time.

Quick Start

Experience the capabilities of groq/compound on Groq:

pip install groq

from groq import Groq
client = Groq()
completion = client.chat.completions.create(
    model="groq/compound",
    messages=[
        {
            "role": "user",
            "content": "Explain why fast inference is critical for reasoning models"
        }
    ]
)
print(completion.choices[0].message.content)