Compound-beta is a compound AI system powered by multiple openly available models already supported in GroqCloud to intelligently and selectively use tools to answer user queries, starting first with web search and code execution.

Try now on Groq

Key Technical Specifications

Technical Details

FEATURE	VALUE
Context Window (Tokens)	128K
Max Output Tokens	8,192
Max File Size	N/A
Token Generation Speed	350 tokens per second
Input Token Price	Varies. Pricing is based on input tokens to underlying models (while in preview)
Output Token Price	Varies. Pricing is based on output tokens from underlying models (while in preview)
Tool Use
Agentic Tooling
JSON Mode
Image Support

Best Practices

• Use system prompts to improve steerability and reduce false refusals. Compound-beta is designed to be highly steerable with appropriate system prompts.
• Consider implementing system-level protections like Llama Guard for input filtering and response validation.
• Deploy with appropriate safeguards when working in specialized domains or with critical content.
• Compound-beta should not be used by customers for processing protected health information. It is not a HIPAA Covered Cloud Service under Groq's Business Associate Addendum for customers at this time.

Quick Start

Experience the capabilities of compound-beta on Groq:

pip install groq

from groq import Groq
client = Groq()
completion = client.chat.completions.create(
    model="compound-beta",
    messages=[
        {
            "role": "user",
            "content": "Explain why fast inference is critical for reasoning models"
        }
    ]
)
print(completion.choices[0].message.content)