Groq

Factory Droid + Groq

Factory Droid is Factory.ai's autonomous engineering agent. Pair it with Groq's LPU inference to get low-latency code generation while keeping your Groq API key on-device via Bring Your Own Key (BYOK).

Prerequisites

Setup

  1. Configure Groq Provider
    Add Groq models to your Factory configuration:
    Edit your Factory config file and add your Groq model definitions:
    • macOS/Linux: ~/.factory/config.json
    • Windows: %USERPROFILE%\.factory\config.json
    JSON
    {
      "custom_models": [
        {
          "model_display_name": "Kimi K2 [Groq]",
          "model": "moonshotai/kimi-k2-instruct-0905",
          "base_url": "https://api.groq.com/openai/v1",
          "api_key": "YOUR_GROQ_KEY",
          "provider": "generic-chat-completion-api",
          "max_tokens": 16384
        },
        {
          "model_display_name": "GPT-OSS 120b [Groq]",
          "model": "openai/gpt-oss-120b",
          "base_url": "https://api.groq.com/openai/v1",
          "api_key": "YOUR_GROQ_KEY",
          "provider": "generic-chat-completion-api",
          "max_tokens": 65536
        }
      ]
    }
  2. Start Coding
    Inside the CLI run /model and choose the Groq model you added under Custom models. You can now use Factory Droid with Groq's low-latency inference.

Factory recommends models with at least 30B parameters when shipping production-critical changes.

Learn More

Was this page helpful?