FreeLLMAPI is a free, open-source LLM API that routes across every provider with a real free tier. The Groq models below are on the free tier of Groq — reachable through one OpenAI-compatible key, with automatic failover when a provider hits its rate limit.
Free Groq models (9)
| Model | Context | Free limits | Capabilities |
|---|---|---|---|
| qwen/qwen3.8-27b | 262K | 30 rpm, 250 rpd | tools, vision |
| openai/gpt-oss-120b | 131K | 30 rpm, 1000 rpd | tools |
| openai/gpt-oss-20b | 131K | 30 rpm, 1000 rpd | tools |
| openai/gpt-oss-safeguard-20b | 131K | 30 rpm, 1000 rpd | tools |
| allam-2-7b | 4K | 30 rpm, 1000 rpd | — |
| meta-llama/llama-prompt-guard-2-22m | 512 | 30 rpm, 14400 rpd | — |
| meta-llama/llama-prompt-guard-2-86m | 512 | 30 rpm, 14400 rpd | — |
| whisper-large-v3-turbo | — | 30 rpm, 1000 rpd | — |
| whisper-large-v3 | — | 30 rpm, 1000 rpd | — |
How to use Groq for free
- Install FreeLLMAPI — the open-source router (GitHub). It runs locally and keeps your keys on your machine.
- Add a free key for Groq on the Keys page — no credit card required.
- Point your OpenAI client at the local endpoint and pick a model:
from openai import OpenAI
# FreeLLMAPI runs locally; grab your unified key + endpoint on the Keys page.
client = OpenAI(base_url="http://localhost:3001/v1", api_key="freellmapi-...")
resp = client.chat.completions.create(
model="openai/gpt-oss-120b",
messages=[{"role": "user", "content": "Hello!"}],
)
print(resp.choices[0].message.content)
Use every one of these through one key. FreeLLMAPI is an open-source, self-hosted router that puts all these free tiers behind a single OpenAI-compatible endpoint and fails over when one is rate-limited. Browse the catalog or go live.
Frequently asked questions
Is the Groq API really free?
Yes — these Groq models run on genuine provider free tiers (on the free tier of Groq). Inference costs nothing; you only add a free provider key.
Do I need a credit card?
No. The providers here offer free tiers that work without a card. You add the free key once and FreeLLMAPI routes to it.
How do I call Groq through FreeLLMAPI?
Install the open-source router, add the provider's free key on the Keys page, then point any OpenAI SDK at your local endpoint — see the code sample above.