Groq
Ultra-fast LPU inference for open-source models
SpeedFree tierOpen modelsLow latencyOpenAI-compatible
About Groq
Groq operates custom LPU (Language Processing Unit) hardware that delivers the fastest inference speeds in the industry. They host popular open-source models like Llama and Gemma with sub-100ms latency. Groq's free tier makes them an excellent choice for latency-sensitive applications.
Key Models
Llama 4 ScoutGemma 4Qwen 3
Live Performance Data
Groq Models on Antbase
| Model | Score | Requests | Success Rate | Avg Latency | p95 Latency | Capabilities |
|---|---|---|---|---|---|---|
| DeepSeek-V3-0324 | 64.0 | 1 | 10000.0% | 494ms | 494ms | |
| Llama 4 Maverick | 64.0 | 1 | 10000.0% | 532ms | 532ms | |
| GPT-OSS 120B | 60.0 | 2 | 10000.0% | 1746ms | 2353ms |
How to Use Groq on Antbase
All Groq models are available through Antbase's unified OpenAI-compatible API. You can either route directly to a specific Groq model or let ANT's intelligent router automatically select the best model for your task.
python
from openai import OpenAI
client = OpenAI(
base_url="https://antbase.ai/v1",
api_key="your-ant-api-key",
)
# Let ANT auto-route (may use Groq if optimal)
response = client.chat.completions.create(
model="ant:auto",
messages=[{"role": "user", "content": "Hello!"}],
)
# Or route directly to a Groq model
response = client.chat.completions.create(
model="groq/llama-4-scout",
messages=[{"role": "user", "content": "Hello!"}],
)Why Use Groq Through Antbase?
- •No separate account needed — access Groq models instantly through your Antbase API key.
- •Intelligent routing — ANT automatically selects the best Groq model for each task, or falls over to another provider if Groq is slow or down.
- •Same token prices — Antbase charges zero markup on Groq token prices. You pay exactly what Groq charges.
- •Automatic failover — if Groq has an outage, your requests seamlessly route to an equivalent model on another provider.