Llama 3.1 8b Instruct Awq is a efficient model from Cloudflare with a 8K context window, supporting function calling. Available through ANT's unified API.
Total Requests
0
P50 Latency
320ms
P95 Latency
1000ms
Selection Rate
0.0%
of eligible requests
Intelligence Score
50/100
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="cloudflare/@cf/meta/llama-3.1-8b-instruct-awq",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)