Meta Llama 3.1 8B Instruct is a efficient model from DeepInfra with a 0 context window, supporting function calling. Available through ANT's unified API.
Total Requests
0
P50 Latency
320ms
P95 Latency
1000ms
Selection Rate
0.0%
of eligible requests
Intelligence Score
50/100
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="deepinfra/meta-llama/Meta-Llama-3.1-8B-Instruct",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)