Llama 3 8B Instruct Gradient 4194k is a efficient model from Featherless with a 8K context window, supporting function calling. Available through ANT's unified API.
Total Requests
1
Success Rate
100%
P50 Latency
8167ms
P95 Latency
8167ms
Selection Rate
0.0%
of eligible requests
Intelligence Score
49/100
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="featherless/gradientai/Llama-3-8B-Instruct-Gradient-4194k",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)