Llama 3.1 8B Instruct is a efficient model from Friendli with a 131K context window, supporting function calling. Priced at $0.000100/1K input, $0.000100/1K output.
Total Requests
0
P50 Latency
480ms
P95 Latency
1500ms
Selection Rate
0.0%
of eligible requests
Intelligence Score
50/100
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="friendli/meta-llama-3.1-8b-instruct",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)