Llama2 8200 1p Bf16 Shard is a efficient model from Featherless with a 4K context window. Available through ANT's unified API.
Limited routing data available for Llama2 8200 1p Bf16 Shard. Intelligence insights will appear as more requests are routed through ANT.
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="featherless/jonsmith/llama2-8200-1p-bf16-shard",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)