Llama2 7b Chat 5g is a efficient model from Featherless with a 4K context window, supporting function calling. Available through ANT's unified API.
Limited routing data available for Llama2 7b Chat 5g. Intelligence insights will appear as more requests are routed through ANT.
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="featherless/SachinKaushik/llama2-7b-chat-5g",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)