LLama 2 7B is a efficient model from Featherless with a 4K context window. Available through ANT's unified API.
Limited routing data available for LLama 2 7B. Intelligence insights will appear as more requests are routed through ANT.
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="featherless/HaroldB/LLama-2-7B",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)