Sparse Llama 3.1 8B Ultrachat 200k 2of4 is a efficient model from Featherless with a 33K context window, supporting function calling. Available through ANT's unified API.
Limited routing data available for Sparse Llama 3.1 8B Ultrachat 200k 2of4. Intelligence insights will appear as more requests are routed through ANT.
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="featherless/neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)