RoLlama3.1 8b Instruct 2024 10 09 is a efficient model from Featherless with a 33K context window, supporting function calling. Available through ANT's unified API.
Limited routing data available for RoLlama3.1 8b Instruct 2024 10 09. Intelligence insights will appear as more requests are routed through ANT.
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="featherless/OpenLLM-Ro/RoLlama3.1-8b-Instruct-2024-10-09",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)