Llama 3.1 70B Instruct

Overview

Llama 3.1 70B Instruct is a efficient model from Featherless with a 33K context window, supporting function calling. Available through ANT's unified API.

ANT Routing Intelligence

Limited routing data available for Llama 3.1 70B Instruct. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="featherless/OpenPipe/Llama-3.1-70B-Instruct",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI