Infinity Instruct 3M 0613 Llama3 70B

Overview

Infinity Instruct 3M 0613 Llama3 70B is a efficient model from Featherless with a 8K context window, supporting function calling. Available through ANT's unified API.

ANT Routing Intelligence

Limited routing data available for Infinity Instruct 3M 0613 Llama3 70B. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="featherless/BAAI/Infinity-Instruct-3M-0613-Llama3-70B",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI