Infinirc Llama3 8B 2G Release V1.0

Overview

Infinirc Llama3 8B 2G Release V1.0 is a efficient model from Featherless with a 8K context window. Available through ANT's unified API.

ANT Routing Intelligence

Limited routing data available for Infinirc Llama3 8B 2G Release V1.0. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="featherless/Infinirc/Infinirc-Llama3-8B-2G-Release-v1.0",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI