Cat Llama 3 70B Instruct

Overview

Cat Llama 3 70B Instruct is a efficient model from Featherless with a 8K context window, supporting function calling. Available through ANT's unified API.

ANT Routing Intelligence

Limited routing data available for Cat Llama 3 70B Instruct. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="featherless/turboderp/Cat-Llama-3-70B-instruct",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI