Open Llama 7b V2 Sharded

Overview

Open Llama 7b V2 Sharded is a efficient model from Featherless with a 4K context window. Available through ANT's unified API.

ANT Routing Intelligence

Limited routing data available for Open Llama 7b V2 Sharded. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="featherless/thisserand/open_llama_7b_v2_sharded",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI