Llama 2 7b Hf Sharded Bf16 1GB

Overview

Llama 2 7b Hf Sharded Bf16 1GB is a efficient model from Featherless with a 4K context window. Available through ANT's unified API.

ANT Routing Intelligence

Limited routing data available for Llama 2 7b Hf Sharded Bf16 1GB. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="featherless/thiagomf/Llama-2-7b-hf-sharded-bf16-1GB",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI