Llama 2 13b Beluga QLoRA

Overview

Llama 2 13b Beluga QLoRA is a efficient model from Featherless with a 4K context window. Available through ANT's unified API.

ANT Routing Intelligence

Limited routing data available for Llama 2 13b Beluga QLoRA. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="featherless/yeontaek/llama-2-13b-Beluga-QLoRA",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI