Ternary Bonsai 27B AWQ 4bit

Overview

Ternary Bonsai 27B AWQ 4bit is a efficient model from Hugging Face with a 0 context window. Priced at $0.0040/1K input, $0.013/1K output.

ANT Routing Intelligence

Limited routing data available for Ternary Bonsai 27B AWQ 4bit. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="huggingface/prism-ml/Ternary-Bonsai-27B-AWQ-4bit",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI