Llama 2 13b FINETUNE4 3.8w R16 Q K V O Gate Up Down

Overview

Llama 2 13b FINETUNE4 3.8w R16 Q K V O Gate Up Down is a efficient model from Featherless with a 4K context window, supporting advanced reasoning. Available through ANT's unified API.

ANT Routing Intelligence

Limited routing data available for Llama 2 13b FINETUNE4 3.8w R16 Q K V O Gate Up Down. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="featherless/CHIH-HUNG/llama-2-13b-FINETUNE4_3.8w-r16-q_k_v_o_gate_up_down",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI