ALE GPT Llama2 7B 1562 Int8 Lora256 Constant Adamw8bit

Overview

ALE GPT Llama2 7B 1562 Int8 Lora256 Constant Adamw8bit is a efficient model from Featherless with a 4K context window. Available through ANT's unified API.

ANT Routing Intelligence

Limited routing data available for ALE GPT Llama2 7B 1562 Int8 Lora256 Constant Adamw8bit. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="featherless/frivasplata/ALE-GPT-llama2-7B-1562-int8-lora256-constant-adamw8bit",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI