Llama 7b Auto Complete Finetuned 4bit 14Sep23

Overview

Llama 7b Auto Complete Finetuned 4bit 14Sep23 is a efficient model from Featherless with a 4K context window. Available through ANT's unified API.

ANT Routing Intelligence

Limited routing data available for Llama 7b Auto Complete Finetuned 4bit 14Sep23. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="featherless/silpakanneganti/llama-7b-auto-complete-finetuned-4bit-14Sep23",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI