K8s Phi3 Vllm

Overview

K8s Phi3 Vllm is a efficient model from Featherless with a 2K context window, supporting vision understanding. Available through ANT's unified API.

ANT Routing Intelligence

Limited routing data available for K8s Phi3 Vllm. Intelligence insights will appear as more requests are routed through ANT.

Quick Start

from openai import OpenAI

client = OpenAI(
    base_url="https://api.antbase.ai/v1",
    api_key="YOUR_ANT_API_KEY",
)

response = client.chat.completions.create(
    model="featherless/Umesh1212/k8s-phi3-vllm",
    messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)

Try it or ask an AI