Gemma 2 2b Fp8 E4m3fn is a efficient model from Featherless with a 8K context window. Available through ANT's unified API.
Limited routing data available for Gemma 2 2b Fp8 E4m3fn. Intelligence insights will appear as more requests are routed through ANT.
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="featherless/rockerBOO/gemma-2-2b-fp8_e4m3fn",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)