Llama 2 7b Chat Hf Lora is a efficient model from Cloudflare with a 8K context window. Priced at $0.0040/1K input, $0.013/1K output.
Total Requests
0
P50 Latency
320ms
P95 Latency
1000ms
Selection Rate
0.0%
of eligible requests
Intelligence Score
50/100
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="cloudflare/@cf/meta-llama/llama-2-7b-chat-hf-lora",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)