NousResearch Llama 2 7b Hf Attribution With Target Modules Qlora 4bit Merged is a efficient model from Featherless with a 4K context window. Available through ANT's unified API.
Limited routing data available for NousResearch Llama 2 7b Hf Attribution With Target Modules Qlora 4bit Merged. Intelligence insights will appear as more requests are routed through ANT.
from openai import OpenAI
client = OpenAI(
base_url="https://api.antbase.ai/v1",
api_key="YOUR_ANT_API_KEY",
)
response = client.chat.completions.create(
model="featherless/mtc/NousResearch-Llama-2-7b-hf-attribution-with-target-modules-qlora-4bit-merged",
messages=[{"role": "user", "content": "Hello!"}]
)
print(response.choices[0].message.content)