Semantic-cache

AI inference provider available on Antbase

OpenAI-compatible

About Semantic-cache

Semantic-cache is an AI model provider accessible through Antbase. Use intelligent routing to automatically select the best model from this provider based on your task requirements.

Live Performance Data

Intelligence Score
60.0
Total Requests
62,062
Success Rate
10000.0%
Avg Latency
0ms
Models
32
Tokens Processed
34.5M

Semantic-cache Models on Antbase

ModelScoreRequestsSuccess RateAvg Latencyp95 LatencyCapabilities
command-a-03-202577.014,82910000.0%0ms0ms
Qwen: Qwen3 Coder Next77.01,30010000.0%0ms0ms
🔧
meta-llama/Llama-4-Scout-17B-16E-Instruct77.018,27110000.0%0ms0ms
gemini-2.5-flash77.018,01710000.0%0ms0ms
deepseek-ai/DeepSeek-V4.1-Flash77.09,06310000.0%0ms0ms
deepseek-ai/DeepSeek-V3-032464.024910000.0%0ms0ms
deepseek/deepseek-r1-turbo61.012610000.0%0ms0ms
TheDrummer/Rocinante-12B-v1.158.02310000.0%0ms0ms
DeepSeek: DeepSeek V4 Flash 073158.03510000.0%0ms0ms
🔧
Qwen: Qwen3.7 Flash58.01710000.0%0ms0ms
👁🔧
deepseek/deepseek-v3-032458.01210000.0%0ms0ms
o3-mini57.01010000.0%0ms0ms
🧠🔧
GPT-4o Mini57.01210000.0%0ms0ms
👁🔧
GPT-4.1 Nano57.01110000.0%0ms0ms
👁🔧
Qwen: Qwen3 Next 80B A3B Thinking57.01010000.0%0ms0ms
🧠🔧
philbert440/Qwen3.8-27B-Uncensored-Cyber57.01010000.0%0ms0ms
huihui-ai/Huihui-Mistral-Small-3.2-24B-Instruct-2506-abliterated57.01010000.0%0ms0ms
Qwen: Qwen3.5-9B55.0210000.0%0ms0ms
👁🔧
mistral-small-latest55.0110000.0%0ms0ms
NVIDIA: Nemotron 3 Nano 30B A3B55.0310000.0%0ms0ms
🔧
DeepHat/DeepHat-V1-7B55.0510000.0%0ms0ms
cloudbjorn/Qwen3.8-27B-Yes-Man-uncensored55.0910000.0%0ms0ms
TheDrummer/Cydonia-24B-v4.355.0110000.0%0ms0ms
Silicone-Moss/CrucibleLab-L3.3-70B-Loki-V2.0-Heretic-Uncensored55.0110000.0%0ms0ms
huihui-ai/Llama-3.3-70B-Instruct-abliterated55.0910000.0%0ms0ms
Vortex5/Shadow-Siren-26B-A4B55.0110000.0%0ms0ms
miss-t/Qwen3.8-27B-AEON-ULTIMATE-UNCENSORED-BF1655.0910000.0%0ms0ms
deepseek-v4-flash55.0110000.0%0ms0ms
OpenAI: gpt-oss-20b55.0310000.0%0ms0ms
🔧
OpenAI: gpt-oss-120b55.0310000.0%0ms0ms
🔧
llama-3.3-70b-instruct55.0110000.0%0ms0ms
huihui-ai/Qwen2.5-72B-Instruct-abliterated55.0810000.0%0ms0ms

How to Use Semantic-cache on Antbase

All Semantic-cache models are available through Antbase's unified OpenAI-compatible API. You can either route directly to a specific Semantic-cache model or let ANT's intelligent router automatically select the best model for your task.

python
from openai import OpenAI

client = OpenAI(
    base_url="https://antbase.ai/v1",
    api_key="your-ant-api-key",
)

# Let ANT auto-route (may use Semantic-cache if optimal)
response = client.chat.completions.create(
    model="ant:auto",
    messages=[{"role": "user", "content": "Hello!"}],
)

Why Use Semantic-cache Through Antbase?

  • •No separate account needed — access Semantic-cache models instantly through your Antbase API key.
  • •Intelligent routing — ANT automatically selects the best Semantic-cache model for each task, or falls over to another provider if Semantic-cache is slow or down.
  • •Same token prices — Antbase charges zero markup on Semantic-cache token prices. You pay exactly what Semantic-cache charges.
  • •Automatic failover — if Semantic-cache has an outage, your requests seamlessly route to an equivalent model on another provider.