DeepSeek V4.1 Flash: 890 Bytes Per Token, and Why That Changes Agent Economics
·8 min read
⚡

DeepSeek V4.1 Flash: 890 Bytes Per Token, and Why That Changes Agent Economics

A 763B mixture-of-experts model that activates 8B parameters during prefill and 16B during decode, with a KV cache four times smaller than its predecessor. The headline is not the parameter count — it is that re-reading a large context stops being the expensive part of an agent loop.

deepseekmodelslong-contextagentsfeatherlesscost

Most model launches ask you to care about a benchmark. This one is worth caring about for a duller reason: it makes a specific thing cheap that agents do constantly and wastefully.

DeepSeek V4.1 Flash is a 763B-parameter mixture-of-experts model, but the parameter count is close to irrelevant to what it costs you. It uses a causal encoder-decoder layout that activates roughly 8B parameters while reading your input and 16B while writing the response. Reading is the cheap half, and reading is what agents do most.

Abstract visualisation of a large translucent sphere of layered light with thin ribbons of particles flowing inward, representing a compressed key-value cache
The interesting number is not 763B. It is 890 bytes per token.

The number that actually matters

Its CSA2 attention scheme holds the global key-value cache at about 890 bytes per token — roughly four times smaller than DeepSeek V4 Flash. The KV cache is the memory a model keeps about everything it has already read, and it is the thing that makes long contexts expensive to serve.

Shrink it fourfold and the economics of a particular pattern change: an agent that re-reads the same large context on every step. That pattern is not a design flaw, it is how tool-calling loops work. Each turn sends the conversation, the tool output, and often the same repository or document again.

  • •Long tool-calling loops, where the same context is re-sent every step.
  • •Repo-scale code changes, where the file set does not shrink between turns.
  • •Document pipelines that re-read a corpus per question.

DeepSeek reports gains on Terminal-Bench 2.1, DeepSWE v1.1 and AutomationBench — all agentic suites rather than single-shot question answering, which is consistent with where the architecture spends its budget.

Natively multimodal, not bolted on

A DeepSeek-ViT encoder was trained in from the start of pre-training rather than attached afterwards. Practically, that means a screenshot or a diagram goes in the same request as the text, in the same message. For agent work this matters more than it sounds: a browser agent that can pass a screenshot without a second round trip to a separate vision model has one less thing to fail.

Using it on Antbase

It is available through Featherless at up to 256K context. On Antbase you can pin it directly, or let a virtual model pick it when the shape of the request suits it.

bash
curl https://antbase.ai/v1/chat/completions \
  -H "Authorization: Bearer $ANTBASE_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "featherless/deepseek-ai/DeepSeek-V4.1-Flash",
    "messages": [
      {"role": "user", "content": "Summarise the failure modes in this trace."}
    ]
  }'

One honest caveat about pinning any Featherless model: Featherless loads models on demand from a catalogue of tens of thousands, so the first call to a model nobody has used recently can take a while as it comes off storage. Antbase gives Featherless a longer attempt budget when there is no alternative to fail over to, which converts a lot of would-be timeouts into slow successes. If you need predictable first-token latency, pin a model on a provider that keeps it warm.

When not to reach for it

Cheap long context is not the same as cheap. If your prompts are short, the KV-cache advantage does nothing for you and a small dense model will be faster and cheaper. The win is specifically in re-reading — if your workload does not re-read, you are paying for an architecture you are not using.

Try ANT routing today

Drop-in OpenAI-compatible API. Change your base URL and every request gets intelligent routing across 30+ providers.