DeepSeek V4.1 Flash 552B
DeepSeek V4.1 Flash 552B needs roughly 571.6 GB VRAM at Q4_K_M quantization (1236.5 GB at FP16). 0 GPUs we track can run it fully in VRAM at 8k context.
0 GPUs run this natively · 0 with CPU offload
- Q4_K_M total
- 571.6 GB
- at 8k context
- KV cache, full context
- 2.3 GB
- 40 layers cache, ~37× fewer entries than tokens
- Inputs
- Text · Image
- MIT, released September 2026
- MoE routing
- 6 of 384 experts
- 16B of 552B active on decode
- Prefill vs decode
- 8B / 16B active
- asymmetric Causal Encoder-Decoder design
- Modalities
- Text + vision
- first native image input in this line
DeepSeek V4.1 Flash 552B is a Mixture of Experts (MoE) model with 552B total parameters but only 16B active per token developed by DeepSeek. Released September 10, 2026 after a two-day API-only beta, DeepSeek describes this as the smallest model in a brand new architecture family, not a re-post-train of V4 Flash 0731 the way 0731 itself was a re-post-train of the April preview. The headline change is structural: DeepSeek calls it a Causal Encoder-Decoder design (its own term, unrelated to the bidirectional encoder-decoder pattern T5 popularized), splitting the 40 layers into 20 encoder and 20 decoder layers with an unusual asymmetry of 8B active parameters during prefill versus 16B during decode. It is a 552B-total, 384-expert mixture of experts routing 6 experts per token, with a 1M-token context window carried over from the V4 line. For the first time in this lineage the same checkpoint accepts image input natively, where V4 Pro and V4 Flash 0731 are both text only. DeepSeek's card also credits a new Engram conditional-memory mechanism, an SWA Bounded Replay technique, and a second-generation Compressed Sparse Attention (CSA2); independent verification of exactly how those mechanisms work was not available at launch, so treat the mechanism names as DeepSeek's own description rather than settled, third-party-confirmed fact.
To run DeepSeek V4.1 Flash 552B locally: The one clearly verified hardware story is the KV cache: DeepSeek's own figures put it at roughly a quarter of V4 Flash 0731's already-compressed cache, which this site's own math confirms works out to about 2.3GB at a full 1M-token context against V4 Flash 0731's roughly 9GB. The catch is the weights. V4 Flash 0731 has a real local story because its routed experts ship natively in a low-bit format with vetted community GGUF builds from about 82.5GB up; this model has neither yet. The only checkpoint that exists so far is the native release itself, about 510GB across 48 safetensors shards, and it is the only figure this page's quantization table can honestly show: nothing smaller has been published, so every ladder rung floors at that same size rather than showing a lower number nobody can actually download. Add KV cache and overhead at a full 1M-token context and the total comes to about 574GB, past even a 512GB M3 Ultra Mac Studio, the largest single unified-memory machine this site tracks. Until a real requantization exists, the API is the only realistic way to run this model. As a MoE model, inference speed depends on active parameters (16B) rather than total size.
DeepSeek's own API changelog reports GPQA Diamond 90.9, Terminal-Bench 2.1 90.6, a Codeforces rating of 3471, and DeepSWE v1.1 74.2, all comfortably ahead of V4 Flash 0731's GPQA 91 and Terminal-Bench 82.7 on the coding and agentic side, while landing close on GPQA itself. DeepSeek states that it comprehensively surpassed V4 Pro on performance, cost, speed and total time, but has not published the side-by-side benchmark table that would let anyone verify the size of that gap, so read the claim as directional rather than quantified. No MMLU-Pro, SWE-bench, or LiveCodeBench figures were published at launch, and no independent lab had re-run any of these numbers on launch day.
DeepSeek V4.1 Flash VRAM at 1M context: about 2.3 GB of KV cache, not 86 GB
DeepSeek's card claims a KV cache roughly a quarter the size of DeepSeek V4 Flash 0731's, itself already a fraction of what a conventional attention stack would need at a million tokens. A second figure on the same card, an exact bytes-per-token count, implies a steeper reduction than that; the two don't agree, so this site uses the more conservative of the two claims rather than the more flattering one.
KV cache only, at FP16. Weights and activation overhead sit on top of these figures.
Filling the entire 1,048,576-token window costs about 2.3 GB of KV cache. The same 40-layer stack storing one entry per token would want about 85.9 GB instead, more than the weights of most models this site tracks. That 2.3 GB figure is also about a quarter of DeepSeek V4 Flash 0731's own already-small 9.2 GB at the same context length, matching DeepSeek's own comparative claim almost exactly. Context, in other words, is not the problem with this model. The weights are (see the verdict below).
VRAM at each quantization
Calculated at 8k context. Since KV cache scales linearly with context, longer sessions need more VRAM than shown here.
| Quant | Weights | KV cache | Total |
|---|---|---|---|
| FP32 | 2208.0 GB | 0.02 GB | 2473.0 GB |
| BF16 | 1104.0 GB | 0.02 GB | 1236.5 GB |
| FP16 | 1104.0 GB | 0.02 GB | 1236.5 GB |
| Q8_0 | 586.8 GB | 0.02 GB | 657.2 GB |
| Q6_K | 510.3 GB | 0.02 GB | 571.6 GB |
| Q5_K_M | 510.3 GB | 0.02 GB | 571.6 GB |
| Q4_K_Mrec | 510.3 GB | 0.02 GB | 571.6 GB |
| Q3_K_M | 510.3 GB | 0.02 GB | 571.6 GB |
| Q2_K | 510.3 GB | 0.02 GB | 571.6 GB |
| NVFP4cuda | 510.3 GB | 0.02 GB | 571.6 GB |
Shown at 8k context with FP16 KV cache. NVFP4 needs a CUDA GPU to run. Toggle TurboQuant in the calculator to view compressed KV cache numbers.
Benchmarks
GPUs that run DeepSeek V4.1 Flash 552B natively (0)
No single GPU in our list fits this model at Q4 with 8k context. Browse all GPUs or try multi-GPU setups.
Notes
Released September 10, 2026 as, in DeepSeek's own words, "the smallest model in our new architecture family," after a two-day API-only beta. The headline change from DeepSeek V4 Flash 0731 is architectural, not just a re-post-train: DeepSeek calls the new design a Causal Encoder-Decoder (its own term, not the bidirectional encoder-decoder pattern T5 popularized), splitting the 40 layers into 20 encoder and 20 decoder layers with an asymmetric 8B active parameters during prefill versus 16B during decode. DeepSeek attributes a new "Engram" conditional-memory mechanism and "SWA Bounded Replay" to the design, on top of a second-generation Compressed Sparse Attention (CSA2) and a native FP4 KV cache format; independent technical verification of these specific mechanisms was not yet available at time of writing; DeepSeek's own card is the only source. What is independently corroborated (community discussion on the day of release, in addition to the HF card) is the headline outcome: roughly a 4x smaller KV cache than V4 Flash 0731's already-compressed one, which itself was already far smaller than a conventional dense-attention model's. On DeepSeek's own API changelog it scores GPQA Diamond 90.9, Terminal-Bench 2.1 90.6, a Codeforces rating of 3471, and DeepSWE v1.1 74.2, and DeepSeek states without publishing a side-by-side table that it "comprehensively surpassed" V4 Pro on performance, cost, speed, and total time. Native multimodal image input ships in the same checkpoint for the first time in this line (V4 Pro and V4 Flash are both text-only). The catch for local use: the only checkpoint that exists is the native ~510GB release itself, so even though the KV cache at a full 1M-token context now costs only a few GB, there is nothing smaller to shrink the weights down to, and the API is the realistic way to use this model today.
Compare DeepSeek V4.1 Flash 552B with other models
Should you run DeepSeek V4.1 Flash locally, today?
Not yet, and not because of context length, which this model handles better than almost anything else this site tracks. The blocker is that no quantized build exists, and this page's own quantization table reflects that honestly rather than guessing: every rung from Q4_K_M down to Q2_K shows the same roughly 510 GB, because that native release is the only checkpoint anyone can actually download right now, the same way this site treats gpt-oss-120b's natively low-bit experts. Add KV cache and overhead at a full 1M-token context and the total comes to about 574 GB, past even a 512 GB Mac Studio M3 Ultra, the largest single unified-memory machine this site tracks; at a short 8k context it is barely smaller, about 572 GB, since the weights are the entire story here, not the context window. Until a real requantization exists the way one eventually did for V4 Flash 0731, the API is the only realistic way to use this model, whatever hardware you own.
Frequently asked questions
- What are the VRAM requirements for DeepSeek V4.1 Flash 552B?
- DeepSeek V4.1 Flash 552B requires approximately 571.6 GB of VRAM at Q4_K_M quantization, 657.2 GB at Q8, and 1236.5 GB at FP16. These numbers assume 8k context window; VRAM scales linearly with context length due to the KV cache.
- How many parameters does DeepSeek V4.1 Flash 552B have?
- DeepSeek V4.1 Flash 552B has 552 billion total parameters, but only 16 billion are active per token thanks to its Mixture of Experts (MoE) architecture. This makes inference significantly faster than the total parameter count suggests.
- Can DeepSeek V4.1 Flash 552B run on a 16 GB GPU?
- No. At Q4_K_M, DeepSeek V4.1 Flash 552B needs 571.6 GB of VRAM, more than 16 GB. You will need a multi-GPU server.
- Can DeepSeek V4.1 Flash 552B run on a 24 GB GPU?
- No. Even at Q4_K_M, DeepSeek V4.1 Flash 552B needs 571.6 GB. Consider a multi-GPU server with 572 GB+ of combined VRAM.
- What is the smallest quantization for DeepSeek V4.1 Flash 552B that fits in 24 GB of VRAM?
- DeepSeek V4.1 Flash 552B cannot fit in 24 GB of VRAM at any standard quantization level. The minimum needed is 571.6 GB at Q2_K.
- What GPU do I need to run DeepSeek V4.1 Flash 552B locally?
- You need a multi-GPU server. At Q4_K_M, DeepSeek V4.1 Flash 552B needs 571.6 GB VRAM, more than any single consumer GPU. That's roughly 8x 80 GB datacenter GPUs (H100, A100, or similar) pooled together.
- How much VRAM does DeepSeek V4.1 Flash need?
- As of launch, more than any single machine this site tracks holds: the only checkpoint available is the native ~510 GB release, which totals roughly 574 GB once KV cache and overhead are added at a full 1,048,576-token context, past even a 512 GB Mac Studio M3 Ultra. Every quantization level this page lists shows the same ~510 GB figure rather than a smaller guess, because nothing smaller than the native release has been published yet.
- Can DeepSeek V4.1 Flash run on a Mac Studio?
- Not yet. The only checkpoint that exists so far is the native ~510 GB release, which doesn't fit even a 512 GB Mac Studio M3 Ultra once KV cache and overhead are counted (about 574 GB total at full context). It would take a genuine community requantization, the kind that eventually shipped for the previous DeepSeek V4 Flash release, before a smaller download exists to try.
- What changed between DeepSeek V4 Flash 0731 and DeepSeek V4.1 Flash?
- The architecture itself, not just training. DeepSeek calls the new design a Causal Encoder-Decoder, splitting the 40 layers into 20 encoder and 20 decoder layers with an asymmetric 8B active parameters on prefill versus 16B on decode, replacing V4 Flash 0731's uniform 43-layer hybrid CSA/HCA stack. The KV cache shrank roughly 4x again on top of V4 Flash 0731's own compression, and the model gained native image input, which V4 Flash 0731 doesn't have. On DeepSeek's own reported benchmarks it also improved on Terminal-Bench 2.1 (82.7 to 90.6) and GPQA Diamond (91 to 90.9, essentially flat).
- Does DeepSeek V4.1 Flash support image input?
- Yes. DeepSeek's own release notes describe native multimodal visual understanding, and the model's published configuration includes a dedicated vision encoder in the same checkpoint. This is the first model in the DeepSeek V4 line to ship with image input; both V4 Pro and V4 Flash 0731 are text only.