Flint 40B (MoE) vs Qwen 3.8 27B
Side-by-side VRAM requirements, benchmark scores, and GPU compatibility for local AI inference.
Quick verdict
Qwen 3.8 27B is more hardware-efficient: it needs 19.0 GB at its Q4_K_M build vs 27.4 GB for Flint 40B (MoE)'s Q4_K_M, fitting on 86 GPUs natively. Flint 40B (MoE) is a Mixture of Experts model: it has 39.8B total parameters but only 2.5B are active per token, making inference faster than its total size suggests.
Analysis
Flint 40B and Qwen 3.8 27B answer the same question from opposite ends: how do you get a strong local coding agent onto one GPU? Qwen 3.8 27B is a dense model that fires all 27B of its parameters on every token (released 14 August 2026, Apache 2.0, text, image and video input). Flint 40B is a sparse mixture of experts that fires about 2.5B of its 39.8B (released 21 October 2026, Apache 2.0, text only). One is built for quality per gigabyte and the other for speed per gigabyte, and the numbers below show what each gives up.
Weights first. Qwen's Q4_K_M is 16.4 GB against 24.2 GB for Flint, because Flint stores all 39.8B parameters even though it computes with a small slice of them. That makes Qwen the easier fit on a 24 GB card at a short context: it fits an RTX 4090 at Q4_K_M with 8k of context (19.0 GB in total), while Flint needs a 32 GB card. Longer context narrows the gap. Qwen keeps 16 of its 64 layers as Gated Attention (4 KV heads of width 256) and gives the other 48 a fixed-size state; Flint caps 35 of its 49 layers at a 513-token window and grows only 14 (4 KV heads of width 128). At 262,144 tokens Qwen's cache is 17.2 GB against Flint's 7.6 GB, and the full-window totals are 37.7 GB for Qwen and 35.6 GB for Flint. The two totals cross at about 213,000 tokens: below that Qwen needs less memory, above it Flint does, and at the full window neither fits a 32 GB card. Speed is where the mixture of experts pays. This site's estimates put Flint at 194 tok/s on an RTX 5090 at Q4_K_M with 8k of context against 68.5 for Qwen, about 2.8 times faster, and at the full window, with both spilling to system RAM, 78.9 against 6.6. Recursive's launch post claims more than five times the speed of dense 25 to 40B models, a vendor figure measured on its own engine. Quality favors Qwen. On the one benchmark both report, Terminal-Bench 2.1, Qwen scores 73.0 against Flint's 54.9, each on its own vendor's harness (Qwen's card names Terminus, Recursive's names Terminus 2, and Recursive counts solutions found through web retrieval as failures). Qwen also reports GPQA Diamond 89.2, LiveCodeBench v6 90.3 and SWE-bench Pro 61.7; Flint's card gives SWE-bench Verified 74.2 and 89.7 on SWE-bench Pro v2, a different suite from the one Qwen reports, so those two figures do not compare. Qwen also reads images and video where Flint is text only, and Recursive's own post says Flint may need more guidance than the larger closed coding models. Tooling is level: both have an Ollama tag (qwen3.8:27b at 18 GB, flint:40b at 23 GB) and both have GGUF builds for llama.cpp.
Bottom line: Pick Qwen 3.8 27B if quality is the priority, you want image or video input, or you have a 24 GB card and a short context. Pick Flint 40B if decode speed matters most and you have a 32 GB card or a 48 to 64 GB Mac: this site's estimates put it at close to three times Qwen's speed at 8k tokens, and its cache stays smaller than Qwen's beyond roughly 213,000 tokens of context. Neither company's benchmark claims are independently verified and Flint was a day old when this page was written, so run both on your own repository.
Total parameters vs. active parameters per token
Flint stores more than Qwen (39.8B against 27B) but computes with a tenth as much per token (about 2.5B against all 27B). Total decides the memory bill; active decides decode speed, and that split is the whole story of this pair.
What a full 262,144-token window costs each model
Both models document a 262,144-token window, so the comparison runs to the full length. Qwen's cache grows faster per token than Flint's, but its weights are 7.8 GB lighter, so the two totals cross rather than one model simply winning.
KV cache only, at FP16. Weights and activation overhead sit on top of these figures.
At 262,144 tokens, Qwen 3.8 27B's KV cache is 17.2 GB against Flint's 7.6 GB. Add each model's Q4_K_M weights and the full-window total is 37.7 GB for Qwen against 35.6 GB for Flint, so neither fits a 32 GB card at the full window, and the totals cross at about 213,000 tokens.
VRAM at each quantization (8k context)
| Quant | Flint 40B (MoE) | Qwen 3.8 27B | Diff |
|---|---|---|---|
| FP32 | 178.6 GB | 121.6 GB | +47% |
| BF16 | 89.5 GB | 61.1 GB | +46% |
| FP16 | 89.5 GB | 61.1 GB | +46% |
| Q8_0 | 47.7 GB | 32.8 GB | +46% |
| Q6_K | 36.9 GB | 25.4 GB | +45% |
| Q5_K_M | 32.0 GB | 22.1 GB | +45% |
| Q4_K_M | 27.4 GB | 19.0 GB | +44% |
| Q3_K_M | 21.8 GB | 15.2 GB | +44% |
| Q2_K | 17.3 GB | 12.1 GB | +43% |
| NVFP4 | 25.9 GB | 15.7 GB | +65% |
Diff is Flint 40B (MoE) relative to Qwen 3.8 27B. Green = lower VRAM (fits more GPUs).
Model specifications
| Spec | Flint 40B (MoE) | Qwen 3.8 27B |
|---|---|---|
| Org | Recursive | Alibaba |
| Parameters | 39.8B | 27B |
| Architecture | MoE (2.5B active) | Dense |
| Context | 256k tokens | 256k tokens |
| Modalities | text | text, vision, video |
| License | Apache 2.0 | Apache 2.0 |
| Commercial | Yes | Yes |
| Released | 2026-10-21 | 2026-08-14 |
| GPUs (native) | 70 / 121 | 86 / 121 |
Benchmark scores
| Benchmark | Flint 40B (MoE) | Qwen 3.8 27B |
|---|---|---|
| SWE-bench Verified | 74.2 | N/A |
| Terminal-Bench 2.1 | 54.9 | 73.0 |
Green = higher score (better). N/A = not yet available. ~ = inherited from a base model, not independently reported for that release itself.
GPUs that run only Flint 40B (MoE)(0)
Every GPU that runs Flint 40B (MoE) also runs Qwen 3.8 27B.
GPUs that run only Qwen 3.8 27B(16)
- NVIDIA RTX 508016 GB
- NVIDIA RTX 5070 Ti16 GB
- NVIDIA RTX 5060 Ti 16GB16 GB
- NVIDIA RTX 408016 GB
- NVIDIA RTX 4070 Ti SUPER16 GB
- NVIDIA RTX 4060 Ti 16GB16 GB
- AMD Radeon RX 9070 XT16 GB
- AMD Radeon RX 7900 GRE16 GB
- AMD Radeon RX 7800 XT16 GB
- AMD Radeon RX 6800 XT16 GB
- +6 more
GPUs that run both natively(70)
- NVIDIA RTX 509032 GB
- NVIDIA RTX 409024 GB
- NVIDIA RTX 309024 GB
- NVIDIA RTX 3090 Ti24 GB
- NVIDIA B300 288GB288 GB
- NVIDIA B200 180GB180 GB
- NVIDIA H200 141GB141 GB
- NVIDIA H100 80GB80 GB
- NVIDIA A100 80GB80 GB
- NVIDIA A100 40GB40 GB
- NVIDIA L40S48 GB
- NVIDIA RTX A600048 GB
- +58 more GPUs run both
Which should you use?
- • You want maximum capability and have a 28 GB+ GPU
- • You want fast inference: MoE only activates 2.5B params per token
- • It's the newer release (2026-10-21 vs 2026-08-14); check the benchmark table above for what actually improved
- • You have limited VRAM: it's a smaller model needing 19.0 GB vs 27.4 GB
- • You need vision/image understanding
Frequently asked questions
- Which is better, Flint 40B (MoE) or Qwen 3.8 27B?
- Flint 40B (MoE) has 39.8B parameters vs 27B for Qwen 3.8 27B, so Flint 40B (MoE) is the larger model. Qwen 3.8 27B is more hardware-efficient, needing 19.0 GB at its Q4_K_M build vs 27.4 GB for Flint 40B (MoE)'s Q4_K_M. Qwen 3.8 27B runs on more GPUs natively (86 vs 70).
- How much VRAM does Flint 40B (MoE) need vs Qwen 3.8 27B?
- At 8k context, Flint 40B (MoE) needs approximately 27.4 GB of VRAM at its Q4_K_M build, while Qwen 3.8 27B needs 19.0 GB at its Q4_K_M build. At the largest build each ships, Flint 40B (MoE) requires 89.5 GB (FP16) vs 61.1 GB (FP16) for Qwen 3.8 27B.
- Can you run Flint 40B (MoE) on the same GPUs as Qwen 3.8 27B?
- Yes, 70 GPUs can run both natively in VRAM, including NVIDIA RTX 5090, NVIDIA RTX 4090, NVIDIA RTX 3090. However, no GPU can run Flint 40B (MoE) without also fitting Qwen 3.8 27B, and 16 GPUs can run Qwen 3.8 27B but not Flint 40B (MoE).
- What is the difference between Flint 40B (MoE) and Qwen 3.8 27B?
- Flint 40B (MoE) has 39.8B parameters (2.5B active, MoE) with a 256k context window. Qwen 3.8 27B has 27B parameters (dense) with a 256k context window.
- Which model fits in 24 GB of VRAM, Flint 40B (MoE) or Qwen 3.8 27B?
- Only Qwen 3.8 27B fits in 24 GB, at its Q4_K_M build (19.0 GB). Flint 40B (MoE) needs 27.4 GB at Q4_K_M, requiring a larger GPU.
- Which handles long context better, Flint 40B (MoE) or Qwen 3.8 27B?
- At 262,144 tokens, Qwen 3.8 27B's KV cache is 17.2 GB against Flint's 7.6 GB. Add each model's Q4_K_M weights and the full-window total is 37.7 GB for Qwen against 35.6 GB for Flint, so neither fits a 32 GB card at the full window, and the totals cross at about 213,000 tokens.