Flint 40B (MoE) vs Qwen 3.8 27B

Side-by-side VRAM requirements, benchmark scores, and GPU compatibility for local AI inference.

Quick verdict

Qwen 3.8 27B is more hardware-efficient: it needs 19.0 GB at its Q4_K_M build vs 27.4 GB for Flint 40B (MoE)'s Q4_K_M, fitting on 86 GPUs natively. Flint 40B (MoE) is a Mixture of Experts model: it has 39.8B total parameters but only 2.5B are active per token, making inference faster than its total size suggests.

Analysis

Flint 40B and Qwen 3.8 27B answer the same question from opposite ends: how do you get a strong local coding agent onto one GPU? Qwen 3.8 27B is a dense model that fires all 27B of its parameters on every token (released 14 August 2026, Apache 2.0, text, image and video input). Flint 40B is a sparse mixture of experts that fires about 2.5B of its 39.8B (released 21 October 2026, Apache 2.0, text only). One is built for quality per gigabyte and the other for speed per gigabyte, and the numbers below show what each gives up.

Weights first. Qwen's Q4_K_M is 16.4 GB against 24.2 GB for Flint, because Flint stores all 39.8B parameters even though it computes with a small slice of them. That makes Qwen the easier fit on a 24 GB card at a short context: it fits an RTX 4090 at Q4_K_M with 8k of context (19.0 GB in total), while Flint needs a 32 GB card. Longer context narrows the gap. Qwen keeps 16 of its 64 layers as Gated Attention (4 KV heads of width 256) and gives the other 48 a fixed-size state; Flint caps 35 of its 49 layers at a 513-token window and grows only 14 (4 KV heads of width 128). At 262,144 tokens Qwen's cache is 17.2 GB against Flint's 7.6 GB, and the full-window totals are 37.7 GB for Qwen and 35.6 GB for Flint. The two totals cross at about 213,000 tokens: below that Qwen needs less memory, above it Flint does, and at the full window neither fits a 32 GB card. Speed is where the mixture of experts pays. This site's estimates put Flint at 194 tok/s on an RTX 5090 at Q4_K_M with 8k of context against 68.5 for Qwen, about 2.8 times faster, and at the full window, with both spilling to system RAM, 78.9 against 6.6. Recursive's launch post claims more than five times the speed of dense 25 to 40B models, a vendor figure measured on its own engine. Quality favors Qwen. On the one benchmark both report, Terminal-Bench 2.1, Qwen scores 73.0 against Flint's 54.9, each on its own vendor's harness (Qwen's card names Terminus, Recursive's names Terminus 2, and Recursive counts solutions found through web retrieval as failures). Qwen also reports GPQA Diamond 89.2, LiveCodeBench v6 90.3 and SWE-bench Pro 61.7; Flint's card gives SWE-bench Verified 74.2 and 89.7 on SWE-bench Pro v2, a different suite from the one Qwen reports, so those two figures do not compare. Qwen also reads images and video where Flint is text only, and Recursive's own post says Flint may need more guidance than the larger closed coding models. Tooling is level: both have an Ollama tag (qwen3.8:27b at 18 GB, flint:40b at 23 GB) and both have GGUF builds for llama.cpp.

Bottom line: Pick Qwen 3.8 27B if quality is the priority, you want image or video input, or you have a 24 GB card and a short context. Pick Flint 40B if decode speed matters most and you have a 32 GB card or a 48 to 64 GB Mac: this site's estimates put it at close to three times Qwen's speed at 8k tokens, and its cache stays smaller than Qwen's beyond roughly 213,000 tokens of context. Neither company's benchmark claims are independently verified and Flint was a day old when this page was written, so run both on your own repository.

Total parameters vs. active parameters per token

Flint stores more than Qwen (39.8B against 27B) but computes with a tenth as much per token (about 2.5B against all 27B). Total decides the memory bill; active decides decode speed, and that split is the whole story of this pair.

Total parameters (B)
Flint 40B (MoE)
39.8
Qwen 3.8 27B
27.0
Active parameters per token (B)
Flint 40B (MoE)
2.5
Qwen 3.8 27B
27.0

What a full 262,144-token window costs each model

Both models document a 262,144-token window, so the comparison runs to the full length. Qwen's cache grows faster per token than Flint's, but its weights are 7.8 GB lighter, so the two totals cross rather than one model simply winning.

0612182464k128k192k256k513-token window7.6 GBFlint17.2 GBQwen 3.8 27B
Flint 40B (MoE) (14 of 49 layers grow with context)Qwen 3.8 27B (16 of 64 layers cache)

KV cache only, at FP16. Weights and activation overhead sit on top of these figures.

At 262,144 tokens, Qwen 3.8 27B's KV cache is 17.2 GB against Flint's 7.6 GB. Add each model's Q4_K_M weights and the full-window total is 37.7 GB for Qwen against 35.6 GB for Flint, so neither fits a 32 GB card at the full window, and the totals cross at about 213,000 tokens.

VRAM at each quantization (8k context)

FP32
Flint 40B (MoE)
178.6 GB
Qwen 3.8 27B
121.6 GB
BF16
Flint 40B (MoE)
89.5 GB
Qwen 3.8 27B
61.1 GB
FP16
Flint 40B (MoE)
89.5 GB
Qwen 3.8 27B
61.1 GB
Q8_0
Flint 40B (MoE)
47.7 GB
Qwen 3.8 27B
32.8 GB
Q6_K
Flint 40B (MoE)
36.9 GB
Qwen 3.8 27B
25.4 GB
Q5_K_M
Flint 40B (MoE)
32.0 GB
Qwen 3.8 27B
22.1 GB
Q4_K_M
Flint 40B (MoE)
27.4 GB
Qwen 3.8 27B
19.0 GB
Q3_K_M
Flint 40B (MoE)
21.8 GB
Qwen 3.8 27B
15.2 GB
Q2_K
Flint 40B (MoE)
17.3 GB
Qwen 3.8 27B
12.1 GB
NVFP4
Flint 40B (MoE)
25.9 GB
Qwen 3.8 27B
15.7 GB
QuantFlint 40B (MoE)Qwen 3.8 27BDiff
FP32178.6 GB121.6 GB+47%
BF1689.5 GB61.1 GB+46%
FP1689.5 GB61.1 GB+46%
Q8_047.7 GB32.8 GB+46%
Q6_K36.9 GB25.4 GB+45%
Q5_K_M32.0 GB22.1 GB+45%
Q4_K_M27.4 GB19.0 GB+44%
Q3_K_M21.8 GB15.2 GB+44%
Q2_K17.3 GB12.1 GB+43%
NVFP425.9 GB15.7 GB+65%

Diff is Flint 40B (MoE) relative to Qwen 3.8 27B. Green = lower VRAM (fits more GPUs).

Model specifications

SpecFlint 40B (MoE)Qwen 3.8 27B
OrgRecursiveAlibaba
Parameters39.8B27B
ArchitectureMoE (2.5B active)Dense
Context256k tokens256k tokens
Modalitiestexttext, vision, video
LicenseApache 2.0Apache 2.0
CommercialYesYes
Released2026-10-212026-08-14
GPUs (native)70 / 12186 / 121

Benchmark scores

BenchmarkFlint 40B (MoE)Qwen 3.8 27B
SWE-bench Verified74.2N/A
Terminal-Bench 2.154.973.0

Green = higher score (better). N/A = not yet available. ~ = inherited from a base model, not independently reported for that release itself.

GPUs that run only Flint 40B (MoE)(0)

Every GPU that runs Flint 40B (MoE) also runs Qwen 3.8 27B.

GPUs that run only Qwen 3.8 27B(16)

GPUs that run both natively(70)

Which should you use?

Choose Flint 40B (MoE) if:
  • • You want maximum capability and have a 28 GB+ GPU
  • • You want fast inference: MoE only activates 2.5B params per token
  • • It's the newer release (2026-10-21 vs 2026-08-14); check the benchmark table above for what actually improved
Choose Qwen 3.8 27B if:
  • • You have limited VRAM: it's a smaller model needing 19.0 GB vs 27.4 GB
  • • You need vision/image understanding

Frequently asked questions

Which is better, Flint 40B (MoE) or Qwen 3.8 27B?
Flint 40B (MoE) has 39.8B parameters vs 27B for Qwen 3.8 27B, so Flint 40B (MoE) is the larger model. Qwen 3.8 27B is more hardware-efficient, needing 19.0 GB at its Q4_K_M build vs 27.4 GB for Flint 40B (MoE)'s Q4_K_M. Qwen 3.8 27B runs on more GPUs natively (86 vs 70).
How much VRAM does Flint 40B (MoE) need vs Qwen 3.8 27B?
At 8k context, Flint 40B (MoE) needs approximately 27.4 GB of VRAM at its Q4_K_M build, while Qwen 3.8 27B needs 19.0 GB at its Q4_K_M build. At the largest build each ships, Flint 40B (MoE) requires 89.5 GB (FP16) vs 61.1 GB (FP16) for Qwen 3.8 27B.
Can you run Flint 40B (MoE) on the same GPUs as Qwen 3.8 27B?
Yes, 70 GPUs can run both natively in VRAM, including NVIDIA RTX 5090, NVIDIA RTX 4090, NVIDIA RTX 3090. However, no GPU can run Flint 40B (MoE) without also fitting Qwen 3.8 27B, and 16 GPUs can run Qwen 3.8 27B but not Flint 40B (MoE).
What is the difference between Flint 40B (MoE) and Qwen 3.8 27B?
Flint 40B (MoE) has 39.8B parameters (2.5B active, MoE) with a 256k context window. Qwen 3.8 27B has 27B parameters (dense) with a 256k context window.
Which model fits in 24 GB of VRAM, Flint 40B (MoE) or Qwen 3.8 27B?
Only Qwen 3.8 27B fits in 24 GB, at its Q4_K_M build (19.0 GB). Flint 40B (MoE) needs 27.4 GB at Q4_K_M, requiring a larger GPU.
Which handles long context better, Flint 40B (MoE) or Qwen 3.8 27B?
At 262,144 tokens, Qwen 3.8 27B's KV cache is 17.2 GB against Flint's 7.6 GB. Add each model's Q4_K_M weights and the full-window total is 37.7 GB for Qwen against 35.6 GB for Flint, so neither fits a 32 GB card at the full window, and the totals cross at about 213,000 tokens.
Full Flint 40B (MoE) page →Full Qwen 3.8 27B page →Check your hardware →