Bonsai 2 9B vs Bonsai 2 27B
Side-by-side VRAM requirements, benchmark scores, and GPU compatibility for local AI inference.
Quick verdict
Bonsai 2 9B is more hardware-efficient: it needs 3.0 GB at its Ternary (PQ2_0) build vs 7.2 GB for Bonsai 2 27B's Ternary (Q2_0), fitting on 117 GPUs natively.
VRAM at each real build (8k context)
Bonsai 2 9B and Bonsai 2 27B both ship as a handful of fixed prebuilt files rather than a standard quantization ladder, so the two don't share equivalent bit-widths to line up row for row. Ranked smallest to largest instead.
| Rank | Bonsai 2 9B | GB | Bonsai 2 27B | GB |
|---|---|---|---|---|
| 1 | Ternary (PTQ1_0) | 2.5 GB | Ternary (Q2_0) | 7.2 GB |
| 2 | Ternary (PQ2_0) | 3.0 GB | — | — |
| 3 | Ternary (Q2_0) | 3.2 GB | — | — |
Each column is that model's own real builds, smallest first; rank pairs them by position, not by matching precision.
Model specifications
| Spec | Bonsai 2 9B | Bonsai 2 27B |
|---|---|---|
| Org | PrismML | PrismML |
| Parameters | 9B | 27B |
| Architecture | Dense | Dense |
| Context | 256k tokens | 256k tokens |
| Modalities | text, vision | text, vision |
| License | Apache 2.0 | Apache 2.0 |
| Commercial | Yes | Yes |
| Released | 2026-10-15 | 2026-09-18 |
| GPUs (native) | 117 / 121 | 113 / 121 |
Benchmark scores
| Benchmark | Bonsai 2 9B | Bonsai 2 27B |
|---|---|---|
| GPQA Diamond | 69.9 | N/A |
| IFEval | 90.0 | N/A |
Green = higher score (better). N/A = not yet available. ~ = inherited from a base model, not independently reported for that release itself.
GPUs that run only Bonsai 2 9B(4)
GPUs that run only Bonsai 2 27B(0)
Every GPU that runs Bonsai 2 27B also runs Bonsai 2 9B.
GPUs that run both natively(113)
- NVIDIA RTX 509032 GB
- NVIDIA RTX 508016 GB
- NVIDIA RTX 5070 Ti16 GB
- NVIDIA RTX 507012 GB
- NVIDIA RTX 5060 Ti 16GB16 GB
- NVIDIA RTX 5060 Ti 8GB8 GB
- NVIDIA RTX 50608 GB
- NVIDIA RTX 50508 GB
- NVIDIA RTX 409024 GB
- NVIDIA RTX 408016 GB
- NVIDIA RTX 4070 Ti SUPER16 GB
- NVIDIA RTX 4070 Ti12 GB
- +101 more GPUs run both
Which should you use?
- • You have limited VRAM: it's a smaller model needing 3.0 GB vs 7.2 GB
- • It's the newer release (2026-10-15 vs 2026-09-18); check the benchmark table above for what actually improved
- • You want maximum capability and have a 8 GB+ GPU
Frequently asked questions
- Which is better, Bonsai 2 9B or Bonsai 2 27B?
- Bonsai 2 9B has 9B parameters vs 27B for Bonsai 2 27B, so Bonsai 2 27B is the larger model. Bonsai 2 9B is more hardware-efficient, needing 3.0 GB at its Ternary (PQ2_0) build vs 7.2 GB for Bonsai 2 27B's Ternary (Q2_0). Bonsai 2 9B runs on more GPUs natively (117 vs 113).
- How much VRAM does Bonsai 2 9B need vs Bonsai 2 27B?
- At 8k context, Bonsai 2 9B needs approximately 3.0 GB of VRAM at its Ternary (PQ2_0) build, while Bonsai 2 27B needs 7.2 GB at its Ternary (Q2_0) build. At the largest build each ships, Bonsai 2 9B requires 3.2 GB (Ternary (Q2_0)) vs 7.2 GB (Ternary (Q2_0)) for Bonsai 2 27B.
- Can you run Bonsai 2 9B on the same GPUs as Bonsai 2 27B?
- Yes, 113 GPUs can run both natively in VRAM, including NVIDIA RTX 5090, NVIDIA RTX 5080, NVIDIA RTX 5070 Ti. However, 4 GPUs can run Bonsai 2 9B but not Bonsai 2 27B, and no GPU can run Bonsai 2 27B without also fitting Bonsai 2 9B.
- What is the difference between Bonsai 2 9B and Bonsai 2 27B?
- Bonsai 2 9B has 9B parameters (dense) with a 256k context window. Bonsai 2 27B has 27B parameters (dense) with a 256k context window.
- Which model fits in 24 GB of VRAM, Bonsai 2 9B or Bonsai 2 27B?
- Both fit in 24 GB of VRAM at their respective recommended builds: Bonsai 2 9B (Ternary (PQ2_0)) needs 3.0 GB and Bonsai 2 27B (Ternary (Q2_0)) needs 7.2 GB.