Apple M5
The Apple M5 ships in 16–32 GB unified-memory configurations at 153 GB/s. Across those configurations it runs 46 of our 84 tracked models natively in VRAM at 8k context.
More memory means more of our tracked models fit natively — see which configuration you need below.
| Configuration | Bandwidth | CPU cores | Native models | + Offload |
|---|---|---|---|---|
| 32 GB | 153 GB/s | 10 (4S + 6E) | 46 / 84 | 0 |
| 16 GB | 153 GB/s | 10 (4S + 6E) | 26 / 84 | 0 |
How much of the Apple M5's memory is actually usable?
macOS and background apps need a slice of the pool before a model gets to use it — this site reserves 8GB on every unified-memory GPU, the same baseline used everywhere else on this site. What's left is real headroom for a model's weights and KV cache:
Base-tier bandwidth, from M5's own vantage point
Apple's cheapest M-series chip doesn't get a bandwidth bump every year — M3 shipped at the exact same 100 GB/s as M2, a full generation with no change at all. Tracking the base tier's memory bandwidth across five generations:
M1's 68 GB/s jumped 47% to M2's 100 GB/s, M3 held flat at that same 100 GB/s, and M4 resumed the climb with a 20% jump to 120 GB/s. M5 (this page) adds the largest single-generation increase in the base tier's five-generation history, up 27.5% to 153 GB/s. Since decode is bandwidth-bound, that compounds directly into tokens/sec: this site's calculator measures Llama 3.1 8B at 18.1 tok/s on this chip versus 14.2 tok/s on the identically-sized M4 16GB — a real generational leap, not a spec-sheet rounding error.
Apple M5 (32GB)
With 32 GB LPDDR5X at 153 GB/s, this configuration runs 46 models natively. It comfortably runs 7B–32B models at Q4; 70B-class models typically need CPU offload.
Apple M5 (32GB): Apple's entry-level M5 chip at its maximum tracked memory configuration, available in the MacBook Pro since October 2025 and the MacBook Air since March 2026, with a 10-core CPU (4 super cores + 6 efficiency cores) and 153 GB/s of unified-memory bandwidth — a 27.5% jump over the M4 base chip's 120 GB/s, the largest single-generation bandwidth increase anywhere in the base tier's five-generation history (see this page's bandwidth note).
With 24 GB of real headroom, this configuration comfortably clears genuine 30B-class models: Qwen3 32B fits at Q4_K_M (23.88 GB, 5.7 tok/s) — about 27% faster than the identically-sized M4 32GB on the same fit (4.5 tok/s there), tracking the 153-vs-120 GB/s bandwidth gap closely — and Qwen 3.6 35B reaches Q3_K_M (21.26 GB, 6.4 tok/s). The MoE-vs-dense gap is stark at this capacity too: Qwen 3.5 35B-A3B — a bigger model by parameter count than Qwen3 32B — fits at Q3_K_M (19.04 GB) at 24.6 tok/s, more than 4x Qwen3 32B's speed, since MoE decode only reads its active parameters off the memory bus. 46 of the 84 tracked models fit natively.
MLX and llama.cpp's Metal backend are both mature on this chip. This configuration's largest fits (~19-24 GB) stay under the default ~24 GB Metal working-set limit (75% of 32 GB), so the manual wired_limit override rarely matters here.
Models the 32 GB configuration runs natively (46)
- Mixtral 8x7B Instruct v0.146.7B · MMLU-Pro 29.7Q2_K · ~7 t/s
- Qwen 3.5 35B-A3B (MoE)35B · MMLU-Pro 85.3Q3_K_M · ~24.6 t/s
- Qwen 3.6 35B35B · MMLU-Pro 85.2Q3_K_M · ~6.4 t/s
- Yi 1.5 34B Chat34.4B · MMLU-Pro 37.0Q3_K_M · ~6.6 t/s
- Qwen3 32B32.8B · MMLU-Pro 65.5Q4_K_M · ~5.7 t/s
Show 41 more
- Qwen 2.5 32B Instruct32.5B · MMLU-Pro 69.0Q3_K_M · ~6.9 t/s
- Qwen 2.5 Coder 32B Instruct32.5B · MMLU-Pro 50.4Q3_K_M · ~6.9 t/s
- DeepSeek R1 Distill Qwen 32B32.5B · MMLU-Pro 65.0Q3_K_M · ~6.9 t/s
- Nemotron 3 Nano 30B32B · MMLU-Pro 78.3Q4_K_M · ~18.8 t/s
- Gemma 4 31B31B · MMLU-Pro 85.2Q3_K_M · ~6.8 t/s
- Qwen3 30B-A3B (MoE)30B · MMLU-Pro 61.5Q4_K_M · ~17.8 t/s
- Gemma 2 27B Instruct27.2B · MMLU-Pro 38.0Q4_K_M · ~6.2 t/s
- Gemma 3 27B Instruct27B · MMLU-Pro 67.5Q5_K_M · ~5.9 t/s
- Qwen 3.6 27B27B · MMLU-Pro 86.2Q5_K_M · ~6.2 t/s
- Bonsai 27B27B · MMLU-Pro 81.5Ternary (Q2_0) · ~13.9 t/s
- Gemma 4 26B (MoE)26B · MMLU-Pro 82.6Q5_K_M · ~13 t/s
- Mistral Small 3.1 24B Instruct24B · MMLU-Pro 66.8Q6_K · ~5.8 t/s
- Mistral Small 22B22.2B · MMLU-Pro 49.2Q6_K · ~6.1 t/s
- GPT-OSS 20B21B · MMLU-Pro 67.9Q6_K · ~12.2 t/s
- Qwen3 14B14.8B · MMLU-Pro 61.0Q8_0 · ~7.2 t/s
- Qwen 2.5 14B Instruct14.7B · MMLU-Pro 63.7Q8_0 · ~7.1 t/s
- Phi-4 14B Instruct14B · MMLU-Pro 70.4Q8_0 · ~7.5 t/s
- Mistral Nemo 12B Instruct12.2B · MMLU-Pro 35.6Q8_0 · ~8.6 t/s
- Gemma 3 12B Instruct12.2B · MMLU-Pro 60.6Q8_0 · ~8.7 t/s
- Gemma 4 12B (Unified)12B · MMLU-Pro 77.2Q8_0 · ~7.7 t/s
- Gemma 2 9B Instruct9.2B · MMLU-Pro 32.0BF16 · ~5.8 t/s
- Qwen 3.5 9B9B · MMLU-Pro 82.5BF16 · ~6.7 t/s
- Llama 3.1 8B Instruct8B · MMLU-Pro 48.3BF16 · ~7.2 t/s
- DeepSeek R1 Distill Llama 8B8B · MMLU-Pro 41.0BF16 · ~7.2 t/s
- Qwen3 8B8B · MMLU-Pro 56.7BF16 · ~7.1 t/s
- Qwen 2.5 7B Instruct7.6B · MMLU-Pro 56.3BF16 · ~7.8 t/s
- Mistral 7B Instruct v0.37.25B · MMLU-Pro 30.0BF16 · ~7.9 t/s
- Gemma 3 4B Instruct4B · MMLU-Pro 43.6FP32 · ~7.4 t/s
- Gemma 4 E4B4B · MMLU-Pro 69.4FP32 · ~7.2 t/s
- Phi-3.5 Mini Instruct3.8B · MMLU-Pro 47.4FP32 · ~6.6 t/s
- Phi-4-mini Instruct3.8B · MMLU-Pro 67.3FP32 · ~7.5 t/s
- Llama 3.2 3B Instruct3.2B · MMLU-Pro 24.0FP32 · ~8.9 t/s
- Qwen 2.5 3B Instruct3.1B · MMLU-Pro 32.4FP32 · ~9.6 t/s
- Gemma 2 2B Instruct2.6B · MMLU-Pro 17.8FP32 · ~10.9 t/s
- Gemma 4 E2B2B · MMLU-Pro 60.0FP32 · ~14.6 t/s
- SmolLM2 1.7B Instruct1.7B · MMLU-Pro 19.0FP32 · ~14.6 t/s
- Qwen 2.5 1.5B Instruct1.5B · MMLU-Pro 16.8FP32 · ~19.6 t/s
- Llama 3.2 1B Instruct1.24B · MMLU-Pro 12.5FP32 · ~23.4 t/s
- Gemma 3 1B Instruct1B · MMLU-Pro 14.7FP32 · ~28.3 t/s
- Qwen 2.5 0.5B Instruct0.5B · MMLU-Pro 10.0FP32 · ~58.3 t/s
- SmolLM2 360M Instruct0.36B · MMLU-Pro 8.0FP32 · ~68.9 t/s
Apple M5 (16GB)
With 16 GB LPDDR5X at 153 GB/s, this configuration runs 26 models natively. It handles smaller models (7B–14B) at Q4–Q5 quantization.
Apple M5 (16GB): the base configuration of Apple's entry-level M5 chip, launched October 2025 as the standard memory on the MacBook Pro, and since March 2026 the MacBook Air too, with the same 10-core CPU (4 super cores + 6 efficiency cores) and 153 GB/s bandwidth as the 32GB build — only the memory pool changes.
With 8 GB of real headroom after the standard 8 GB reservation, this site's calculator fits Llama 3.1 8B at Q5_K_M (7.58 GB, 18.1 tok/s) and Qwen2.5 7B at Q6_K (7.51 GB, 18.2 tok/s) — about 27.5% faster than the identically-sized M4 16GB on the same two models (14.2 and 14.3 tok/s there), tracking the 153-vs-120 GB/s bandwidth ratio almost exactly. 26 of the 84 tracked models fit natively — the same count as the base M1 through M4 16GB configurations at this identical 8 GB headroom, since capacity, not bandwidth, decides the model list.
MLX and llama.cpp's Metal backend are both mature here. 16GB remains the practical minimum for serious local LLM inference on Apple Silicon — worth confirming before buying, since it's still the standard configuration on the entry MacBook Air and MacBook Pro.
Models the 16 GB configuration runs natively (26)
- Bonsai 27B27B · MMLU-Pro 81.51-bit (Q1_0) · ~22.6 t/s
- Qwen3 14B14.8B · MMLU-Pro 61.0Q2_K · ~17.5 t/s
- Phi-4 14B Instruct14B · MMLU-Pro 70.4Q2_K · ~18.3 t/s
- Mistral Nemo 12B Instruct12.2B · MMLU-Pro 35.6Q2_K · ~20.4 t/s
- Gemma 3 12B Instruct12.2B · MMLU-Pro 60.6Q3_K_M · ~17.7 t/s
Show 21 more
- Gemma 2 9B Instruct9.2B · MMLU-Pro 32.0Q2_K · ~19.4 t/s
- Qwen 3.5 9B9B · MMLU-Pro 82.5Q5_K_M · ~18.3 t/s
- Llama 3.1 8B Instruct8B · MMLU-Pro 48.3Q5_K_M · ~18.1 t/s
- DeepSeek R1 Distill Llama 8B8B · MMLU-Pro 41.0Q5_K_M · ~18.1 t/s
- Qwen3 8B8B · MMLU-Pro 56.7Q5_K_M · ~17.7 t/s
- Qwen 2.5 7B Instruct7.6B · MMLU-Pro 56.3Q6_K · ~18.2 t/s
- Mistral 7B Instruct v0.37.25B · MMLU-Pro 30.0Q6_K · ~17.4 t/s
- Gemma 3 4B Instruct4B · MMLU-Pro 43.6Q8_0 · ~25.7 t/s
- Gemma 4 E4B4B · MMLU-Pro 69.4Q8_0 · ~23.3 t/s
- Phi-3.5 Mini Instruct3.8B · MMLU-Pro 47.4Q6_K · ~19.3 t/s
- Phi-4-mini Instruct3.8B · MMLU-Pro 67.3Q8_0 · ~23.9 t/s
- Llama 3.2 3B Instruct3.2B · MMLU-Pro 24.0Q8_0 · ~28.2 t/s
- Qwen 2.5 3B Instruct3.1B · MMLU-Pro 32.4BF16 · ~18.8 t/s
- Gemma 2 2B Instruct2.6B · MMLU-Pro 17.8BF16 · ~20.2 t/s
- Gemma 4 E2B2B · MMLU-Pro 60.0BF16 · ~27.8 t/s
- SmolLM2 1.7B Instruct1.7B · MMLU-Pro 19.0BF16 · ~24.4 t/s
- Qwen 2.5 1.5B Instruct1.5B · MMLU-Pro 16.8FP32 · ~19.6 t/s
- Llama 3.2 1B Instruct1.24B · MMLU-Pro 12.5FP32 · ~23.4 t/s
- Gemma 3 1B Instruct1B · MMLU-Pro 14.7FP32 · ~28.3 t/s
- Qwen 2.5 0.5B Instruct0.5B · MMLU-Pro 10.0FP32 · ~58.3 t/s
- SmolLM2 360M Instruct0.36B · MMLU-Pro 8.0FP32 · ~68.9 t/s
Too large for any Apple M5 configuration (38)
- Llama 3.3 70B Instruct
- Qwen 2.5 72B Instruct
- DeepSeek R1 Distill Llama 70B
- Command-R 35B
- Llama 3.1 70B Instruct
- Mixtral 8x22B Instruct v0.1
- Llama 3.1 405B Instruct
- DeepSeek V3 671B
- DeepSeek R1 671B
- Llama 4 Scout 109B
- Llama 4 Maverick 400B
- Qwen3 235B-A22B (MoE)
- MiniMax M1 456B
- GPT-OSS 120B
- GLM-4.5 355B
- GLM-4.5 Air 106B
- GLM-4.6 355B
- GLM-4.6V 106B
- GLM-4.7 358B
- Qwen 3.5 122B-A10B (MoE)
- MiniMax M2.5 229B
- GLM-5 744B
- MiniMax M2.7 229B
- Nemotron 3 Super 120B
- Kimi K2.6
- GLM-5.1 754B
- DeepSeek V4 Pro 1.6T
- DeepSeek V4 Flash 284B
- Mistral Medium 3.5 128B
- GLM-5.2 753B
- Nemotron 3 Ultra 550B-A55B
- Step 3.5 Flash
- Step 3.7 Flash
- MiMo V2.5 Pro
- Kimi K2.5
- MiniMax M3
- Inkling
- Kimi K3
Continue reading
Frequently asked questions
- How much memory does the Apple M5 have?
- The Apple M5 ships in 2 unified-memory configurations: 32 GB and 16 GB, all at 153 GB/s.
- Should I get the 16 GB or 32 GB Apple M5?
- Both run everything that fits natively in 16 GB. The extra memory in the 32 GB configuration additionally fits Mixtral 8x7B Instruct v0.1, Qwen 3.5 35B-A3B (MoE), Qwen 3.6 35B, and 17 more models natively in VRAM — worth the upgrade if you plan to run any of those.
- How much VRAM does the Apple M5 (32GB) have?
- The Apple M5 (32GB) has 32 GB of LPDDR5X with 153 GB/s memory bandwidth (unified system memory, shared between CPU and GPU).
- What is the Apple M5 (32GB) best for?
- With 32 GB of VRAM, the Apple M5 (32GB) is well-suited for running 7B–32B models at Q4 with room for context, making it a great all-rounder for local LLM inference.
- What LLMs can the Apple M5 (32GB) run locally?
- The Apple M5 (32GB) can run 46 of the 84 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Llama 3.1 8B Instruct at BF16, Llama 3.2 3B Instruct at FP32, Llama 3.2 1B Instruct at FP32.
- Can the Apple M5 (32GB) run Llama 3.3 70B Instruct?
- The Apple M5 (32GB) does not have enough VRAM to run Llama 3.3 70B Instruct. You would need more VRAM or a lower quantization level.
Show 8 more questions
- Can the Apple M5 (32GB) run Qwen 3.6 27B?
- Yes. The Apple M5 (32GB) runs Qwen 3.6 27B natively in VRAM at Q5_K_M quantization, achieving approximately 6.2 tokens per second.
- Can the Apple M5 (32GB) run Llama 3.1 8B Instruct?
- Yes. The Apple M5 (32GB) runs Llama 3.1 8B Instruct natively in VRAM at BF16 quantization, achieving approximately 7.2 tokens per second.
- How much VRAM does the Apple M5 (16GB) have?
- The Apple M5 (16GB) has 16 GB of LPDDR5X with 153 GB/s memory bandwidth (unified system memory, shared between CPU and GPU).
- What is the Apple M5 (16GB) best for?
- With 16 GB of VRAM, the Apple M5 (16GB) handles smaller models (7B–14B) at Q4–Q5 quantization — ideal for entry-level local LLM experimentation and lightweight inference.
- What LLMs can the Apple M5 (16GB) run locally?
- The Apple M5 (16GB) can run 26 of the 84 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Llama 3.1 8B Instruct at Q5_K_M, Llama 3.2 3B Instruct at Q8_0, Llama 3.2 1B Instruct at FP32.
- Can the Apple M5 (16GB) run Llama 3.3 70B Instruct?
- The Apple M5 (16GB) does not have enough VRAM to run Llama 3.3 70B Instruct. You would need more VRAM or a lower quantization level.
- Can the Apple M5 (16GB) run Qwen 3.6 27B?
- The Apple M5 (16GB) does not have enough VRAM to run Qwen 3.6 27B. You would need more VRAM or a lower quantization level.
- Can the Apple M5 (16GB) run Llama 3.1 8B Instruct?
- Yes. The Apple M5 (16GB) runs Llama 3.1 8B Instruct natively in VRAM at Q5_K_M quantization, achieving approximately 18.1 tokens per second.