Apple M2 Ultra
The Apple M2 Ultra ships in 64–192 GB unified-memory configurations at 800 GB/s. Across those configurations it runs 82 of our 99 tracked models natively in VRAM at 8k context.
More memory means more of our tracked models fit natively; see which configuration you need below.
| Configuration | Bandwidth | CPU cores | Native models | + Offload |
|---|---|---|---|---|
| 192 GB | 800 GB/s | 24 (16P + 8E) | 82 / 99 | 0 |
| 64 GB | 800 GB/s | 24 (16P + 8E) | 63 / 99 | 0 |
How much of the Apple M2 Ultra's memory is actually usable?
macOS and background apps need a slice of the pool before a model gets to use it: this site reserves 8GB on every unified-memory GPU, the same baseline used everywhere else on this site. What's left is real headroom for a model's weights and KV cache:
Apple M2 Ultra (192GB)
With 192 GB LPDDR5 at 800 GB/s, this configuration runs 82 models natively. 184 GB of real headroom after this site's standard 8 GB reservation clears every dense model this site tracks up to 72B at full BF16 precision: Llama 3.3 70B and Qwen2.5 72B both fit at BF16 (159.8 GB and 164.3 GB) instead of being squeezed into Q4, at roughly 4.4-4.5 tok/s. It's also the only real M2 Ultra configuration that reaches 405B-parameter territory: Llama 3.1 405B fits at Q2_K (177.6 GB, ~4 tok/s), a capability the 64GB base configuration doesn't have at any quantization. Mixture-of-experts models are where the extra memory pays off most: Qwen3 235B-A22B fits at Q4_K_M (162.1 GB) around 13.8 tok/s, and GPT-OSS 120B reaches Q8_0 (139.6 GB) at roughly 34.8 tok/s. 82 of the 99 tracked models fit natively.
Apple M2 Ultra (192GB): the maximum-memory configuration of Apple's second Ultra-tier chip, two M2 Max dies fused with Apple's UltraFusion interposer, a high-speed silicon bridge that lets the pair act as one chip, launched June 2023 in the Mac Studio and Mac Pro. 192GB is the real ceiling for this chip: Apple never released the 384GB "M2 Extreme" that pre-launch leaks predicted, so 192GB, not 384GB, is the most memory any Mac has ever shipped with an M2-generation chip.
184 GB of real headroom after this site's standard 8 GB reservation clears every dense model this site tracks up to 72B at full BF16 precision: Llama 3.3 70B and Qwen2.5 72B both fit at BF16 (159.8 GB and 164.3 GB) instead of being squeezed into Q4, at roughly 4.4-4.5 tok/s. It's also the only real M2 Ultra configuration that reaches 405B-parameter territory: Llama 3.1 405B fits at Q2_K (177.6 GB, ~4 tok/s), a capability the 64GB base configuration doesn't have at any quantization. Mixture-of-experts models are where the extra memory pays off most: Qwen3 235B-A22B fits at Q4_K_M (162.1 GB) around 13.8 tok/s, and GPT-OSS 120B reaches Q8_0 (139.6 GB) at roughly 34.8 tok/s. 82 of the 99 tracked models fit natively.
Full MLX and llama.cpp Metal support. Community llama.cpp benchmarks on 76-core-GPU M2 Ultra report roughly 88-94 tok/s decode on a 7B model at Q4_0, and 1,100-1,400 tok/s prompt processing at F16 (ggml-org/llama.cpp Discussion #4167), figures set by GPU core count and 800 GB/s bandwidth, independent of which real memory configuration (64GB or 192GB) is installed.
Models the 192 GB configuration runs natively (82)
- MiniMax M3428B · MMLU-Pro N/AQ2_K · ~21.2 t/s
- Llama 3.1 405B Instruct405B · MMLU-Pro 73.3Q2_K · ~4 t/s
- Llama 4 Maverick 400B400B · MMLU-Pro 80.5Q2_K · ~25 t/s
- Ornith 1.5 397B (MoE)396.8B · MMLU-Pro N/AQ2_K · ~35.5 t/s
- GLM-4.7 358B358B · MMLU-Pro 84.3Q2_K · ~14.6 t/s
Show 77 more
- GLM-4.5 355B355B · MMLU-Pro 84.6Q2_K · ~14.6 t/s
- GLM-4.6 355B355B · MMLU-Pro 83.2Q2_K · ~14.6 t/s
- GLM-5.3-Flash 320B320B · MMLU-Pro N/AQ3_K_M · ~22 t/s
- DeepSeek V4 Flash 284B284B · MMLU-Pro 86.3Q3_K_M · ~30.6 t/s
- DeepSeek V4 Flash 0731 284B284B · MMLU-Pro N/AUD-Q8_K_XL · ~25.8 t/s
- Qwen3 235B-A22B (MoE)235B · MMLU-Pro 84.4Q4_K_M · ~13.8 t/s
- MiniMax M2.5 229B229B · MMLU-Pro 84.8Q4_K_M · ~28.6 t/s
- MiniMax M2.7 229B229B · MMLU-Pro 86.0Q4_K_M · ~28.6 t/s
- Step 3.7 Flash198B · MMLU-Pro N/AQ6_K · ~20.2 t/s
- Step 3.5 Flash196.81B · MMLU-Pro 84.4Q6_K · ~20.2 t/s
- Qwen3.8-Flash-Next180B · MMLU-Pro N/AQ6_K · ~38.5 t/s
- Mixtral 8x22B Instruct v0.1141B · MMLU-Pro 40.0Q8_0 · ~4.6 t/s
- Mistral Medium 3.5 128B128B · MMLU-Pro N/AQ8_0 · ~4.6 t/s
- Qwen 3.5 122B-A10B (MoE)122B · MMLU-Pro 86.7Q8_0 · ~18 t/s
- Nemotron 3 Super 120B120B · MMLU-Pro 83.7Q8_0 · ~14.8 t/s
- GPT-OSS 120B117B · MMLU-Pro 80.7Q8_0 · ~34.8 t/s
- Llama 4 Scout 109B109B · MMLU-Pro 74.3Q8_0 · ~10.2 t/s
- GLM-4.5 Air 106B106B · MMLU-Pro 81.4Q8_0 · ~14.5 t/s
- GLM-4.6V 106B106B · MMLU-Pro 79.9Q8_0 · ~14.5 t/s
- Qwen 2.5 72B Instruct72B · MMLU-Pro 71.1BF16 · ~4.4 t/s
- Llama 3.3 70B Instruct70B · MMLU-Pro 68.9BF16 · ~4.5 t/s
- DeepSeek R1 Distill Llama 70B70B · MMLU-Pro 70.0BF16 · ~4.5 t/s
- Llama 3.1 70B Instruct70B · MMLU-Pro 66.4BF16 · ~4.5 t/s
- Mixtral 8x7B Instruct v0.146.7B · MMLU-Pro 29.7BF16 · ~7.4 t/s
- Command-R 35B35B · MMLU-Pro 33.0BF16 · ~7.9 t/s
- Qwen 3.5 35B-A3B (MoE)35B · MMLU-Pro 85.3BF16 · ~31.7 t/s
- Qwen 3.6 35B35B · MMLU-Pro 85.2BF16 · ~8.9 t/s
- Ornith 1.5 35B-A3B (MoE)35B · MMLU-Pro N/ABF16 · ~31.7 t/s
- Yi 1.5 34B Chat34.4B · MMLU-Pro 37.0BF16 · ~9 t/s
- Qwen3 32B32.8B · MMLU-Pro 65.5BF16 · ~9.6 t/s
- Qwen 2.5 32B Instruct32.5B · MMLU-Pro 69.0BF16 · ~9.5 t/s
- Qwen 2.5 Coder 32B Instruct32.5B · MMLU-Pro 62.3BF16 · ~9.5 t/s
- DeepSeek R1 Distill Qwen 32B32.5B · MMLU-Pro 65.0BF16 · ~9.5 t/s
- Nemotron 3 Nano 30B32B · MMLU-Pro 78.3BF16 · ~31.3 t/s
- Gemma 4 31B30.7B · MMLU-Pro 85.2BF16 · ~10.2 t/s
- Qwen3 30B-A3B (MoE)30B · MMLU-Pro 61.5BF16 · ~30.8 t/s
- Nemotron 3.5 Lightning 30B-A3B30B · MMLU-Pro 81.6BF16 · ~31.9 t/s
- Muse Glimmer 30B27.8B · MMLU-Pro N/ABF16 · ~11.5 t/s
- Gemma 2 27B Instruct27.2B · MMLU-Pro 38.0BF16 · ~11.1 t/s
- Gemma 3 27B Instruct27B · MMLU-Pro 67.5BF16 · ~11.5 t/s
- Qwen 3.6 27B27B · MMLU-Pro 86.2BF16 · ~11.7 t/s
- UI-Mate 27B27B · MMLU-Pro ~86.2BF16 · ~11.7 t/s
- Bonsai 27B27B · MMLU-Pro ~81.5Ternary (Q2_0) · ~82.7 t/s
- Bonsai 2 27B27B · MMLU-Pro N/ATernary (Q2_0) · ~99.4 t/s
- Qwen 3.8 27B27B · MMLU-Pro N/ABF16 · ~11.7 t/s
- Gemma 4 26B (MoE)25.2B · MMLU-Pro 82.6BF16 · ~24.9 t/s
- Mistral Small 3.1 24B Instruct24B · MMLU-Pro 66.8BF16 · ~13 t/s
- Mistral Small 22B22.2B · MMLU-Pro 49.2BF16 · ~13.8 t/s
- GPT-OSS 20B21B · MMLU-Pro 67.9BF16 · ~26.4 t/s
- Qwen3 14B14.8B · MMLU-Pro 61.0BF16 · ~20.7 t/s
- Qwen 2.5 14B Instruct14.7B · MMLU-Pro 63.7BF16 · ~20.6 t/s
- Phi-4 14B Instruct14B · MMLU-Pro 70.4BF16 · ~21.8 t/s
- Mistral Nemo 12B Instruct12.2B · MMLU-Pro 35.6BF16 · ~24.9 t/s
- Gemma 3 12B Instruct12.2B · MMLU-Pro 60.6BF16 · ~25.1 t/s
- Gemma 4 12B (Unified)12B · MMLU-Pro 77.2BF16 · ~23.5 t/s
- Gemma 2 9B Instruct9.2B · MMLU-Pro 32.0BF16 · ~30.2 t/s
- Qwen 3.5 9B9B · MMLU-Pro 82.5BF16 · ~35 t/s
- Ornith 1.5 9B9B · MMLU-Pro N/ABF16 · ~35 t/s
- Llama 3.1 8B Instruct8B · MMLU-Pro 48.3BF16 · ~37.5 t/s
- DeepSeek R1 Distill Llama 8B8B · MMLU-Pro 41.0BF16 · ~37.5 t/s
- Qwen3 8B8B · MMLU-Pro 56.7BF16 · ~37.2 t/s
- Qwen 2.5 7B Instruct7.6B · MMLU-Pro 56.3BF16 · ~40.8 t/s
- Mistral 7B Instruct v0.37.25B · MMLU-Pro 30.0BF16 · ~41.1 t/s
- Gemma 3 4B Instruct4B · MMLU-Pro 43.6BF16 · ~75.3 t/s
- Gemma 4 E4B4B · MMLU-Pro 69.4BF16 · ~71.1 t/s
- Phi-3.5 Mini Instruct3.8B · MMLU-Pro 47.4BF16 · ~59.1 t/s
- Phi-4-mini Instruct3.8B · MMLU-Pro 67.3BF16 · ~73.8 t/s
- Llama 3.2 3B Instruct3.2B · MMLU-Pro 24.0BF16 · ~87.2 t/s
- Qwen 2.5 3B Instruct3.1B · MMLU-Pro 32.4BF16 · ~98.4 t/s
- Gemma 2 2B Instruct2.6B · MMLU-Pro 17.8BF16 · ~105.4 t/s
- Gemma 4 E2B2B · MMLU-Pro 60.0BF16 · ~145.4 t/s
- SmolLM2 1.7B Instruct1.7B · MMLU-Pro 19.0BF16 · ~127.7 t/s
- Qwen 2.5 1.5B Instruct1.5B · MMLU-Pro 16.8BF16 · ~197.8 t/s
- Llama 3.2 1B Instruct1.24B · MMLU-Pro 12.5BF16 · ~232.9 t/s
- Gemma 3 1B Instruct1B · MMLU-Pro 14.7BF16 · ~275 t/s
- Qwen 2.5 0.5B Instruct0.5B · MMLU-Pro 10.0BF16 · ~581.5 t/s
- SmolLM2 360M Instruct0.36B · MMLU-Pro 8.0BF16 · ~606.3 t/s
Apple M2 Ultra (64GB)
With 64 GB LPDDR5 at 800 GB/s, this configuration runs 63 models natively. 56 GB of real headroom after the standard 8 GB reservation, identical capacity to the M2 Max 64GB configuration, so the same 63 of 99 tracked models fit natively, including Llama 3.3 70B and Qwen2.5 72B at Q4_K_M. What changes is speed, not capacity: this site's calculator projects roughly 14.1 tok/s for Llama 3.3 70B here, almost exactly double the M2 Max 64GB's 7.1 tok/s, because doubling bandwidth (800 vs 400 GB/s) doubles decode throughput on a workload this bandwidth-bound without changing what fits.
Apple M2 Ultra (64GB): the base memory configuration of Apple's second Ultra-tier chip, the entry point into the Mac Studio and Mac Pro's Ultra lineup starting at $3,999 in June 2023. It shares the 192GB configuration's full 800 GB/s of unified memory bandwidth and 24-core CPU (16P+8E); Apple doesn't cut bandwidth for the smaller memory build on this chip, unlike the bandwidth-binned 96GB M3 Max a generation later.
56 GB of real headroom after the standard 8 GB reservation, identical capacity to the M2 Max 64GB configuration, so the same 63 of 99 tracked models fit natively, including Llama 3.3 70B and Qwen2.5 72B at Q4_K_M. What changes is speed, not capacity: this site's calculator projects roughly 14.1 tok/s for Llama 3.3 70B here, almost exactly double the M2 Max 64GB's 7.1 tok/s, because doubling bandwidth (800 vs 400 GB/s) doubles decode throughput on a workload this bandwidth-bound without changing what fits.
Same MLX and llama.cpp Metal maturity as the 192GB sibling. The Ultra tier's advantage over a same-capacity Max configuration is decode speed, not new capability; choosing this over an M2 Max 64GB buys roughly 2x tokens/sec on models that already fit both, not the ability to run anything new.
Models the 64 GB configuration runs natively (63)
- Qwen 3.5 122B-A10B (MoE)122B · MMLU-Pro 86.7Q2_K · ~49.6 t/s
- Nemotron 3 Super 120B120B · MMLU-Pro 83.7Q2_K · ~40.1 t/s
- Llama 4 Scout 109B109B · MMLU-Pro 74.3Q2_K · ~26.4 t/s
- GLM-4.5 Air 106B106B · MMLU-Pro 81.4Q2_K · ~38.1 t/s
- GLM-4.6V 106B106B · MMLU-Pro 79.9Q2_K · ~38.1 t/s
Show 58 more
- Qwen 2.5 72B Instruct72B · MMLU-Pro 71.1Q4_K_M · ~13.8 t/s
- Llama 3.3 70B Instruct70B · MMLU-Pro 68.9Q4_K_M · ~14.1 t/s
- DeepSeek R1 Distill Llama 70B70B · MMLU-Pro 70.0Q4_K_M · ~14.1 t/s
- Llama 3.1 70B Instruct70B · MMLU-Pro 66.4Q4_K_M · ~14.1 t/s
- Mixtral 8x7B Instruct v0.146.7B · MMLU-Pro 29.7Q6_K · ~17.6 t/s
- Command-R 35B35B · MMLU-Pro 33.0Q8_0 · ~13.3 t/s
- Qwen 3.5 35B-A3B (MoE)35B · MMLU-Pro 85.3Q8_0 · ~59.3 t/s
- Qwen 3.6 35B35B · MMLU-Pro 85.2Q8_0 · ~16.3 t/s
- Ornith 1.5 35B-A3B (MoE)35B · MMLU-Pro N/AQ8_0 · ~59.3 t/s
- Yi 1.5 34B Chat34.4B · MMLU-Pro 37.0Q8_0 · ~16.6 t/s
- Qwen3 32B32.8B · MMLU-Pro 65.5Q8_0 · ~17.7 t/s
- Qwen 2.5 32B Instruct32.5B · MMLU-Pro 69.0Q8_0 · ~17.4 t/s
- Qwen 2.5 Coder 32B Instruct32.5B · MMLU-Pro 62.3Q8_0 · ~17.4 t/s
- DeepSeek R1 Distill Qwen 32B32.5B · MMLU-Pro 65.0Q8_0 · ~17.4 t/s
- Nemotron 3 Nano 30B32B · MMLU-Pro 78.3Q8_0 · ~57.8 t/s
- Gemma 4 31B30.7B · MMLU-Pro 85.2Q8_0 · ~18.7 t/s
- Qwen3 30B-A3B (MoE)30B · MMLU-Pro 61.5Q8_0 · ~56 t/s
- Nemotron 3.5 Lightning 30B-A3B30B · MMLU-Pro 81.6Q8_0 · ~59.9 t/s
- Muse Glimmer 30B27.8B · MMLU-Pro N/AQ8_0 · ~21.5 t/s
- Gemma 2 27B Instruct27.2B · MMLU-Pro 38.0Q8_0 · ~20 t/s
- Gemma 3 27B Instruct27B · MMLU-Pro 67.5Q8_0 · ~21.2 t/s
- Qwen 3.6 27B27B · MMLU-Pro 86.2Q8_0 · ~21.9 t/s
- UI-Mate 27B27B · MMLU-Pro ~86.2Q8_0 · ~21.9 t/s
- Bonsai 27B27B · MMLU-Pro ~81.5Ternary (Q2_0) · ~82.7 t/s
- Bonsai 2 27B27B · MMLU-Pro N/ATernary (Q2_0) · ~99.4 t/s
- Qwen 3.8 27B27B · MMLU-Pro N/AQ8_0 · ~21.9 t/s
- Gemma 4 26B (MoE)25.2B · MMLU-Pro 82.6Q8_0 · ~46.2 t/s
- Mistral Small 3.1 24B Instruct24B · MMLU-Pro 66.8BF16 · ~13 t/s
- Mistral Small 22B22.2B · MMLU-Pro 49.2BF16 · ~13.8 t/s
- GPT-OSS 20B21B · MMLU-Pro 67.9BF16 · ~26.4 t/s
- Qwen3 14B14.8B · MMLU-Pro 61.0BF16 · ~20.7 t/s
- Qwen 2.5 14B Instruct14.7B · MMLU-Pro 63.7BF16 · ~20.6 t/s
- Phi-4 14B Instruct14B · MMLU-Pro 70.4BF16 · ~21.8 t/s
- Mistral Nemo 12B Instruct12.2B · MMLU-Pro 35.6BF16 · ~24.9 t/s
- Gemma 3 12B Instruct12.2B · MMLU-Pro 60.6BF16 · ~25.1 t/s
- Gemma 4 12B (Unified)12B · MMLU-Pro 77.2BF16 · ~23.5 t/s
- Gemma 2 9B Instruct9.2B · MMLU-Pro 32.0BF16 · ~30.2 t/s
- Qwen 3.5 9B9B · MMLU-Pro 82.5BF16 · ~35 t/s
- Ornith 1.5 9B9B · MMLU-Pro N/ABF16 · ~35 t/s
- Llama 3.1 8B Instruct8B · MMLU-Pro 48.3BF16 · ~37.5 t/s
- DeepSeek R1 Distill Llama 8B8B · MMLU-Pro 41.0BF16 · ~37.5 t/s
- Qwen3 8B8B · MMLU-Pro 56.7BF16 · ~37.2 t/s
- Qwen 2.5 7B Instruct7.6B · MMLU-Pro 56.3BF16 · ~40.8 t/s
- Mistral 7B Instruct v0.37.25B · MMLU-Pro 30.0BF16 · ~41.1 t/s
- Gemma 3 4B Instruct4B · MMLU-Pro 43.6BF16 · ~75.3 t/s
- Gemma 4 E4B4B · MMLU-Pro 69.4BF16 · ~71.1 t/s
- Phi-3.5 Mini Instruct3.8B · MMLU-Pro 47.4BF16 · ~59.1 t/s
- Phi-4-mini Instruct3.8B · MMLU-Pro 67.3BF16 · ~73.8 t/s
- Llama 3.2 3B Instruct3.2B · MMLU-Pro 24.0BF16 · ~87.2 t/s
- Qwen 2.5 3B Instruct3.1B · MMLU-Pro 32.4BF16 · ~98.4 t/s
- Gemma 2 2B Instruct2.6B · MMLU-Pro 17.8BF16 · ~105.4 t/s
- Gemma 4 E2B2B · MMLU-Pro 60.0BF16 · ~145.4 t/s
- SmolLM2 1.7B Instruct1.7B · MMLU-Pro 19.0BF16 · ~127.7 t/s
- Qwen 2.5 1.5B Instruct1.5B · MMLU-Pro 16.8BF16 · ~197.8 t/s
- Llama 3.2 1B Instruct1.24B · MMLU-Pro 12.5BF16 · ~232.9 t/s
- Gemma 3 1B Instruct1B · MMLU-Pro 14.7BF16 · ~275 t/s
- Qwen 2.5 0.5B Instruct0.5B · MMLU-Pro 10.0BF16 · ~581.5 t/s
- SmolLM2 360M Instruct0.36B · MMLU-Pro 8.0BF16 · ~606.3 t/s
Too large for any Apple M2 Ultra configuration (17)
Compare Apple M2 Ultra with other GPUs
- Apple M2 Ultra (192GB)vsApple M3 Ultra (512GB)-320 GB VRAM
- Apple M2 Ultra (192GB)vsApple M1 Ultra (128GB)+64 GB VRAM
- Apple M2 Ultra (192GB)vsNVIDIA RTX 4090+168 GB VRAM
- Apple M2 Ultra (192GB)vsNVIDIA RTX 6000 Ada+144 GB VRAM
- Apple M2 Ultra (192GB)vsAMD Instinct MI300X192 GB each
- Apple M2 Ultra (192GB)vsApple M3 Max (128GB)+64 GB VRAM
Frequently asked questions
- How much memory does the Apple M2 Ultra have?
- The Apple M2 Ultra ships in 2 unified-memory configurations: 192 GB and 64 GB, all at 800 GB/s.
- Should I get the 64 GB or 192 GB Apple M2 Ultra?
- Both run everything that fits natively in 64 GB. The extra memory in the 192 GB configuration additionally fits MiniMax M3, Llama 3.1 405B Instruct, Llama 4 Maverick 400B, and 16 more models natively in VRAM, worth the upgrade if you plan to run any of those.
- How much VRAM does the Apple M2 Ultra (192GB) have?
- The Apple M2 Ultra (192GB) has 192 GB of LPDDR5 with 800 GB/s memory bandwidth (unified system memory, shared between CPU and GPU).
- What is the Apple M2 Ultra (192GB) best for?
- With 192 GB of unified memory, the Apple M2 Ultra (192GB) is a high-capacity workstation platform capable of running the largest open-weight models (70B–405B) at high quantization with ample context.
- What LLMs can the Apple M2 Ultra (192GB) run locally?
- The Apple M2 Ultra (192GB) can run 82 of the 99 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Ornith 1.5 397B (MoE) at Q2_K, Qwen3.8-Flash-Next at Q6_K, GLM-5.3-Flash 320B at Q3_K_M.
- Can the Apple M2 Ultra (192GB) run Gemma 4 31B?
- Yes. The Apple M2 Ultra (192GB) runs Gemma 4 31B natively in VRAM at BF16 quantization, achieving approximately 10.2 tokens per second.
Show 8 more questions
- Can the Apple M2 Ultra (192GB) run Qwen 3.6 27B?
- Yes. The Apple M2 Ultra (192GB) runs Qwen 3.6 27B natively in VRAM at BF16 quantization, achieving approximately 11.7 tokens per second.
- Can the Apple M2 Ultra (192GB) run Qwen3 8B?
- Yes. The Apple M2 Ultra (192GB) runs Qwen3 8B natively in VRAM at BF16 quantization, achieving approximately 37.2 tokens per second.
- How much VRAM does the Apple M2 Ultra (64GB) have?
- The Apple M2 Ultra (64GB) has 64 GB of LPDDR5 with 800 GB/s memory bandwidth (unified system memory, shared between CPU and GPU).
- What is the Apple M2 Ultra (64GB) best for?
- With 64 GB of VRAM, the Apple M2 Ultra (64GB) is ideal for running 70B-class models at Q4 quantization and large MoE models, a workstation sweet spot for local inference.
- What LLMs can the Apple M2 Ultra (64GB) run locally?
- The Apple M2 Ultra (64GB) can run 63 of the 99 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Qwen 3.8 27B at Q8_0, Ornith 1.5 35B-A3B (MoE) at Q8_0, Qwen 3.5 122B-A10B (MoE) at Q2_K.
- Can the Apple M2 Ultra (64GB) run Gemma 4 31B?
- Yes. The Apple M2 Ultra (64GB) runs Gemma 4 31B natively in VRAM at Q8_0 quantization, achieving approximately 18.7 tokens per second.
- Can the Apple M2 Ultra (64GB) run Qwen 3.6 27B?
- Yes. The Apple M2 Ultra (64GB) runs Qwen 3.6 27B natively in VRAM at Q8_0 quantization, achieving approximately 21.9 tokens per second.
- Can the Apple M2 Ultra (64GB) run Qwen3 8B?
- Yes. The Apple M2 Ultra (64GB) runs Qwen3 8B natively in VRAM at BF16 quantization, achieving approximately 37.2 tokens per second.