Apple M4 Ultra (192GB)
The Apple M4 Ultra (192GB) has 192 GB VRAM and 1092 GB/s memory bandwidth. It can run 64 of our 70 tracked models natively in VRAM at 8k context.
With 192 GB LPDDR5X, the Apple M4 Ultra (192GB) is a workstation-tier GPU that can run 64 models natively. It handles 70B-class models at Q4 quantization.
The Apple M4 Ultra (192GB) is the base configuration of Apple's M4 Ultra chip, available in the Mac Pro and Mac Studio. With 192GB of unified memory shared between CPU and GPU at 1,092 GB/s, it runs 70B parameter models entirely in memory at practical speeds using MLX or llama.cpp. Compared to discrete GPU setups of similar memory capacity, the M4 Ultra trades raw bandwidth for a silent, fanless-class system with no PCIe bottleneck between CPU and GPU memory.
Apple M4 Ultra (192GB): Base M4 Ultra with 192GB at 1092 GB/s. Same CPU/GPU config as 384GB.
70B at Q4 native ~20-30 t/s. 405B at Q2 with CPU offload.
Same as 384GB. Silent fanless-class system with no PCIe bottleneck.
| Vendor | Apple |
| Architecture | Apple M4 Ultra |
| CPU cores | 32 (24P + 8E) |
| VRAM | 192 GB (unified) |
| Memory type | LPDDR5X |
| Memory bandwidth | 1092 GB/s |
| Compute backend | METAL |
| Tier | Workstation |
| Released | 2025 |
| Models (native) | 64 / 70 |
| Models (offload) | 0 / 70 |
Software: MLX gives the best performance on Apple Silicon; llama.cpp Metal backend is a solid alternative. Both are well-supported by Ollama.
Popular models for this GPU
Models this GPU runs natively in VRAM (64)
- MiniMax M1 456B456B · MMLU-Pro 81.1Q2_K · ~79.4 t/s
- Llama 3.1 405B Instruct405B · MMLU-Pro 73.3Q2_K · ~8.2 t/s
- Llama 4 Maverick 400B400B · MMLU-Pro 80.5Q2_K · ~214.8 t/s
- GLM-4.7 358B358B · MMLU-Pro 84.3Q3_K_M · ~87.3 t/s
- GLM-4.5 355B355B · MMLU-Pro 84.6Q3_K_M · ~87.3 t/s
- GLM-4.6 355B355B · MMLU-Pro 84.5Q3_K_M · ~87.3 t/s
- DeepSeek V4 Flash 284B284B · MMLU-Pro 86.3Q4_K_M · ~164.1 t/s
- Qwen3 235B-A22B (MoE)235B · MMLU-Pro 84.4Q5_K_M · ~84.8 t/s
- MiniMax M2.5 229B229B · MMLU-Pro 84.8Q5_K_M · ~186.5 t/s
- MiniMax M2.7 229B229B · MMLU-Pro 86.0Q5_K_M · ~186.5 t/s
- Mixtral 8x22B Instruct v0.1141B · MMLU-Pro 40.0Q8_0 · ~30.8 t/s
- Qwen 3.5 122B-A10B (MoE)122B · MMLU-Pro 86.7Q8_0 · ~120.1 t/s
- Nemotron 3 Super 120B120B · MMLU-Pro 83.7Q8_0 · ~100.1 t/s
- GPT-OSS 120B117B · MMLU-Pro 80.7Q8_0 · ~240.2 t/s
- Llama 4 Scout 109B109B · MMLU-Pro 74.3Q8_0 · ~70.7 t/s
- GLM-4.5 Air 106B106B · MMLU-Pro 81.4Q8_0 · ~100.1 t/s
- GLM-4.6V 106B106B · MMLU-Pro 79.9Q8_0 · ~100.1 t/s
- Qwen 2.5 72B Instruct72B · MMLU-Pro 71.1BF16 · ~7.6 t/s
- Llama 3.3 70B Instruct70B · MMLU-Pro 68.9BF16 · ~7.8 t/s
- DeepSeek R1 Distill Llama 70B70B · MMLU-Pro 70.0BF16 · ~7.8 t/s
- Llama 3.1 70B Instruct70B · MMLU-Pro 66.4BF16 · ~7.8 t/s
- Mixtral 8x7B Instruct v0.146.7B · MMLU-Pro 29.7BF16 · ~46.6 t/s
- Command-R 35B35B · MMLU-Pro 33.0FP32 · ~7.8 t/s
- Qwen 3.5 35B-A3B (MoE)35B · MMLU-Pro 84.2FP32 · ~100.1 t/s
- Qwen 3.6 35B35B · MMLU-Pro 85.2FP32 · ~7.8 t/s
- Yi 1.5 34B Chat34.4B · MMLU-Pro 37.0FP32 · ~7.9 t/s
- Qwen3 32B32.8B · MMLU-Pro 65.5FP32 · ~8.3 t/s
- Qwen 2.5 32B Instruct32.5B · MMLU-Pro 69.0FP32 · ~8.4 t/s
- Qwen 2.5 Coder 32B Instruct32.5B · MMLU-Pro 50.4FP32 · ~8.4 t/s
- DeepSeek R1 Distill Qwen 32B32.5B · MMLU-Pro 65.0FP32 · ~8.4 t/s
- Nemotron 3 Nano 30B32B · MMLU-Pro 78.3FP32 · ~100.1 t/s
- Gemma 4 31B31B · MMLU-Pro 85.2FP32 · ~8.8 t/s
- Qwen3 30B-A3B (MoE)30B · MMLU-Pro 61.5FP32 · ~100.1 t/s
- Gemma 2 27B Instruct27.2B · MMLU-Pro 38.0FP32 · ~10 t/s
- Gemma 3 27B Instruct27B · MMLU-Pro 67.5FP32 · ~10.1 t/s
- Qwen 3.6 27B27B · MMLU-Pro 86.2FP32 · ~10.1 t/s
- Gemma 4 26B (MoE)26B · MMLU-Pro 82.6FP32 · ~79 t/s
- Mistral Small 3.1 24B Instruct24B · MMLU-Pro 66.8FP32 · ~11.4 t/s
- Mistral Small 22B22.2B · MMLU-Pro 49.2FP32 · ~12.3 t/s
- GPT-OSS 20B21B · MMLU-Pro 67.9FP32 · ~75.1 t/s
- Qwen3 14B14.8B · MMLU-Pro 61.0FP32 · ~18.4 t/s
- Qwen 2.5 14B Instruct14.7B · MMLU-Pro 63.7FP32 · ~18.6 t/s
- Phi-4 14B Instruct14B · MMLU-Pro 70.4FP32 · ~19.5 t/s
- Mistral Nemo 12B Instruct12.2B · MMLU-Pro 35.6FP32 · ~22.4 t/s
- Gemma 3 12B Instruct12.2B · MMLU-Pro 60.6FP32 · ~22.4 t/s
- Gemma 2 9B Instruct9.2B · MMLU-Pro 32.0FP32 · ~29.7 t/s
- Llama 3.1 8B Instruct8B · MMLU-Pro 48.3FP32 · ~34.1 t/s
- DeepSeek R1 Distill Llama 8B8B · MMLU-Pro 41.0FP32 · ~34.1 t/s
- Qwen3 8B8B · MMLU-Pro 56.7FP32 · ~34.1 t/s
- Qwen 2.5 7B Instruct7.6B · MMLU-Pro 56.3FP32 · ~35.9 t/s
- Mistral 7B Instruct v0.37.25B · MMLU-Pro 30.0FP32 · ~37.7 t/s
- Gemma 3 4B Instruct4B · MMLU-Pro 43.6FP32 · ~68.3 t/s
- Gemma 4 E4B4B · MMLU-Pro 69.4FP32 · ~68.3 t/s
- Phi-3.5 Mini Instruct3.8B · MMLU-Pro 47.4FP32 · ~71.8 t/s
- Llama 3.2 3B Instruct3.2B · MMLU-Pro 24.0FP32 · ~85.3 t/s
- Qwen 2.5 3B Instruct3.1B · MMLU-Pro 32.4FP32 · ~88.1 t/s
- Gemma 2 2B Instruct2.6B · MMLU-Pro 17.8FP32 · ~105 t/s
- Gemma 4 E2B2B · MMLU-Pro 60.0FP32 · ~136.5 t/s
- SmolLM2 1.7B Instruct1.7B · MMLU-Pro 19.0FP32 · ~160.6 t/s
- Qwen 2.5 1.5B Instruct1.5B · MMLU-Pro 16.8FP32 · ~182 t/s
- Llama 3.2 1B Instruct1.24B · MMLU-Pro 12.5FP32 · ~220.2 t/s
- Gemma 3 1B Instruct1B · MMLU-Pro 14.7FP32 · ~273 t/s
- Qwen 2.5 0.5B Instruct0.5B · MMLU-Pro 10.0FP32 · ~546 t/s
- SmolLM2 360M Instruct0.36B · MMLU-Pro 8.0FP32 · ~758.3 t/s
Too large for this GPU (6)
Compare Apple M4 Ultra (192GB) with other GPUs
- Apple M4 Ultra (192GB)vsApple M2 Ultra (192GB)192 GB each
- Apple M4 Ultra (192GB)vsNVIDIA RTX 5090+160 GB VRAM
- Apple M4 Ultra (192GB)vsNVIDIA RTX Pro 6000+96 GB VRAM
- Apple M4 Ultra (192GB)vsNVIDIA DGX Spark (128GB)+64 GB VRAM
- Apple M4 Ultra (192GB)vsApple M4 Max (128GB)+64 GB VRAM
- Apple M4 Ultra (192GB)vsApple M4 Max (128GB)+64 GB VRAM
Frequently asked questions
- How much VRAM does the Apple M4 Ultra (192GB) have?
- The Apple M4 Ultra (192GB) has 192 GB of LPDDR5X with 1092 GB/s memory bandwidth (unified system memory, shared between CPU and GPU).
- What is the Apple M4 Ultra (192GB) best for?
- With 192 GB of VRAM, the Apple M4 Ultra (192GB) is a server-class GPU designed for running the largest open-weight models (70B–405B) at high quantization with ample context.
- What LLMs can the Apple M4 Ultra (192GB) run locally?
- The Apple M4 Ultra (192GB) can run 64 of the 70 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Llama 3.3 70B Instruct at BF16, Llama 3.1 8B Instruct at FP32, Llama 3.2 3B Instruct at FP32.
- Can the Apple M4 Ultra (192GB) run Llama 3.3 70B Instruct?
- Yes. The Apple M4 Ultra (192GB) runs Llama 3.3 70B Instruct natively in VRAM at BF16 quantization, achieving approximately 7.8 tokens per second.
- Can the Apple M4 Ultra (192GB) run Qwen 3.6 27B?
- Yes. The Apple M4 Ultra (192GB) runs Qwen 3.6 27B natively in VRAM at FP32 quantization, achieving approximately 10.1 tokens per second.
- Can the Apple M4 Ultra (192GB) run Llama 3.1 8B Instruct?
- Yes. The Apple M4 Ultra (192GB) runs Llama 3.1 8B Instruct natively in VRAM at FP32 quantization, achieving approximately 34.1 tokens per second.