AMD Radeon RX 9070 XT
The AMD Radeon RX 9070 XT has 16 GB VRAM and 640 GB/s memory bandwidth. It can run 46 of our 99 tracked models natively in VRAM at 8k context.
With 16 GB GDDR6, the AMD Radeon RX 9070 XT is a consumer-tier GPU that can run 46 models natively.
The AMD Radeon RX 9070 XT launched March 6, 2025 at a $599 MSRP as the top RDNA 4 gaming card: a full Navi 48 die (53.9 billion transistors, 356.5 mm2) with 64 compute units and 4,096 stream processors, 64MB of Infinity Cache, and 16GB of GDDR6 at 20 Gbps on a 256-bit bus, which is 640 GB/s. Total board power is 304 W. It is the same die as the 32GB Radeon AI PRO R9700 workstation card, so the two share a bandwidth figure and differ in VRAM capacity and price.
AMD Radeon RX 9070 XT: AMD's top RDNA 4 card, priced at $599 against the $749 RTX 5070 Ti and the $429 RTX 5060 Ti 16GB, the two NVIDIA cards that share its 16GB capacity. Its 640 GB/s lands between them: 29% less than the 5070 Ti's 896 GB/s and 43% more than the 5060 Ti's 448 GB/s, so on anything that fits in 16GB it decodes at about 75% of the 5070 Ti's speed and about 1.4 times the 5060 Ti's (Qwen3 14B at Q4_K_M: 48.1, 64.4 and 34.9 tok/s). It is the same Navi 48 die as the 32GB Radeon AI PRO R9700 workstation card, so the consumer version trades half the VRAM for less than half the price: $599 versus $1,299.
46 of this site's 99 tracked models fit natively at 8k context, the same set as every other 16GB card, because capacity rather than bandwidth decides what fits. The strongest are 27B-class dense models at Q3_K_M: Qwen 3.8 27B, Qwen 3.6 27B and UI-Mate 27B each total 15.15 GB against this card's 15.2 GB of usable VRAM and decode at 35.9 tok/s, while Q4_K_M needs 19.02 GB and offloads at 9.8 tok/s. 35B-class mixture-of-experts models such as Ornith 1.5 35B-A3B and the two Qwen 35B-A3B releases fit only at Q2_K (15.12 GB) but decode at 105.0 tok/s, because only about 3B parameters are read per token. Qwen3 14B holds Q4_K_M with room to spare (11.6 GB, 48.1 tok/s), GPT-OSS 20B fits at Q4_K_M (14.55 GB, 116.6 tok/s), and Llama 3.1 8B runs at Q8_0 (10.73 GB, 52.8 tok/s). 70B-class models are out of reach.
AMD's ROCm support tables list the RX 9070 XT (gfx1201) on Linux, limited to Ubuntu 24.04.4 and 22.04.5 or RHEL 10.1 and 9.7, and in the HIP SDK 7.2 table for Windows; RDNA 4 needs a recent ROCm (6.4.1 or newer), since older builds ship no gfx1201 kernels. llama.cpp's Vulkan backend needs no ROCm install at all. On the project's public Vulkan llama-bench scoreboard (Llama 2 7B Q4_0; driver not stated), this card generates 137.1 tok/s and reads a 512-token prompt at 5,036 tok/s. This site's decode model (88% of rated bandwidth plus a fixed cost per layer) predicts about 115 tok/s for that 3.56 GiB file, so the tok/s figures on this page are likely somewhat conservative for small dense models; the scoreboard's prompt-processing speed also shows a compute advantage that the bandwidth-only estimate does not model.
| Vendor | AMD |
| Architecture | RDNA 4 |
| VRAM | 16 GB |
| Memory type | GDDR6 |
| Memory bandwidth | 640 GB/s |
| Compute backend | ROCM |
| Tier | Consumer |
| Released | 2025 |
| Models (native) | 46 / 99 |
| Models (offload) | 12 / 99 |
Need more than 16GB? Rent an RTX 3090 from $0.22/hr ↗
Prices as of Oct 13, 2026. Rates change; check RunPod for current pricing. Affiliate link: CanItRun may earn a commission. Doesn't affect the fit calculation above.
Popular models for this GPU
Models this GPU runs natively in VRAM (46)
- Qwen 3.5 35B-A3B (MoE)35B · MMLU-Pro 85.3Q2_K · ~105 t/s
- Qwen 3.6 35B-A3B (MoE)35B · MMLU-Pro 85.2Q2_K · ~105 t/s
- Ornith 1.5 35B-A3B (MoE)35B · MMLU-Pro N/AQ2_K · ~105 t/s
- Nemotron 3 Nano 30B32B · MMLU-Pro 78.3Q2_K · ~87.1 t/s
- Gemma 4 31B30.7B · MMLU-Pro 85.2Q2_K · ~37 t/s
Show 41 more
- Qwen3 30B-A3B (MoE)30B · MMLU-Pro 61.5Q2_K · ~82.6 t/s
- Muse Glimmer 30B27.8B · MMLU-Pro N/AQ3_K_M · ~36.8 t/s
- Gemma 2 27B Instruct27.2B · MMLU-Pro 38.0Q2_K · ~37.5 t/s
- Gemma 3 27B Instruct27B · MMLU-Pro 67.5Q2_K · ~42.1 t/s
- Qwen 3.6 27B27B · MMLU-Pro 86.2Q3_K_M · ~35.9 t/s
- UI-Mate 27B27B · MMLU-Pro ~86.2Q3_K_M · ~35.9 t/s
- Bonsai 27B27B · MMLU-Pro ~81.5Ternary (Q2_0) · ~56.9 t/s
- Bonsai 2 27B27B · MMLU-Pro N/ATernary (Q2_0) · ~65.5 t/s
- Qwen 3.8 27B27B · MMLU-Pro N/AQ3_K_M · ~35.9 t/s
- Gemma 4 26B (MoE)25.2B · MMLU-Pro 82.6Q3_K_M · ~107.3 t/s
- Mistral Small 3.1 24B Instruct24B · MMLU-Pro 66.8Q3_K_M · ~39.6 t/s
- Mistral Small 22B22.2B · MMLU-Pro 49.2Q3_K_M · ~39 t/s
- GPT-OSS 20B21B · MMLU-Pro 67.9Q4_K_M · ~116.6 t/s
- Qwen3 14B14.8B · MMLU-Pro 61.0Q6_K · ~37.9 t/s
- Qwen 2.5 14B Instruct14.7B · MMLU-Pro 63.7Q5_K_M · ~41.1 t/s
- Phi-4 14B Instruct14B · MMLU-Pro 70.4Q6_K · ~38.8 t/s
- Mistral Nemo 12B Instruct12.2B · MMLU-Pro 35.6Q6_K · ~44.3 t/s
- Gemma 3 12B Instruct12.2B · MMLU-Pro 60.6Q6_K · ~45.1 t/s
- Gemma 4 12B (Unified)12B · MMLU-Pro 77.2Q8_0 · ~37.9 t/s
- Gemma 2 9B Instruct9.2B · MMLU-Pro 32.0Q8_0 · ~40.2 t/s
- Qwen 3.5 9B9B · MMLU-Pro 82.5Q8_0 · ~51.6 t/s
- Ornith 1.5 9B9B · MMLU-Pro N/AQ8_0 · ~51.6 t/s
- Llama 3.1 8B Instruct8B · MMLU-Pro 48.3Q8_0 · ~52.8 t/s
- DeepSeek R1 Distill Llama 8B8B · MMLU-Pro 41.0Q8_0 · ~52.8 t/s
- Qwen3 8B8B · MMLU-Pro 56.7Q8_0 · ~51.5 t/s
- Qwen 2.5 7B Instruct7.6B · MMLU-Pro 56.3Q8_0 · ~59.3 t/s
- Gemma 4 E4B7.52B · MMLU-Pro 69.4Q8_0 · ~88.6 t/s
- Mistral 7B Instruct v0.37.25B · MMLU-Pro 30.0Q8_0 · ~57.1 t/s
- Gemma 4 E2B4.65B · MMLU-Pro 60.0BF16 · ~96.4 t/s
- Gemma 3 4B Instruct4B · MMLU-Pro 43.6BF16 · ~59.2 t/s
- Phi-3.5 Mini Instruct3.8B · MMLU-Pro 47.4BF16 · ~47.3 t/s
- Phi-4-mini Instruct3.8B · MMLU-Pro 67.3BF16 · ~57.7 t/s
- Llama 3.2 3B Instruct3.2B · MMLU-Pro 24.0BF16 · ~68 t/s
- Qwen 2.5 3B Instruct3.1B · MMLU-Pro 32.4BF16 · ~73 t/s
- Gemma 2 2B Instruct2.6B · MMLU-Pro 17.8BF16 · ~81 t/s
- SmolLM2 1.7B Instruct1.7B · MMLU-Pro 19.0BF16 · ~96.7 t/s
- Qwen 2.5 1.5B Instruct1.5B · MMLU-Pro 16.8BF16 · ~134.7 t/s
- Llama 3.2 1B Instruct1.24B · MMLU-Pro 12.5BF16 · ~171.2 t/s
- Gemma 3 1B Instruct1B · MMLU-Pro 14.7BF16 · ~175.7 t/s
- Qwen 2.5 0.5B Instruct0.5B · MMLU-Pro 10.0BF16 · ~294.6 t/s
- SmolLM2 360M Instruct0.36B · MMLU-Pro 8.0BF16 · ~263.6 t/s
Models that fit with CPU offload (12)
These use system RAM for layers that don't fit in VRAM, so expect much slower inference.
- Qwen 2.5 72B Instruct72B · MMLU-Pro 71.1Q2_K · ~1.6 t/s
- Llama 3.3 70B Instruct70B · MMLU-Pro 68.9Q3_K_M · ~1.1 t/s
- DeepSeek R1 Distill Llama 70B70B · MMLU-Pro 70.0Q3_K_M · ~1.1 t/s
- Llama 3.1 70B Instruct70B · MMLU-Pro 66.4Q3_K_M · ~1.1 t/s
- Mixtral 8x7B Instruct v0.146.7B · MMLU-Pro 29.7Q5_K_M · ~5.2 t/s
- Command-R 35B35B · MMLU-Pro 33.0Q5_K_M · ~1.2 t/s
- Yi 1.5 34B Chat34.4B · MMLU-Pro 37.0Q6_K · ~1.6 t/s
- Qwen3 32B32.8B · MMLU-Pro 65.5Q8_0 · ~1.1 t/s
- Qwen 2.5 32B Instruct32.5B · MMLU-Pro 69.0Q8_0 · ~1.1 t/s
- Qwen 2.5 Coder 32B Instruct32.5B · MMLU-Pro 62.3Q8_0 · ~1.1 t/s
- DeepSeek R1 Distill Qwen 32B32.5B · MMLU-Pro 65.0Q8_0 · ~1.1 t/s
- Nemotron 3.5 Lightning 30B-A3B30B · MMLU-Pro 81.6Q8_0 · ~17 t/s
Too large for this GPU (41)
- Mixtral 8x22B Instruct v0.1
- Llama 3.1 405B Instruct
- DeepSeek V3 671B
- DeepSeek R1 671B
- Llama 4 Scout 109B
- Llama 4 Maverick 400B
- Qwen3 235B-A22B (MoE)
- MiniMax M1 456B
- GPT-OSS 120B
- GLM-4.5 355B
- GLM-4.5 Air 106B
- GLM-4.6 355B
- GLM-4.6V 106B
- GLM-4.7 358B
- Qwen 3.5 122B-A10B (MoE)
- MiniMax M2.5 229B
- GLM-5 744B
- MiniMax M2.7 229B
- Nemotron 3 Super 120B
- Kimi K2.6
- GLM-5.1 754B
- DeepSeek V4 Pro 1.6T
- DeepSeek V4 Flash 284B
- Mistral Medium 3.5 128B
- GLM-5.2 753B
- Nemotron 3 Ultra 550B-A55B
- Step 3.5 Flash
- Step 3.7 Flash
- MiMo V2.5 Pro
- Kimi K2.5
- MiniMax M3
- Inkling
- Kimi K3
- DeepSeek V4 Flash 0731 284B
- Qwen3.8 2.4T-A95B
- Qwen3.8-Flash-Next
- DeepSeek V4 Pro 0813 1.6T
- Ornith 1.5 397B (MoE)
- GLM-5.3 753B
- GLM-5.3-Flash 320B
- DeepSeek V4.1 Flash 552B
Compare AMD Radeon RX 9070 XT with other GPUs
Continue reading
Frequently asked questions
- How much VRAM does the AMD Radeon RX 9070 XT have?
- The AMD Radeon RX 9070 XT has 16 GB of GDDR6 with 640 GB/s memory bandwidth.
- What is the AMD Radeon RX 9070 XT best for?
- With 16 GB of VRAM, the AMD Radeon RX 9070 XT handles smaller models (7B–14B) at Q4–Q5 quantization, ideal for entry-level local LLM experimentation and lightweight inference.
- What LLMs can the AMD Radeon RX 9070 XT run locally?
- The AMD Radeon RX 9070 XT can run 46 of the 99 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Qwen 3.8 27B at Q3_K_M, Ornith 1.5 35B-A3B (MoE) at Q2_K, Ornith 1.5 9B at Q8_0.
- Can the AMD Radeon RX 9070 XT run Gemma 4 31B?
- Yes. The AMD Radeon RX 9070 XT runs Gemma 4 31B natively in VRAM at Q2_K quantization, achieving approximately 37 tokens per second.
- Can the AMD Radeon RX 9070 XT run Qwen 3.6 27B?
- Yes. The AMD Radeon RX 9070 XT runs Qwen 3.6 27B natively in VRAM at Q3_K_M quantization, achieving approximately 35.9 tokens per second.
- Can the AMD Radeon RX 9070 XT run Qwen3 8B?
- Yes. The AMD Radeon RX 9070 XT runs Qwen3 8B natively in VRAM at Q8_0 quantization, achieving approximately 51.5 tokens per second.