AMD Radeon RX 7800 XT
The AMD Radeon RX 7800 XT has 16 GB VRAM and 624 GB/s memory bandwidth. It can run 46 of our 99 tracked models natively in VRAM at 8k context.
With 16 GB GDDR6, the AMD Radeon RX 7800 XT is a consumer-tier GPU that can run 46 models natively.
The AMD Radeon RX 7800 XT launched September 6, 2023 at a $499 MSRP as the 16GB RDNA 3 card between the RX 7700 XT and the RX 7900 GRE: a Navi 32 chiplet design with 60 compute units and 3,840 stream processors, 64MB of Infinity Cache, and 16GB of GDDR6 at 19.5 Gbps on a 256-bit bus, which is 624 GB/s. Total board power is 263 W. It has the same capacity as the RTX 4060 Ti 16GB that launched at the same price, with more than double that card's memory bandwidth.
AMD Radeon RX 7800 XT: AMD's 16GB RDNA 3 mid-range card, launched at $499, the same price as NVIDIA's RTX 4060 Ti 16GB, which has the same capacity but 288 GB/s against this card's 624 GB/s, 2.17 times as much. That gap carries almost straight into decode speed on this site, a little compressed by a fixed per-layer cost: Qwen3 14B at Q4_K_M runs 47.0 tok/s here against 23.1 tok/s on the 4060 Ti 16GB. Within AMD's 16GB cards it sits 8% above the RX 7900 GRE's 576 GB/s and 2.6% below the newer RX 9070 XT's 640 GB/s.
46 of this site's 99 tracked models fit natively at 8k context, the same set as every other 16GB card. The strongest are 27B-class dense models at Q3_K_M: Qwen 3.8 27B, Qwen 3.6 27B and UI-Mate 27B each total 15.15 GB against this card's 15.2 GB of usable VRAM and decode at 35.1 tok/s, while Q4_K_M needs 19.02 GB and offloads at 9.7 tok/s. 35B-class mixture-of-experts models such as Ornith 1.5 35B-A3B and the two Qwen 35B-A3B releases fit only at Q2_K (15.12 GB) but decode at 104.3 tok/s, because only about 3B parameters are read per token. Qwen3 14B holds Q4_K_M with room to spare (11.6 GB, 47.0 tok/s), GPT-OSS 20B fits at Q4_K_M (14.55 GB, 115.1 tok/s), and Llama 3.1 8B runs at Q8_0 (10.73 GB, 51.6 tok/s). 70B-class models are out of reach.
AMD's ROCm support tables list the RX 7800 XT (gfx1101) on Linux, limited to Ubuntu 24.04.4 and 22.04.5 or RHEL 10.1 and 9.7, and in the HIP SDK 7.2 table for Windows, so the common advice that ROCm is Linux-only does not apply to this card. llama.cpp's Vulkan backend needs no ROCm install. On the project's public Vulkan llama-bench scoreboard (Llama 2 7B Q4_0; driver not stated), this card generates 118.3 tok/s and reads a 512-token prompt at 2,017 tok/s. This site's decode model (88% of rated bandwidth plus a fixed cost per layer) predicts about 113 tok/s for that 3.56 GiB file, within 5% of the measurement.
| Vendor | AMD |
| Architecture | RDNA 3 |
| VRAM | 16 GB |
| Memory type | GDDR6 |
| Memory bandwidth | 624 GB/s |
| Compute backend | ROCM |
| Tier | Consumer |
| Released | 2023 |
| Models (native) | 46 / 99 |
| Models (offload) | 12 / 99 |
Need more than 16GB? Rent an RTX 3090 from $0.22/hr ↗
Prices as of Oct 13, 2026. Rates change; check RunPod for current pricing. Affiliate link: CanItRun may earn a commission. Doesn't affect the fit calculation above.
Popular models for this GPU
Models this GPU runs natively in VRAM (46)
- Qwen 3.5 35B-A3B (MoE)35B · MMLU-Pro 85.3Q2_K · ~104.3 t/s
- Qwen 3.6 35B-A3B (MoE)35B · MMLU-Pro 85.2Q2_K · ~104.3 t/s
- Ornith 1.5 35B-A3B (MoE)35B · MMLU-Pro N/AQ2_K · ~104.3 t/s
- Nemotron 3 Nano 30B32B · MMLU-Pro 78.3Q2_K · ~86.7 t/s
- Gemma 4 31B30.7B · MMLU-Pro 85.2Q2_K · ~36.2 t/s
Show 41 more
- Qwen3 30B-A3B (MoE)30B · MMLU-Pro 61.5Q2_K · ~82 t/s
- Muse Glimmer 30B27.8B · MMLU-Pro N/AQ3_K_M · ~35.9 t/s
- Gemma 2 27B Instruct27.2B · MMLU-Pro 38.0Q2_K · ~36.7 t/s
- Gemma 3 27B Instruct27B · MMLU-Pro 67.5Q2_K · ~41.1 t/s
- Qwen 3.6 27B27B · MMLU-Pro 86.2Q3_K_M · ~35.1 t/s
- UI-Mate 27B27B · MMLU-Pro ~86.2Q3_K_M · ~35.1 t/s
- Bonsai 27B27B · MMLU-Pro ~81.5Ternary (Q2_0) · ~55.8 t/s
- Bonsai 2 27B27B · MMLU-Pro N/ATernary (Q2_0) · ~64.3 t/s
- Qwen 3.8 27B27B · MMLU-Pro N/AQ3_K_M · ~35.1 t/s
- Gemma 4 26B (MoE)25.2B · MMLU-Pro 82.6Q3_K_M · ~106.2 t/s
- Mistral Small 3.1 24B Instruct24B · MMLU-Pro 66.8Q3_K_M · ~38.7 t/s
- Mistral Small 22B22.2B · MMLU-Pro 49.2Q3_K_M · ~38.1 t/s
- GPT-OSS 20B21B · MMLU-Pro 67.9Q4_K_M · ~115.1 t/s
- Qwen3 14B14.8B · MMLU-Pro 61.0Q6_K · ~37.1 t/s
- Qwen 2.5 14B Instruct14.7B · MMLU-Pro 63.7Q5_K_M · ~40.2 t/s
- Phi-4 14B Instruct14B · MMLU-Pro 70.4Q6_K · ~37.9 t/s
- Mistral Nemo 12B Instruct12.2B · MMLU-Pro 35.6Q6_K · ~43.3 t/s
- Gemma 3 12B Instruct12.2B · MMLU-Pro 60.6Q6_K · ~44.1 t/s
- Gemma 4 12B (Unified)12B · MMLU-Pro 77.2Q8_0 · ~37.1 t/s
- Gemma 2 9B Instruct9.2B · MMLU-Pro 32.0Q8_0 · ~39.3 t/s
- Qwen 3.5 9B9B · MMLU-Pro 82.5Q8_0 · ~50.4 t/s
- Ornith 1.5 9B9B · MMLU-Pro N/AQ8_0 · ~50.4 t/s
- Llama 3.1 8B Instruct8B · MMLU-Pro 48.3Q8_0 · ~51.6 t/s
- DeepSeek R1 Distill Llama 8B8B · MMLU-Pro 41.0Q8_0 · ~51.6 t/s
- Qwen3 8B8B · MMLU-Pro 56.7Q8_0 · ~50.4 t/s
- Qwen 2.5 7B Instruct7.6B · MMLU-Pro 56.3Q8_0 · ~58 t/s
- Gemma 4 E4B7.52B · MMLU-Pro 69.4Q8_0 · ~86.9 t/s
- Mistral 7B Instruct v0.37.25B · MMLU-Pro 30.0Q8_0 · ~55.8 t/s
- Gemma 4 E2B4.65B · MMLU-Pro 60.0BF16 · ~94.5 t/s
- Gemma 3 4B Instruct4B · MMLU-Pro 43.6BF16 · ~57.9 t/s
- Phi-3.5 Mini Instruct3.8B · MMLU-Pro 47.4BF16 · ~46.2 t/s
- Phi-4-mini Instruct3.8B · MMLU-Pro 67.3BF16 · ~56.4 t/s
- Llama 3.2 3B Instruct3.2B · MMLU-Pro 24.0BF16 · ~66.5 t/s
- Qwen 2.5 3B Instruct3.1B · MMLU-Pro 32.4BF16 · ~71.4 t/s
- Gemma 2 2B Instruct2.6B · MMLU-Pro 17.8BF16 · ~79.2 t/s
- SmolLM2 1.7B Instruct1.7B · MMLU-Pro 19.0BF16 · ~94.7 t/s
- Qwen 2.5 1.5B Instruct1.5B · MMLU-Pro 16.8BF16 · ~132.1 t/s
- Llama 3.2 1B Instruct1.24B · MMLU-Pro 12.5BF16 · ~167.6 t/s
- Gemma 3 1B Instruct1B · MMLU-Pro 14.7BF16 · ~172.5 t/s
- Qwen 2.5 0.5B Instruct0.5B · MMLU-Pro 10.0BF16 · ~290.3 t/s
- SmolLM2 360M Instruct0.36B · MMLU-Pro 8.0BF16 · ~260.3 t/s
Models that fit with CPU offload (12)
These use system RAM for layers that don't fit in VRAM, so expect much slower inference.
- Qwen 2.5 72B Instruct72B · MMLU-Pro 71.1Q2_K · ~1.6 t/s
- Llama 3.3 70B Instruct70B · MMLU-Pro 68.9Q3_K_M · ~1.1 t/s
- DeepSeek R1 Distill Llama 70B70B · MMLU-Pro 70.0Q3_K_M · ~1.1 t/s
- Llama 3.1 70B Instruct70B · MMLU-Pro 66.4Q3_K_M · ~1.1 t/s
- Mixtral 8x7B Instruct v0.146.7B · MMLU-Pro 29.7Q5_K_M · ~5.2 t/s
- Command-R 35B35B · MMLU-Pro 33.0Q5_K_M · ~1.2 t/s
- Yi 1.5 34B Chat34.4B · MMLU-Pro 37.0Q6_K · ~1.6 t/s
- Qwen3 32B32.8B · MMLU-Pro 65.5Q8_0 · ~1.1 t/s
- Qwen 2.5 32B Instruct32.5B · MMLU-Pro 69.0Q8_0 · ~1.1 t/s
- Qwen 2.5 Coder 32B Instruct32.5B · MMLU-Pro 62.3Q8_0 · ~1.1 t/s
- DeepSeek R1 Distill Qwen 32B32.5B · MMLU-Pro 65.0Q8_0 · ~1.1 t/s
- Nemotron 3.5 Lightning 30B-A3B30B · MMLU-Pro 81.6Q8_0 · ~17 t/s
Too large for this GPU (41)
- Mixtral 8x22B Instruct v0.1
- Llama 3.1 405B Instruct
- DeepSeek V3 671B
- DeepSeek R1 671B
- Llama 4 Scout 109B
- Llama 4 Maverick 400B
- Qwen3 235B-A22B (MoE)
- MiniMax M1 456B
- GPT-OSS 120B
- GLM-4.5 355B
- GLM-4.5 Air 106B
- GLM-4.6 355B
- GLM-4.6V 106B
- GLM-4.7 358B
- Qwen 3.5 122B-A10B (MoE)
- MiniMax M2.5 229B
- GLM-5 744B
- MiniMax M2.7 229B
- Nemotron 3 Super 120B
- Kimi K2.6
- GLM-5.1 754B
- DeepSeek V4 Pro 1.6T
- DeepSeek V4 Flash 284B
- Mistral Medium 3.5 128B
- GLM-5.2 753B
- Nemotron 3 Ultra 550B-A55B
- Step 3.5 Flash
- Step 3.7 Flash
- MiMo V2.5 Pro
- Kimi K2.5
- MiniMax M3
- Inkling
- Kimi K3
- DeepSeek V4 Flash 0731 284B
- Qwen3.8 2.4T-A95B
- Qwen3.8-Flash-Next
- DeepSeek V4 Pro 0813 1.6T
- Ornith 1.5 397B (MoE)
- GLM-5.3 753B
- GLM-5.3-Flash 320B
- DeepSeek V4.1 Flash 552B
Compare AMD Radeon RX 7800 XT with other GPUs
Continue reading
Frequently asked questions
- How much VRAM does the AMD Radeon RX 7800 XT have?
- The AMD Radeon RX 7800 XT has 16 GB of GDDR6 with 624 GB/s memory bandwidth.
- What is the AMD Radeon RX 7800 XT best for?
- With 16 GB of VRAM, the AMD Radeon RX 7800 XT handles smaller models (7B–14B) at Q4–Q5 quantization, ideal for entry-level local LLM experimentation and lightweight inference.
- What LLMs can the AMD Radeon RX 7800 XT run locally?
- The AMD Radeon RX 7800 XT can run 46 of the 99 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Qwen 3.8 27B at Q3_K_M, Ornith 1.5 35B-A3B (MoE) at Q2_K, Ornith 1.5 9B at Q8_0.
- Can the AMD Radeon RX 7800 XT run Gemma 4 31B?
- Yes. The AMD Radeon RX 7800 XT runs Gemma 4 31B natively in VRAM at Q2_K quantization, achieving approximately 36.2 tokens per second.
- Can the AMD Radeon RX 7800 XT run Qwen 3.6 27B?
- Yes. The AMD Radeon RX 7800 XT runs Qwen 3.6 27B natively in VRAM at Q3_K_M quantization, achieving approximately 35.1 tokens per second.
- Can the AMD Radeon RX 7800 XT run Qwen3 8B?
- Yes. The AMD Radeon RX 7800 XT runs Qwen3 8B natively in VRAM at Q8_0 quantization, achieving approximately 50.4 tokens per second.