How much VRAM does the AMD Radeon RX 7900 XTX have?

The AMD Radeon RX 7900 XTX has 24 GB of GDDR6 with 960 GB/s memory bandwidth.

What is the AMD Radeon RX 7900 XTX best for?

With 24 GB of VRAM, the AMD Radeon RX 7900 XTX is well-suited for running 7B–32B models at Q4 with room for context, making it a great all-rounder for local LLM inference.

What LLMs can the AMD Radeon RX 7900 XTX run locally?

The AMD Radeon RX 7900 XTX can run 42 of the 70 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Llama 3.1 8B Instruct at BF16, Llama 3.2 3B Instruct at FP32, Llama 3.2 1B Instruct at FP32.

Can the AMD Radeon RX 7900 XTX run Llama 3.3 70B Instruct?

The AMD Radeon RX 7900 XTX can run Llama 3.3 70B Instruct with CPU offload at Q4_K_M quantization, but inference will be slower than native VRAM execution.

Can the AMD Radeon RX 7900 XTX run Qwen 3.6 27B?

Yes. The AMD Radeon RX 7900 XTX runs Qwen 3.6 27B natively in VRAM at Q5_K_M quantization, achieving approximately 55.2 tokens per second.

Can the AMD Radeon RX 7900 XTX run Llama 3.1 8B Instruct?

Yes. The AMD Radeon RX 7900 XTX runs Llama 3.1 8B Instruct natively in VRAM at BF16 quantization, achieving approximately 60 tokens per second.

AMD Radeon RX 7900 XTX

The AMD Radeon RX 7900 XTX has 24 GB VRAM and 960 GB/s memory bandwidth. It can run 42 of our 70 tracked models natively in VRAM at 8k context.

With 24 GB GDDR6, the AMD Radeon RX 7900 XTX is a consumer-tier GPU that can run 42 models natively. It handles 70B-class models at Q4 quantization.

AMD Radeon RX 7900 XTX: December 2022 RDNA 3 flagship with 24GB GDDR6 at 960 GB/s — AMD's consumer flagship.

7B-32B at Q4 native. ~8-15 t/s for 7B depending on backend.

ROCm Linux-only with llama.cpp compiled for AMD. Windows users need Vulkan driver. vLLM has strong MI300X support trickling down.

Vendor	AMD
Architecture	RDNA 3
VRAM	24 GB
Memory type	GDDR6
Memory bandwidth	960 GB/s
Compute backend	ROCM
Tier	Consumer
Released	2022
Models (native)	42 / 70
Models (offload)	11 / 70

Software: ROCm is Linux-only; on Windows use the Vulkan backend instead. Requires llama.cpp compiled with ROCm support.

Popular models for this GPU

Mixtral 8x7B Instruct v0.1 Qwen 3.5 35B-A3B (MoE)Qwen 3.6 35B Yi 1.5 34B Chat Qwen3 32B

Models this GPU runs natively in VRAM (42)

Models that fit with CPU offload (11)

These use system RAM for layers that don't fit in VRAM — expect much slower inference.

Too large for this GPU (17)

Compare AMD Radeon RX 7900 XTX with other GPUs

Frequently asked questions

How much VRAM does the AMD Radeon RX 7900 XTX have?: The AMD Radeon RX 7900 XTX has 24 GB of GDDR6 with 960 GB/s memory bandwidth.
What is the AMD Radeon RX 7900 XTX best for?: With 24 GB of VRAM, the AMD Radeon RX 7900 XTX is well-suited for running 7B–32B models at Q4 with room for context, making it a great all-rounder for local LLM inference.
What LLMs can the AMD Radeon RX 7900 XTX run locally?: The AMD Radeon RX 7900 XTX can run 42 of the 70 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Llama 3.1 8B Instruct at BF16, Llama 3.2 3B Instruct at FP32, Llama 3.2 1B Instruct at FP32.
Can the AMD Radeon RX 7900 XTX run Llama 3.3 70B Instruct?: The AMD Radeon RX 7900 XTX can run Llama 3.3 70B Instruct with CPU offload at Q4_K_M quantization, but inference will be slower than native VRAM execution.
Can the AMD Radeon RX 7900 XTX run Qwen 3.6 27B?: Yes. The AMD Radeon RX 7900 XTX runs Qwen 3.6 27B natively in VRAM at Q5_K_M quantization, achieving approximately 55.2 tokens per second.
Can the AMD Radeon RX 7900 XTX run Llama 3.1 8B Instruct?: Yes. The AMD Radeon RX 7900 XTX runs Llama 3.1 8B Instruct natively in VRAM at BF16 quantization, achieving approximately 60 tokens per second.