How much VRAM does the AMD Radeon RX 6800 XT have?

The AMD Radeon RX 6800 XT has 16 GB of GDDR6 with 512 GB/s memory bandwidth.

What is the AMD Radeon RX 6800 XT best for?

With 16 GB of VRAM, the AMD Radeon RX 6800 XT handles smaller models (7B–14B) at Q4–Q5 quantization, ideal for entry-level local LLM experimentation and lightweight inference.

What LLMs can the AMD Radeon RX 6800 XT run locally?

The AMD Radeon RX 6800 XT can run 48 of the 107 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Qwen 3.8 27B at Q3_K_M, Ornith 1.5 35B-A3B (MoE) at Q2_K, Ornith 1.5 9B at Q8_0.

Can the AMD Radeon RX 6800 XT run Gemma 4 31B?

Yes. The AMD Radeon RX 6800 XT runs Gemma 4 31B natively in VRAM at Q2_K quantization, achieving approximately 30.4 tokens per second.

Can the AMD Radeon RX 6800 XT run Qwen 3.6 27B?

Yes. The AMD Radeon RX 6800 XT runs Qwen 3.6 27B natively in VRAM at Q3_K_M quantization, achieving approximately 29.5 tokens per second.

Can the AMD Radeon RX 6800 XT run Qwen3 8B?

Yes. The AMD Radeon RX 6800 XT runs Qwen3 8B natively in VRAM at Q8_0 quantization, achieving approximately 42.2 tokens per second.

AMD Radeon RX 6800 XT

The AMD Radeon RX 6800 XT has 16 GB VRAM and 512 GB/s memory bandwidth. It can run 48 of our 107 tracked models natively in VRAM at 8k context.

With 16 GB GDDR6, the AMD Radeon RX 6800 XT is a consumer-tier GPU that can run 48 models natively.

AMD Radeon RX 6800 XT: 2020 RDNA 2 with 16GB GDDR6 at 512 GB/s, used market value.

7B-14B at Q4 native. ~6-10 t/s for 7B.

ROCm Linux support is maturing. Vulkan works cross-platform. Best budget AMD option.

Vendor	AMD
Architecture	RDNA 2
VRAM	16 GB
Memory type	GDDR6
Memory bandwidth	512 GB/s
Compute backend	ROCM
Tier	Consumer
Released	2020
Models (native)	48 / 107
Models (offload)	14 / 107

Software: ROCm is Linux-only; on Windows use the Vulkan backend instead. Requires llama.cpp compiled with ROCm support.

Need more than 16GB? Rent an RTX 3090 from $0.22/hr ↗

Prices as of Oct 17, 2026. Rates change; check RunPod for current pricing. Affiliate link: CanItRun may earn a commission. Doesn't affect the fit calculation above.

Popular models for this GPU

Qwen 3.5 35B-A3B (MoE)Qwen 3.6 35B-A3B (MoE)Ornith 1.5 35B-A3B (MoE)Gemma 4 31B Qwen3 30B-A3B (MoE)

Models this GPU runs natively in VRAM (48)

Show 43 more

Models that fit with CPU offload (14)

These use system RAM for layers that don't fit in VRAM, so expect much slower inference.

Too large for this GPU (45)

Compare AMD Radeon RX 6800 XT with other GPUs

AMD Radeon RX 6800 XTvsNVIDIA RTX 408016 GB each

Continue reading

hardware10 min

AMD Radeon for LLMs: ROCm & Vulkan Complete Guide

Frequently asked questions

How much VRAM does the AMD Radeon RX 6800 XT have?: The AMD Radeon RX 6800 XT has 16 GB of GDDR6 with 512 GB/s memory bandwidth.
What is the AMD Radeon RX 6800 XT best for?: With 16 GB of VRAM, the AMD Radeon RX 6800 XT handles smaller models (7B–14B) at Q4–Q5 quantization, ideal for entry-level local LLM experimentation and lightweight inference.
What LLMs can the AMD Radeon RX 6800 XT run locally?: The AMD Radeon RX 6800 XT can run 48 of the 107 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Qwen 3.8 27B at Q3_K_M, Ornith 1.5 35B-A3B (MoE) at Q2_K, Ornith 1.5 9B at Q8_0.
Can the AMD Radeon RX 6800 XT run Gemma 4 31B?: Yes. The AMD Radeon RX 6800 XT runs Gemma 4 31B natively in VRAM at Q2_K quantization, achieving approximately 30.4 tokens per second.
Can the AMD Radeon RX 6800 XT run Qwen 3.6 27B?: Yes. The AMD Radeon RX 6800 XT runs Qwen 3.6 27B natively in VRAM at Q3_K_M quantization, achieving approximately 29.5 tokens per second.
Can the AMD Radeon RX 6800 XT run Qwen3 8B?: Yes. The AMD Radeon RX 6800 XT runs Qwen3 8B natively in VRAM at Q8_0 quantization, achieving approximately 42.2 tokens per second.