How much VRAM does the AMD Radeon RX 6800 XT have?

The AMD Radeon RX 6800 XT has 16 GB of GDDR6 with 512 GB/s memory bandwidth.

What is the AMD Radeon RX 6800 XT best for?

With 16 GB of VRAM, the AMD Radeon RX 6800 XT handles smaller models (7B–14B) at Q4–Q5 quantization, ideal for entry-level local LLM experimentation and lightweight inference.

What LLMs can the AMD Radeon RX 6800 XT run locally?

The AMD Radeon RX 6800 XT can run 45 of the 97 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Qwen 3.8 27B at Q3_K_M, Ornith 1.5 35B-A3B (MoE) at Q2_K, Ornith 1.5 9B at Q8_0.

Can the AMD Radeon RX 6800 XT run Gemma 4 31B?

Yes. The AMD Radeon RX 6800 XT runs Gemma 4 31B natively in VRAM at Q2_K quantization, achieving approximately 25.2 tokens per second.

Can the AMD Radeon RX 6800 XT run Qwen 3.6 27B?

Yes. The AMD Radeon RX 6800 XT runs Qwen 3.6 27B natively in VRAM at Q3_K_M quantization, achieving approximately 24.6 tokens per second.

Can the AMD Radeon RX 6800 XT run Qwen3 8B?

Yes. The AMD Radeon RX 6800 XT runs Qwen3 8B natively in VRAM at Q8_0 quantization, achieving approximately 34.3 tokens per second.

AMD Radeon RX 6800 XT

The AMD Radeon RX 6800 XT has 16 GB VRAM and 512 GB/s memory bandwidth. It can run 45 of our 97 tracked models natively in VRAM at 8k context.

With 16 GB GDDR6, the AMD Radeon RX 6800 XT is a consumer-tier GPU that can run 45 models natively. 7B-14B at Q4 native. ~6-10 t/s for 7B.

AMD Radeon RX 6800 XT: 2020 RDNA 2 with 16GB GDDR6 at 512 GB/s, used market value.

7B-14B at Q4 native. ~6-10 t/s for 7B.

ROCm Linux support is maturing. Vulkan works cross-platform. Best budget AMD option.

Vendor	AMD
Architecture	RDNA 2
VRAM	16 GB
Memory type	GDDR6
Memory bandwidth	512 GB/s
Compute backend	ROCM
Tier	Consumer
Released	2020
Models (native)	45 / 97
Models (offload)	12 / 97

Software: ROCm is Linux-only; on Windows use the Vulkan backend instead. Requires llama.cpp compiled with ROCm support.

Popular models for this GPU

Qwen 3.5 35B-A3B (MoE)Ornith 1.5 35B-A3B (MoE)Nemotron 3 Nano 30B Gemma 4 31B Qwen3 30B-A3B (MoE)

Models this GPU runs natively in VRAM (45)

Show 40 more

Models that fit with CPU offload (12)

These use system RAM for layers that don't fit in VRAM, so expect much slower inference.

Too large for this GPU (40)

Compare AMD Radeon RX 6800 XT with other GPUs

AMD Radeon RX 6800 XTvsNVIDIA RTX 408016 GB each

Continue reading

hardware10 min

AMD Radeon for LLMs: ROCm & Vulkan Complete Guide

Frequently asked questions

How much VRAM does the AMD Radeon RX 6800 XT have?: The AMD Radeon RX 6800 XT has 16 GB of GDDR6 with 512 GB/s memory bandwidth.
What is the AMD Radeon RX 6800 XT best for?: With 16 GB of VRAM, the AMD Radeon RX 6800 XT handles smaller models (7B–14B) at Q4–Q5 quantization, ideal for entry-level local LLM experimentation and lightweight inference.
What LLMs can the AMD Radeon RX 6800 XT run locally?: The AMD Radeon RX 6800 XT can run 45 of the 97 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Qwen 3.8 27B at Q3_K_M, Ornith 1.5 35B-A3B (MoE) at Q2_K, Ornith 1.5 9B at Q8_0.
Can the AMD Radeon RX 6800 XT run Gemma 4 31B?: Yes. The AMD Radeon RX 6800 XT runs Gemma 4 31B natively in VRAM at Q2_K quantization, achieving approximately 25.2 tokens per second.
Can the AMD Radeon RX 6800 XT run Qwen 3.6 27B?: Yes. The AMD Radeon RX 6800 XT runs Qwen 3.6 27B natively in VRAM at Q3_K_M quantization, achieving approximately 24.6 tokens per second.
Can the AMD Radeon RX 6800 XT run Qwen3 8B?: Yes. The AMD Radeon RX 6800 XT runs Qwen3 8B natively in VRAM at Q8_0 quantization, achieving approximately 34.3 tokens per second.