Intel Arc A770 16GB
The Intel Arc A770 16GB has 16 GB VRAM and 560 GB/s memory bandwidth. It can run 40 of our 70 tracked models natively in VRAM at 8k context.
With 16 GB GDDR6, the Intel Arc A770 16GB is a consumer-tier GPU that can run 40 models natively. It handles 30B-class models at Q4 quantization.
The Intel Arc A770 16GB is Intel's flagship Alchemist discrete GPU and the most capable Arc card for LLM inference, fitting 13B models at Q4 quantization entirely in its 16GB GDDR6 framebuffer. With 560 GB/s bandwidth it outpaces many NVIDIA mid-range cards on memory throughput. The Vulkan backend in llama.cpp provides workable inference speeds, though CUDA alternatives remain faster per token.
Intel Arc A770 16GB: 2022 Xe-HPG Alchemist with 16GB GDDR6 at 560 GB/s — Intel's top Alchemist for LLM inference.
7B-14B at Q4 native; 13B at Q4 fits with headroom. ~5-8 t/s for 7B via Vulkan.
Vulkan via llama.cpp works cross-platform. SYCL backend requires oneAPI toolkit. Ollama support limited.
| Vendor | Intel |
| Architecture | Xe-HPG (Alchemist) |
| VRAM | 16 GB |
| Memory type | GDDR6 |
| Memory bandwidth | 560 GB/s |
| Compute backend | VULKAN |
| Tier | Consumer |
| Released | 2022 |
| Models (native) | 40 / 70 |
| Models (offload) | 9 / 70 |
Popular models for this GPU
Models this GPU runs natively in VRAM (40)
- Qwen 3.5 35B-A3B (MoE)35B · MMLU-Pro 84.2Q2_K · ~624.1 t/s
- Yi 1.5 34B Chat34.4B · MMLU-Pro 37.0Q2_K · ~49.5 t/s
- Qwen3 32B32.8B · MMLU-Pro 65.5Q2_K · ~51.9 t/s
- Qwen 2.5 32B Instruct32.5B · MMLU-Pro 69.0Q2_K · ~52.4 t/s
- Qwen 2.5 Coder 32B Instruct32.5B · MMLU-Pro 50.4Q2_K · ~52.4 t/s
- DeepSeek R1 Distill Qwen 32B32.5B · MMLU-Pro 65.0Q2_K · ~52.4 t/s
- Nemotron 3 Nano 30B32B · MMLU-Pro 78.3Q2_K · ~624.1 t/s
- Gemma 4 31B31B · MMLU-Pro 85.2Q2_K · ~54.9 t/s
- Qwen3 30B-A3B (MoE)30B · MMLU-Pro 61.5Q2_K · ~624.1 t/s
- Gemma 2 27B Instruct27.2B · MMLU-Pro 38.0Q2_K · ~62.6 t/s
- Gemma 3 27B Instruct27B · MMLU-Pro 67.5Q3_K_M · ~48.2 t/s
- Qwen 3.6 27B27B · MMLU-Pro 86.2Q3_K_M · ~48.2 t/s
- Gemma 4 26B (MoE)26B · MMLU-Pro 82.6Q3_K_M · ~377 t/s
- Mistral Small 3.1 24B Instruct24B · MMLU-Pro 66.8Q3_K_M · ~54.3 t/s
- Mistral Small 22B22.2B · MMLU-Pro 49.2Q3_K_M · ~58.7 t/s
- GPT-OSS 20B21B · MMLU-Pro 67.9Q4_K_M · ~273.5 t/s
- Qwen3 14B14.8B · MMLU-Pro 61.0Q6_K · ~46.1 t/s
- Qwen 2.5 14B Instruct14.7B · MMLU-Pro 63.7Q5_K_M · ~59.2 t/s
- Phi-4 14B Instruct14B · MMLU-Pro 70.4Q6_K · ~48.8 t/s
- Mistral Nemo 12B Instruct12.2B · MMLU-Pro 35.6Q8_0 · ~45.9 t/s
- Gemma 3 12B Instruct12.2B · MMLU-Pro 60.6Q8_0 · ~45.9 t/s
- Gemma 2 9B Instruct9.2B · MMLU-Pro 32.0Q8_0 · ~60.9 t/s
- Llama 3.1 8B Instruct8B · MMLU-Pro 48.3Q8_0 · ~70 t/s
- DeepSeek R1 Distill Llama 8B8B · MMLU-Pro 41.0Q8_0 · ~70 t/s
- Qwen3 8B8B · MMLU-Pro 56.7Q8_0 · ~70 t/s
- Qwen 2.5 7B Instruct7.6B · MMLU-Pro 56.3Q8_0 · ~73.7 t/s
- Mistral 7B Instruct v0.37.25B · MMLU-Pro 30.0Q8_0 · ~77.2 t/s
- Gemma 3 4B Instruct4B · MMLU-Pro 43.6BF16 · ~70 t/s
- Gemma 4 E4B4B · MMLU-Pro 69.4BF16 · ~70 t/s
- Phi-3.5 Mini Instruct3.8B · MMLU-Pro 47.4BF16 · ~73.7 t/s
- Llama 3.2 3B Instruct3.2B · MMLU-Pro 24.0BF16 · ~87.5 t/s
- Qwen 2.5 3B Instruct3.1B · MMLU-Pro 32.4FP32 · ~45.2 t/s
- Gemma 2 2B Instruct2.6B · MMLU-Pro 17.8FP32 · ~53.8 t/s
- Gemma 4 E2B2B · MMLU-Pro 60.0FP32 · ~70 t/s
- SmolLM2 1.7B Instruct1.7B · MMLU-Pro 19.0FP32 · ~82.4 t/s
- Qwen 2.5 1.5B Instruct1.5B · MMLU-Pro 16.8FP32 · ~93.3 t/s
- Llama 3.2 1B Instruct1.24B · MMLU-Pro 12.5FP32 · ~112.9 t/s
- Gemma 3 1B Instruct1B · MMLU-Pro 14.7FP32 · ~140 t/s
- Qwen 2.5 0.5B Instruct0.5B · MMLU-Pro 10.0FP32 · ~280 t/s
- SmolLM2 360M Instruct0.36B · MMLU-Pro 8.0FP32 · ~388.9 t/s
Models that fit with CPU offload (9)
These use system RAM for layers that don't fit in VRAM — expect much slower inference.
- GLM-4.5 Air 106B106B · MMLU-Pro 81.4Q2_K · ~35.5 t/s
- GLM-4.6V 106B106B · MMLU-Pro 79.9Q2_K · ~35.5 t/s
- Qwen 2.5 72B Instruct72B · MMLU-Pro 71.1Q3_K_M · ~4.5 t/s
- Llama 3.3 70B Instruct70B · MMLU-Pro 68.9Q3_K_M · ~4.7 t/s
- DeepSeek R1 Distill Llama 70B70B · MMLU-Pro 70.0Q3_K_M · ~4.7 t/s
- Llama 3.1 70B Instruct70B · MMLU-Pro 66.4Q3_K_M · ~4.7 t/s
- Mixtral 8x7B Instruct v0.146.7B · MMLU-Pro 29.7Q5_K_M · ~16.9 t/s
- Command-R 35B35B · MMLU-Pro 33.0Q5_K_M · ~6.2 t/s
- Qwen 3.6 35B35B · MMLU-Pro 85.2Q6_K · ~4.9 t/s
Too large for this GPU (21)
- Mixtral 8x22B Instruct v0.1
- Llama 3.1 405B Instruct
- DeepSeek V3 671B
- DeepSeek R1 671B
- Llama 4 Scout 109B
- Llama 4 Maverick 400B
- Qwen3 235B-A22B (MoE)
- MiniMax M1 456B
- GPT-OSS 120B
- GLM-4.5 355B
- GLM-4.6 355B
- GLM-4.7 358B
- Qwen 3.5 122B-A10B (MoE)
- MiniMax M2.5 229B
- GLM-5 744B
- MiniMax M2.7 229B
- Nemotron 3 Super 120B
- Kimi K2.6
- GLM-5.1 754B
- DeepSeek V4 Pro 1.6T
- DeepSeek V4 Flash 284B
Compare Intel Arc A770 16GB with other GPUs
Frequently asked questions
- How much VRAM does the Intel Arc A770 16GB have?
- The Intel Arc A770 16GB has 16 GB of GDDR6 with 560 GB/s memory bandwidth.
- What is the Intel Arc A770 16GB best for?
- With 16 GB of VRAM, the Intel Arc A770 16GB handles smaller models (7B–14B) at Q4–Q5 quantization — ideal for entry-level local LLM experimentation and lightweight inference.
- What LLMs can the Intel Arc A770 16GB run locally?
- The Intel Arc A770 16GB can run 40 of the 70 open-weight models tracked by CanItRun natively in VRAM at 8k context. Top options include: Llama 3.1 8B Instruct at Q8_0, Llama 3.2 3B Instruct at BF16, Llama 3.2 1B Instruct at FP32.
- Can the Intel Arc A770 16GB run Llama 3.3 70B Instruct?
- The Intel Arc A770 16GB can run Llama 3.3 70B Instruct with CPU offload at Q3_K_M quantization, but inference will be slower than native VRAM execution.
- Can the Intel Arc A770 16GB run Qwen 3.6 27B?
- Yes. The Intel Arc A770 16GB runs Qwen 3.6 27B natively in VRAM at Q3_K_M quantization, achieving approximately 48.2 tokens per second.
- Can the Intel Arc A770 16GB run Llama 3.1 8B Instruct?
- Yes. The Intel Arc A770 16GB runs Llama 3.1 8B Instruct natively in VRAM at Q8_0 quantization, achieving approximately 70 tokens per second.