CanItRun Logocanitrun.

Gemma 4 E4B

Gemma 4 E4B needs roughly 3.6 GB VRAM at Q4_K_M quantization (10.1 GB at FP16). 106 GPUs we track can run it fully in VRAM at 8k context.

106 GPUs run this natively · 1 with CPU offload

Google4B params125k contextApache 2.0Commercial use ok

Gemma 4 E4B is a 4B parameter dense large language model developed by Google. Released in April 2026, it supports text and vision and audio inputs with a 128K context window, released under the Apache 2.0 license, allowing commercial use.

To run Gemma 4 E4B locally, you need approximately 3.6 GB of VRAM at Q4_K_M quantization with 8k context. 106 of the GPUs we track can run it fully in VRAM, with a further 1 able to offload to system RAM. At Q4_K_M it needs just 3.6 GB, making it accessible even on mid-range 16 GB cards like RTX 4080 and RTX 4070 Ti Super. At Q8_K_M (5.6 GB), you get near-FP16 quality while still fitting on 8, 12, 16, 24, 48 and 80 GB GPUs. FP16 requires 10.1 GB, limiting it to 48 and 80 GB GPUs.

With an MMLU-Pro score of 69.4, it delivers strong general reasoning for local deployment. The license allows commercial use.

VRAM at each quantization

Assumes 8k context. KV cache grows linearly with context length.

QuantWeightsKV cacheTotal
FP3216.0 GB1.01 GB19.1 GB
BF168.0 GB1.01 GB10.1 GB
FP168.0 GB1.01 GB10.1 GB
Q8_04.0 GB1.01 GB5.6 GB
Q6_K3.3 GB1.01 GB4.8 GB
Q5_K_Mrec2.6 GB1.01 GB4.0 GB
Q4_K_M2.3 GB1.01 GB3.6 GB
Q3_K_M1.7 GB1.01 GB3.0 GB
Q2_K1.3 GB1.01 GB2.6 GB
NVFP4cuda2.0 GB1.01 GB3.4 GB

KV cache shown at 8k context (FP16). NVFP4 requires a CUDA GPU. Enable TurboQuant in the calculator to see reduced KV cache estimates.

Benchmarks

MMLU-Pro
69.4

GPUs that run Gemma 4 E4B natively (106)

Plus 1 GPUs that run it with CPU offload (slower)
Hugging Face ↗Ollama ↗Released 2026-04-02

Frequently asked questions

What are the VRAM requirements for Gemma 4 E4B?
Gemma 4 E4B requires approximately 3.6 GB of VRAM at Q4_K_M quantization, 5.6 GB at Q8, and 10.1 GB at FP16. These numbers assume 8k context window; VRAM scales linearly with context length due to the KV cache.
How many parameters does Gemma 4 E4B have?
Gemma 4 E4B has 4 billion parameters.
How capable is Gemma 4 E4B?
With an MMLU-Pro score of 69.4, Gemma 4 E4B delivers solid general-purpose performance suitable for most everyday tasks and professional use.
Can Gemma 4 E4B run on a 16 GB GPU?
Yes. Gemma 4 E4B needs 3.6 GB at Q4_K_M, which fits in a 16 GB GPU like the RTX 4080 or RTX 4070 Ti Super.
What is the smallest quantization for Gemma 4 E4B that fits in 24 GB of VRAM?
At FP32, Gemma 4 E4B needs 19.0 GB — the highest-quality quantization that fits in 24 GB of VRAM.
What GPU do I need to run Gemma 4 E4B locally?
A 16 GB GPU is enough. At Q4_K_M, Gemma 4 E4B needs 3.6 GB VRAM. Good options: RTX 4080 (16 GB), RTX 4070 Ti Super (16 GB).