Qwen3 235B-A22B Instruct

235B-A22B

Alibaba Qwen3

Qwen3 flagship MoE (22B active / 235B total). Q4_K_M ~142GB; rivals DeepSeek-R1 class models.

⬇ 1.4K HF downloads♥ 10 likesQwen/Qwen3-235B-A22B-GGUF· stats from 8/14/2026
Pro GPU

41K

Max Context

3

Quant Variants

GGUF Q4_K_M

Best Quality

97.8%

Accuracy Retained

Calculate VRAMHugging FaceCompare

Quantization Variants

Per-quant VRAM, quality loss, and inference speed on RTX 4090

Measured = site benchmarks · Estimated = formula · Community = public reports

FormatLevelBPWVRAMPPL LossSpeedSourceActions
GGUFQ4_K_M4.85142.0 GB2.2%10 tok/sEstimated
CalcHF
GGUFQ3_K_M3.87115.0 GB4.8%12 tok/sEstimated
CalcHF
AWQINT44125.0 GB3.2%14 tok/sEstimated
CalcHF

Similar models

Compare with Qwen3 32B
32B

Qwen3 32B Instruct

Alibaba Qwen3

Consumer GPUPro GPU
16.8 GBmin VRAM·97.5%accuracy

Qwen3 dense 32B — successor to Qwen2.5-32B with stronger reasoning and thinking mode.

8B

Qwen3 8B Instruct

Alibaba Qwen3

Consumer GPUMac / Apple Silicon
5.1 GBmin VRAM·99.4%accuracy

Latest Qwen3 dense 8B with thinking mode. Strong upgrade from Qwen2.5 7B for local deploy.

14B

Qwen3 14B Instruct

Alibaba Qwen3

Consumer GPUMac / Apple Silicon
9.5 GBmin VRAM·98.8%accuracy

Qwen3 14B — best balance of reasoning and VRAM in the 2026 Qwen lineup.

30B-A3B

Qwen3 30B-A3B Instruct

Alibaba Qwen3

Consumer GPUMac / Apple Silicon
17.5 GBmin VRAM·98.9%accuracy

Qwen3 MoE with only 3B active params. Q4 ~19GB file; outperforms QwQ-32B on 16GB cards.

How to actually run this

Deployment guides for this model and this class of hardware.