Hardware
Radeon RX 7900 XTX
Radeon RX 7900 XTX has 24 GB GDDR6 and 960 GB/s. See which open models fit, at which quant, and roughly how fast. Figures below use the default memory (24 GB), 32 GB system RAM, and DDR5-5600 for anything that spills. Updated 2026-10-24.
Memory24 GB GDDR6
Bandwidth960 GB/s
Kindgpu
Year2022
24GB GDDR6, 384-bit, 960 GB/s. Source.
RSS for new models on this device
Models that fit
| Model | Verdict | Quant | Context | tok/s |
|---|---|---|---|---|
| GLM 4 32B 0414 32.6B | Tight fit | Q5_K_S | 4K | 23–32 |
| gemma 4 31B it 30.7B | Tight fit | Q5_K_S | 4K | 21–29 |
| Qwen3 32B 32.8B | Tight fit | UD-Q4_K_XL | 8K | 24–32 |
| Qwen3 VL 32B Instruct 32.8B | Tight fit | UD-Q4_K_XL | 8K | 24–32 |
| Qwen2.5 32B Instruct 32.8B | Tight fit | Q4_K_M | 8K | 24–33 |
| Qwen2.5 Coder 32B Instruct 32.8B | Tight fit | Q4_K_M | 8K | 24–33 |
| DeepSeek R1 Distill Qwen 32B 32.8B | Tight fit | Q4_K_M | 8K | 24–33 |
| Swift Qwen3.8 27B 27.3B | Tight fit | Q5_K_M | 8K | 25–35 |
| Qwen3.8 27B 27.3B | Tight fit | UD-Q6_K | 8K | 23–32 |
| gemma 3 27b it 27.0B | Tight fit | Q6_K | 4K | 22–30 |
| medgemma 27b text it 27.0B | Tight fit | Q6_K | 4K | 22–30 |
| Qwen3.6 27B 26.9B | Tight fit | Q6_K | 4K | 23–32 |
| Qwen3.5 27B 26.9B | Tight fit | Q6_K | 4K | 23–32 |
| Devstral Small 2 24B Instruct 2512 23.6B | Tight fit | UD-Q6_K_XL | 8K | 24–33 |
| Mistral Small 3.2 24B Instruct 2506 23.6B | Tight fit | UD-Q6_K_XL | 8K | 24–33 |
| Magistral Small 2509 23.6B | Tight fit | UD-Q6_K_XL | 8K | 24–33 |
| Qwen3.5 35B A3B 34.7B | Tight fit | UD-Q4_K_XL | 8K | 252–344 |
| Qwen3.6 35B A3B 34.7B | Tight fit | UD-Q4_K_XL | 8K | 251–342 |
| Tiel Coder 35B A3B 34.7B | Tight fit | UD-Q4_K_XL | 8K | 251–342 |
| GLM 4.7 Flash 29.9B | Tight fit | UD-Q5_K_XL | 8K | 104–142 |
| Kwaipilot KAT Coder V2.5 Dev 34.7B | Tight fit | Q4_K_M | 8K | 131–178 |
| Cyber Tiel Coder 35B A3B GGUF MTP 35.5B | Tight fit | Q4_K_M (est.) | 8K | 266–362 |
| Qwen3.8 35B A3B Distill 35.5B | Tight fit | Q4_K_M | 8K | 264–360 |
| Qwen3 Coder 30B A3B Instruct 30.5B | Tight fit | UD-Q5_K_XL | 8K | 180–245 |
| Qwen3 30B A3B Instruct 2507 30.5B | Tight fit | UD-Q5_K_XL | 8K | 180–245 |
| Qwen3 VL 30B A3B Instruct 30.5B | Tight fit | UD-Q5_K_XL | 8K | 180–245 |
| Qwen3 30B A3B Thinking 2507 30.5B | Tight fit | UD-Q5_K_XL | 8K | 179–245 |
| DeepSeek R1 Distill Llama 70B 70.6B | Tight fit | UD-IQ2_XXS | 8K | 24–33 |
| Llama 3.3 70B Instruct 70.6B | Tight fit | UD-IQ2_XXS | 8K | 24–33 |
| Hermes 4 70B 70.6B | Tight fit | UD-IQ2_XXS | 8K | 24–33 |
| bottlecapai ThinkingCap gemma 4 26B A4B it 25.2B | Tight fit | Q5_K_M | 8K | 102–139 |
| gemma 4 26B A4B it 25.2B | Tight fit | UD-Q5_K_XL | 8K | 98–134 |
| NVIDIA Nemotron 3.5 Lightning 30B A3B 32.9B | Tight fit | IQ4_NL | 8K | 223–304 |
| Qwen3 Coder Next 79.7B | Tight fit | UD-IQ1_M | 8K | 118–161 |
| Nemotron 3 Nano 30B A3B 31.6B | Tight fit | Q4_K_S | 8K | 209–285 |
| NVIDIA Nemotron 3 Nano Omni 30B A3B Reasoning 31.6B | Tight fit | UD-IQ4_XS | 8K | 230–314 |
| LFM2.5 24B A2B 24.0B | Tight fit | UD-Q6_K_XL | 8K | 212–289 |
| Qwen3 Next 80B A3B Thinking 79.7B | Tight fit | UD-IQ1_S | 2K | 499–681 |
| GLM 4.7 Flash REAP 23B A3B 23.0B | Tight fit | UD-Q6_K_XL | 8K | 171–234 |
| gpt oss 20b 20.9B | Runs great | UD-Q8_K_XL | 8K | 131–179 |
105 more models in the catalog do not fit this default profile, or ranked below the first 40 that do.
Example: Tight fit fully on your Radeon RX 7900 XTX at Q5_K_S, 4K context, about 23–32 tok/s. Weights 21.0 GB plus 0.24 GB of KV cache — 21.7 GB of 22.3 GB usable. Weights shown in the verdict use GiB (the same 1024³ counting as GPU memory).