Hardware

GeForce RTX 5090

GeForce RTX 5090 has 32 GB GDDR7 and 1792 GB/s. See which open models fit, at which quant, and roughly how fast. Figures below use the default memory (32 GB), 32 GB system RAM, and DDR5-5600 for anything that spills. Updated 2026-10-24.

Memory32 GB GDDR7

Bandwidth1792 GB/s

Kindgpu

Year2025

NVIDIA official compare table: memory config and bandwidth. Source.

RSS for new models on this device

Models that fit

Model	Verdict	Quant	Context	tok/s
Qwen2.5 32B Instruct 32.8B	Runs	Q5_K_M	8K	39–53
Qwen2.5 Coder 32B Instruct 32.8B	Runs	Q5_K_M	8K	39–53
DeepSeek R1 Distill Qwen 32B 32.8B	Tight fit	Q6_K	8K	34–46
Qwen3 32B 32.8B	Tight fit	UD-Q6_K_XL	4K	33–45
Qwen3 VL 32B Instruct 32.8B	Tight fit	UD-Q6_K_XL	4K	33–45
GLM 4 32B 0414 32.6B	Tight fit	UD-Q6_K_XL	8K	34–46
Qwen3 Coder Next 79.7B	Tight fit	UD-IQ3_S	8K	169–230
DeepSeek R1 Distill Llama 70B 70.6B	Tight fit	UD-IQ3_XXS	8K	32–44
Llama 3.3 70B Instruct 70.6B	Tight fit	UD-IQ3_XXS	8K	32–44
Hermes 4 70B 70.6B	Tight fit	UD-IQ3_XXS	8K	32–44
gemma 4 31B it 30.7B	Tight fit	UD-Q6_K_XL	8K	28–38
Qwen3.8 27B 27.3B	Tight fit	UD-Q8_K_L	8K	34–47
Swift Qwen3.8 27B 27.3B	Tight fit	Q8_0	8K	33–45
gemma 3 27b it 27.0B	Tight fit	Q8_0	8K	30–41
medgemma 27b text it 27.0B	Tight fit	Q8_0	8K	30–41
Qwen3.6 27B 26.9B	Tight fit	Q8_0	8K	34–46
Qwen3.5 27B 26.9B	Tight fit	Q8_0	8K	34–46
Kwaipilot KAT Coder V2.5 Dev 34.7B	Runs	Q5_K_M	8K	210–286
Cyber Tiel Coder 35B A3B GGUF MTP 35.5B	Tight fit	Q6_K (est.)	8K	375–511
Qwen3.8 35B A3B Distill 35.5B	Tight fit	Q6_K	8K	374–510
Tiel Coder 35B A3B 34.7B	Tight fit	UD-Q5_K_XL	8K	399–544
Qwen3.5 35B A3B 34.7B	Tight fit	UD-Q6_K	8K	374–510
Qwen3.6 35B A3B 34.7B	Tight fit	UD-Q6_K	8K	364–497
NVIDIA Nemotron 3.5 Lightning 30B A3B 32.9B	Tight fit	UD-Q5_K_XL	8K	307–419
Devstral Small 2 24B Instruct 2512 23.6B	Tight fit	UD-Q8_K_XL	8K	32–44
Mistral Small 3.2 24B Instruct 2506 23.6B	Tight fit	UD-Q8_K_XL	8K	32–44
Magistral Small 2509 23.6B	Tight fit	UD-Q8_K_XL	8K	32–44
Nemotron 3 Nano 30B A3B 31.6B	Tight fit	UD-Q5_K_XL	8K	323–441
NVIDIA Nemotron 3 Nano Omni 30B A3B Reasoning 31.6B	Tight fit	UD-Q5_K_XL	8K	307–419
GLM 4.7 Flash 29.9B	Runs	UD-Q6_K_XL	8K	164–224
Qwen3 Coder 30B A3B Instruct 30.5B	Tight fit	UD-Q6_K_XL	8K	290–396
Qwen3 30B A3B Instruct 2507 30.5B	Tight fit	UD-Q6_K_XL	8K	290–396
Qwen3 VL 30B A3B Instruct 30.5B	Tight fit	UD-Q6_K_XL	8K	290–396
Qwen3 30B A3B Thinking 2507 30.5B	Tight fit	UD-Q6_K_XL	8K	290–396
Qwen2.5 72B Instruct 72.7B	Tight fit	IQ2_XXS	8K	35–48
Qwen3 Next 80B A3B Instruct 79.7B	Tight fit	UD-Q2_K_XL	4K	641–874
Qwen3 Next 80B A3B Thinking 79.7B	Tight fit	UD-Q2_K_XL	4K	641–874
bottlecapai ThinkingCap gemma 4 26B A4B it 25.2B	Tight fit	Q8_0	8K	157–214
gemma 4 26B A4B it 25.2B	Tight fit	UD-Q8_K_XL	8K	154–210
LFM2.5 24B A2B 24.0B	Runs	Q8_0	8K	352–480

105 more models in the catalog do not fit this default profile, or ranked below the first 40 that do.

Example: Runs fully on your GeForce RTX 5090 at Q5_K_M, 8K context, about 39–53 tok/s. Weights 21.7 GB plus 2.00 GB of KV cache — 24.2 GB of 29.9 GB usable. Up to 16K context still fits. Weights shown in the verdict use GiB (the same 1024³ counting as GPU memory).