Can I run it?

Can I run Qwen3.8 27B on GeForce RTX 4060 Ti 8GB?

Tight fit

Tight fit fully on your GeForce RTX 4060 Ti 8GB at UD-IQ1_M, 4K context, about 23–31 tok/s. Weights 6.27 GB plus 0.32 GB of KV cache — 6.95 GB of 7.13 GB usable.

Best quantUD-IQ1_M

Working context4K

Max that fits4K

Speed23–31 tok/s

Weights6.27 GB

KV cache0.32 GB

Total6.95 GB

Usable7.13 GB

Qwen3.8 27B details · GeForce RTX 4060 Ti 8GB page · How this estimate is made

Run commands

llama.cpp

llama-server -hf unsloth/Qwen3.8-27B-GGUF:UD-IQ1_M -c 4096 -ngl 64

Ollama

ollama run qwen3.8

LM Studio

lms get unsloth/Qwen3.8-27B-GGUF
# Then load quant UD-IQ1_M

Assumptions

Estimate, not a benchmark. Decode speed uses a memory-bandwidth model at 55–75% of peak.
KV cache is FP16. Engine overhead assumes llama.cpp (0.3 GB + 1% of the weights). Ollama is closer to 0.9 GB + 3%, LM Studio closer to 1 GB + 3%.
UD-IQ1_M size is the real GGUF file size from Hugging Face.
0.5 GB is reserved because this GPU also drives a display, then 5% of the rest is left free.
Speed is quoted at 4K context, not at the maximum context that still fits.

Larger models that also fit

No close alternative in the current catalog.

Updated 2026-10-24. Profile on this page is the device default plus 32 GB of DDR5-5600 system RAM.