Can I run it?

Can I run Qwen3.8 27B on GeForce RTX 3070?

Heavily degraded

Heavily degraded fully on your GeForce RTX 3070 at UD-IQ1_M, 4K context, about 35–48 tok/s. Weights 6.27 GB plus 0.32 GB of KV cache — 6.95 GB of 7.13 GB usable.

Best quantUD-IQ1_M

Working context4K

Max that fits4K

Speed35–48 tok/sEstimate from memory bandwidth, not a benchmark. Method.

Weights6.27 GB

KV cache0.32 GB

Total6.95 GB

Usable7.13 GB

Qwen3.8 27B details · GeForce RTX 3070 page · How this estimate is made

Run commands

llama.cpp

llama-server -hf unsloth/Qwen3.8-27B-GGUF:UD-IQ1_M -c 4096 -ngl 64

Ollama

ollama run qwen3.8

LM Studio

lms get unsloth/Qwen3.8-27B-GGUF
# Then load quant UD-IQ1_M

Assumptions

Estimate from memory bandwidth, not a benchmark. Decode speed uses 55–75% of peak bandwidth.
KV cache is FP16. Engine overhead assumes llama.cpp (0.3 GB + 1% of the weights). Ollama is closer to 0.9 GB + 3%, LM Studio closer to 1 GB + 3%.
UD-IQ1_M size is the real GGUF file size from Hugging Face.
0.5 GB is reserved because this GPU also drives a display, then 5% of the rest is left free.
Speed is quoted at 4K context, not at the maximum context that still fits.
This quant is IQ1 or IQ2. It can load, but quality is heavily degraded, so it is left off best-fit lists.

Larger models that also fit

No close alternative in the current catalog.

Updated 2026-10-24. Profile on this page is the device default plus 32 GB of DDR5-5600 system RAM.