https://gpufit.tech/gpu/l4New catalog models scored against NVIDIA L4.https://gpufit.tech/models/bottlecapai-thinkingcap-gemma-4-26b-a4b-ithttps://gpufit.tech/models/bottlecapai-thinkingcap-gemma-4-26b-a4b-itFri, 23 Oct 2026 21:26:38 GMTTight fit fully on your NVIDIA L4 at Q5_K_M, 8K context, about 32–43 tok/s. Weights 18.6 GB plus 0.51 GB of KV cache — 19.6 GB of 22.8 GB usable. Up to 64K context still fits. 32–43 tok/s.https://gpufit.tech/models/nvidia-nemotron-3-5-bolt-e4bhttps://gpufit.tech/models/nvidia-nemotron-3-5-bolt-e4bFri, 23 Oct 2026 09:47:55 GMTRuns fully on your NVIDIA L4 at BF16, 8K context, about 10–14 tok/s. Weights 14.0 GB plus 0.14 GB of KV cache — 14.6 GB of 22.8 GB usable. Up to 128K context still fits. 10–14 tok/s.https://gpufit.tech/models/deepseek-v4-1-flash-1017https://gpufit.tech/models/deepseek-v4-1-flash-1017Sat, 17 Oct 2026 20:36:06 GMTWon't fit on NVIDIA L4. The smallest quant UD-IQ1_S is 217.0 GB before KV cache, and usable memory is 22.8 GB.https://gpufit.tech/models/lfm2-5-24b-a2bhttps://gpufit.tech/models/lfm2-5-24b-a2bTue, 13 Oct 2026 14:19:48 GMTTight fit fully on your NVIDIA L4 at UD-Q6_K_XL, 8K context, about 66–90 tok/s. Weights 20.4 GB plus 0.63 GB of KV cache — 21.5 GB of 22.8 GB usable. Up to 16K context still fits. 66–90 tok/s.