Hardware

Apple M3 Max (30-core GPU)

Apple M3 Max (30-core GPU) has 36 / 48 / 96 GB Unified and 300 GB/s. See which open models fit, at which quant, and roughly how fast. Figures below use the default memory (36 GB). Updated 2026-10-17.

Memory36 / 48 / 96 GB Unified
Bandwidth300 GB/s
Kindmac
Year2023

30-core GPU version, 300 GB/s. Memory configs 36–96GB. Source.

RSS for new models on this device

Models that fit

ModelVerdictQuantContexttok/s
Kwaipilot KAT Coder V2.5 Dev
34.7B
Tight fitQ5_K_M8K35–48
Qwen3.8 35B A3B Distill
35.5B
Tight fitQ5_K_M8K71–97
Qwen3.5 35B A3B
34.7B
Tight fitUD-Q5_K_XL8K67–92
Qwen3.6 35B A3B
34.7B
Tight fitUD-Q5_K_XL8K67–91
NVIDIA Nemotron 3.5 Lightning 30B A3B
32.9B
Tight fitUD-Q5_K_S8K58–80
NVIDIA Nemotron 3 Nano Omni 30B A3B Reasoning
31.6B
Tight fitUD-Q5_K_S8K59–81
Nemotron 3 Nano 30B A3B
31.6B
Tight fitUD-Q5_K_XL4K58–79
GLM 4.7 Flash
29.9B
Tight fitUD-Q6_K_XL8K27–37
Qwen3 Coder 30B A3B Instruct
30.5B
Tight fitUD-Q6_K_XL8K49–66
Qwen3 30B A3B Instruct 2507
30.5B
Tight fitUD-Q6_K_XL8K49–66
Qwen3 VL 30B A3B Instruct
30.5B
Tight fitUD-Q6_K_XL8K49–66
Qwen3 30B A3B Thinking 2507
30.5B
Tight fitUD-Q6_K_XL8K49–66
Qwen3 Coder Next
79.7B
Tight fitUD-Q2_K_XL8K31–42
gemma 4 26B A4B it
25.2B
Tight fitQ8_08K26–36
LFM2.5 24B A2B
24.0B
Tight fitQ8_08K59–80
Qwen3 Next 80B A3B Instruct
79.7B
Tight fitUD-IQ2_XXS8K92–126
Qwen3 Next 80B A3B Thinking
79.7B
Tight fitUD-IQ2_XXS8K92–126
GLM 4.7 Flash REAP 23B A3B
23.0B
Tight fitUD-Q8_K_XL4K43–59
gpt oss 20b
20.9B
Runs greatUD-Q8_K_XL8K41–56
Qwen2.5 14B Instruct
14.8B
RunsQ8_08K9.5–13
NousResearch Hermes 4 14B
14.8B
RunsQ8_08K9.7–13
DeepSeek R1 Distill Qwen 14B
14.8B
RunsQ8_08K9.5–13
Qwen2.5 Coder 14B Instruct 128K
14.8B
RunsQ8_08K9.5–13
phi 4
14.7B
RunsQ8_08K9.6–13
DeepSeek R1 Distill Llama 8B
8.0B
RunsBF168K9.6–13
Llama 3.1 8B Instruct
8.0B
RunsBF168K9.6–13
Apertus 8B Instruct 2509
8.1B
RunsBF168K9.6–13
Qwen2.5 7B Instruct
7.6B
Runs greatF168K11–14
Qwen2.5 VL 7B Instruct
7.6B
Runs greatBF168K11–14
DeepSeek R1 Distill Qwen 7B
7.6B
Runs greatF168K11–14
Qwen2.5 Coder 7B Instruct 128K
7.6B
Runs greatF168K11–14
gemma 4 E4B it
7.5B
Runs greatBF168K10–14
gemma 4 E4B it qat
7.5B
Runs greatUD-Q4_K_XL8K34–46
LFM2.5 8B A1B
8.5B
RunsBF168K69–94
gemma 4 E2B it
4.6B
Runs greatBF168K17–23
Qwen3.5 4B
4.2B
Runs greatBF168K19–26
Qwen3 4B
4.0B
Runs greatBF168K18–24
Qwen3 VL 4B Instruct
4.0B
Runs greatBF168K18–24
Qwen3 4B Thinking 2507
4.0B
Runs greatF168K18–24
Qwen3 VL 4B Thinking
4.0B
Runs greatBF168K18–24

90 more models in the catalog do not fit this default profile, or ranked below the first 40 that do.

Example: Tight fit fully in unified memory on your Apple M3 Max (30-core GPU) at Q5_K_M, 8K context, about 35–48 tok/s. Weights 23.3 GB plus 0.19 GB of KV cache — 24.0 GB of 27.0 GB usable. Up to 128K context still fits. Weights shown in the verdict use GiB (the same 1024³ counting as GPU memory).