Hardware
Apple M3 Max (30-core GPU)
Apple M3 Max (30-core GPU) has 36 / 48 / 96 GB Unified and 300 GB/s. See which open models fit, at which quant, and roughly how fast. Figures below use the default memory (36 GB). Updated 2026-10-17.
Memory36 / 48 / 96 GB Unified
Bandwidth300 GB/s
Kindmac
Year2023
30-core GPU version, 300 GB/s. Memory configs 36–96GB. Source.
RSS for new models on this device
Models that fit
| Model | Verdict | Quant | Context | tok/s |
|---|---|---|---|---|
| Kwaipilot KAT Coder V2.5 Dev 34.7B | Tight fit | Q5_K_M | 8K | 35–48 |
| Qwen3.8 35B A3B Distill 35.5B | Tight fit | Q5_K_M | 8K | 71–97 |
| Qwen3.5 35B A3B 34.7B | Tight fit | UD-Q5_K_XL | 8K | 67–92 |
| Qwen3.6 35B A3B 34.7B | Tight fit | UD-Q5_K_XL | 8K | 67–91 |
| NVIDIA Nemotron 3.5 Lightning 30B A3B 32.9B | Tight fit | UD-Q5_K_S | 8K | 58–80 |
| NVIDIA Nemotron 3 Nano Omni 30B A3B Reasoning 31.6B | Tight fit | UD-Q5_K_S | 8K | 59–81 |
| Nemotron 3 Nano 30B A3B 31.6B | Tight fit | UD-Q5_K_XL | 4K | 58–79 |
| GLM 4.7 Flash 29.9B | Tight fit | UD-Q6_K_XL | 8K | 27–37 |
| Qwen3 Coder 30B A3B Instruct 30.5B | Tight fit | UD-Q6_K_XL | 8K | 49–66 |
| Qwen3 30B A3B Instruct 2507 30.5B | Tight fit | UD-Q6_K_XL | 8K | 49–66 |
| Qwen3 VL 30B A3B Instruct 30.5B | Tight fit | UD-Q6_K_XL | 8K | 49–66 |
| Qwen3 30B A3B Thinking 2507 30.5B | Tight fit | UD-Q6_K_XL | 8K | 49–66 |
| Qwen3 Coder Next 79.7B | Tight fit | UD-Q2_K_XL | 8K | 31–42 |
| gemma 4 26B A4B it 25.2B | Tight fit | Q8_0 | 8K | 26–36 |
| LFM2.5 24B A2B 24.0B | Tight fit | Q8_0 | 8K | 59–80 |
| Qwen3 Next 80B A3B Instruct 79.7B | Tight fit | UD-IQ2_XXS | 8K | 92–126 |
| Qwen3 Next 80B A3B Thinking 79.7B | Tight fit | UD-IQ2_XXS | 8K | 92–126 |
| GLM 4.7 Flash REAP 23B A3B 23.0B | Tight fit | UD-Q8_K_XL | 4K | 43–59 |
| gpt oss 20b 20.9B | Runs great | UD-Q8_K_XL | 8K | 41–56 |
| Qwen2.5 14B Instruct 14.8B | Runs | Q8_0 | 8K | 9.5–13 |
| NousResearch Hermes 4 14B 14.8B | Runs | Q8_0 | 8K | 9.7–13 |
| DeepSeek R1 Distill Qwen 14B 14.8B | Runs | Q8_0 | 8K | 9.5–13 |
| Qwen2.5 Coder 14B Instruct 128K 14.8B | Runs | Q8_0 | 8K | 9.5–13 |
| phi 4 14.7B | Runs | Q8_0 | 8K | 9.6–13 |
| DeepSeek R1 Distill Llama 8B 8.0B | Runs | BF16 | 8K | 9.6–13 |
| Llama 3.1 8B Instruct 8.0B | Runs | BF16 | 8K | 9.6–13 |
| Apertus 8B Instruct 2509 8.1B | Runs | BF16 | 8K | 9.6–13 |
| Qwen2.5 7B Instruct 7.6B | Runs great | F16 | 8K | 11–14 |
| Qwen2.5 VL 7B Instruct 7.6B | Runs great | BF16 | 8K | 11–14 |
| DeepSeek R1 Distill Qwen 7B 7.6B | Runs great | F16 | 8K | 11–14 |
| Qwen2.5 Coder 7B Instruct 128K 7.6B | Runs great | F16 | 8K | 11–14 |
| gemma 4 E4B it 7.5B | Runs great | BF16 | 8K | 10–14 |
| gemma 4 E4B it qat 7.5B | Runs great | UD-Q4_K_XL | 8K | 34–46 |
| LFM2.5 8B A1B 8.5B | Runs | BF16 | 8K | 69–94 |
| gemma 4 E2B it 4.6B | Runs great | BF16 | 8K | 17–23 |
| Qwen3.5 4B 4.2B | Runs great | BF16 | 8K | 19–26 |
| Qwen3 4B 4.0B | Runs great | BF16 | 8K | 18–24 |
| Qwen3 VL 4B Instruct 4.0B | Runs great | BF16 | 8K | 18–24 |
| Qwen3 4B Thinking 2507 4.0B | Runs great | F16 | 8K | 18–24 |
| Qwen3 VL 4B Thinking 4.0B | Runs great | BF16 | 8K | 18–24 |
90 more models in the catalog do not fit this default profile, or ranked below the first 40 that do.
Example: Tight fit fully in unified memory on your Apple M3 Max (30-core GPU) at Q5_K_M, 8K context, about 35–48 tok/s. Weights 23.3 GB plus 0.19 GB of KV cache — 24.0 GB of 27.0 GB usable. Up to 128K context still fits. Weights shown in the verdict use GiB (the same 1024³ counting as GPU memory).