Hardware

Apple M2

Apple M2 has 8 / 16 / 24 GB Unified and 100 GB/s. See which open models fit, at which quant, and roughly how fast. Figures below use the default memory (16 GB). Updated 2026-10-17.

Memory8 / 16 / 24 GB Unified

Bandwidth100 GB/s

Kindmac

Year2022

100 GB/s. 8, 16, or 24GB. Source.

RSS for new models on this device

Models that fit

Model	Verdict	Quant	Context	tok/s
GLM 4.7 Flash REAP 23B A3B 23.0B	Tight fit	Q3_K_S	8K	31–42
Kwaipilot KAT Coder V2.5 Dev 34.7B	Tight fit	IQ2_S	4K	26–36
Qwen3.5 35B A3B 34.7B	Tight fit	UD-IQ2_XXS	8K	50–69
Qwen3.6 35B A3B 34.7B	Tight fit	UD-IQ2_XXS	8K	50–68
LFM2.5 24B A2B 24.0B	Tight fit	UD-IQ3_XXS	8K	39–53
GLM 4.7 Flash 29.9B	Tight fit	UD-IQ2_XXS	8K	21–28
gemma 4 26B A4B it 25.2B	Tight fit	UD-Q2_K_XL	8K	15–20
gemma 4 E4B it qat 7.5B	Runs great	UD-Q4_K_XL	8K	11–15
Qwen3 Coder 30B A3B Instruct 30.5B	Tight fit	UD-IQ2_XXS	8K	30–41
Qwen3 30B A3B Instruct 2507 30.5B	Tight fit	UD-IQ2_XXS	8K	30–41
Qwen3 VL 30B A3B Instruct 30.5B	Tight fit	UD-IQ2_XXS	8K	30–41
Qwen3 30B A3B Thinking 2507 30.5B	Tight fit	UD-IQ2_XXS	8K	30–41
LFM2.5 8B A1B 8.5B	Tight fit	UD-Q8_K_XL	8K	37–50
Ministral 3 3B Instruct 2512 3.4B	Runs great	Q8_0	8K	12–17
Qwen3.5 2B 1.9B	Runs great	BF16	8K	14–19
DeepSeek R1 Distill Qwen 1.5B 1.8B	Runs great	BF16	8K	14–20
Qwen3 1.7B 1.7B	Runs great	BF16	8K	13–17
Qwen3 VL 2B Instruct 1.7B	Runs great	BF16	8K	13–17
Qwen3 VL 2B Thinking 1.7B	Runs great	BF16	8K	13–17
Qwen2.5 1.5B Instruct 1.5B	Runs great	F16	8K	17–23
Qwen2.5 Coder 1.5B Instruct 1.5B	Runs great	F16	8K	17–23
Llama 3.2 1B Instruct 1.2B	Runs great	BF16	8K	20–27
LFM2.5 1.2B Instruct 1.2B	Runs great	BF16	8K	21–29
gemma 3 1b it 1.0B	Runs great	BF16	8K	25–34
Qwen3.5 0.8B 0.75B	Runs great	BF16	8K	34–46
Qwen3 0.6B 0.60B	Runs great	BF16	8K	26–35
Qwen2.5 0.5B Instruct 0.49B	Runs great	F16	8K	50–69
Qwen2.5 14B Instruct 14.8B	Tight fit	Q5_K_S	4K	5.0–6.8
Qwen3 14B 14.8B	Tight fit	Q5_K_S	4K	5.0–6.9
NousResearch Hermes 4 14B 14.8B	Tight fit	Q5_K_S	4K	5.0–6.9
Ministral 3 14B Instruct 2512 13.5B	Tight fit	UD-Q5_K_XL	8K	5.0–6.8
Ministral 3 14B Reasoning 2512 13.5B	Tight fit	UD-Q5_K_XL	8K	5.0–6.8
DeepSeek R1 Distill Qwen 14B 14.8B	Tight fit	Q4_K_M	8K	5.2–7.1
Qwen2.5 Coder 14B Instruct 128K 14.8B	Tight fit	Q4_K_M	8K	5.2–7.1
phi 4 14.7B	Tight fit	Q4_K_M	8K	5.2–7.1
gemma 4 12b it 11.9B	Tight fit	Q6_K	8K	4.2–5.8
Devstral Small 2 24B Instruct 2512 23.6B	Tight fit	Q3_K_S	4K	5.0–6.8
Mistral Small 3.2 24B Instruct 2506 23.6B	Tight fit	Q3_K_S	4K	5.0–6.8
Magistral Small 2509 23.6B	Tight fit	Q3_K_S	4K	5.0–6.8
Qwen3.8 27B 27.3B	Tight fit	UD-Q2_K_XL	8K	5.3–7.2

90 more models in the catalog do not fit this default profile, or ranked below the first 40 that do.

Example: Tight fit fully in unified memory on your Apple M2 at Q3_K_S, 8K context, about 31–42 tok/s. Weights 9.59 GB plus 0.41 GB of KV cache — 10.4 GB of 11.0 GB usable. Weights shown in the verdict use GiB (the same 1024³ counting as GPU memory).