Apple M4 Pro
Mac mini
64 GB RAM · 32 models tested
Avg Score
66 /100
Avg Speed
31354.8 tok/s
Models Tested
32
| Model | Size | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| gpt-oss-20b | 95 | 118.2 | 2.2s | Excellent | |
| gpt-oss:20b | 20.9B MXFP4 | 94 | 54.5 | 2.9s | Excellent |
| nemotron-3-nano | 93 | 93.3 | 257 ms | Excellent | |
| qwen/qwen3-8b | 8B 4bit | 89 | 33.4 | 257 ms | Excellent |
| gemma4:12b-it-qat | 11.9B Q4_0 | 88 | 30.0 | 7.1s | Excellent |
| gemma4:26b-nvfp4 | nvfp4 | 85 | 65.7 | 30.0s | Not Rec. |
| qwen3.5-9b | 9B Q4_K_S | 84 | 30.2 | 499 ms | Excellent |
| unsloth-phi-4 | 4bit | 82 | 27.4 | 457 ms | Excellent |
| ministral-3:8b | 8.9B Q4_K_M | 79 | 41.4 | 257 ms | Good |
| lfm2-24b-a2b | 78 | 105.9 | 252 ms | Good | |
| lmstudio-community/meta-llama-3.1-8b-instruct | 8B Q4_K_M | 78 | 46.0 | 245 ms | Good |
| qwen3.5-9b-mlx | 9B 4bit | 77 | 20.3 | 4.2s | Good |
| mlx-community/meta-llama-3.1-8b-instruct | 8B 4bit | 77 | 54.3 | 277 ms | Good |
| qwen3.6:35b-a3b-coding-nvfp4 | nvfp4 | 76 | 72.7 | 30.0s | Not Rec. |
| gemma-3-27b-it-qat | 27B 4bit | 76 | 8.9 | 4.0s | Good |
| llama3.2:latest | 3.2B Q4_K_M | 73 | 98.9 | 125 ms | Good |
| mistral:latest | 7.2B Q4_0 | 72 | 54.3 | 124 ms | Good |
| qwen3.5-9b | 9B Q4_K_M | 72 | 28.9 | 338 ms | Good |
| qwen3.6:35b | 36.0B Q4_K_M | 70 | 30.6 | 30.0s | Not Rec. |
| qwen3.5-2b-mlx | 2B 4bit | 65 | 48.9 | 4.2s | Good |
| richardyoung/qwythos-9b-abliterated:Q8_0 | 9.0B Q8_0 | 65 | 25.3 | 397 ms | Good |
| microsoft/phi-4-mini-reasoning | 3.8B 4bit | 64 | 90.3 | 198 ms | Good |
| qwen3.5-4b-mlx | 4B 4bit | 62 | 0.0 | 5.5s | Not Rec. |
| lfm2.5-thinking:1.2b | 1.2B Q4_K_M | 60 | 227.0 | 30.0s | Not Rec. |
| qwen3.5:35b-a3b | 36.0B Q4_K_M | 59 | 30.5 | 30.0s | Not Rec. |
| qwen3.5-0.8b-mlx | 0.8B 4bit | 53 | 52.9 | 4.0s | Marginal |
| microllm-250m:latest | 256.74M F16 | 34 | 291.6 | 79 ms | Not Rec. |
| microllm-10m:latest | 10.00M F16 | 33 | 1544.8 | 12 ms | Not Rec. |
| microllm-50m:latest | 49.31M F16 | 28 | 1000000.0 | 30.0s | Not Rec. |
| qwen3.5-27b | 27B Q4_K_M | 26 | 9.5 | 1.1s | Not Rec. |
| qwen3.6:27b | 27.8B Q4_K_M | 20 | 10.6 | 30.0s | Not Rec. |
| lfm2-24b-a2b | 18 | 6.6 | 1.0s | Not Rec. |