Apple M4 Pro
Mac mini
64 GB RAM · 20 models tested
Avg Score
70 /100
Avg Speed
47.9 tok/s
Models Tested
20
| Model | Size | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| gpt-oss-20b | 95 | 118.2 | 2.2s | Excellent | |
| nemotron-3-nano | 93 | 93.3 | 257 ms | Excellent | |
| qwen/qwen3-8b | 8B 4bit | 89 | 33.4 | 257 ms | Excellent |
| qwen3.5-9b | 9B Q4_K_S | 84 | 30.2 | 499 ms | Excellent |
| unsloth-phi-4 | 4bit | 82 | 27.4 | 457 ms | Excellent |
| lfm2-24b-a2b | 78 | 105.9 | 252 ms | Good | |
| lmstudio-community/meta-llama-3.1-8b-instruct | 8B Q4_K_M | 78 | 46.0 | 245 ms | Good |
| qwen3.5-9b-mlx | 9B 4bit | 77 | 20.3 | 4.2s | Good |
| mlx-community/meta-llama-3.1-8b-instruct | 8B 4bit | 77 | 54.3 | 277 ms | Good |
| gemma-3-27b-it-qat | 27B 4bit | 76 | 8.9 | 4.0s | Good |
| llama3.2:latest | 3.2B Q4_K_M | 73 | 98.9 | 125 ms | Good |
| mistral:latest | 7.2B Q4_0 | 72 | 54.3 | 124 ms | Good |
| qwen3.5-9b | 9B Q4_K_M | 72 | 28.9 | 338 ms | Good |
| qwen3.5-2b-mlx | 2B 4bit | 65 | 48.9 | 4.2s | Good |
| microsoft/phi-4-mini-reasoning | 3.8B 4bit | 64 | 90.3 | 198 ms | Good |
| qwen3.5-4b-mlx | 4B 4bit | 62 | 0.0 | 5.5s | Not Rec. |
| qwen3.5:35b-a3b | 36.0B Q4_K_M | 59 | 30.5 | 30.0s | Not Rec. |
| qwen3.5-0.8b-mlx | 0.8B 4bit | 53 | 52.9 | 4.0s | Marginal |
| qwen3.5-27b | 27B Q4_K_M | 26 | 9.5 | 1.1s | Not Rec. |
| lfm2-24b-a2b | 18 | 6.6 | 1.0s | Not Rec. |