Apple M4 Pro
Mac Mini
64 GB RAM · 3 models tested
Avg Score
72 /100
Avg Speed
52.9 tok/s
Models Tested
3
| Model | Size | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| llama3.2:latest | 3.2B Q4_K_M | 77 | 98.9 | 125 ms | Good |
| mistral:latest | 7.2B Q4_0 | 76 | 54.3 | 124 ms | Good |
| llama3.1:8b | 8.0B Q4_K_M | 64 | 5.5 | 1.4s | Not Rec. |