Comparing
meta-llama-3.1-8b-instruct
llama · 8B · 4bit
Apple M4 · 32 GB RAM
76 /100
Choose a benchmark to compare with
| Model | CPU | RAM | tok/s | Global | Verdict | |
|---|---|---|---|---|---|---|
| qwen2.5:7b 7.6B/Q4_K_M | Apple M4 | 32 GB | 22.2 | 84 | Excellent | Compare |
| qwen2.5:14b 14.8B/Q4_K_M | Apple M4 | 32 GB | 11.2 | 83 | Excellent | Compare |
| gemma3:12b 12.2B/Q4_K_M | Apple M4 | 32 GB | 12.7 | 80 | Excellent | Compare |
| gemma3:4b 4.3B/Q4_K_M | Apple M4 | 32 GB | 34.6 | 80 | Excellent | Compare |
| qwen3.5:4b 4.7B/Q4_K_M | Apple M4 | 32 GB | 16.6 | 80 | Excellent | Compare |
| qwen3.5:9b 9.7B/Q4_K_M | Apple M4 | 32 GB | 11.8 | 80 | Excellent | Compare |
| qwen2.5-coder:7b 7.6B/Q4_K_M | Apple M4 | 32 GB | 22.1 | 79 | Good | Compare |
| yi:6b 6B/Q4_0 | Apple M4 | 32 GB | 27.6 | 77 | Good | Compare |
| qwen2.5:3b 3.1B/Q4_K_M | Apple M4 | 32 GB | 47.2 | 77 | Good | Compare |
| google/gemma-3-12b 12B/4bit | Apple M4 | 32 GB | 7.9 | 77 | Good | Compare |
| gemma2:2b 2.6B/Q4_0 | Apple M4 | 32 GB | 55.1 | 77 | Good | Compare |
| gemma2:9b 9.2B/Q4_0 | Apple M4 | 32 GB | 17.5 | 76 | Good | Compare |
| llama3.1:8b 8.0B/Q4_K_M | Apple M4 | 32 GB | 20.3 | 75 | Good | Compare |
| qwen3.5:27b 27.8B/Q4_K_M | Apple M4 | 32 GB | 4.4 | 75 | Good | Compare |
| phi4:14b 14.7B/Q4_K_M | Apple M4 | 32 GB | 11.0 | 75 | Good | Compare |
| llama3.2:3b 3.2B/Q4_K_M | Apple M4 | 32 GB | 44.1 | 74 | Good | Compare |
| granite3.1-dense:8b 8.2B/Q4_K_M | Apple M4 | 32 GB | 18.8 | 74 | Good | Compare |
| google/gemma-3-4b 4B/4bit | Apple M4 | 32 GB | 22.2 | 74 | Good | Compare |
| mistral:latest 7.2B/Q4_K_M | Apple M4 | 32 GB | 22.5 | 73 | Good | Compare |
| qwen3.5:2b 2.3B/Q8_0 | Apple M4 | 32 GB | 30.4 | 73 | Good | Compare |
| qwen3:0.6b 751.63M/Q4_K_M | Apple M4 | 32 GB | 145.2 | 73 | Good | Compare |
| llama3.2:latest 3.2B/Q4_K_M | Apple M4 Pro | 64 GB | 98.9 | 73 | Good | Compare |
| mistral:7b 7.2B/Q4_K_M | Apple M4 | 32 GB | 22.0 | 72 | Good | Compare |
| mistral:latest 7.2B/Q4_0 | Apple M4 Pro | 64 GB | 54.3 | 72 | Good | Compare |
| llama-3.2-3b-instruct 3B/4bit | Apple M4 | 32 GB | 48.2 | 72 | Good | Compare |
| mistral-nemo:12b 12.2B/Q4_0 | Apple M4 | 32 GB | 14.6 | 71 | Good | Compare |
| phi4-mini:latest 3.8B/Q4_K_M | Apple M4 | 32 GB | 36.2 | 71 | Good | Compare |
| llama3:latest 8.0B/Q4_0 | Apple M4 | 32 GB | 22.3 | 71 | Good | Compare |
| codegemma:7b 9B/Q4_0 | Apple M4 | 32 GB | 18.7 | 71 | Good | Compare |
| qwen2.5:1.5b 1.5B/Q4_K_M | Apple M4 | 32 GB | 84.1 | 70 | Good | Compare |
| deepseek-v2:16b 15.7B/Q4_0 | Apple M4 | 32 GB | 56.6 | 69 | Good | Compare |
| granite3.1-dense:2b 2.5B/Q4_K_M | Apple M4 | 32 GB | 54.6 | 68 | Good | Compare |
| gemma3:1b 999.89M/Q4_K_M | Apple M4 | 32 GB | 39.4 | 68 | Good | Compare |
| nous-hermes2:latest 11B/Q4_0 | Apple M4 | 32 GB | 15.9 | 68 | Good | Compare |
| gemma3:1b 999.89M/Q4_K_M | Apple M4 | 32 GB | 39.5 | 68 | Good | Compare |
| neural-chat:7b 7B/Q4_0 | Apple M4 | 32 GB | 22.5 | 67 | Good | Compare |
| aya:8b 8.0B/F16 | Apple M4 | 32 GB | 20.0 | 66 | Good | Compare |
| llama3.1:8b 8.0B/Q4_K_M | Apple M4 Pro | 64 GB | 5.5 | 66 | Not Rec. | Compare |
| qwen3.5:0.8b 873.44M/Q8_0 | Apple M4 | 32 GB | 48.2 | 65 | Good | Compare |
| smollm2:1.7b 1.7B/Q8_0 | Apple M4 | 32 GB | 51.8 | 64 | Good | Compare |
| phi3:3.8b 3.8B/Q4_0 | Apple M4 | 32 GB | 42.0 | 64 | Good | Compare |
| solar:10.7b 11B/Q4_0 | Apple M4 | 32 GB | 15.8 | 63 | Good | Compare |
| phi3:14b 14.0B/Q4_0 | Apple M4 | 32 GB | 12.7 | 63 | Good | Compare |
| starling-lm:7b 7B/Q4_0 | Apple M4 | 32 GB | 23.7 | 63 | Good | Compare |
| codellama:7b 7B/Q4_0 | Apple M4 | 32 GB | 23.6 | 63 | Good | Compare |
| dolphin-phi:2.7b 3B/Q4_0 | Apple M4 | 32 GB | 56.1 | 61 | Good | Compare |
| qwen3:0.6b 751.63M/Q4_K_M | Apple M4 | 32 GB | 144.3 | 61 | Good | Compare |
| vicuna:13b 13B/Q4_0 | Apple M4 | 32 GB | 13.4 | 59 | Marginal | Compare |
| vicuna:7b 7B/Q4_0 | Apple M4 | 32 GB | 23.4 | 59 | Marginal | Compare |
| phi:2.7b 3B/Q4_0 | Apple M4 | 32 GB | 56.6 | 59 | Marginal | Compare |
| wizardlm2:7b 7B/Q4_0 | Apple M4 | 32 GB | 23.2 | 59 | Marginal | Compare |
| deepseek-coder:6.7b 7B/Q4_0 | Apple M4 | 32 GB | 24.1 | 57 | Marginal | Compare |
| qwen2.5:0.5b 494.03M/Q4_K_M | Apple M4 | 32 GB | 165.0 | 57 | Marginal | Compare |
| llama2:13b 13B/Q4_0 | Apple M4 | 32 GB | 13.5 | 56 | Marginal | Compare |
| orca-mini:7b 7B/Q4_0 | Apple M4 | 32 GB | 24.4 | 55 | Marginal | Compare |
| llama2:7b 7B/Q4_0 | Apple M4 | 32 GB | 25.1 | 55 | Marginal | Compare |
| smollm2:360m 361.82M/F16 | Apple M4 | 32 GB | 117.9 | 52 | Marginal | Compare |
| qwen3.5-2b-mlx 2B/8bit | Apple M4 | 32 GB | 18.6 | 49 | Marginal | Compare |
| qwen3:8b 8.2B/Q4_K_M | Apple M4 | 32 GB | 18.7 | 47 | Marginal | Compare |
| qwen3:4b 4.0B/Q4_K_M | Apple M4 | 32 GB | 11.3 | 47 | Marginal | Compare |
| orca-mini:3b 3B/Q4_0 | Apple M4 | 32 GB | 30.6 | 47 | Marginal | Compare |
| stablelm2:1.6b 2B/Q4_0 | Apple M4 | 32 GB | 93.8 | 45 | Marginal | Compare |
| tinyllama:1.1b 1B/Q4_0 | Apple M4 | 32 GB | 121.0 | 43 | Marginal | Compare |
| smollm2:135m 134.52M/F16 | Apple M4 | 32 GB | 241.0 | 41 | Marginal | Compare |
| starcoder2:3b 3B/Q4_0 | Apple M4 | 32 GB | 49.4 | 39 | Not Rec. | Compare |
| starcoder2:7b 7B/Q4_0 | Apple M4 | 32 GB | 23.8 | 35 | Not Rec. | Compare |
| deepseek-r1:14b 14.8B/Q4_K_M | Apple M4 | 32 GB | 11.4 | 22 | Not Rec. | Compare |
| mistralai/magistral-small-2509 24B/4bit | Apple M4 | 32 GB | 5.1 | 20 | Not Rec. | Compare |
68 benchmarks available