Back to result

Comparing

stablelm2:1.6b

stablelm · 2B · Q4_0

Apple M4 · 32 GB RAM

53 /100
Marginal

Choose a benchmark to compare with

Model CPU RAM tok/s Global Verdict
qwen2.5:7b 7.6B/Q4_K_M Apple M4 32 GB 22.2
85
 Excellent Compare
gemma3:4b 4.3B/Q4_K_M Apple M4 32 GB 34.6
83
 Excellent Compare
qwen2.5:14b 14.8B/Q4_K_M Apple M4 32 GB 11.2
82
 Excellent Compare
qwen2.5-coder:7b 7.6B/Q4_K_M Apple M4 32 GB 22.1
81
 Excellent Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M4 32 GB 16.6
81
 Excellent Compare
yi:6b 6B/Q4_0 Apple M4 32 GB 27.6
80
 Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M Apple M4 32 GB 11.8
80
 Excellent Compare
gemma2:2b 2.6B/Q4_0 Apple M4 32 GB 55.1
80
 Excellent Compare
qwen2.5:3b 3.1B/Q4_K_M Apple M4 32 GB 47.2
80
 Excellent Compare
gemma3:12b 12.2B/Q4_K_M Apple M4 32 GB 12.7
80
 Excellent Compare
gemma2:9b 9.2B/Q4_0 Apple M4 32 GB 17.5
78
 Good Compare
llama3.2:3b 3.2B/Q4_K_M Apple M4 32 GB 44.1
78
 Good Compare
llama3.1:8b 8.0B/Q4_K_M Apple M4 32 GB 20.3
77
 Good Compare
qwen3:0.6b 751.63M/Q4_K_M Apple M4 32 GB 145.2
77
 Good Compare
llama3.2:latest 3.2B/Q4_K_M Apple M4 Pro 64 GB 98.9
77
 Good Compare
qwen3.5:2b 2.3B/Q8_0 Apple M4 32 GB 30.4
77
 Good Compare
granite3.1-dense:8b 8.2B/Q4_K_M Apple M4 32 GB 18.8
76
 Good Compare
mistral:latest 7.2B/Q4_K_M Apple M4 32 GB 22.5
76
 Good Compare
mistral:latest 7.2B/Q4_0 Apple M4 Pro 64 GB 54.3
76
 Good Compare
qwen3:0.6b 751.63M/Q4_K_M Apple M4 32 GB 143.9
75
 Good Compare
phi4:14b 14.7B/Q4_K_M Apple M4 32 GB 11.0
75
 Good Compare
mistral:7b 7.2B/Q4_K_M Apple M4 32 GB 22.0
75
 Good Compare
phi4-mini:latest 3.8B/Q4_K_M Apple M4 32 GB 36.2
75
 Good Compare
qwen2.5:1.5b 1.5B/Q4_K_M Apple M4 32 GB 84.1
74
 Good Compare
llama3:latest 8.0B/Q4_0 Apple M4 32 GB 22.3
74
 Good Compare
qwen2.5:7b 7.6B/Q4_K_M Apple M4 32 GB 20.5
74
 Good Compare
codegemma:7b 9B/Q4_0 Apple M4 32 GB 18.7
74
 Good Compare
mistral-nemo:12b 12.2B/Q4_0 Apple M4 32 GB 14.6
73
 Good Compare
deepseek-v2:16b 15.7B/Q4_0 Apple M4 32 GB 56.6
73
 Good Compare
gemma3:4b 4.3B/Q4_K_M Apple M4 32 GB 35.9
72
 Good Compare
granite3.1-dense:2b 2.5B/Q4_K_M Apple M4 32 GB 54.6
72
 Good Compare
gemma2:2b 2.6B/Q4_0 Apple M4 32 GB 53.8
72
 Good Compare
gemma3:1b 999.89M/Q4_K_M Apple M4 32 GB 39.4
72
 Good Compare
gemma3:1b 999.89M/Q4_K_M Apple M4 32 GB 39.5
72
 Good Compare
nous-hermes2:latest 11B/Q4_0 Apple M4 32 GB 15.9
71
 Good Compare
neural-chat:7b 7B/Q4_0 Apple M4 32 GB 22.5
71
 Good Compare
qwen2.5:3b 3.1B/Q4_K_M Apple M4 32 GB 38.5
71
 Good Compare
aya:8b 8.0B/F16 Apple M4 32 GB 20.0
70
 Good Compare
qwen3:1.7b 2.0B/Q4_K_M Apple M4 32 GB 37.9
70
 Good Compare
qwen2.5-coder:7b 7.6B/Q4_K_M Apple M4 32 GB 21.5
70
 Good Compare
qwen3.5:0.8b 873.44M/Q8_0 Apple M4 32 GB 48.2
70
 Good Compare
smollm2:1.7b 1.7B/Q8_0 Apple M4 32 GB 51.8
69
 Good Compare
llama3.2:3b 3.2B/Q4_K_M Apple M4 32 GB 27.8
69
 Good Compare
llama3.1:8b 8.0B/Q4_K_M Apple M4 32 GB 20.2
69
 Good Compare
phi3:3.8b 3.8B/Q4_0 Apple M4 32 GB 42.0
69
 Good Compare
gemma2:9b 9.2B/Q4_0 Apple M4 32 GB 16.8
69
 Good Compare
starling-lm:7b 7B/Q4_0 Apple M4 32 GB 23.7
68
 Good Compare
qwen2.5:1.5b 1.5B/Q4_K_M Apple M4 32 GB 81.5
68
 Good Compare
llama3:latest 8.0B/Q4_0 Apple M4 32 GB 21.4
68
 Good Compare
codellama:7b 7B/Q4_0 Apple M4 32 GB 23.6
68
 Good Compare
gemma3:12b 12.2B/Q4_K_M Apple M4 32 GB 12.3
67
 Good Compare
granite3.1-dense:2b 2.5B/Q4_K_M Apple M4 32 GB 53.4
67
 Good Compare
dolphin-phi:2.7b 3B/Q4_0 Apple M4 32 GB 56.1
66
 Good Compare
solar:10.7b 11B/Q4_0 Apple M4 32 GB 15.8
66
 Good Compare
phi3:14b 14.0B/Q4_0 Apple M4 32 GB 12.7
66
 Good Compare
qwen3:0.6b 751.63M/Q4_K_M Apple M4 32 GB 144.3
66
 Good Compare
phi4:14b 14.7B/Q4_K_M Apple M4 32 GB 11.1
65
 Good Compare
gemma3:1b 999.89M/Q4_K_M Apple M4 32 GB 67.5
65
 Good Compare
vicuna:7b 7B/Q4_0 Apple M4 32 GB 23.4
65
 Good Compare
wizardlm2:7b 7B/Q4_0 Apple M4 32 GB 23.2
65
 Good Compare
phi:2.7b 3B/Q4_0 Apple M4 32 GB 56.6
65
 Good Compare
codegemma:7b 9B/Q4_0 Apple M4 32 GB 19.2
65
 Good Compare
llama3.1:8b 8.0B/Q4_K_M Apple M4 Pro 64 GB 5.5
64
 Not Rec. Compare
llama3.2:1b 1.2B/Q8_0 Apple M4 32 GB 69.6
63
 Good Compare
qwen2.5:0.5b 494.03M/Q4_K_M Apple M4 32 GB 165.0
63
 Good Compare
llama3.2:1b 1.2B/Q8_0 Apple M4 32 GB 28.2
63
 Good Compare
smollm2:1.7b 1.7B/Q8_0 Apple M4 32 GB 50.3
63
 Good Compare
deepseek-coder:6.7b 7B/Q4_0 Apple M4 32 GB 24.1
63
 Good Compare
vicuna:13b 13B/Q4_0 Apple M4 32 GB 13.4
62
 Good Compare
mistral:7b 7.2B/Q4_K_M Apple M4 32 GB 13.6
61
 Good Compare
gemma3:1b 999.89M/Q4_K_M Apple M4 32 GB 87.9
61
 Good Compare
orca-mini:7b 7B/Q4_0 Apple M4 32 GB 24.4
61
 Good Compare
llama2:7b 7B/Q4_0 Apple M4 32 GB 25.1
61
 Good Compare
llama2:13b 13B/Q4_0 Apple M4 32 GB 13.5
60
 Good Compare
smollm2:360m 361.82M/F16 Apple M4 32 GB 117.9
59
 Marginal Compare
qwen2.5:0.5b 494.03M/Q4_K_M Apple M4 32 GB 162.7
59
 Marginal Compare
smollm2:360m 361.82M/F16 Apple M4 32 GB 115.1
58
 Marginal Compare
orca-mini:3b 3B/Q4_0 Apple M4 32 GB 30.6
54
 Marginal Compare
tinyllama:1.1b 1B/Q4_0 Apple M4 32 GB 121.0
51
 Marginal Compare
tinyllama:1.1b 1B/Q4_0 Apple M4 32 GB 129.6
50
 Marginal Compare
qwen3:8b 8.2B/Q4_K_M Apple M4 32 GB 18.7
50
 Marginal Compare
smollm2:135m 134.52M/F16 Apple M4 32 GB 241.0
49
 Marginal Compare
qwen3:4b 4.0B/Q4_K_M Apple M4 32 GB 11.3
48
 Marginal Compare
smollm2:135m 134.52M/F16 Apple M4 32 GB 245.0
48
 Marginal Compare
stablelm2:1.6b 2B/Q4_0 Apple M4 32 GB 62.8
48
 Marginal Compare
starcoder2:3b 3B/Q4_0 Apple M4 32 GB 49.4
48
 Marginal Compare
falcon:7b 7B/Q4_0 Apple M4 32 GB 24.3
47
 Marginal Compare
starcoder2:7b 7B/Q4_0 Apple M4 32 GB 23.8
44
 Marginal Compare
qwen3:8b 8.2B/Q4_K_M Apple M4 32 GB 18.2
42
 Marginal Compare
phi4-mini Apple M4 32 GB 21.8
39
 Not Rec. Compare
phi4-mini Apple M4 32 GB 21.7
38
 Not Rec. Compare
deepseek-r1:14b 14.8B/Q4_K_M Apple M4 32 GB 11.4
26
 Not Rec. Compare
deepseek-r1:14b 14.8B/Q4_K_M Apple M4 32 GB 10.8
25
 Not Rec. Compare

93 benchmarks available