Back to result

Comparing

qwen2.5-7b-instruct

qwen2 · 7B · 4bit

Apple M4 · 32 GB RAM

84 /100
Excellent

Choose a benchmark to compare with

Model CPU RAM tok/s Global Verdict
gpt-oss-20b Apple M4 Pro 64 GB 118.2
95
 Excellent Compare
gpt-oss:20b 20.9B/MXFP4 Intel Core™ Ultra 9 285K 47 GB 239.9
95
 Excellent Compare
openai/gpt-oss-20b 20B/MXFP4 Apple M4 24 GB 29.3
95
 Excellent Compare
openai/gpt-oss-20b 20B/MXFP4 Apple M4 32 GB 40.7
94
 Excellent Compare
qwen/qwen3-30b-a3b-2507 30B/4bit Apple M4 32 GB 44.8
94
 Excellent Compare
nemotron-3-nano Apple M4 Pro 64 GB 93.3
93
 Excellent Compare
gpt-oss:20b 20.9B/MXFP4 AMD RYZEN AI MAX+ 395 125 GB 47.1
93
 Excellent Compare
qwen3-coder:30b 30.5B/Q4_K_M Intel Core™ Ultra 9 285K 47 GB 207.9
90
 Excellent Compare
qwen3:14b 14.8B/Q4_K_M Apple M1 Max 32 GB 24.0
90
 Excellent Compare
qwen/qwen3-8b 8B/4bit Apple M4 Pro 64 GB 33.4
89
 Excellent Compare
lfm2:24b 23.8B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 85.3
88
 Excellent Compare
gpt-oss-safeguard-20b-mlx 20B/MXFP4 Apple M4 24 GB 41.4
87
 Excellent Compare
nemotron-3-nano:latest 31.6B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 59.9
87
 Excellent Compare
qwen3:30b 30.5B/Q4_K_M Intel Core™ Ultra 9 285K 47 GB 204.8
86
 Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M Apple M1 Max 32 GB 23.1
85
 Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M Intel Core™ i5-14600KF 32 GB 88.6
85
 Excellent Compare
qwen3:8b 8.2B/Q4_K_M Intel Core™ Ultra 9 285K 47 GB 208.0
84
 Excellent Compare
qwen2.5:7b 7.6B/Q4_K_M Apple M4 32 GB 22.2
84
 Excellent Compare
qwen3.5-9b 9B/Q4_K_S Apple M4 Pro 64 GB 30.2
84
 Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M Intel Core™ i5-14600KF 32 GB 86.3
84
 Excellent Compare
nvidia/nemotron-3-nano 30B/4bit Apple M4 32 GB 47.9
84
 Excellent Compare
qwen2.5:14b 14.8B/Q4_K_M Apple M4 32 GB 11.2
83
 Excellent Compare
gpt-oss:20b 20.9B/MXFP4 Apple M4 24 GB 17.1
83
 Excellent Compare
qwen3:14b 14.8B/Q4_K_M Apple M4 24 GB 11.1
83
 Excellent Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M1 Max 32 GB 32.4
83
 Excellent Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M1 Max 32 GB 33.8
83
 Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 30.8
82
 Excellent Compare
qwen3-coder-next:latest 79.7B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 34.5
82
 Excellent Compare
unsloth-phi-4 4bit Apple M4 Pro 64 GB 27.4
82
 Excellent Compare
qwen2.5-7b-instruct 7B/4bit Apple M4 32 GB 22.0
82
 Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M AMD RYZEN AI MAX+ 395 w/ Radeon 8060S 125 GB 30.8
82
 Excellent Compare
qwen3.5:4b 4.7B/Q4_K_M AMD RYZEN AI MAX+ 395 w/ Radeon 8060S 125 GB 46.8
82
 Excellent Compare
gemma3n:latest 6.9B/Q4_K_M AMD EPYC 9654P 96-Core Processor 128 GB 108.7
81
 Excellent Compare
qwen3.5-9b 9B/4bit Apple M4 32 GB 20.4
81
 Excellent Compare
qwen3:8b 8.2B/Q4_K_M Intel Core™ i5-14600KF 32 GB 108.3
81
 Excellent Compare
glm-4.7-flash:q4_K_M 29.9B/Q4_K_M Intel Core™ i5-14600KF 32 GB 35.1
81
 Excellent Compare
qwen3:8b 8.2B/Q4_K_M Intel Core™ i5-14600KF 32 GB 109.1
81
 Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M Apple M4 32 GB 11.8
80
 Excellent Compare
qwen3-vl:30b 31.1B/Q4_K_M Intel Core™ Ultra 9 285K 47 GB 208.9
80
 Excellent Compare
qwen3-coder:30b 30.5B/Q4_K_M Intel Gen Intel® Core™ i7-12700K 96 GB 14.7
80
 Excellent Compare
gemma3:12b 12.2B/Q4_K_M Apple M4 32 GB 12.7
80
 Excellent Compare
qwen3.5:122b-a10b 125.1B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 19.1
80
 Excellent Compare
mlx-community/gemma-3-4b-it-qat-4bit Apple M4 32 GB 43.2
80
 Excellent Compare
gemma3:4b 4.3B/Q4_K_M Apple M4 32 GB 34.6
80
 Excellent Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M4 32 GB 16.6
80
 Excellent Compare
qwen3.5:27b 27.8B/Q4_K_M AMD RYZEN AI MAX+ 395 w/ Radeon 8060S 125 GB 10.7
79
 Good Compare
qwen2.5-coder-7b-instruct-mlx 7B/4bit Apple M4 32 GB 22.5
79
 Good Compare
qwen2.5-coder:7b 7.6B/Q4_K_M Apple M4 32 GB 22.1
79
 Good Compare
lfm2-24b-a2b Apple M4 Pro 64 GB 105.9
78
 Good Compare
lmstudio-community/meta-llama-3.1-8b-instruct 8B/Q4_K_M Apple M4 Pro 64 GB 46.0
78
 Good Compare
yi:6b 6B/Q4_0 Apple M4 32 GB 27.6
77
 Good Compare
qwen2.5:3b 3.1B/Q4_K_M Apple M4 32 GB 47.2
77
 Good Compare
gemma2:2b 2.6B/Q4_0 Apple M4 32 GB 55.1
77
 Good Compare
qwen3.5-9b-mlx 9B/4bit Apple M4 Pro 64 GB 20.3
77
 Good Compare
deepseek-r1:7b 7.6B/Q4_K_M Apple M4 32 GB 22.2
77
 Good Compare
internlm2:7b 7.7B/Q4_0 Apple M4 32 GB 22.7
77
 Good Compare
mlx-community/meta-llama-3.1-8b-instruct 8B/4bit Apple M4 Pro 64 GB 54.3
77
 Good Compare
qwen3.5:35b 36.0B/Q4_K_M Intel Core™ i5-14600KF 32 GB 16.0
77
 Good Compare
qwen3.5:9b 9.7B/Q4_K_M Intel Gen Intel® Core™ i7-13700K 64 GB 30.5
77
 Good Compare
cogito:8b 8.0B/Q4_K_M Apple M4 32 GB 21.0
77
 Good Compare
gemma2:9b 9.2B/Q4_0 Apple M4 32 GB 17.5
76
 Good Compare
ministral-3:8b 8.9B/Q4_K_M Apple M4 32 GB 19.5
76
 Good Compare
glm4:9b 9.4B/Q4_0 Apple M4 32 GB 19.0
76
 Good Compare
google/gemma-3-4b 4B/4bit Apple M4 32 GB 39.4
76
 Good Compare
gemma-3-27b-it-qat 27B/4bit Apple M4 Pro 64 GB 8.9
76
 Good Compare
qwen3.5:27b 27.8B/Q4_K_M Apple M4 32 GB 4.4
75
 Good Compare
exaone-3.5-2.4b-instruct-mlx 2.4B/8bit Apple M4 32 GB 37.0
75
 Good Compare
phi4:14b 14.7B/Q4_K_M Apple M4 32 GB 11.0
75
 Good Compare
qwen3.5-27b 27B/4bit Apple M4 32 GB 6.6
75
 Good Compare
llama3.1:8b 8.0B/Q4_K_M Apple M4 32 GB 20.3
75
 Good Compare
granite3.1-dense:8b 8.2B/Q4_K_M Apple M4 32 GB 18.8
74
 Good Compare
mlx-community/Llama-3.2-3B-Instruct-4bit Apple M4 32 GB 50.6
74
 Good Compare
llama3.2:3b 3.2B/Q4_K_M Apple M4 32 GB 44.1
74
 Good Compare
hermes3:8b 8.0B/Q4_0 Apple M4 32 GB 22.3
74
 Good Compare
dolphin3:8b 8.0B/Q4_K_M Apple M4 32 GB 21.0
74
 Good Compare
mistralai/magistral-small-2509 24B/4bit Apple M4 32 GB 7.9
74
 Good Compare
qwen3.5:2b 2.3B/Q8_0 Apple M4 32 GB 30.4
73
 Good Compare
qwen2.5-coder-3b-instruct-mlx 3B/4bit Apple M4 32 GB 52.3
73
 Good Compare
mlx-community/Yi-1.5-6B-Chat-4bit Apple M4 32 GB 29.1
73
 Good Compare
qwen3:0.6b 751.63M/Q4_K_M Apple M4 32 GB 145.2
73
 Good Compare
mistral:latest 7.2B/Q4_K_M Apple M4 32 GB 22.5
73
 Good Compare
llama3.2:latest 3.2B/Q4_K_M Apple M4 Pro 64 GB 98.9
73
 Good Compare
qwen3:1.7b 2.0B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 120.7
72
 Good Compare
mistral:latest 7.2B/Q4_0 Apple M4 Pro 64 GB 54.3
72
 Good Compare
mlx-community/gemma-3-1b-it-8bit Apple M4 32 GB 86.3
72
 Good Compare
mistral:7b 7.2B/Q4_K_M Apple M4 32 GB 22.0
72
 Good Compare
qwen3.5-9b 9B/Q4_K_S Apple M4 32 GB 14.4
72
 Not Rec. Compare
aya-expanse:8b 8.0B/Q4_K_M Apple M4 32 GB 19.7
72
 Good Compare
qwen3.5-9b 9B/Q4_K_M Apple M4 Pro 64 GB 28.9
72
 Good Compare
codegemma:7b 9B/Q4_0 Apple M4 32 GB 18.7
71
 Good Compare
mistral-nemo:12b 12.2B/Q4_0 Apple M4 32 GB 14.6
71
 Good Compare
ministral-3:3b 3.8B/Q4_K_M Apple M4 32 GB 42.2
71
 Good Compare
llama3:latest 8.0B/Q4_0 Apple M4 32 GB 22.3
71
 Good Compare
qwen3.5-4b-mlx 4B/4bit Apple M4 32 GB 23.1
71
 Good Compare
qwen3.5:9b 9.7B/Q4_K_M AMD Ryzen 5 5500 16 GB 5.3
71
 Good Compare
phi4-mini:latest 3.8B/Q4_K_M Apple M4 32 GB 36.2
71
 Good Compare
qwen2.5-coder-1.5b-instruct-mlx 1.5B/8bit Apple M4 32 GB 58.4
70
 Good Compare
qwen2.5:1.5b 1.5B/Q4_K_M Apple M4 32 GB 84.1
70
 Good Compare
mistral:7b 7.2B/Q4_K_M Apple M4 32 GB 22.5
70
 Good Compare
qwen3.5-2b-mlx 2B/8bit Apple M4 32 GB 32.9
70
 Good Compare
yi-coder:9b 8.8B/Q4_0 Apple M4 32 GB 19.4
70
 Good Compare
deepseek-v2:16b 15.7B/Q4_0 Apple M4 32 GB 56.6
69
 Good Compare
qwen2.5-1.5b-instruct 1.5B/8bit Apple M4 32 GB 58.1
69
 Good Compare
mistralai/devstral-small-2-2512 24B/4bit Apple M4 32 GB 5.7
69
 Good Compare
lfm2.5-1.2b-instruct-mlx 1.2B/8bit Apple M4 32 GB 77.3
68
 Good Compare
granite3.1-dense:2b 2.5B/Q4_K_M Apple M4 32 GB 54.6
68
 Good Compare
nous-hermes2:latest 11B/Q4_0 Apple M4 32 GB 15.9
68
 Good Compare
qwen2.5-coder:7b 7.6B/Q4_K_M Intel Gen Intel® Core™ i7-13700K 64 GB 34.4
68
 Good Compare
gemma3:1b 999.89M/Q4_K_M Apple M4 32 GB 39.4
68
 Good Compare
gemma3:1b 999.89M/Q4_K_M Apple M4 32 GB 39.5
68
 Good Compare
cogito:3b 3.6B/Q4_K_M Apple M4 32 GB 45.6
67
 Good Compare
neural-chat:7b 7B/Q4_0 Apple M4 32 GB 22.5
67
 Good Compare
aya:8b 8.0B/F16 Apple M4 32 GB 20.0
66
 Good Compare
granite-3.3-2b-instruct 2B/bf16 Apple M4 32 GB 18.3
66
 Good Compare
qwen3.5:27b 27.8B/Q4_K_M Apple M4 24 GB 4.0
66
 Good Compare
deepseek-r1:1.5b 1.8B/Q4_K_M Apple M4 32 GB 85.4
66
 Good Compare
deepseek-r1:7b 7.6B/Q4_K_M Intel Core™ i5-6500 16 GB 35.6
66
 Good Compare
qwen3.5-2b-mlx 2B/4bit Apple M4 Pro 64 GB 48.9
65
 Good Compare
smollm2-1.7b-instruct 1.7B/bf16 Apple M4 32 GB 28.5
65
 Good Compare
starling-lm:7b 7B/Q4_0 Apple M4 32 GB 23.8
65
 Good Compare
qwen2.5:1.5b 1.5B/Q4_K_M Intel Core™ i7-4771 32 GB 19.6
65
 Good Compare
qwen3.5:0.8b 873.44M/Q8_0 Apple M4 32 GB 48.2
65
 Good Compare
qwen3.5:4b 4.7B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 45.7
65
 Not Rec. Compare
smollm2:1.7b 1.7B/Q8_0 Apple M4 32 GB 51.8
64
 Good Compare
microsoft/phi-4-mini-reasoning 3.8B/4bit Apple M4 Pro 64 GB 90.3
64
 Good Compare
phi3:3.8b 3.8B/Q4_0 Apple M4 32 GB 42.0
64
 Good Compare
falcon-h1-1.5b-instruct 1.5B/Q4_K_M Intel Core™ i5-5300U 16 GB 6.6
63
 Good Compare
solar:10.7b 11B/Q4_0 Apple M4 32 GB 15.8
63
 Good Compare
starling-lm:7b 7B/Q4_0 Apple M4 32 GB 23.7
63
 Good Compare
phi3:14b 14.0B/Q4_0 Apple M4 32 GB 12.7
63
 Good Compare
codellama:7b 7B/Q4_0 Apple M4 32 GB 23.6
63
 Good Compare
llama3.2:1b 1.2B/Q8_0 AMD Ryzen 9 8945HS 15 GB 170.2
62
 Good Compare
microsoft/phi-4-mini-reasoning 3.8B/4bit Apple M4 32 GB 40.3
62
 Good Compare
qwen3.5-4b-mlx 4B/4bit Apple M4 Pro 64 GB 0.0
62
 Not Rec. Compare
qwen3.5:0.8b 873.44M/Q8_0 Apple M1 Max 32 GB 65.8
62
 Good Compare
qwen3.5:0.8b 873.44M/Q8_0 Apple M1 Max 32 GB 67.6
62
 Good Compare
qwen3-vl:2b 2.1B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 127.4
62
 Good Compare
dolphin-phi:2.7b 3B/Q4_0 Apple M4 32 GB 56.1
61
 Good Compare
qwen2.5-1.5b-instruct 1.5B/Q4_K_M Intel Core™ i5-5300U 16 GB 6.6
61
 Good Compare
qwen2.5-coder-1.5b-instruct 1.5B/Q4_K_M Intel Core™ i5-5300U 16 GB 7.3
61
 Good Compare
qwen3.5:4b 4.7B/Q4_K_M Intel Core™ i5-6500 16 GB 35.7
61
 Good Compare
qwen3:0.6b 751.63M/Q4_K_M Apple M4 32 GB 144.3
61
 Good Compare
qwen3.5-0.8b-mlx 0.8B/8bit Apple M4 32 GB 108.0
60
 Good Compare
text-embedding-nomic-embed-text-v1.5 Q4_K_M Apple M4 32 GB 45.3
59
 Marginal Compare
vicuna:7b 7B/Q4_0 Apple M4 32 GB 23.4
59
 Marginal Compare
vicuna:13b 13B/Q4_0 Apple M4 32 GB 13.4
59
 Marginal Compare
qwen3.5-9b-mlx 9B/4bit Apple M4 24 GB 14.3
59
 Marginal Compare
wizardlm2:7b 7B/Q4_0 Apple M4 32 GB 23.2
59
 Marginal Compare
qwen3.5:35b-a3b 36.0B/Q4_K_M Apple M4 Pro 48 GB 30.5
59
 Not Rec. Compare
gemma-3-1b-it 1B/Q4_K_M Intel Core™ i5-5300U 16 GB 8.7
59
 Marginal Compare
phi:2.7b 3B/Q4_0 Apple M4 32 GB 56.6
59
 Marginal Compare
qwen3.5-9b-mlx 9B/4bit Apple M4 24 GB 16.7
58
 Marginal Compare
qwen3:14b 14.8B/Q4_K_M Apple M1 Max 32 GB 24.4
58
 Marginal Compare
gemma-2-2b-it 2B/Q4_K_M Intel Core™ i5-5300U 16 GB 3.6
58
 Marginal Compare
qwen3.5:9b 9.7B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 30.3
57
 Marginal Compare
falcon-h1-0.5b-instruct 0.5B/Q4_K_M Intel Core™ i5-5300U 16 GB 16.3
57
 Marginal Compare
qwen2.5:0.5b 494.03M/Q4_K_M Apple M4 32 GB 165.0
57
 Marginal Compare
mlx-community/Llama-3.2-1B-Instruct-4bit Apple M4 32 GB 126.4
57
 Marginal Compare
deepseek-coder:6.7b 7B/Q4_0 Apple M4 32 GB 24.1
57
 Marginal Compare
llama2:13b 13B/Q4_0 Apple M4 32 GB 13.5
56
 Marginal Compare
orca-mini:7b 7B/Q4_0 Apple M4 32 GB 24.4
55
 Marginal Compare
phi-3.5-mini-instruct 4bit Apple M4 32 GB 43.4
55
 Marginal Compare
qwen2.5-coder-0.5b-instruct 0.5B/Q4_K_M Intel Core™ i5-5300U 16 GB 13.5
55
 Marginal Compare
qwen3.5-0.8b-mlx 0.8B/4bit Apple M4 32 GB 68.2
55
 Marginal Compare
llama2:7b 7B/Q4_0 Apple M4 32 GB 25.1
55
 Marginal Compare
internlm2_5-1_8b-chat Q4_K_M Intel Core™ i5-5300U 16 GB 6.6
55
 Marginal Compare
falcon3-1b-instruct 1B/3bit Apple M4 32 GB 121.8
54
 Marginal Compare
qwen3.5-0.8b-mlx 0.8B/4bit Apple M4 Pro 64 GB 52.9
53
 Marginal Compare
mlx-community/Nanbeige4.1-3B-8bit Apple M4 32 GB 25.4
53
 Marginal Compare
qwen2.5-0.5b-instruct 0.5B/Q4_K_M Intel Core™ i5-5300U 16 GB 13.2
53
 Marginal Compare
qwen3.5:9b 9.7B/Q4_K_M Apple M1 Max 32 GB 18.6
53
 Marginal Compare
qwen2.5-0.5b-instruct-mlx 0.5B/4bit Apple M4 32 GB 257.5
52
 Marginal Compare
smollm2:360m 361.82M/F16 Apple M4 32 GB 117.9
52
 Marginal Compare
smollm2-360m-instruct 360M/bf16 Apple M4 32 GB 121.1
52
 Marginal Compare
gemma3:270m 268.10M/Q8_0 Apple M3 Pro 36 GB 239.2
50
 Marginal Compare
granite-3.1-1b-a400m-instruct 1B/Q4_K_M Intel Core™ i5-5300U 16 GB 19.6
50
 Marginal Compare
llama-3.2-1b-instruct 1B/Q4_K_M Intel Core™ i5-5300U 16 GB 9.9
50
 Marginal Compare
mlx-community/stablelm-2-zephyr-1_6b-4bit Apple M4 32 GB 93.6
50
 Marginal Compare
qwen3.5-0.8b 0.8B/Q4_K_M Intel Core™ i5-5300U 16 GB 6.2
48
 Marginal Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M4 16 GB 18.9
48
 Marginal Compare
smollm2-1.7b-instruct 1.7B/Q4_K_M Intel Core™ i5-5300U 16 GB 6.6
48
 Marginal Compare
smollm2-360m-instruct 360M/Q4_K_M Intel Core™ i5-5300U 16 GB 20.0
48
 Marginal Compare
orca-mini:3b 3B/Q4_0 Apple M4 32 GB 30.6
47
 Marginal Compare
qwen3:4b 4.0B/Q4_K_M Apple M4 32 GB 11.3
47
 Marginal Compare
qwen3:8b 8.2B/Q4_K_M Apple M4 32 GB 18.7
47
 Marginal Compare
stablelm2:1.6b 2B/Q4_0 Apple M4 32 GB 93.8
45
 Marginal Compare
qwen2.5-math-1.5b-instruct 1.5B/4bit Apple M4 32 GB 91.7
45
 Marginal Compare
mlx-community/quantized-gemma-2b-it Apple M4 32 GB 44.4
45
 Marginal Compare
yi-coder-1.5b-chat 1.5B/Q4_K_M Intel Core™ i5-5300U 16 GB 7.7
45
 Marginal Compare
opencoder-1.5b-instruct 1.5B/Q4_K_M Intel Core™ i5-5300U 16 GB 4.8
44
 Marginal Compare
amd-olmo-1b-sft 1B/Q4_K_M Intel Core™ i5-5300U 16 GB 9.2
44
 Marginal Compare
tinyllama:1.1b 1B/Q4_0 Apple M4 32 GB 121.0
43
 Marginal Compare
falcon-h1-tiny-90m-instruct 90M/Q4_K_M Intel Core™ i5-5300U 16 GB 67.8
43
 Marginal Compare
tinyllama Apple M4 32 GB 133.4
43
 Marginal Compare
gemma-3-270m-it-qat-mlx 270M/4bit Apple M4 32 GB 344.2
43
 Marginal Compare
smollm2:135m 134.52M/F16 Apple M4 32 GB 241.0
41
 Marginal Compare
qwen3-0.6b 0.6B/Q4_K_M Intel Core™ i5-5300U 16 GB 14.4
40
 Marginal Compare
starcoder2:3b 3B/Q4_0 Apple M4 32 GB 49.4
39
 Not Rec. Compare
phi-3-mini-128k-instruct 4bit Apple M4 32 GB 44.0
38
 Not Rec. Compare
smollm2-135m-instruct 135M/Q4_K_M Intel Core™ i5-5300U 16 GB 39.3
38
 Not Rec. Compare
deepseek-r1-distill-qwen-14b-mlx 14B/5bit Apple M4 24 GB 10.3
36
 Not Rec. Compare
stablelm-2-zephyr-1.6b 1.6B/Q4_K_M Intel Core™ i5-5300U 16 GB 6.5
35
 Not Rec. Compare
starcoder2:7b 7B/Q4_0 Apple M4 32 GB 23.8
35
 Not Rec. Compare
qwen3.5-27b-claude-4.6-opus-distilled-mlx 27B/4bit Apple M4 24 GB 6.1
34
 Not Rec. Compare
qwen3.5:latest 9.7B/Q4_K_M Apple M4 16 GB 13.3
34
 Not Rec. Compare
tinyllama-1.1b-chat-v1.0 1.1B/Q3_K_M Intel Core™ i5-5300U 16 GB 9.9
33
 Not Rec. Compare
lmstudio-community/Phi-4-reasoning-plus-MLX-4bit Apple M4 32 GB 11.5
33
 Not Rec. Compare
bloomz-560m 560M/Q4_K_M Intel Core™ i5-5300U 16 GB 12.2
30
 Not Rec. Compare
deepseek-coder-1.3b-instruct 1.3B/Q8_0 Intel Core™ i5-5300U 16 GB 7.1
30
 Not Rec. Compare
phi-1_5 Q8_0 Intel Core™ i5-5300U 16 GB 6.9
28
 Not Rec. Compare
qwen3.5-27b 27B/Q4_K_M Apple M4 Pro 64 GB 9.5
26
 Not Rec. Compare
deepseek-r1:14b 14.8B/Q4_K_M Apple M4 32 GB 11.4
22
 Not Rec. Compare
qwen3.5:27b 27.8B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 10.6
20
 Not Rec. Compare
qwen3-1.7b 1.7B/Q4_K_M Intel Core™ i5-5300U 16 GB 5.9
19
 Not Rec. Compare
lfm2-24b-a2b Apple M4 Pro 64 GB 6.6
18
 Not Rec. Compare

215 benchmarks available