Back to result

Comparing

GPT-20B:20b

gptoss · 20.9B · MXFP4

Intel Core™ Ultra X7 358H · 64 GB RAM

79 /100
Good

Choose a benchmark to compare with

Model CPU RAM tok/s Global Verdict
qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx 30B/MXFP4 Apple M2 Max 96 GB 79.6
97
Excellent Compare
qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx 30B/MXFP4 Apple M4 Max 128 GB 112.8
96
Excellent Compare
nemotron3:33b 33.0B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 62.7
96
Excellent Compare
gpt-oss-20b Apple M4 Pro 64 GB 118.2
95
Excellent Compare
qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx 30B/MXFP4 Apple M2 Max 96 GB 80.4
95
Excellent Compare
gpt-oss:20b 20.9B/MXFP4 Intel Core™ Ultra 9 285K 47 GB 239.9
95
Excellent Compare
openai/gpt-oss-20b 20B/MXFP4 Apple M4 24 GB 29.3
95
Excellent Compare
gemma4:26b 25.8B/Q4_K_M Cortex-X925 122 GB 67.4
94
Excellent Compare
qwen3-30b-a3b-t16-c32k-instruct:latest 30.5B/Q4_K_M Intel Xeon® E5-2637 v3 96 GB 116.0
94
Excellent Compare
GPT-20B:20b 20.9B/MXFP4 Intel Core™ i7-14700F 64 GB 181.0
94
Excellent Compare
gpt-oss:20b 20.9B/MXFP4 Apple M4 Pro 48 GB 54.5
94
Excellent Compare
openai/gpt-oss-20b 20B/MXFP4 Apple M4 32 GB 40.7
94
Excellent Compare
qwen/qwen3-30b-a3b-2507 30B/4bit Apple M4 32 GB 44.8
94
Excellent Compare
gpt-oss:20b 20.9B/MXFP4 AMD RYZEN AI MAX+ 395 64 GB 48.0
94
Excellent Compare
gpt-oss:20b 20.9B/MXFP4 Cortex-X925 122 GB 60.5
93
Excellent Compare
nemotron-3-nano Apple M4 Pro 64 GB 93.3
93
Excellent Compare
google/gemma-4-26b-a4b-qat 26B/Q4_0 AMD Ryzen 7 9700X 8-Core Processor 31 GB 109.7
93
Excellent Compare
GPT-OSS-20B:20b 20.9B/MXFP4 Intel Core™ i7-14700F 128 GB 178.6
93
Excellent Compare
gemma-4-26b-a4b-it-qat 26B/Q4_K_XL AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 166.9
93
Excellent Compare
GPT-20B:20b 20.9B/MXFP4 Intel Core™ i7-14700F 128 GB 177.5
93
Excellent Compare
gemma-4-26b-a4b-it-qat 26B/Q4_K_XL AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 156.0
93
Excellent Compare
qwen3-30b-a3b-t16-c32k-instruct:latest 30.5B/Q4_K_M Intel Xeon® E5-2637 v3 96 GB 100.0
93
Excellent Compare
gpt-oss:20b 20.9B/MXFP4 AMD RYZEN AI MAX+ 395 125 GB 47.1
93
Excellent Compare
GPT-20B:20b 20.9B/MXFP4 NVIDIA RTX Spark N1X (6144-core GPU, 20-core ) RTX Spark N1X (6144-core GPU, 20-core ) 55 GB 57.8
93
Excellent Compare
nemotron-3-nano:4b 4.0B/Q4_K_M Apple M1 Pro 16 GB 31.7
93
Excellent Compare
google/gemma-4-12b-qat 12B/Q4_0 AMD Ryzen 7 9700X 8-Core Processor 31 GB 90.7
92
Excellent Compare
qwen/qwen3-vl-30b 30B/Q4_K_M AMD Ryzen 5 5500 31 GB 24.8
92
Excellent Compare
qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-mtp 35B AMD Ryzen 5 5600X 6-Core Processor 47 GB 42.6
92
Excellent Compare
gpt-oss:20b 20.9B/MXFP4 Cortex-X925 122 GB 60.7
92
Excellent Compare
Gemma4-26B:26b 25.8B/Q4_K_M NVIDIA RTX Spark N1X (6144-core GPU, 20-core ) RTX Spark N1X (6144-core GPU, 20-core ) 55 GB 61.3
92
Excellent Compare
Qwen3-30B:30b 30.5B/Q4_K_M NVIDIA RTX Spark N1X (6144-core GPU, 20-core ) RTX Spark N1X (6144-core GPU, 20-core ) 55 GB 80.5
91
Excellent Compare
gemma4:12b-mlx Apple M2 Pro 16 GB 24.7
91
Excellent Compare
gemma-4-31b-it-qat 31B/Q4_K_XL AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 40.2
91
Excellent Compare
Qwen3-Coder-30B:30b 30.5B/Q4_K_M Intel Core™ i7-14700F 128 GB 74.0
91
Excellent Compare
qwen3-coder:30b-a3b-q4_K_M 30.5B/Q4_K_M Intel Core™ Ultra 9 285HX 63 GB 175.3
91
Excellent Compare
gemma-4-26b-a4b-it-qat 26B/Q4_K_XL AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 167.8
91
Excellent Compare
qwen3.6:35b-a3b-q8_0 36.0B/Q8_0 Cortex-X925 122 GB 56.2
91
Excellent Compare
Gemma4-26B:26b 25.8B/Q4_K_M AMD Ryzen 9 9955HX3D 16-Core Processor 31 GB 40.5
91
Excellent Compare
gemma4:e4b-it-q8_0 8.0B/Q8_0 Apple M1 Pro 16 GB 30.0
91
Excellent Compare
gemma4:e4b-mlx Apple M1 Pro 16 GB 41.8
90
Excellent Compare
qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex 35B Apple M5 Max 64 GB 86.6
90
Excellent Compare
Kimi-48B:48B 49.1B/unknown NVIDIA RTX Spark N1X (6144-core GPU, 20-core ) RTX Spark N1X (6144-core GPU, 20-core ) 55 GB 62.7
90
Excellent Compare
gemma4:e4b 8.0B/Q4_K_M Apple M1 Pro 16 GB 35.6
90
Excellent Compare
gemma4:e4b-mlx Apple M2 Pro 16 GB 46.1
90
Excellent Compare
gemma-4-26b-a4b-it-qat 26B/Q4_K_XL AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 156.5
90
Excellent Compare
qwen3-coder:30b 30.5B/Q4_K_M Intel Core™ Ultra 9 285K 47 GB 207.9
90
Excellent Compare
qwen3-coder:30b-a3b-q8_0 30.5B/Q8_0 Intel Core™ Ultra 9 285HX 63 GB 43.1
90
Excellent Compare
Qwen3.8-27B-Opus-Distill-IQ3_XXS:latest 27.3B/IQ3_XXS AMD Ryzen 7 9700X 8-Core Processor 31 GB 61.8
90
Excellent Compare
openai/gpt-oss-20b 20B/MXFP4 AMD Ryzen 5 5500 31 GB 58.7
90
Excellent Compare
gemma4:e4b 8.0B/Q4_K_M Apple M1 Pro 16 GB 35.7
90
Excellent Compare
unsloth/gemma-4-26b-a4b-it 26B/Q3_K_M Apple M4 24 GB 24.9
90
Excellent Compare
qwen3:14b 14.8B/Q4_K_M Apple M1 Max 32 GB 24.0
90
Excellent Compare
qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex 35B Apple M4 Max 128 GB 78.1
90
Excellent Compare
Gemma4-26B:26b 25.8B/Q4_K_M AMD Ryzen 9 9955HX3D 16-Core Processor 31 GB 39.2
90
Excellent Compare
qwen3.5:35b-a3b-q4_K_M 36.0B/Q4_K_M Intel Xeon® E5-2637 v3 96 GB 48.4
90
Excellent Compare
gemma4:e4b 8.0B/Q4_K_M Apple M1 Pro 16 GB 35.5
90
Excellent Compare
qwen/qwen3-30b-a3b-2507 30B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 132.6
90
Excellent Compare
qwen3.5:35b-a3b-q4_K_M 36.0B/Q4_K_M Intel Xeon® E5-2637 v3 96 GB 47.1
90
Excellent Compare
Qwen3.8-27B-UD-Q3_K_XL 27.3B/Q4_K Intel Gen Intel® Core™ i5-12600K 31 GB 39.0
90
Excellent Compare
qwen/qwen3-30b-a3b-2507 30B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 181.4
90
Excellent Compare
qwen/qwen3-30b-a3b-2507 30B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 157.5
90
Excellent Compare
GPT-20B:20b 20.9B/MXFP4 AMD Ryzen 9 9955HX3D 16-Core Processor 31 GB 36.6
90
Excellent Compare
gemma4:latest 8.0B/Q4_K_M AMD Ryzen 7 5800H 16 GB 46.3
89
Excellent Compare
nemotron-3-nano:latest 31.6B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 65.2
89
Excellent Compare
gemma4:12b 11.9B/Q4_K_M Apple M2 Pro 16 GB 18.5
89
Excellent Compare
qwen3.6:35b-mlx nvfp4 Apple M5 Max 48 GB 129.4
89
Excellent Compare
qwen3.8-27b-nvfp4-budget 27B AMD Ryzen 7 9700X 8-Core Processor 31 GB 48.5
89
Excellent Compare
gemma4:26b 25.8B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 48.3
89
Excellent Compare
qwen3.6-27b-mtp 27B/Q5_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 74.9
89
Excellent Compare
qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-mtp 35B AMD Ryzen 5 5600X 6-Core Processor 47 GB 42.2
89
Excellent Compare
qwen3-coder:30b 30.5B/Q4_K_M Apple M4 Max 64 GB 89.9
89
Excellent Compare
qwen/qwen3-8b 8B/4bit Apple M4 Pro 64 GB 33.4
89
Excellent Compare
qwen3.8:27b-q8_0 27.3B/Q8_0 AMD EPYC 7713 64-Core Processor 1007 GB 39.9
89
Excellent Compare
qwen3.8:27b-q8_0 27.3B/Q8_0 AMD EPYC 7713 64-Core Processor 1007 GB 40.0
89
Excellent Compare
qwen/qwen3-30b-a3b-2507 30B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 104.5
89
Excellent Compare
qwen/qwen3.6-35b-a3b 35B/4bit Apple M5 Max 64 GB 130.2
89
Excellent Compare
gemma4:12b 11.9B/Q4_K_M Apple M2 Pro 16 GB 18.4
89
Excellent Compare
qwen/qwen3-30b-a3b-2507 30B/Q3_K_L AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 151.8
89
Excellent Compare
Qwen3.8-27B-Ridge-3.7bpw_empero.ai:latest 27.3B/IQ2_M AMD Ryzen 7 9700X 8-Core Processor 31 GB 60.6
89
Excellent Compare
lfm2:24b 23.8B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 95.4
88
Excellent Compare
qwen/qwen3-30b-a3b-2507 30B/Q3_K_L AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 122.8
88
Excellent Compare
qwen/qwen3.6-35b-a3b 35B/Q4_K_M AMD Ryzen 7 9700X 8-Core Processor 31 GB 86.1
88
Excellent Compare
qwen/qwen3-30b-a3b-2507 30B/Q3_K_L AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 103.0
88
Excellent Compare
huihui-qwen3.6-35b-a3b-claude-4.7-opus-abliterated-mtp 35B/Q4_K AMD Ryzen 5 5600X 6-Core Processor 47 GB 39.8
88
Excellent Compare
qwopus3.6-27b-coder-compat-mtp 27B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 80.8
88
Excellent Compare
huihui-qwen3.6-35b-a3b-claude-4.7-opus-abliterated-mtp 35B/Q4_K AMD Ryzen 5 5600X 6-Core Processor 47 GB 37.7
88
Excellent Compare
qwen3.8-27b-fable-fusion-f711-gain-mlx 27B/MXFP4 Apple M4 Max 128 GB 30.4
88
Excellent Compare
hf.co/lmstudio-community/gemma-4-E4B-it-GGUF:Q6_K 7.52B/unknown Apple M1 Pro 16 GB 34.6
88
Excellent Compare
Qwen3-Coder-30B:30B 30.5B/Q4_K_M Intel Core™ Ultra X7 358H 64 GB 32.2
88
Excellent Compare
qwen3.8-27b-ridge 27B AMD Ryzen 7 9700X 8-Core Processor 31 GB 53.8
88
Excellent Compare
Qwen3-30B:30b 30.5B/Q4_K_M Intel Core™ Ultra X7 358H 64 GB 31.3
88
Excellent Compare
qwen3.8-27b-fable-distill-heretic-ara-i1 27B/IQ3_S AMD Ryzen 7 9700X 8-Core Processor 31 GB 48.8
88
Excellent Compare
gemma-4-26b-a4b-it-qat 26B/Q4_K_XL AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 169.2
88
Excellent Compare
gemma-4-26b-a4b-it-qat 26B/Q4_K_XL AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 169.6
88
Excellent Compare
gemma-4-26b-a4b-it-qat 26B/Q4_K_XL AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 170.5
88
Excellent Compare
qwopus3.6-27b-coder-compat-mtp 27B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 42.9
88
Excellent Compare
gemma4:12b-it-qat 11.9B/Q4_0 Apple M4 Pro 24 GB 30.0
88
Excellent Compare
gemma4:26b 25.8B/Q4_K_M Cortex-X925 122 GB 66.7
88
Not Rec. Compare
Qwen3-30B:30b 30.5B/Q4_K_M Intel Core™ Ultra X7 358H 64 GB 31.0
88
Excellent Compare
qwen3.6:35b-a3b 36.0B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 43.3
88
Excellent Compare
lfm2:24b 23.8B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 85.3
88
Excellent Compare
Qwen3-30B:30b 30.5B/Q4_K_M AMD Ryzen 9 9955HX3D 16-Core Processor 31 GB 42.5
88
Excellent Compare
hf.co/unsloth/gemma-4-E4B-it-GGUF:Q5_K_M 7.52B/unknown Apple M1 Pro 16 GB 28.3
88
Excellent Compare
qwen/qwen3-30b-a3b-2507 30B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 65.1
88
Excellent Compare
Qwen3-30B:30b 30.5B/Q4_K_M AMD Ryzen 9 9955HX3D 16-Core Processor 31 GB 41.8
88
Excellent Compare
gpt-oss-orchestrator:latest 20.9B/MXFP4 Apple M4 24 GB 24.6
88
Excellent Compare
qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex 35B Apple M4 Max 128 GB 76.7
88
Not Rec. Compare
qwen/qwen3-coder-30b 30B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 95.4
88
Excellent Compare
qwen3.5:35b-a3b 36.0B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 42.0
88
Excellent Compare
Qwen3-30B:30b 30.5B/Q4_K_M AMD Ryzen 9 9955HX3D 16-Core Processor 31 GB 42.8
88
Excellent Compare
gemma4:e4b-it-q8_0 8.0B/Q8_0 Apple M1 Pro 16 GB 27.8
88
Excellent Compare
maternion/ling-3.0-tiny:8b 7.9B/Q4_K_M Apple M1 Pro 16 GB 73.0
88
Excellent Compare
gemma4:e2b-mlx Apple M1 Pro 16 GB 72.8
88
Not Rec. Compare
qwen/qwen3.6-35b-a3b 35B/6bit Apple M5 Max 64 GB 86.5
87
Excellent Compare
Qwen3-80B:80B 79.7B/Q4_K_M NVIDIA RTX Spark N1X (6144-core GPU, 20-core ) RTX Spark N1X (6144-core GPU, 20-core ) 55 GB 43.6
87
Excellent Compare
nemotron-3.5-lightning:latest 32.9B/Q4_K_M Cortex-X925 122 GB 84.1
87
Not Rec. Compare
gpt-oss:20b 20.9B/MXFP4 Apple M4 24 GB 24.3
87
Excellent Compare
Gemma4-26B:26b 25.8B/Q4_K_M Intel Core™ Ultra X7 358H 64 GB 23.4
87
Excellent Compare
qwen3.6-27b-mtp 27B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 43.9
87
Excellent Compare
qwen/qwen3.8-27b 27B/4bit Apple M4 Max 128 GB 29.1
87
Excellent Compare
Gemma4-26B:26b 25.8B/Q4_K_M Intel Core™ Ultra X7 358H 64 GB 23.1
87
Excellent Compare
gpt-oss-safeguard-20b-mlx 20B/MXFP4 Apple M4 24 GB 41.4
87
Excellent Compare
GPT-20B:20b 20.9B/MXFP4 AMD Ryzen 9 9955HX3D 16-Core Processor 31 GB 36.9
87
Excellent Compare
nemotron-3-nano:latest 31.6B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 59.9
87
Excellent Compare
hf.co/unsloth/gemma-4-E4B-it-GGUF:Q4_K_M 7.52B/unknown Apple M1 Pro 16 GB 35.0
87
Excellent Compare
gpt-oss:20b 20.9B/MXFP4 Apple M4 24 GB 26.4
87
Excellent Compare
qwen3-vl-4b-instruct 4B/Q4_K_M Apple M2 Max 96 GB 72.0
87
Excellent Compare
qwen3-vl-4b-instruct 4B/Q4_K_M Apple M2 Max 96 GB 71.2
87
Excellent Compare
gemma4:latest 8.0B/Q4_K_M AMD Ryzen 9 9950X 16-Core Processor 125 GB 42.4
87
Excellent Compare
qwen3-vl-4b-instruct 4B/Q4_K_M Apple M2 Max 96 GB 71.2
87
Excellent Compare
qwen3-vl-4b-instruct 4B/Q4_K_M Apple M2 Max 96 GB 71.6
87
Excellent Compare
hf.co/ornith-ai/Ornith-1.0-9B-GGUF:Q4_K_M 8.95B/unknown Apple M1 Pro 16 GB 22.2
87
Excellent Compare
Ling-3.0-tiny-IQ4_XS:latest 7.9B/IQ4_XS Intel Core™ i7-7700HQ 16 GB 24.7
87
Excellent Compare
gemma4:12b 11.9B/Q4_K_M Cortex-X925 122 GB 26.3
86
Excellent Compare
Kimi-48B:48B 49.1B/unknown Intel Core™ Ultra X7 358H 64 GB 22.8
86
Excellent Compare
qwen3:30b 30.5B/Q4_K_M Intel Core™ Ultra 9 285K 47 GB 204.8
86
Excellent Compare
Qwen3.6-35B-A3B-Q4_K_M:latest 34.7B/Q4_K_M AMD Ryzen 7 9700X 8-Core Processor 31 GB 92.9
86
Excellent Compare
qwen3.6-35b-a3b-nvfp4-dspark-v2@? 35B AMD Ryzen 7 9700X 8-Core Processor 31 GB 69.2
86
Excellent Compare
hf.co/unsloth/gpt-oss-20b-GGUF:Q4_K_M 20.9B/unknown Apple M1 Pro 16 GB 35.9
86
Excellent Compare
gemma4:12b 11.9B/Q4_K_M Cortex-X925 122 GB 27.5
86
Excellent Compare
Kimi-48B:48B 49.1B/unknown Intel Core™ Ultra X7 358H 64 GB 23.1
86
Excellent Compare
glm-4.7-flash:latest 29.9B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 47.8
86
Not Rec. Compare
qwen/qwen3.6-35b-a3b 35B/Q4_K_M AMD Ryzen 7 9700X 8-Core Processor 31 GB 22.1
85
Excellent Compare
qwen3.6-27b-mtp-pi-reasoning 27B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 38.8
85
Excellent Compare
gemma4:e4b-mlx Apple M2 Pro 16 GB 47.3
85
Excellent Compare
qwen3.6-27b-mtp-pi-reasoning 27B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 78.5
85
Excellent Compare
gemma4:26b 25.8B/Q4_K_M Apple M4 24 GB 24.5
85
Excellent Compare
qwen3.6-27b-mtp-pi-reasoning 27B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 42.2
85
Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M Apple M1 Max 32 GB 23.1
85
Excellent Compare
ornith-1.5-35b 35B/Q4_K_M AMD Ryzen 7 9700X 8-Core Processor 31 GB 80.4
85
Excellent Compare
unsloth/gemma-4-26b-a4b-it-qat 26B/Q4_K_XL Intel Gen Intel® Core™ i9-11900H 15 GB 11.9
85
Excellent Compare
gemma4:26b-nvfp4 nvfp4 Apple M4 Pro 48 GB 65.7
85
Not Rec. Compare
gemma-4-31b-it-mlx 31B/8bit Apple M4 Max 128 GB 13.6
85
Excellent Compare
Kimi-48B:48B 49.1B/unknown AMD Ryzen 9 9955HX3D 16-Core Processor 31 GB 42.3
85
Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M Intel Core™ i5-14600KF 32 GB 88.6
85
Excellent Compare
Kimi-48B:48B 49.1B/unknown Intel Core™ i7-14700F 64 GB 32.8
85
Excellent Compare
qwen3.8:27b-bf16 27.3B/BF16 AMD EPYC 7713 64-Core Processor 1007 GB 27.2
85
Excellent Compare
qwen3.8:27b 27.3B/Q4_K_M Cortex-X925 122 GB 27.4
85
Excellent Compare
Kimi-48B:48B 49.1B/unknown AMD Ryzen 9 9955HX3D 16-Core Processor 31 GB 43.0
85
Excellent Compare
nemotron-3-nano:4b 4.0B/Q4_K_M Apple M1 Pro 16 GB 31.7
85
Excellent Compare
gemma4:12b-mlx Apple M2 Pro 16 GB 27.2
84
Excellent Compare
qwopus3.6-35b-a3b-coder-mtp 35B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 106.2
84
Excellent Compare
qwen/qwen3.6-35b-a3b 35B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 115.8
84
Excellent Compare
qwen3:8b 8.2B/Q4_K_M Intel Core™ Ultra 9 285K 47 GB 208.0
84
Excellent Compare
qwen2.5:7b 7.6B/Q4_K_M Apple M4 32 GB 22.2
84
Excellent Compare
gemma4:e4b 8.0B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 53.0
84
Excellent Compare
qwen3.5-9b 9B/Q4_K_S Apple M4 Pro 64 GB 30.2
84
Excellent Compare
qwopus3.6-35b-a3b-coder-mtp 35B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 108.4
84
Excellent Compare
unsloth/gemma-4-26b-a4b-it 26B/Q3_K_M Apple M4 24 GB 16.5
84
Excellent Compare
qwen2.5-7b-instruct 7B/4bit Apple M4 32 GB 24.4
84
Excellent Compare
qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex 35B AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 147.6
84
Excellent Compare
openai/gpt-oss-20b 20B/MXFP4 AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 221.5
84
Not Rec. Compare
laguna-xs-2.1 AMD RYZEN AI MAX+ 395 125 GB 65.9
84
Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M Intel Core™ i5-14600KF 32 GB 86.3
84
Excellent Compare
nvidia/nemotron-3-nano 30B/4bit Apple M4 32 GB 47.9
84
Excellent Compare
gptoss · 20.9B · MXFP4 20.9/MXFP4 Intel Core™ i5-10400 32 GB 17.5
84
Excellent Compare
qwen/qwen3.8-27b 27B/4bit Apple M4 Max 128 GB 28.9
84
Excellent Compare
qwen3:30b-a3b 30.5B/Q4_K_M Cortex-X925 122 GB 92.7
84
Excellent Compare
hf.co/unsloth/gemma-4-E2B-it-GGUF:UD-Q8_K_XL 4.65B/unknown Apple M1 Pro 16 GB 48.0
84
Excellent Compare
qwen3.5:9b-mlx nvfp4 Apple M1 Pro 16 GB 25.0
84
Excellent Compare
glm-4.7-flash:latest 29.9B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 58.0
83
Excellent Compare
qwen2.5:14b 14.8B/Q4_K_M Apple M4 32 GB 11.2
83
Excellent Compare
zai-org/glm-4.7-flash 30B/Q4_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 102.9
83
Excellent Compare
qwen3:30b-a3b-instruct-2507-q4_K_M 30.5B/Q4_K_M Intel Xeon® E5-2637 v3 96 GB 17.7
83
Excellent Compare
gpt-oss:20b 20.9B/MXFP4 Apple M4 24 GB 17.1
83
Excellent Compare
qwen3:14b 14.8B/Q4_K_M Apple M4 24 GB 11.1
83
Excellent Compare
ministral-3-14b-instruct-2512 14B/Q5_K_M AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 83.7
83
Excellent Compare
gemma4:e2b 5.1B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 88.1
83
Excellent Compare
gemma4:e2b 5.1B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 87.9
83
Excellent Compare
qwen3:30b-a3b-instruct-2507-q4_K_M 30.5B/Q4_K_M Intel Core™ i9-14900K 128 GB 21.2
83
Excellent Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M1 Max 32 GB 32.4
83
Excellent Compare
gemma4:31b 31.3B/Q4_K_M Cortex-X925 122 GB 10.9
83
Excellent Compare
qwen3:30b-a3b-instruct-2507-q4_K_M 30.5B/Q4_K_M Intel Core™ i9-14900K 128 GB 21.0
83
Excellent Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M1 Max 32 GB 33.8
83
Excellent Compare
ornith-1.5-9b 9B/Q6_K AMD Ryzen 7 9700X 8-Core Processor 31 GB 102.9
83
Excellent Compare
qwen3-vl:4b-instruct 4.4B/Q4_K_M Apple M2 Max 96 GB 90.6
83
Excellent Compare
gemma-4-26b-a4b-it@iq3_xxs 26B/IQ3_XXS Intel Gen Intel® Core™ i9-11900H 15 GB 10.3
83
Excellent Compare
unsloth/gemma-4-26b-a4b-it@q4_k_m 26B/Q4_K_M Intel Gen Intel® Core™ i9-11900H 15 GB 9.4
83
Excellent Compare
qwen3-vl:4b-instruct 4.4B/Q4_K_M Apple M2 Max 96 GB 91.2
83
Excellent Compare
qwen3-5-4b-q4-k-m 4B/Q4_K_M Intel Core™ i5-10400 32 GB 62.7
83
Excellent Compare
qwen3-5-4b-q4-k-m 4B/Q4_K_M Intel Core™ i5-10400 32 GB 62.7
83
Excellent Compare
qwen/qwen3.8-27b 27B/4bit Apple M4 Max 128 GB 27.6
83
Excellent Compare
openai/gpt-oss-20b 20B/MXFP4 Apple M5 Max 64 GB 131.7
83
Not Rec. Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M1 Pro 16 GB 36.6
83
Excellent Compare
qwen3.6-35b-a3b-uncensored-genesis-hermes-v7 35B AMD Ryzen 7 9700X 8-Core Processor 31 GB 20.9
82
Excellent Compare
Ornith-1.5-35B-A3B-NVFP4-Q5K-mtp:latest 35.5B/NVFP4 AMD Ryzen 7 9700X 8-Core Processor 31 GB 67.9
82
Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 30.8
82
Excellent Compare
qwen3-coder-next:latest 79.7B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 34.5
82
Excellent Compare
qwen3:14b 14.8B/Q4_K_M AMD Ryzen 9 3900X 12-Core Processor 64 GB 74.4
82
Excellent Compare
openai/gpt-oss-20b 20B/MXFP4 Apple M4 24 GB 31.8
82
Excellent Compare
qwen3-coder:30b 30.5B/Q4_K_M AMD Ryzen 5 5500U 63 GB 14.3
82
Excellent Compare
unsloth-phi-4 4bit Apple M4 Pro 64 GB 27.4
82
Excellent Compare
qwen3.8-9b-heretic-uncensored-nvfp4 9B/Q8_0 AMD Ryzen 7 9700X 8-Core Processor 31 GB 130.1
82
Excellent Compare
qwen2.5-7b-instruct 7B/4bit Apple M4 32 GB 22.0
82
Excellent Compare
deepseek-coder-v2:16b 15.7B/Q4_0 Cortex-X925 122 GB 117.2
82
Excellent Compare
Qwen3-80B:80B 79.7B/Q4_K_M Intel Core™ Ultra X7 358H 64 GB 19.3
82
Excellent Compare
google/gemma-4-26b-a4b-it-qat 26B/Q4_0 Intel Gen Intel® Core™ i9-11900H 15 GB 12.0
82
Excellent Compare
qwen3:14b 14.8B/Q4_K_M Apple M4 24 GB 10.3
82
Excellent Compare
qwen3.6-35b-a3b 35B/Q4_K_S Apple M2 Max 96 GB 55.2
82
Not Rec. Compare
Qwen3-80B:80B 79.7B/Q4_K_M Intel Core™ Ultra X7 358H 64 GB 19.6
82
Excellent Compare
qwen3.5:35b-a3b-q4_K_M 36.0B/Q4_K_M Intel Xeon® E5-2637 v3 96 GB 20.4
82
Excellent Compare
qwen3.6-35b-a3b 35B/Q4_K_S Apple M2 Max 96 GB 54.7
82
Not Rec. Compare
qwen3.5:9b 9.7B/Q4_K_M AMD RYZEN AI MAX+ 395 w/ Radeon 8060S 125 GB 30.8
82
Excellent Compare
qwen3.5:4b 4.7B/Q4_K_M AMD RYZEN AI MAX+ 395 w/ Radeon 8060S 125 GB 46.8
82
Excellent Compare
glm-4.7-flash:latest 29.9B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 47.6
82
Excellent Compare
gemma4:e2b-mlx Apple M1 Pro 16 GB 70.4
82
Excellent Compare
gemma4:12b-mlx Apple M2 Pro 16 GB 25.3
81
Excellent Compare
Nemotron-3-Nano-Omni-30B-A3B-Reasoning-Q4_K_M:latest 31.6B/Q4_K_M AMD Ryzen 7 9700X 8-Core Processor 31 GB 56.8
81
Excellent Compare
gpt-oss:20b 20.9B/MXFP4 Intel Core™ Ultra X7 358H 64 GB 19.1
81
Excellent Compare
gemma3n:latest 6.9B/Q4_K_M AMD EPYC 9654P 96-Core Processor 128 GB 108.7
81
Excellent Compare
qwen3.5:35b-a3b-q4_K_M 36.0B/Q4_K_M Intel Xeon® E5-2637 v3 96 GB 24.2
81
Excellent Compare
llama-3.1-8b-instruct 8B/Q8_0 AMD Ryzen 5 5500 31 GB 35.6
81
Excellent Compare
qwen/qwen3.8-27b 27B/8bit Apple M4 Max 128 GB 16.4
81
Excellent Compare
qwen3.5-9b 9B/4bit Apple M4 32 GB 20.4
81
Excellent Compare
gemma-4-e2b-it-qat Q4_K_XL Intel Gen Intel® Core™ i9-11900H 15 GB 22.2
81
Excellent Compare
lmstudio-community/gemma-4-26b-a4b-it 26B/Q4_K_M Intel Gen Intel® Core™ i9-11900H 15 GB 9.9
81
Excellent Compare
qwen3:8b 8.2B/Q4_K_M Intel Core™ i5-14600KF 32 GB 108.3
81
Excellent Compare
glm-4.7-flash:q4_K_M 29.9B/Q4_K_M Intel Core™ i5-14600KF 32 GB 35.1
81
Excellent Compare
qwen3:8b 8.2B/Q4_K_M Intel Core™ i5-14600KF 32 GB 109.1
81
Excellent Compare
qwen3.5:9b 9.7B/Q4_K_M Apple M4 32 GB 11.8
80
Excellent Compare
qwen3.8:27b 27.3B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 18.4
80
Excellent Compare
qwen3.8-27b-claude-opus-reasoning-distilled 27B/Q4_K_M Apple M4 Max 128 GB 24.0
80
Excellent Compare
nvidia/nemotron-3-nano-omni 30B/Q4_K_M AMD Ryzen 7 9700X 8-Core Processor 31 GB 55.4
80
Excellent Compare
qwen3.6:35b-mlx nvfp4 Apple M5 Max 48 GB 129.8
80
Not Rec. Compare
glm-4.7-flash-reap-39-i1 Q5_K_M AMD Ryzen 7 9700X 8-Core Processor 31 GB 154.8
80
Excellent Compare
rnj-1:8b 8.3B/Q4_K_M Apple M1 Pro 16 GB 22.3
80
Excellent Compare
qwen3.6:27b 27.8B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 11.2
80
Excellent Compare
qwen3-vl:30b 31.1B/Q4_K_M Intel Core™ Ultra 9 285K 47 GB 208.9
80
Excellent Compare
qwen3:8b 8.2B/Q4_K_M Intel Xeon® Gold 6230 252 GB 65.1
80
Excellent Compare
qwen3-coder:30b 30.5B/Q4_K_M Intel Gen Intel® Core™ i7-12700K 96 GB 14.7
80
Excellent Compare
gemma3:12b 12.2B/Q4_K_M Apple M4 32 GB 12.7
80
Excellent Compare
qwen3.5:122b-a10b 125.1B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 19.1
80
Excellent Compare
qwen3.6:35b-a3b-q8_0 36.0B/Q8_0 Cortex-X925 122 GB 55.5
80
Not Rec. Compare
gemma-3-4b-it-q4-k-m 4B/Q4_K_M Intel Core™ i5-10400 32 GB 75.0
80
Excellent Compare
mlx-community/gemma-3-4b-it-qat-4bit Apple M4 32 GB 43.2
80
Excellent Compare
gemma3:4b 4.3B/Q4_K_M Apple M4 32 GB 34.6
80
Excellent Compare
qwen3.5-35b-a3b 35B/IQ3_XXS Intel Gen Intel® Core™ i9-11900H 15 GB 10.6
80
Excellent Compare
qwen3-next:80b-a3b-instruct-q4_K_M 79.7B/Q4_K_M Intel Xeon® E5-2637 v3 96 GB 14.9
80
Excellent Compare
gemma-3-4b-it-q4-k-m 4B/Q4_K_M Intel Core™ i5-10400 32 GB 75.0
80
Excellent Compare
lfm2.5:8b 8.5B/Q4_K_M Apple M1 Pro 16 GB 98.5
80
Excellent Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M4 32 GB 16.6
80
Excellent Compare
qwen/qwen3.8-27b 27B/8bit Apple M4 Max 128 GB 16.1
80
Excellent Compare
huihui_ai/Qwen3.8-abliterated:27b 27.3B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 17.5
80
Excellent Compare
Qwen3.8-27B-UD-IQ4_XS_unsloth:latest 27.3B/IQ4_XS AMD Ryzen 7 9700X 8-Core Processor 31 GB 10.8
80
Excellent Compare
granite4.2:3b 3.7B/Q4_K_M Apple M1 Pro 16 GB 46.8
80
Excellent Compare
qwen3.5:27b 27.8B/Q4_K_M AMD RYZEN AI MAX+ 395 w/ Radeon 8060S 125 GB 10.7
79
Good Compare
qwen2.5-coder-7b-instruct-mlx 7B/4bit Apple M4 32 GB 22.5
79
Good Compare
qwen3:32b 32.8B/Q4_K_M Cortex-X925 122 GB 9.7
79
Good Compare
GPT-120B:120b 116.8B/MXFP4 Intel Core™ i7-14700F 128 GB 18.2
79
Good Compare
qwen2.5-coder:7b 7.6B/Q4_K_M Apple M4 32 GB 22.1
79
Good Compare
qwen3.5:35b-a3b-q4_K_M 36.0B/Q4_K_M Intel Core™ i9-14900K 128 GB 16.4
79
Good Compare
slim-rpcache-ornith-1.0-9b 9B/BF16 AMD Ryzen 7 7800X3D 8-Core Processor 31 GB 52.3
79
Good Compare
lfm2.5:latest 8.5B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 134.4
79
Good Compare
ministral-3:8b 8.9B/Q4_K_M Apple M4 Pro 24 GB 41.4
79
Good Compare
unsloth/gemma-4-e4b-it@q4_k_m Q4_K_M Intel Gen Intel® Core™ i9-11900H 15 GB 10.8
79
Good Compare
unsloth/gemma-4-e4b-it-qat Q4_K_XL Intel Gen Intel® Core™ i9-11900H 15 GB 12.1
79
Good Compare
gemma-4-e2b-it@q5_k_xl Q5_K_XL Intel Gen Intel® Core™ i9-11900H 15 GB 17.2
79
Good Compare
qwen3.6-35b-a3b 35B/IQ3_XXS Intel Gen Intel® Core™ i9-11900H 15 GB 9.3
79
Good Compare
lfm2-24b-a2b Apple M4 Pro 64 GB 105.9
78
Good Compare
gemma4:e4b-mlx Apple M2 Pro 16 GB 26.9
78
Not Rec. Compare
qwen3-coder:30b-a3b-q8_0 30.5B/Q8_0 AMD Ryzen 5 5500U 63 GB 8.0
78
Good Compare
gemma4:31b 31.3B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 9.8
78
Good Compare
qwen2.5-coder:32b 32.8B/Q4_K_M Cortex-X925 122 GB 9.5
78
Good Compare
qwen3.5-35b-a3b-t48-c8k:latest 36.0B/Q4_K_M Intel Xeon® E5-4650 v2 256 GB 7.1
78
Not Rec. Compare
qwen3-next:80b-a3b-instruct-q4_K_M 79.7B/Q4_K_M Intel Xeon® E5-2637 v3 96 GB 8.7
78
Good Compare
qwen3-next:80b-a3b-instruct-q4_K_M 79.7B/Q4_K_M Intel Xeon® E5-2637 v3 96 GB 8.7
78
Good Compare
lfm2:24b-a2b 23.8B/Q4_K_M Intel Gen Intel® Core™ i7-1355U 31 GB 11.5
78
Good Compare
google/gemma-4-e4b-it-qat Q4_0 Intel Gen Intel® Core™ i9-11900H 15 GB 11.4
78
Good Compare
GPT-20B:20b 20.9B/MXFP4 Intel Core™ Ultra X7 358H 64 GB 19.6
78
Good Compare
lmstudio-community/meta-llama-3.1-8b-instruct 8B/Q4_K_M Apple M4 Pro 64 GB 46.0
78
Good Compare
qwen3:8b 8.2B/Q4_K_M AMD Ryzen 9 3900X 12-Core Processor 64 GB 48.5
78
Good Compare
yi:6b 6B/Q4_0 Apple M4 32 GB 27.6
77
Good Compare
qwen2.5:3b 3.1B/Q4_K_M Cortex-A78AE 7 GB 21.4
77
Good Compare
qwen2.5:3b 3.1B/Q4_K_M Apple M4 32 GB 47.2
77
Good Compare
gemma2:2b 2.6B/Q4_0 Apple M4 32 GB 55.1
77
Good Compare
phi4:14b 14.7B/Q4_K_M Cortex-X925 122 GB 22.9
77
Good Compare
qwen3.5-9b-mlx 9B/4bit Apple M4 Pro 64 GB 20.3
77
Good Compare
deepseek-r1:7b 7.6B/Q4_K_M Apple M4 32 GB 22.2
77
Good Compare
gemma4:12b 11.9B/Q4_K_M Cortex-X925 122 GB 26.8
77
Not Rec. Compare
internlm2:7b 7.7B/Q4_0 Apple M4 32 GB 22.7
77
Good Compare
gemma-4-e4b-it@q5_k_xl Q5_K_XL Intel Gen Intel® Core™ i9-11900H 15 GB 9.3
77
Good Compare
lmstudio-community/gemma-4-e4b-it-qat Q4_0 Intel Gen Intel® Core™ i9-11900H 15 GB 11.4
77
Good Compare
lmstudio-community/gemma-4-e2b-it Q8_0 Intel Gen Intel® Core™ i9-11900H 15 GB 13.3
77
Good Compare
mlx-community/meta-llama-3.1-8b-instruct 8B/4bit Apple M4 Pro 64 GB 54.3
77
Good Compare
qwen3.5:35b 36.0B/Q4_K_M Intel Core™ i5-14600KF 32 GB 16.0
77
Good Compare
openai/gpt-oss-20b 20B/MXFP4 Apple M4 24 GB 30.5
77
Not Rec. Compare
qwen3.5-35b-a3b-mtp 35B/IQ3_XXS Intel Gen Intel® Core™ i9-11900H 15 GB 7.8
77
Good Compare
qwen3.6-35b-a3b-mtp 35B/IQ3_XXS Intel Gen Intel® Core™ i9-11900H 15 GB 9.2
77
Good Compare
qwen3.5:9b 9.7B/Q4_K_M Intel Gen Intel® Core™ i7-13700K 64 GB 30.5
77
Good Compare
cogito:8b 8.0B/Q4_K_M Apple M4 32 GB 21.0
77
Good Compare
adityakale/kotakneo AMD RYZEN AI MAX+ 395 125 GB 81.2
77
Good Compare
gemma3:4b 4.3B/Q4_K_M Cortex-A78AE 7 GB 15.0
76
Good Compare
Gemma4-31B:31B 31.3B/Q4_K_M Intel Core™ Ultra X7 358H 64 GB 3.8
76
Not Rec. Compare
glm-4.7-flash:bf16 29.9B/F16 Cortex-X925 122 GB 25.8
76
Good Compare
gemma2:9b 9.2B/Q4_0 Apple M4 32 GB 17.5
76
Good Compare
gemma4:31b 31.3B/Q4_K_M Apple M4 Max 64 GB 22.4
76
Not Rec. Compare
ministral-3:8b 8.9B/Q4_K_M Apple M4 32 GB 19.5
76
Good Compare
qwen3-coder:latest 30.5B/Q4_K_M Intel Gen Intel® Core™ i7-1355U 31 GB 7.6
76
Good Compare
glm4:9b 9.4B/Q4_0 Apple M4 32 GB 19.0
76
Good Compare
google/gemma-3-4b 4B/4bit Apple M4 32 GB 39.4
76
Good Compare
lmstudio-community/gemma-4-e4b-it Q4_K_M Intel Gen Intel® Core™ i9-11900H 15 GB 10.8
76
Good Compare
qwen3.6:35b-a3b-coding-nvfp4 nvfp4 Apple M4 Pro 48 GB 72.7
76
Not Rec. Compare
gemma-3-27b-it-qat 27B/4bit Apple M4 Pro 64 GB 8.9
76
Good Compare
llama3.2:latest 3.2B/Q4_K_M AMD Ryzen 5 2600X Six-Core Processor 16 GB 57.0
76
Good Compare
hf.co/empero-ai/Qwen3.8-2B-Distill-GGUF:BF16 1.94B/BF16 Apple M1 Pro 16 GB 40.3
76
Good Compare
hf.co/bartowski/ai9stars_G9v3-3B-GGUF:BF16 2.99B/BF16 Apple M1 Pro 16 GB 29.9
76
Good Compare
gemma4:e2b 5.1B/Q4_K_M Intel Core™ i5-10210U 15 GB 13.5
76
Good Compare
qwen3.5:27b 27.8B/Q4_K_M Apple M4 32 GB 4.4
75
Good Compare
exaone-3.5-2.4b-instruct-mlx 2.4B/8bit Apple M4 32 GB 37.0
75
Good Compare
mistral-small:24b 23.6B/Q4_K_M Cortex-X925 122 GB 14.3
75
Good Compare
phi4:14b 14.7B/Q4_K_M Apple M4 32 GB 11.0
75
Good Compare
qwen2.5:72b 72.7B/Q4_K_M Cortex-X925 122 GB 4.4
75
Not Rec. Compare
qwen3.5-27b 27B/4bit Apple M4 32 GB 6.6
75
Good Compare
lmstudio-community/gemma-4-12b-it-qat 12B/Q4_0 Intel Gen Intel® Core™ i9-11900H 15 GB 5.8
75
Good Compare
unsloth/gemma-4-12b-it-qat 12B/Q4_K_XL Intel Gen Intel® Core™ i9-11900H 15 GB 6.0
75
Good Compare
unsloth/gemma-4-e2b-it@q8_0 Q8_0 Intel Gen Intel® Core™ i9-11900H 15 GB 13.0
75
Good Compare
llama3.1:8b 8.0B/Q4_K_M Apple M4 32 GB 20.3
75
Good Compare
Qwen3.8-27B-Ridge-3.7bpw_empero.ai:latest 27.3B/IQ2_M AMD Ryzen 7 9700X 8-Core Processor 31 GB 60.3
75
Good Compare
granite3.1-dense:8b 8.2B/Q4_K_M Apple M4 32 GB 18.8
74
Good Compare
minimax-m2.7:cloud Apple M4 24 GB 0.0
74
Not Rec. Compare
liquid/lfm2-24b-a2b 24B/4bit Apple M4 24 GB 51.8
74
Good Compare
phi4-mini:latest 3.8B/Q4_K_M Cortex-A78AE 7 GB 18.4
74
Good Compare
qwen3-next:80b-a3b-instruct-q4_K_M 79.7B/Q4_K_M Intel Xeon® E5-4650 v2 256 GB 3.9
74
Not Rec. Compare
mlx-community/Llama-3.2-3B-Instruct-4bit Apple M4 32 GB 50.6
74
Good Compare
llama3.2:3b 3.2B/Q4_K_M Apple M4 32 GB 44.1
74
Good Compare
google/gemma-4-12b-it-qat 12B/Q4_0 Intel Gen Intel® Core™ i9-11900H 15 GB 5.0
74
Good Compare
hermes3:8b 8.0B/Q4_0 Apple M4 32 GB 22.3
74
Good Compare
dolphin3:8b 8.0B/Q4_K_M Apple M4 32 GB 21.0
74
Good Compare
liquid/lfm2-24b-a2b 24B/4bit Apple M4 24 GB 58.9
74
Good Compare
llama3.2:3b 3.2B/Q4_K_M Cortex-A78AE 7 GB 21.1
74
Good Compare
mistralai/magistral-small-2509 24B/4bit Apple M4 32 GB 7.9
74
Good Compare
lfm2.5:latest 8.5B/Q4_K_M Intel Core™ i5-8350U 23 GB 18.3
73
Good Compare
qwen3.5:2b 2.3B/Q8_0 Apple M4 32 GB 30.4
73
Good Compare
Qwen3.8-27B-Opus-Distill-IQ3_XXS:latest 27.3B/IQ3_XXS AMD Ryzen 7 9700X 8-Core Processor 31 GB 61.4
73
Good Compare
qwen2.5-coder:3b 3.1B/Q4_K_M Cortex-A78AE 7 GB 21.3
73
Good Compare
qwen2.5-coder-3b-instruct-mlx 3B/4bit Apple M4 32 GB 52.3
73
Good Compare
llama3.3:70b 70.6B/Q4_K_M Cortex-X925 122 GB 4.6
73
Not Rec. Compare
mlx-community/Yi-1.5-6B-Chat-4bit Apple M4 32 GB 29.1
73
Good Compare
unsloth/qwen3.5-9b@q4_k_m 9B/Q4_K_M Intel Gen Intel® Core™ i9-11900H 15 GB 6.5
73
Good Compare
qwen3.5-9b@q5_k_xl 9B/Q5_K_XL Intel Gen Intel® Core™ i9-11900H 15 GB 5.6
73
Good Compare
qwen3:0.6b 751.63M/Q4_K_M Apple M4 32 GB 145.2
73
Good Compare
mistral:latest 7.2B/Q4_K_M Apple M4 32 GB 22.5
73
Good Compare
llama3.2:latest 3.2B/Q4_K_M Apple M4 Pro 64 GB 98.9
73
Good Compare
mistral:latest 7.2B/Q4_K_M AMD Ryzen 5 2600X Six-Core Processor 16 GB 31.7
73
Good Compare
qwen3:1.7b 2.0B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 120.7
72
Good Compare
mistral:latest 7.2B/Q4_0 Apple M4 Pro 64 GB 54.3
72
Good Compare
qwen3-vl:8b 8.8B/Q4_K_M Intel Xeon® Gold 6230 252 GB 68.2
72
Good Compare
mlx-community/gemma-3-1b-it-8bit Apple M4 32 GB 86.3
72
Good Compare
mistral:7b 7.2B/Q4_K_M Apple M4 32 GB 22.0
72
Good Compare
qwen3.5-9b 9B/Q4_K_S Apple M4 32 GB 14.4
72
Not Rec. Compare
gemma4:e2b 5.1B/Q4_K_M Intel Gen Intel® Core™ i7-1355U 31 GB 10.8
72
Good Compare
aya-expanse:8b 8.0B/Q4_K_M Apple M4 32 GB 19.7
72
Good Compare
qwen3.5-9b 9B/Q4_K_M Apple M4 Pro 64 GB 28.9
72
Good Compare
ministral-3:8b 8.9B/Q4_K_M Apple M1 Pro 16 GB 19.8
72
Good Compare
llama3.1:8b 8.0B/Q4_K_M Apple M1 Pro 16 GB 21.5
72
Good Compare
qwen3.5-35b-a3b-uncensored-hauhaucs-aggressive 35B/Q4_K_M Apple M2 Max 96 GB 59.8
71
Good Compare
qwen3.5-35b-a3b-uncensored-hauhaucs-aggressive 35B/Q4_K_M Apple M2 Max 96 GB 59.8
71
Good Compare
codegemma:7b 9B/Q4_0 Apple M4 32 GB 18.7
71
Good Compare
mistral-nemo:12b 12.2B/Q4_0 Apple M4 32 GB 14.6
71
Good Compare
ministral-3:3b 3.8B/Q4_K_M Apple M4 32 GB 42.2
71
Good Compare
llama3:latest 8.0B/Q4_0 Apple M4 32 GB 22.3
71
Good Compare
qwen3.5-4b-mlx 4B/4bit Apple M4 32 GB 23.1
71
Good Compare
qwen3:30b-a3b-instruct-2507-q4_K_M 30.5B/Q4_K_M Intel Xeon® E5-4620 0 256 GB 4.0
71
Not Rec. Compare
qwen3.5:9b 9.7B/Q4_K_M AMD Ryzen 5 5500 16 GB 5.3
71
Good Compare
google/gemma-3-27b 27B/4bit Apple M4 24 GB 5.9
71
Not Rec. Compare
phi4-mini:latest 3.8B/Q4_K_M Apple M4 32 GB 36.2
71
Good Compare
gemma4:12b-mlx Apple M1 Pro 16 GB 25.0
71
Not Rec. Compare
hf.co/openbmb/MiniCPM5-1B-GGUF:F16 1.08B/F16 Apple M1 Pro 16 GB 88.1
71
Good Compare
qwen2.5-coder-1.5b-instruct-mlx 1.5B/8bit Apple M4 32 GB 58.4
70
Good Compare
qwen2.5:1.5b 1.5B/Q4_K_M Apple M4 32 GB 84.1
70
Good Compare
mistral:7b 7.2B/Q4_K_M Apple M4 32 GB 22.5
70
Good Compare
qwen3.5-2b-mlx 2B/8bit Apple M4 32 GB 32.9
70
Good Compare
qwen3-next-80b-t48:latest 79.7B/Q4_K_M Intel Xeon® E5-4620 0 256 GB 3.0
70
Not Rec. Compare
qwen3.6:35b 36.0B/Q4_K_M Apple M4 Pro 48 GB 30.6
70
Not Rec. Compare
yi-coder:9b 8.8B/Q4_0 Apple M4 32 GB 19.4
70
Good Compare
deepseek-v2:16b 15.7B/Q4_0 Apple M4 32 GB 56.6
69
Good Compare
qwen2.5-1.5b-instruct 1.5B/8bit Apple M4 32 GB 58.1
69
Good Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M1 Pro 16 GB 36.9
69
Good Compare
qwen2-57b:57B 57.4B/Q4_K_M Intel Core™ i7-14700F 64 GB 7.7
69
Good Compare
mistralai/devstral-small-2-2512 24B/4bit Apple M4 32 GB 5.7
69
Good Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M1 Pro 16 GB 36.7
69
Good Compare
ornith-1.5:9b 9.0B/Q4_K_M Apple M1 Pro 16 GB 22.2
69
Good Compare
lfm2.5-1.2b-instruct-mlx 1.2B/8bit Apple M4 32 GB 77.3
68
Good Compare
granite3.1-dense:2b 2.5B/Q4_K_M Apple M4 32 GB 54.6
68
Good Compare
nous-hermes2:latest 11B/Q4_0 Apple M4 32 GB 15.9
68
Good Compare
google/gemma-4-e4b Q4_K_M AMD Ryzen 7 5800H 16 GB 26.2
68
Good Compare
hf.co/unsloth/Qwen3.8-27B-GGUF:UD-IQ1_M 27.3B/unknown AMD RYZEN AI MAX+ 395 125 GB 21.1
68
Good Compare
maternion/ling-3.0-tiny:8b 7.9B/Q4_K_M Apple M1 Pro 16 GB 73.6
68
Good Compare
qwen2.5-coder:7b 7.6B/Q4_K_M Intel Gen Intel® Core™ i7-13700K 64 GB 34.4
68
Good Compare
hf.co/bloomer010/Ling-3.0-tiny-GGUF:Q8_0 7.89B/unknown Apple M1 Pro 16 GB 58.9
68
Good Compare
hf.co/bloomer010/Ling-3.0-tiny-GGUF:Q8_0 7.89B/unknown Apple M1 Pro 16 GB 58.4
68
Good Compare
gemma3:1b 999.89M/Q4_K_M Apple M4 32 GB 39.4
68
Good Compare
gemma3:1b 999.89M/Q4_K_M Apple M4 32 GB 39.5
68
Good Compare
qwen3.5:4b-mlx nvfp4 Apple M1 Pro 16 GB 42.2
68
Good Compare
GPT-120B:120b 116.8B/MXFP4 Intel Core™ Ultra X7 358H 64 GB 12.1
68
Not Rec. Compare
maternion/ling-3.0-tiny:8b 7.9B/Q4_K_M Apple M1 Pro 16 GB 72.1
68
Good Compare
qwen3.5:4b 4.7B/Q4_K_M Apple M1 Pro 16 GB 36.5
68
Good Compare
qwen2.5-coder:1.5b 1.5B/Q4_K_M Intel Core™ i5-10210U 15 GB 21.8
68
Good Compare
GPT-OSS-120B:120B 116.8B/MXFP4 Intel Core™ Ultra X7 358H 64 GB 11.7
67
Not Rec. Compare
qwen2-57b:57B 57.4B/Q4_K_M Intel Core™ Ultra X7 358H 64 GB 8.6
67
Good Compare
cogito:3b 3.6B/Q4_K_M Apple M4 32 GB 45.6
67
Good Compare
codestral:22b 22.2B/Q4_0 Cortex-X925 122 GB 17.2
67
Good Compare
GPT-120B:120b 116.8B/MXFP4 Intel Core™ Ultra X7 358H 64 GB 11.8
67
Not Rec. Compare
neural-chat:7b 7B/Q4_0 Apple M4 32 GB 22.5
67
Good Compare
llama3.2:3b 3.2B/Q4_K_M Intel Core™ i5-10210U 15 GB 10.0
67
Good Compare
aya:8b 8.0B/F16 Apple M4 32 GB 20.0
66
Good Compare
qwen3.8-27b-mlx 27B Apple M5 Max 64 GB 33.2
66
Good Compare
GPT-120B:120b 116.8B/MXFP4 NVIDIA RTX Spark N1X (6144-core GPU, 20-core ) RTX Spark N1X (6144-core GPU, 20-core ) 55 GB 16.8
66
Not Rec. Compare
granite-3.3-2b-instruct 2B/bf16 Apple M4 32 GB 18.3
66
Good Compare
qwen3.5:27b 27.8B/Q4_K_M Apple M4 24 GB 4.0
66
Good Compare
hf.co/empero-ai/Qwen3.8-2B-Distill-GGUF:BF16 1.94B/BF16 Apple M1 Pro 16 GB 40.4
66
Good Compare
deepseek-r1:1.5b 1.8B/Q4_K_M Apple M4 32 GB 85.4
66
Good Compare
gemma4:31b 31.3B/Q4_K_M Cortex-X925 122 GB 10.7
66
Not Rec. Compare
hf.co/empero-ai/Qwen3.8-2B-Distill-GGUF:BF16 1.94B/BF16 Apple M1 Pro 16 GB 40.2
66
Good Compare
granite3.1-moe:3b 3.3B/Q4_K_M Intel Gen Intel® Core™ i7-1355U 31 GB 27.2
66
Good Compare
GPT-120B:120b 116.8B/MXFP4 Intel Core™ i7-14700F 64 GB 10.1
66
Not Rec. Compare
qwen3.5:27b 27.8B/Q4_K_M Apple M4 24 GB 3.8
66
Good Compare
deepseek-r1:7b 7.6B/Q4_K_M Intel Core™ i5-6500 16 GB 35.6
66
Good Compare
ornith-1.5-9b_hybrid-imatrix F16 AMD Ryzen 9 3900X 12-Core Processor 128 GB 5.4
66
Not Rec. Compare
hf.co/empero-ai/Qwen3.8-2B-Distill-GGUF:BF16 1.94B/BF16 Apple M1 Pro 16 GB 40.2
66
Good Compare
hf.co/empero-ai/Qwen3.8-4B-Distill-GGUF:Q4_K_M 4.33B/unknown Apple M4 16 GB 26.5
66
Good Compare
qwen3-4b-qwen3.6-plus-reasoning-distilled 4B/Q4_1 Apple M2 Max 96 GB 99.6
65
Good Compare
glm-4.6v-flash Q4_K_S Apple M2 Max 96 GB 49.9
65
Good Compare
qwen3.5-2b-mlx 2B/4bit Apple M4 Pro 64 GB 48.9
65
Good Compare
qwen2.5:1.5b 1.5B/Q4_K_M ZHAOXIN KaiXian KX-7000 KaiXian KX-7000 30 GB 16.8
65
Good Compare
hf.co/bartowski/ai9stars_G9v3-3B-GGUF:BF16 2.99B/BF16 Apple M1 Pro 16 GB 29.6
65
Good Compare
smollm2-1.7b-instruct 1.7B/bf16 Apple M4 32 GB 28.5
65
Good Compare
starling-lm:7b 7B/Q4_0 Apple M4 32 GB 23.8
65
Good Compare
richardyoung/qwythos-9b-abliterated:Q8_0 9.0B/Q8_0 Apple M4 Pro 24 GB 25.3
65
Good Compare
qwen2.5:1.5b 1.5B/Q4_K_M Intel Core™ i7-4771 32 GB 19.6
65
Good Compare
qwen3.5-35b-a3b-t48-c8k:latest 36.0B/Q4_K_M Intel Xeon® E5-4620 0 256 GB 3.4
65
Not Rec. Compare
qwen3.5:0.8b 873.44M/Q8_0 Apple M4 32 GB 48.2
65
Good Compare
qwen3.5:4b 4.7B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 45.7
65
Not Rec. Compare
smollm2:1.7b 1.7B/Q8_0 Apple M4 32 GB 51.8
64
Good Compare
hf.co/bartowski/ai9stars_G9v3-3B-GGUF:BF16 2.99B/BF16 Apple M1 Pro 16 GB 29.9
64
Good Compare
microsoft/phi-4-mini-reasoning 3.8B/4bit Apple M4 Pro 64 GB 90.3
64
Good Compare
phi3:3.8b 3.8B/Q4_0 Apple M4 32 GB 42.0
64
Good Compare
hf.co/bartowski/ai9stars_G9v3-3B-GGUF:BF16 2.99B/BF16 Apple M1 Pro 16 GB 29.9
64
Good Compare
qwen3.5:4b 4.7B/Q4_K_M Intel Core™ i5-10210U 15 GB 7.4
64
Good Compare
falcon-h1-1.5b-instruct 1.5B/Q4_K_M Intel Core™ i5-5300U 16 GB 6.6
63
Good Compare
llama3.2:1b 1.2B/Q8_0 Cortex-A78AE 7 GB 40.2
63
Good Compare
solar:10.7b 11B/Q4_0 Apple M4 32 GB 15.8
63
Good Compare
gemma4:12b 11.9B/Q4_K_M Apple M1 Pro 16 GB 15.3
63
Not Rec. Compare
starling-lm:7b 7B/Q4_0 Apple M4 32 GB 23.7
63
Good Compare
phi3:14b 14.0B/Q4_0 Apple M4 32 GB 12.7
63
Good Compare
codellama:7b 7B/Q4_0 Apple M4 32 GB 23.6
63
Good Compare
Qwen3-80B:80B 79.7B/Q4_K_M AMD Ryzen 9 9955HX3D 16-Core Processor 31 GB 4.9
62
Not Rec. Compare
hf.co/openbmb/MiniCPM5-1B-GGUF:F16 1.08B/F16 Apple M1 Pro 16 GB 88.0
62
Good Compare
qwen3-vl-4b-instruct-q4_k_m.gguf Apple M2 Max 96 GB 67.8
62
Good Compare
llama3.2:1b 1.2B/Q8_0 AMD Ryzen 9 8945HS 15 GB 170.2
62
Good Compare
qwen3.5-35b-a3b-uncensored-hauhaucs-aggressive Apple M2 Max 96 GB 67.9
62
Good Compare
qwen3-vl-4b-instruct-q4_k_m Apple M2 Max 96 GB 67.2
62
Good Compare
microsoft/phi-4-mini-reasoning 3.8B/4bit Apple M4 32 GB 40.3
62
Good Compare
qwen3.5-4b-mlx 4B/4bit Apple M4 Pro 64 GB 0.0
62
Not Rec. Compare
google/gemma-4-e4b Q4_K_M AMD Ryzen 7 5800H 16 GB 27.6
62
Good Compare
qwen3.5:0.8b 873.44M/Q8_0 Apple M1 Max 32 GB 65.8
62
Good Compare
qwen3.5:0.8b 873.44M/Q8_0 Apple M1 Max 32 GB 67.6
62
Good Compare
hf.co/openbmb/MiniCPM5-1B-GGUF:F16 1.08B/F16 Apple M1 Pro 16 GB 88.6
62
Good Compare
qwen3-vl:2b 2.1B/Q4_K_M AMD RYZEN AI MAX+ 395 125 GB 127.4
62
Good Compare
hf.co/ornith-ai/Ornith-1.0-9B-GGUF:Q4_K_M 8.95B/unknown Apple M1 Pro 16 GB 22.3
62
Good Compare
hf.co/openbmb/MiniCPM5-1B-GGUF:F16 1.08B/F16 Apple M1 Pro 16 GB 89.1
62
Good Compare
dolphin-phi:2.7b 3B/Q4_0 Apple M4 32 GB 56.1
61
Good Compare
qwen2.5-1.5b-instruct 1.5B/Q4_K_M Intel Core™ i5-5300U 16 GB 6.6
61
Good Compare
qwen2.5-coder-1.5b-instruct 1.5B/Q4_K_M Intel Core™ i5-5300U 16 GB 7.3
61
Good Compare
qwen3-235b-a22b-t48-c8k:latest 235.1B/Q4_K_M Intel Xeon® E5-4650 v2 256 GB 1.7
61
Not Rec. Compare
qwen3:0.6b 751.63M/Q4_K_M Intel Core™ i5-8350U 23 GB 27.0
61
Good Compare
qwen3.5:4b 4.7B/Q4_K_M Intel Core™ i5-6500 16 GB 35.7
61
Good Compare
qwen3:0.6b 751.63M/Q4_K_M Apple M4 32 GB 144.3
61
Good Compare
hf.co/LiquidAI/LFM2.5-2.6B-GGUF:F16 2.7B/unknown Apple M1 Pro 16 GB 31.4
61
Good Compare
hf.co/LiquidAI/LFM2.5-2.6B-GGUF:F16 2.7B/unknown Apple M1 Pro 16 GB 31.0
61
Good Compare
hf.co/ornith-ai/Ornith-1.0-9B-GGUF:Q4_K_M 8.95B/unknown Apple M1 Pro 16 GB 22.2
61
Good Compare
hf.co/LiquidAI/LFM2.5-2.6B-GGUF:F16 2.7B/unknown Apple M1 Pro 16 GB 31.3
61
Good Compare
deepseek-r1:1.5b 1.8B/Q4_K_M Cortex-A78AE 7 GB 34.6
60
Good Compare
qwen3.5-0.8b-mlx 0.8B/8bit Apple M4 32 GB 108.0
60
Good Compare
lfm2.5-thinking:1.2b 1.2B/Q4_K_M Apple M4 Pro 48 GB 227.0
60
Not Rec. Compare
qwen3.8-27b-mlx 27B/8bit Apple M5 Max 64 GB 18.3
59
Marginal Compare
text-embedding-nomic-embed-text-v1.5 Q4_K_M Apple M4 32 GB 45.3
59
Marginal Compare
vicuna:7b 7B/Q4_0 Apple M4 32 GB 23.4
59
Marginal Compare
vicuna:13b 13B/Q4_0 Apple M4 32 GB 13.4
59
Marginal Compare

499 benchmarks available