Leaderboard
Real benchmarks from real hardware. Compare local LLM performance across different setups. Run the command below to contribute yours.
$
npm install -g metrillm@latest$
metrillmRequires Node 20+ and Ollama or LM Studio running
Or run without installing: npx metrillm@latest
Trending
Last 30 days- 1 qwen3.8-27b-uncensored-hauhaucs-aggressive-mtp 2
- 2 google/gemma-4-e4b 2
- 3 qwen3.8-27b-uncensored-ymq-mtp 1
- 4 gemma4:e4b 1
- 5 qwen3.5:35b 1
- 1 Gigabyte Technology Co., Ltd. B760 AORUS ELITE AX DDR4 17
- 2 System manufacturer 11
- 3 NVIDIA NVIDIA_DGX_Spark 7
- 4 ASUSTeK COMPUTER INC. ROG Strix G513IM_G513IM 3
- 5 ASUSTeK COMPUTER INC. ROG Strix G16 G614PH_G614PH 2
- 1 Intel Core™ i5-14400F 17
- 2 AMD Ryzen 7 5800X 8-Core Processor 8
- 3 Cortex-X925 7
- 4 AMD Ryzen 7 4800H 3
- 5 AMD Ryzen 9 5950X 16-Core Processor 3
Benchmarks
500
total runs
Models
287
unique models
Families
44
model families
Hardware
52
unique CPUs
Filters
500 results
| # | CPU | Model | Size | RAM | Runtime | tok/s | TTFT | HW Fit | Quality | Global | Flags | Verdict | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Apple M2 Max | qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx | 30B/MXFP4 | 96 GB | LM-STUDIOMLX | 79.6 | 1.7 s | 95 | 98 | 97 | THINK | Excellent | ||
| 2 | Apple M4 Max | qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx | 30B/MXFP4 | 128 GB | LM-STUDIOMLX | 112.8 | 1.5 s | 95 | 96 | 96 | THINK | Excellent | ||
| 3 | AMD RYZEN AI MAX+ 395 | nemotron3:33b | 33.0B/Q4_K_M | 125 GB | OLLAMAGGUF | 62.7 | 1.0 s | 95 | 97 | 96 | ECOTHINK | Excellent | ||
| 4 | Apple M4 Pro | gpt-oss-20b | — | 64 GB | LM-STUDIOGGUF | 118.2 | 2.2 s | 94 | 95 | 95 | THINK | Excellent | ||
| 5 | Apple M2 Max | qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx | 30B/MXFP4 | 96 GB | LM-STUDIOMLX | 80.4 | 1.8 s | 94 | 96 | 95 | THINK | Excellent | ||
| 6 | Intel Core™ Ultra 9 285K | gpt-oss:20b | 20.9B/MXFP4 | 47 GB | OLLAMAGGUF | 239.9 | 616 ms | 98 | 94 | 95 | THINK | Excellent | ||
| 7 | Apple M4 | openai/gpt-oss-20b | 20B/MXFP4 | 24 GB | LM-STUDIOMLX | 29.3 | 1.8 s | 99 | 93 | 95 | THINK | Excellent | ||
| 8 | Cortex-X925 | gemma4:26b | 25.8B/Q4_K_M | 122 GB | OLLAMAGGUF | 67.4 | 529 ms | 100 | 92 | 94 | Excellent | |||
| 9 | Intel Xeon® E5-2637 v3 | qwen3-30b-a3b-t16-c32k-instruct:latest | 30.5B/Q4_K_M | 96 GB | OLLAMAGGUF | 116.0 | 575 ms | 100 | 91 | 94 | Excellent | |||
| 10 | Intel Core™ i7-14700F | GPT-20B:20b | 20.9B/MXFP4 | 64 GB | OLLAMAGGUF | 181.0 | 1.3 s | 96 | 93 | 94 | THINK | Excellent | ||
| 11 | Apple M4 Pro | gpt-oss:20b | 20.9B/MXFP4 | 48 GB | OLLAMAGGUF | 54.5 | 2.9 s | 92 | 95 | 94 | THINK | Excellent | ||
| 12 | Apple M4 | openai/gpt-oss-20b | 20B/MXFP4 | 32 GB | LM-STUDIOMLX | 40.7 | 1.3 s | 100 | 92 | 94 | THINK | Excellent | ||
| 13 | Apple M4 | qwen/qwen3-30b-a3b-2507 | 30B/4bit | 32 GB | LM-STUDIOMLX | 44.8 | 405 ms | 100 | 91 | 94 | Excellent | |||
| 14 | AMD RYZEN AI MAX+ 395 | gpt-oss:20b | 20.9B/MXFP4 | 64 GB | OLLAMAGGUF | 48.0 | 2.3 s | 91 | 95 | 94 | THINK | Excellent | ||
| 15 | Intel Core™ i5-14400F | gpt-oss:20b | 20.9B/MXFP4 | 32 GB | OLLAMAGGUF | 80.4 | 1.6 s | 97 | 93 | 94 | THINK | Excellent | ||
| 16 | Cortex-X925 | gpt-oss:20b | 20.9B/MXFP4 | 122 GB | OLLAMAGGUF | 60.5 | 3.1 s | 87 | 95 | 93 | THINK | Excellent | ||
| 17 | Apple M4 Pro | nemotron-3-nano | — | 64 GB | LM-STUDIOGGUF | 93.3 | 257 ms | 100 | 90 | 93 | THINK | Excellent | ||
| 18 | AMD Ryzen 7 9700X 8-Core Processor | google/gemma-4-26b-a4b-qat | 26B/Q4_0 | 31 GB | LM-STUDIOGGUF | 109.7 | 156 ms | 96 | 92 | 93 | Excellent | |||
| 19 | Intel Core™ i7-14700F | GPT-OSS-20B:20b | 20.9B/MXFP4 | 128 GB | OLLAMAGGUF | 178.6 | 1.4 s | 92 | 93 | 93 | THINK | Excellent | ||
| 20 | AMD Ryzen 7 7800X3D 8-Core Processor | gemma-4-26b-a4b-it-qat | 26B/Q4_K_XL | 31 GB | LM-STUDIOGGUF | 166.9 | 113 ms | 93 | 93 | 93 | ECO | Excellent |
...
Don't miss new benchmarks
Get notified when new models and hardware configurations are tested. No spam, unsubscribe anytime.