Leaderboard
Real benchmarks from real hardware. Compare local LLM performance across different setups. Run the command below to contribute yours.
$
npm install -g metrillm@latest$
metrillmRequires Node 20+ and Ollama or LM Studio running
Or run without installing: npx metrillm@latest
Trending
Last 7 days- 1 qwen/qwen3.6-35b-a3b 2
- 2 qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex 1
- 3 qwen36-distill-apex 1
- 4 gemma4:latest 1
- 5 openai/gpt-oss-20b 1
- 1 MacBook Pro 5
- 2 Micro-Star International Co., Ltd. MS-7E47 1
- 1 Apple M5 Max 5
- 2 AMD Ryzen 9 9950X 16-Core Processor 1
Benchmarks
423
total runs
Models
262
unique models
Families
46
model families
Hardware
36
unique CPUs
Filters
423 results
| # | CPU | Model | Size | RAM | Runtime | tok/s | TTFT | HW Fit | Quality | Global | Flags | Verdict | ||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Apple M2 Max | qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx | 30B/MXFP4 | 96 GB | LM-STUDIOMLX | 79.6 | 1.7 s | 95 | 98 | 97 | THINK | Excellent | ||
| 2 | AMD RYZEN AI MAX+ 395 | nemotron3:33b | 33.0B/Q4_K_M | 125 GB | OLLAMAGGUF | 62.7 | 1.0 s | 95 | 97 | 96 | ECOTHINK | Excellent | ||
| 3 | Apple M4 Pro | gpt-oss-20b | — | 64 GB | LM-STUDIOGGUF | 118.2 | 2.2 s | 94 | 95 | 95 | THINK | Excellent | ||
| 4 | Apple M2 Max | qwen3-30b-a3b-thinking-2507-claude-4.5-sonnet-high-reasoning-distill-mlx | 30B/MXFP4 | 96 GB | LM-STUDIOMLX | 80.4 | 1.8 s | 94 | 96 | 95 | THINK | Excellent | ||
| 5 | Intel Core™ Ultra 9 285K | gpt-oss:20b | 20.9B/MXFP4 | 47 GB | OLLAMAGGUF | 239.9 | 616 ms | 98 | 94 | 95 | THINK | Excellent | ||
| 6 | Apple M4 | openai/gpt-oss-20b | 20B/MXFP4 | 24 GB | LM-STUDIOMLX | 29.3 | 1.8 s | 99 | 93 | 95 | THINK | Excellent | ||
| 7 | Cortex-X925 | gemma4:26b | 25.8B/Q4_K_M | 122 GB | OLLAMAGGUF | 67.4 | 529 ms | 100 | 92 | 94 | Excellent | |||
| 8 | Apple M4 Pro | gpt-oss:20b | 20.9B/MXFP4 | 48 GB | OLLAMAGGUF | 54.5 | 2.9 s | 92 | 95 | 94 | THINK | Excellent | ||
| 9 | Apple M4 | openai/gpt-oss-20b | 20B/MXFP4 | 32 GB | LM-STUDIOMLX | 40.7 | 1.3 s | 100 | 92 | 94 | THINK | Excellent | ||
| 10 | Apple M4 | qwen/qwen3-30b-a3b-2507 | 30B/4bit | 32 GB | LM-STUDIOMLX | 44.8 | 405 ms | 100 | 91 | 94 | Excellent | |||
| 11 | AMD RYZEN AI MAX+ 395 | gpt-oss:20b | 20.9B/MXFP4 | 64 GB | OLLAMAGGUF | 48.0 | 2.3 s | 91 | 95 | 94 | THINK | Excellent | ||
| 12 | Cortex-X925 | gpt-oss:20b | 20.9B/MXFP4 | 122 GB | OLLAMAGGUF | 60.5 | 3.1 s | 87 | 95 | 93 | THINK | Excellent | ||
| 13 | Apple M4 Pro | nemotron-3-nano | — | 64 GB | LM-STUDIOGGUF | 93.3 | 257 ms | 100 | 90 | 93 | THINK | Excellent | ||
| 14 | AMD Ryzen 7 7800X3D 8-Core Processor | gemma-4-26b-a4b-it-qat | 26B/Q4_K_XL | 31 GB | LM-STUDIOGGUF | 166.9 | 113 ms | 93 | 93 | 93 | ECO | Excellent | ||
| 15 | AMD Ryzen 7 7800X3D 8-Core Processor | gemma-4-26b-a4b-it-qat | 26B/Q4_K_XL | 31 GB | LM-STUDIOGGUF | 156.0 | 109 ms | 93 | 93 | 93 | ECO | Excellent | ||
| 16 | AMD RYZEN AI MAX+ 395 | gpt-oss:20b | 20.9B/MXFP4 | 125 GB | OLLAMAGGUF | 47.1 | 1.8 s | 85 | 96 | 93 | ECOTHINK | Excellent | ||
| 17 | AMD Ryzen 5 5500 | qwen/qwen3-vl-30b | 30B/Q4_K_M | 31 GB | LM-STUDIOGGUF | 24.8 | 735 ms | 95 | 90 | 92 | Excellent | |||
| 18 | AMD Ryzen 5 5600X 6-Core Processor | qwen3.6-35b-a3b-claude-4.7-opus-reasoning-distilled-apex-mtp | 35B | 47 GB | LM-STUDIOGGUF | 42.6 | 3.1 s | 87 | 94 | 92 | ECOTHINK | Excellent | ||
| 19 | Cortex-X925 | gpt-oss:20b | 20.9B/MXFP4 | 122 GB | OLLAMAGGUF | 60.7 | 3.2 s | 86 | 95 | 92 | THINK | Excellent | ||
| 20 | Apple M2 Pro | gemma4:12b-mlx | — | 16 GB | OLLAMAGGUF | 24.7 | 610 ms | 96 | 89 | 91 | Excellent |
...
Don't miss new benchmarks
Get notified when new models and hardware configurations are tested. No spam, unsubscribe anytime.