Back to leaderboard

spark-x2.5-4b

LM-STUDIO GGUF

spark2_5 · 4B · Q4_K_M

Good

Sep 30, 2026 · AMD Ryzen 7 4800H

google/gemma-4-12b-qat

LM-STUDIO GGUF

gemma4 · 12B · Q4_0

Excellent

Aug 19, 2026 · AMD Ryzen 7 9700X 8-Core Processor

Global Score
77 vs 92
Hardware Fit
90 vs 100
Quality Score
71 vs 89

Hardware

spark-x2.5-4b google/gemma-4-12b…
MachineASUSTeK COMPUTER INC. ROG Strix G513IM_G513IMMicro-Star International Co., Ltd. MS-7E51
CPUAMD Ryzen 7 4800HAMD Ryzen 7 9700X 8-Core Processor
Cores1616
RAM15 GB31 GB
GPUAMD Radeon(TM) Graphics, NVIDIA GeForce RTX 3060 Laptop GPUNVIDIA GeForce RTX 5080, AMD Radeon(TM) Graphics
OSMicrosoft Windows 11 Pro 10.0.26200Microsoft Windows 11 Pro 10.0.26200
Archx64x64
Power Modebalancedbalanced

Performance

spark-x2.5-4b google/gemma-4-12b…
Tokens/sec48.990.7
First chunk20 ms26 ms
TTFT168 ms127 ms
Load timeN/AN/A
Memory usage9.4 GB6.7 GB
Memory %61%21%

HW Fit Score Breakdown

spark-x2.5-4b

Speed
50/50
TTFT
20/20
Memory
20/30

google/gemma-4-12b-qat

Speed
50/50
TTFT
20/20
Memory
30/30

Quality

spark-x2.5-4b

Reasoning
13/20
Coding
14/20
Instruction
16/20
Structured
15/15
Math
4/15
Multilingual
9/10
Reasoning: Adequate Coding: Adequate Instruction Following: Strong Structured Output: Strong Math: Weak Multilingual: Strong

google/gemma-4-12b-qat

Reasoning
17/20
Coding
19/20
Instruction
18/20
Structured
15/15
Math
11/15
Multilingual
9/10
Reasoning: Strong Coding: Strong Instruction Following: Strong Structured Output: Strong Math: Adequate Multilingual: Strong

Run yours and compare

$ npm install -g metrillm@latest
$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest