Back to leaderboard

gpt-oss:20b

OLLAMA GGUF

gptoss · 20.9B · MXFP4

Excellent

Mar 5, 2026 · Intel Core™ Ultra 9 285K

google/gemma-4-12b-qat

LM-STUDIO GGUF

gemma4 · 12B · Q4_0

Excellent

Aug 19, 2026 · AMD Ryzen 7 9700X 8-Core Processor

Global Score
95 vs 92
Hardware Fit
98 vs 100
Quality Score
94 vs 89

Hardware

gpt-oss:20b google/gemma-4-12b…
MachineASUSMicro-Star International Co., Ltd. MS-7E51
CPUIntel Core™ Ultra 9 285KAMD Ryzen 7 9700X 8-Core Processor
Cores2416
RAM47 GB31 GB
GPUNVIDIA GeForce RTX 5090, Intel(R) GraphicsNVIDIA GeForce RTX 5080, AMD Radeon(TM) Graphics
OSMicrosoft Windows 11 Pro 10.0.26200Microsoft Windows 11 Pro 10.0.26200
Archx64x64
Power Modebalancedbalanced

Performance

gpt-oss:20b google/gemma-4-12b…
Tokens/sec239.990.7
First chunk180 ms26 ms
TTFT616 ms127 ms
Load time4.3 sN/A
Memory usage13.9 GB6.7 GB
Memory %29%21%

HW Fit Score Breakdown

gpt-oss:20b

Speed
50/50
TTFT
20/20
Memory
28/30

google/gemma-4-12b-qat

Speed
50/50
TTFT
20/20
Memory
30/30

Quality

gpt-oss:20b

Reasoning
19/20
Coding
19/20
Instruction
17/20
Structured
14/15
Math
15/15
Multilingual
10/10
Reasoning: Strong Coding: Strong Instruction Following: Strong Structured Output: Strong Math: Strong Multilingual: Strong

google/gemma-4-12b-qat

Reasoning
17/20
Coding
19/20
Instruction
18/20
Structured
15/15
Math
11/15
Multilingual
9/10
Reasoning: Strong Coding: Strong Instruction Following: Strong Structured Output: Strong Math: Adequate Multilingual: Strong
View gpt-oss:20b details | View google/gemma-4-12b… details

Run yours and compare

$ npm install -g metrillm@latest
$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest