Back to leaderboard

Nemotron-3-Nano-Omni-30B-A3B-Reasoning-Q4_K_M:latest

OLLAMA GGUF

nemotron_h_moe · 31.6B · Q4_K_M

Excellent

Aug 19, 2026 · AMD Ryzen 7 9700X 8-Core Processor

huihui-devstral-small-2-24b-instruct-2512-abliterated-i1

LM-STUDIO GGUF

mistral3 · 24B · Q4_K_S

Good

Sep 19, 2026 · AMD Ryzen 7 5800X 8-Core Processor

Global Score
81 vs 78
Hardware Fit
78 vs 74
Quality Score
82 vs 79

Hardware

Nemotron-3-Nano-Om… huihui-devstral-sm…
MachineMicro-Star International Co., Ltd. MS-7E51System manufacturer
CPUAMD Ryzen 7 9700X 8-Core ProcessorAMD Ryzen 7 5800X 8-Core Processor
Cores1616
RAM31 GB32 GB
GPUNVIDIA GeForce RTX 5080, AMD Radeon(TM) GraphicsAMD Radeon RX 9060 XT
OSMicrosoft Windows 11 Pro 10.0.26200Microsoft Windows 11 Home 10.0.26200
Archx64x64
Power Modebalancedbalanced

Performance

Nemotron-3-Nano-Om… huihui-devstral-sm…
Tokens/sec56.817.5
First chunk421 ms20 ms
TTFT421 ms279 ms
Load time0.1 sN/A
Memory usage26.0 GB15.6 GB
Memory %84%49%

HW Fit Score Breakdown

Nemotron-3-Nano-Omni-30…

Speed
50/50
TTFT
20/20
Memory
8/30

huihui-devstral-small-2…

Speed
29/50
TTFT
20/20
Memory
25/30

Quality

Nemotron-3-Nano-Omni-30…

Reasoning
14/20
Coding
18/20
Instruction
16/20
Structured
15/15
Math
10/15
Multilingual
9/10
Reasoning: Adequate Coding: Strong Instruction Following: Strong Structured Output: Strong Math: Adequate Multilingual: Strong

huihui-devstral-small-2…

Reasoning
16/20
Coding
17/20
Instruction
15/20
Structured
14/15
Math
7/15
Multilingual
10/10
Reasoning: Strong Coding: Strong Instruction Following: Strong Structured Output: Strong Math: Weak Multilingual: Strong

Run yours and compare

$ npm install -g metrillm@latest
$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest