nemotron-3.5-bolt:74b-a9b-iq2

OLLAMA GGUF

nemotron_h_moe · 74.0B · IQ2_XXS

Excellent

Oct 16, 2026 · AMD RYZEN AI MAX+ 395

slim-rpcache-ornith-1.0-9b

LM-STUDIO GGUF

qwen35 · 9B · BF16

Good

Jul 4, 2026 · AMD Ryzen 7 7800X3D 8-Core Processor

Global Score

90 vs 79

Hardware Fit

96 vs 78

Quality Score

87 vs 79

Hardware

nemotron-3.5-bolt:… slim-rpcache-ornit…

MachineAZW GTR ProASUS

CPUAMD RYZEN AI MAX+ 395AMD Ryzen 7 7800X3D 8-Core Processor

Cores3216

RAM125 GB31 GB

GPURadeon 8060SNVIDIA GeForce RTX 4090, Raphael

OSUbuntu 24.04.5 LTScachyos rolling

Archx64x64

Power Modeperformanceperformance

Performance

nemotron-3.5-bolt:… slim-rpcache-ornit…

Tokens/sec49.952.3

First chunk370 ms11 ms

TTFT370 ms177 ms

Load time7.6 sN/A

Memory usage3.9 GB25.6 GB

Memory %3%84%

HW Fit Score Breakdown

nemotron-3.5-bolt:74b-a…

Speed

46/50

TTFT

20/20

Memory

30/30

slim-rpcache-ornith-1.0…

Speed

50/50

TTFT

20/20

Memory

8/30

Quality

nemotron-3.5-bolt:74b-a…

Reasoning

15/20

Coding

18/20

Instruction

16/20

Structured

15/15

Math

13/15

Multilingual

10/10

Reasoning: Strong Coding: Strong Instruction Following: Strong Structured Output: Strong Math: Strong Multilingual: Strong

slim-rpcache-ornith-1.0…

Reasoning

16/20

Coding

16/20

Instruction

14/20

Structured

14/15

Math

9/15

Multilingual

10/10

Reasoning: Strong Coding: Strong Instruction Following: Adequate Structured Output: Strong Math: Adequate Multilingual: Strong

View nemotron-3.5-bolt:… details | View slim-rpcache-ornit… details

Run yours and compare

$ npm install -g metrillm@latest

$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest