Back to leaderboard

llama3.3:70b-instruct-q4_K_M

OLLAMA GGUF

llama · 70.6B · Q4_K_M

Not Rec.

Aug 20, 2026 · Intel Xeon® E5-2637 v3

prism-ml/bonsai-27b

LM-STUDIO GGUF

qwen35 · 27B · Q1_0

Excellent

Sep 20, 2026 · AMD Ryzen 9 8940HX

Global Score
51 vs 81
Hardware Fit
31 vs 95
Quality Score
60 vs 75

Hardware

llama3.3:70b-instr… prism-ml/bonsai-27b
MachineDell Inc. Precision Tower 7910ASUSTeK COMPUTER INC. ROG Strix G16 G614PH_G614PH
CPUIntel Xeon® E5-2637 v3AMD Ryzen 9 8940HX
Cores1632
RAM96 GB15 GB
GPUNVIDIA GeForce RTX 3090, NVIDIA GeForce RTX 3060NVIDIA GeForce RTX 5050 Laptop GPU, AMD Radeon(TM) 610M
OSMicrosoft Windows 10 Pro 10.0.19045Microsoft Windows 11 Home Single Language 10.0.26200
Archx64x64
Power Modebalancedbalanced

Performance

llama3.3:70b-instr… prism-ml/bonsai-27b
Tokens/sec1.733.6
First chunk5553 ms20 ms
TTFT5.6 s409 ms
Load time0.4 sN/A
Memory usage50.3 GB5.3 GB
Memory %53%35%

HW Fit Score Breakdown

llama3.3:70b-instruct-q…

Speed
2/50
TTFT
5/20
Memory
24/30

prism-ml/bonsai-27b

Speed
46/50
TTFT
20/20
Memory
29/30

Quality

llama3.3:70b-instruct-q…

Reasoning
17/20
Coding
6/20
Instruction
6/20
Structured
11/15
Math
11/15
Multilingual
9/10
Reasoning: Strong Coding: Weak Instruction Following: Weak Structured Output: Adequate Math: Adequate Multilingual: Strong

prism-ml/bonsai-27b

Reasoning
17/20
Coding
13/20
Instruction
13/20
Structured
15/15
Math
8/15
Multilingual
9/10
Reasoning: Strong Coding: Adequate Instruction Following: Adequate Structured Output: Strong Math: Adequate Multilingual: Strong

Run yours and compare

$ npm install -g metrillm@latest
$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest