richardyoung/qwythos-9b-abliterated:Q8_0
OLLAMA GGUFqwen35 · 9.0B · Q8_0
Jun 28, 2026 · Apple M4 Pro
llama-3.1-8b-instruct
LM-STUDIO GGUFllama · 8B · Q8_0
Apr 26, 2026 · AMD Ryzen 5 5500
Global Score
65 vs 81
Hardware Fit
96 vs 100
Quality Score
52 vs 73
Hardware
richardyoung/qwyth… llama-3.1-8b-instr…
MachineMac miniASUS
CPUApple M4 ProAMD Ryzen 5 5500
Cores1212
RAM24 GB31 GB
GPUApple M4 ProNavi 44 [Radeon RX 9060 XT]
OSmacOS 15.6.1Nobara Linux 43
Archarm64x64
Power Modebalancedperformance
Performance
richardyoung/qwyth… llama-3.1-8b-instr…
Tokens/sec25.335.6
First chunk397 ms52 ms
TTFT397 ms256 ms
Load time6.3 sN/A
Memory usage8.3 GB8.6 GB
Memory %34%28%
HW Fit Score Breakdown
richardyoung/qwythos-9b…
Speed
47/50
TTFT
20/20
Memory
29/30
llama-3.1-8b-instruct
Speed
50/50
TTFT
20/20
Memory
30/30
Quality
richardyoung/qwythos-9b…
Reasoning
18/20
Coding
13/20
Instruction
6/20
Structured
0/15
Math
14/15
Multilingual
1/10
Reasoning: Strong Coding: Adequate Instruction Following: Weak Structured Output: Poor Math: Strong Multilingual: Poor
llama-3.1-8b-instruct
Reasoning
13/20
Coding
17/20
Instruction
13/20
Structured
15/15
Math
5/15
Multilingual
10/10
Reasoning: Adequate Coding: Strong Instruction Following: Adequate Structured Output: Strong Math: Weak Multilingual: Strong
Run yours and compare
$
npm install -g metrillm@latest$
metrillmRequires Node 20+ and Ollama or LM Studio running
Or run without installing: npx metrillm@latest