slim-rpcache-ornith-1.0-9b

LM-STUDIO GGUF

qwen35 · 9B · BF16

Good

Jul 4, 2026 · AMD Ryzen 7 7800X3D 8-Core Processor

gemma3n:latest

OLLAMA GGUF

gemma3n · 6.9B · Q4_K_M

Excellent

Mar 6, 2026 · AMD EPYC 9654P 96-Core Processor

Global Score

79 vs 81

Hardware Fit

78 vs 100

Quality Score

79 vs 73

Hardware

slim-rpcache-ornit… gemma3n:latest

MachineASUSSupermicro AS -2015HS-TNR

CPUAMD Ryzen 7 7800X3D 8-Core ProcessorAMD EPYC 9654P 96-Core Processor

Cores1664

RAM31 GB128 GB

GPUNVIDIA GeForce RTX 4090, RaphaelGH100 [H100L 94GB], ASPEED Graphics Family, GH100 [H100L 94GB]

OScachyos rollingUbuntu 24.04.3 LTS

Archx64x64

Power Modeperformanceperformance

Performance

slim-rpcache-ornit… gemma3n:latest

Tokens/sec52.3108.7

First chunk11 ms333 ms

TTFT177 ms333 ms

Load timeN/A4.5 s

Memory usage25.6 GB8.6 GB

Memory %84%7%

HW Fit Score Breakdown

slim-rpcache-ornith-1.0…

Speed

50/50

TTFT

20/20

Memory

8/30

gemma3n:latest

Speed

50/50

TTFT

20/20

Memory

30/30

Quality

slim-rpcache-ornith-1.0…

Reasoning

16/20

Coding

16/20

Instruction

14/20

Structured

14/15

Math

9/15

Multilingual

10/10

Reasoning: Strong Coding: Strong Instruction Following: Adequate Structured Output: Strong Math: Adequate Multilingual: Strong

gemma3n:latest

Reasoning

14/20

Coding

14/20

Instruction

14/20

Structured

14/15

Math

7/15

Multilingual

10/10

Reasoning: Adequate Coding: Adequate Instruction Following: Adequate Structured Output: Strong Math: Weak Multilingual: Strong

View slim-rpcache-ornit… details | View gemma3n:latest details

Run yours and compare

$ npm install -g metrillm@latest

$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest