gemma3n:latest

OLLAMA GGUF

gemma3n · 6.9B · Q4_K_M

Excellent

Mar 6, 2026 · AMD EPYC 9654P 96-Core Processor

slim-rpcache-ornith-1.0-9b

LM-STUDIO GGUF

qwen35 · 9B · BF16

Good

Jul 4, 2026 · AMD Ryzen 7 7800X3D 8-Core Processor

Global Score

81 vs 79

Hardware Fit

100 vs 78

Quality Score

73 vs 79

Hardware

gemma3n:latest slim-rpcache-ornit…

MachineSupermicro AS -2015HS-TNRASUS

CPUAMD EPYC 9654P 96-Core ProcessorAMD Ryzen 7 7800X3D 8-Core Processor

Cores6416

RAM128 GB31 GB

GPUGH100 [H100L 94GB], ASPEED Graphics Family, GH100 [H100L 94GB]NVIDIA GeForce RTX 4090, Raphael

OSUbuntu 24.04.3 LTScachyos rolling

Archx64x64

Power Modeperformanceperformance

Performance

gemma3n:latest slim-rpcache-ornit…

Tokens/sec108.752.3

First chunk333 ms11 ms

TTFT333 ms177 ms

Load time4.5 sN/A

Memory usage8.6 GB25.6 GB

Memory %7%84%

HW Fit Score Breakdown

gemma3n:latest

Speed

50/50

TTFT

20/20

Memory

30/30

slim-rpcache-ornith-1.0…

Speed

50/50

TTFT

20/20

Memory

8/30

Quality

gemma3n:latest

Reasoning

14/20

Coding

14/20

Instruction

14/20

Structured

14/15

Math

7/15

Multilingual

10/10

Reasoning: Adequate Coding: Adequate Instruction Following: Adequate Structured Output: Strong Math: Weak Multilingual: Strong

slim-rpcache-ornith-1.0…

Reasoning

16/20

Coding

16/20

Instruction

14/20

Structured

14/15

Math

9/15

Multilingual

10/10

Reasoning: Strong Coding: Strong Instruction Following: Adequate Structured Output: Strong Math: Adequate Multilingual: Strong

View gemma3n:latest details | View slim-rpcache-ornit… details

Run yours and compare

$ npm install -g metrillm@latest

$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest