gemma4:26b

OLLAMA GGUF

gemma4 · 25.8B · Q4_K_M

Not Rec.

Apr 3, 2026 · Apple M4

mistral-small:24b

OLLAMA GGUF

llama · 23.6B · Q4_K_M

Good

Jun 26, 2026 · Cortex-X925

Global Score

33 vs 75

Hardware Fit

50 vs 64

Quality Score

25 vs 80

Hardware

gemma4:26b mistral-small:24b

MachineMac miniNVIDIA NVIDIA_DGX_Spark

CPUApple M4Cortex-X925

Cores1020

RAM24 GB122 GB

GPUApple M4Device 2e12

OSmacOS 26.3Ubuntu 24.04.4 LTS

Archarm64arm64

Power Modebalancedperformance

Performance

gemma4:26b mistral-small:24b

Tokens/sec20.014.3

First chunk941 ms327 ms

TTFT30.0 s327 ms

Load time0.2 s12.0 s

Memory usage20.3 GB18.5 GB

Memory %85%15%

HW Fit Score Breakdown

gemma4:26b

Speed

42/50

TTFT

0/20

Memory

8/30

mistral-small:24b

Speed

14/50

TTFT

20/20

Memory

30/30

Quality

gemma4:26b

Reasoning

14/20

Coding

1/20

Instruction

6/20

Structured

3/15

Math

0/15

Multilingual

1/10

Reasoning: Adequate Coding: Poor Instruction Following: Weak Structured Output: Poor Math: Poor Multilingual: Poor

mistral-small:24b

Reasoning

16/20

Coding

18/20

Instruction

14/20

Structured

13/15

Math

9/15

Multilingual

10/10

Reasoning: Strong Coding: Strong Instruction Following: Adequate Structured Output: Strong Math: Adequate Multilingual: Strong

View gemma4:26b details | View mistral-small:24b details

Run yours and compare

$ npm install -g metrillm@latest

$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest