gemma3:270m

gemma3 · 268.10M · Q8_0

MacBook Pro (Apple M3 Pro)

36 GB · macOS 15.7.5

Tested on March 5, 2026
Top 81% Compare
Global Score
50 /100
Marginal
Hardware Fit
97/100
Quality
30/100

Get this model

Hardware

Machine
MacBook Pro
CPU
Apple M3 Pro
Cores
12 total (6 perf + 6 eff)
Frequency
2.4 GHz
RAM
36 GB LPDDR5
GPU
Apple M3 Pro
OS
macOS 15.7.5
Arch
arm64
Power Mode
balanced

Performance

Tokens/sec
239.2
Standard deviation
±12.1
First chunk latency
127 ms
Time to first token
127 ms
Load time
0.7 s
Memory usage
0.6 GB (2%)
Total tokens
814

Score breakdown

Speed
50/50
Time to first token
20/20
Memory
27/30

Quality

Reasoning
4/20
Coding
2/20
Instruction following
10/20
Structured output
8/15
Math
1/15
Multilingual
5/10

Category levels

Reasoning: Poor Coding: Poor Instruction Following: Adequate Structured Output: Adequate Math: Poor Multilingual: Weak

Metadata

Spec version
0.2.1
Runtime
Ollama 0.17.6
Model format
GGUF
Hardware profile
BALANCED
Result hash
40f3aaec2c4d0d65447b84d41514428e68a486ac2e565d95c1dff279512089a8

Interpretation

Hardware fit: 97/100. Overall suitability: MARGINAL (Global 50/100). Category profile: Reasoning: Poor, Coding: Poor, Instruction Following: Adequate, Structured Output: Adequate, Math: Poor, Multilingual: Weak.

Bench Environment

Power: AC CPU load: avg 16% (peak 21%)

Run yours now

$ npm install -g metrillm@latest
$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest