gemma2:9b

gemma2 · 9.2B · Q4_0

2 benchmarks across different hardware

Avg Score
74 /100
69–78
Avg Speed
17.2 tok/s
16.8–17.5
Avg TTFT
360 ms
Benchmarks
2
Hardware RAM Score tok/s TTFT Verdict
Apple M4 (MacBook Air) 32 GB 78 17.5 347 ms Good
Apple M4 (MacBook Air) 32 GB 69 16.8 372 ms Good