gemma3n:latest
gemma3n · 6.9B · Q4_K_M
1 benchmark across different hardware
Avg Score
81 /100
81–81
Avg Speed
108.7 tok/s
108.7–108.7
Avg TTFT
333 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| AMD EPYC 9654P 96-Core Processor (Supermicro AS -2015HS-TNR) | 128 GB | 81 | 108.7 | 333 ms | Excellent |