AMD EPYC 9654P 96-Core Processor
Supermicro AS -2015HS-TNR
128 GB RAM · 1 model tested
Avg Score
81 /100
Avg Speed
108.7 tok/s
Models Tested
1
| Model | Size | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| gemma3n:latest | 6.9B Q4_K_M | 81 | 108.7 | 333 ms | Excellent |
Supermicro AS -2015HS-TNR
128 GB RAM · 1 model tested
| Model | Size | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| gemma3n:latest | 6.9B Q4_K_M | 81 | 108.7 | 333 ms | Excellent |