starcoder2:7b
starcoder2 · 7B · Q4_0
1 benchmark across different hardware
Avg Score
44 /100
44–44
Avg Speed
23.8 tok/s
23.8–23.8
Avg TTFT
251 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 44 | 23.8 | 251 ms | Marginal |