starcoder2:3b
starcoder2 · 3B · Q4_0
1 benchmark across different hardware
Avg Score
48 /100
48–48
Avg Speed
49.4 tok/s
49.4–49.4
Avg TTFT
155 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 48 | 49.4 | 155 ms | Marginal |