starcoder2:3b
starcoder2 · 3B · Q4_0
2 benchmarks across different hardware
Avg Score
37 /100
35–39
Avg Speed
40.5 tok/s
31.5–49.4
Avg TTFT
274 ms
Benchmarks
2
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 39 | 49.4 | 155 ms | Not Rec. |
| Cortex-A78AE (NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super) | 7 GB | 35 | 31.5 | 392 ms | Not Rec. |