qwen2.5:3b
qwen2 · 3.1B · Q4_K_M
2 benchmarks across different hardware
Avg Score
77 /100
77–77
Avg Speed
34.3 tok/s
21.4–47.2
Avg TTFT
587 ms
Benchmarks
2
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Cortex-A78AE (NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super) | 7 GB | 77 | 21.4 | 1.0s | Good |
| Apple M4 (MacBook Air) | 32 GB | 77 | 47.2 | 168 ms | Good |