qwen2.5-coder:3b

qwen2 · 3.1B · Q4_K_M

1 benchmark across different hardware

Avg Score
73 /100
73–73
Avg Speed
21.3 tok/s
21.3–21.3
Avg TTFT
969 ms
Benchmarks
1
Hardware RAM Score tok/s TTFT Verdict
Cortex-A78AE (NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super) 7 GB 73 21.3 969 ms Good