qwen2.5:7b

qwen2 · 7.6B · Q4_K_M

2 benchmarks across different hardware

Avg Score
80 /100
74–85
Avg Speed
21.3 tok/s
20.5–22.2
Avg TTFT
290 ms
Benchmarks
2
Hardware RAM Score tok/s TTFT Verdict
Apple M4 (MacBook Air) 32 GB 85 22.2 285 ms Excellent
Apple M4 (MacBook Air) 32 GB 74 20.5 295 ms Good