qwen2.5-7b-instruct

qwen2 · 7B · 4bit

2 benchmarks across different hardware

Avg Score
83 /100
82–84
Avg Speed
23.2 tok/s
22–24.4
Avg TTFT
471 ms
Benchmarks
2
Hardware RAM Score tok/s TTFT Verdict
Apple M4 (MacBook Air) 32 GB 84 24.4 464 ms Excellent
Apple M4 (MacBook Air) 32 GB 82 22.0 477 ms Excellent