mistral:7b

llama · 7.2B · Q4_K_M

2 benchmarks across different hardware

Avg Score
71 /100
70–72
Avg Speed
22.2 tok/s
22–22.5
Avg TTFT
257 ms
Benchmarks
2
Hardware RAM Score tok/s TTFT Verdict
Apple M4 (MacBook Air) 32 GB 72 22.0 261 ms Good
Apple M4 (MacBook Air) 32 GB 70 22.5 252 ms Good