mistral:7b

llama · 7.2B · Q4_K_M

2 benchmarks across different hardware

Avg Score
68 /100
61–75
Avg Speed
17.8 tok/s
13.6–22
Avg TTFT
389 ms
Benchmarks
2
Hardware RAM Score tok/s TTFT Verdict
Apple M4 (MacBook Air) 32 GB 75 22.0 261 ms Good
Apple M4 (MacBook Air) 32 GB 61 13.6 517 ms Good