mistral:latest
llama · 7.2B · Q4_K_M
3 benchmarks across different hardware
Avg Score
73 /100
72–73
Avg Speed
36.2 tok/s
22.5–54.3
Avg TTFT
161 ms
Benchmarks
3
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 73 | 22.5 | 257 ms | Good |
| AMD Ryzen 5 2600X Six-Core Processor (Micro-Star International Co., Ltd. MS-7B79) | 16 GB | 73 | 31.7 | 102 ms | Good |
| Apple M4 Pro (Mac Mini) | 64 GB | 72 | 54.3 | 124 ms | Good |