orca-mini:7b
llama · 7B · Q4_0
1 benchmark across different hardware
Avg Score
55 /100
55–55
Avg Speed
24.4 tok/s
24.4–24.4
Avg TTFT
219 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 55 | 24.4 | 219 ms | Marginal |