phi-3.5-mini-instruct
phi3 · 4bit
1 benchmark across different hardware
Avg Score
55 /100
55–55
Avg Speed
43.4 tok/s
43.4–43.4
Avg TTFT
359 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 55 | 43.4 | 359 ms | Marginal |