phi-3-mini-128k-instruct
phi3 · 4bit
1 benchmark across different hardware
Avg Score
38 /100
38–38
Avg Speed
44 tok/s
44–44
Avg TTFT
385 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 38 | 44.0 | 385 ms | Not Rec. |