mlx-community/Llama-3.2-3B-Instruct-4bit
1 benchmark across different hardware
Avg Score
74 /100
74–74
Avg Speed
50.6 tok/s
50.6–50.6
Avg TTFT
257 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 74 | 50.6 | 257 ms | Good |