mlx-community/meta-llama-3.1-8b-instruct
llama · 8B · 4bit
1 benchmark across different hardware
Avg Score
77 /100
77–77
Avg Speed
54.3 tok/s
54.3–54.3
Avg TTFT
277 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 Pro (Mac mini) | 64 GB | 77 | 54.3 | 277 ms | Good |