llama3.1:8b
llama · 8.0B · Q4_K_M
3 benchmarks across different hardware
Avg Score
64 /100
46–75
Avg Speed
16.6 tok/s
7.8–21.5
Avg TTFT
769 ms
Benchmarks
3
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 75 | 20.3 | 315 ms | Good |
| Apple M1 Pro (MacBook Pro) | 16 GB | 72 | 21.5 | 368 ms | Good |
| Cortex-A78AE (NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super) | 7 GB | 46 | 7.8 | 1.6s | Marginal |