llama3.1:8b
llama · 8.0B · Q4_K_M
2 benchmarks across different hardware
Avg Score
61 /100
46–75
Avg Speed
14.1 tok/s
7.8–20.3
Avg TTFT
970 ms
Benchmarks
2
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 75 | 20.3 | 315 ms | Good |
| Cortex-A78AE (NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super) | 7 GB | 46 | 7.8 | 1.6s | Marginal |