llama3.1:8b
llama · 8.0B · Q4_K_M
4 benchmarks across different hardware
Avg Score
69 /100
46–81
Avg Speed
30 tok/s
7.8–70.2
Avg TTFT
592 ms
Benchmarks
4
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Intel Core™ i5-14400F (Gigabyte Technology Co., Ltd. B760 AORUS ELITE AX DDR4) | 32 GB | 81 | 70.2 | 58 ms | Excellent |
| Apple M4 (MacBook Air) | 32 GB | 75 | 20.3 | 315 ms | Good |
| Apple M1 Pro (MacBook Pro) | 16 GB | 72 | 21.5 | 368 ms | Good |
| Cortex-A78AE (NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super) | 7 GB | 46 | 7.8 | 1.6s | Marginal |