llama3:latest

llama · 8.0B · Q4_0

2 benchmarks across different hardware

Avg Score
71 /100
68–74
Avg Speed
21.8 tok/s
21.4–22.3
Avg TTFT
296 ms
Benchmarks
2
Hardware RAM Score tok/s TTFT Verdict
Apple M4 (MacBook Air) 32 GB 74 22.3 295 ms Good
Apple M4 (MacBook Air) 32 GB 68 21.4 297 ms Good