llama-3.1-8b-instruct
llama · 8B · Q8_0
1 benchmark across different hardware
Avg Score
81 /100
81–81
Avg Speed
35.6 tok/s
35.6–35.6
Avg TTFT
256 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| AMD Ryzen 5 5500 (ASUS) | 31 GB | 81 | 35.6 | 256 ms | Excellent |