meta-llama-3.1-8b-instruct
llama · 8B · 4bit
1 benchmark across different hardware
Avg Score
76 /100
76–76
Avg Speed
21.6 tok/s
21.6–21.6
Avg TTFT
512 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 76 | 21.6 | 512 ms | Good |