vicuna:13b
llama · 13B · Q4_0
1 benchmark across different hardware
Avg Score
62 /100
62–62
Avg Speed
13.4 tok/s
13.4–13.4
Avg TTFT
438 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 62 | 13.4 | 438 ms | Good |