vicuna:13b
llama · 13B · Q4_0
1 benchmark across different hardware
Avg Score
59 /100
59–59
Avg Speed
13.4 tok/s
13.4–13.4
Avg TTFT
438 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 59 | 13.4 | 438 ms | Marginal |