vicuna:7b
llama · 7B · Q4_0
1 benchmark across different hardware
Avg Score
65 /100
65–65
Avg Speed
23.4 tok/s
23.4–23.4
Avg TTFT
242 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 65 | 23.4 | 242 ms | Good |