starling-lm:7b
llama · 7B · Q4_0
1 benchmark across different hardware
Avg Score
68 /100
68–68
Avg Speed
23.7 tok/s
23.7–23.7
Avg TTFT
234 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 68 | 23.7 | 234 ms | Good |