starling-lm:7b

llama · 7B · Q4_0

2 benchmarks across different hardware

Avg Score
64 /100
63–65
Avg Speed
23.7 tok/s
23.7–23.8
Avg TTFT
233 ms
Benchmarks
2
Hardware RAM Score tok/s TTFT Verdict
Apple M4 (MacBook Air) 32 GB 65 23.8 232 ms Good
Apple M4 (MacBook Air) 32 GB 63 23.7 234 ms Good