tinyllama:1.1b

llama · 1B · Q4_0

2 benchmarks across different hardware

Avg Score
51 /100
50–51
Avg Speed
125.3 tok/s
121–129.6
Avg TTFT
70 ms
Benchmarks
2
Hardware RAM Score tok/s TTFT Verdict
Apple M4 (MacBook Air) 32 GB 51 121.0 82 ms Marginal
Apple M4 (MacBook Air) 32 GB 50 129.6 58 ms Marginal