neural-chat:7b
llama · 7B · Q4_0
1 benchmark across different hardware
Avg Score
71 /100
71–71
Avg Speed
22.5 tok/s
22.5–22.5
Avg TTFT
242 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 71 | 22.5 | 242 ms | Good |