neural-chat:7b
llama · 7B · Q4_0
1 benchmark across different hardware
Avg Score
67 /100
67–67
Avg Speed
22.5 tok/s
22.5–22.5
Avg TTFT
242 ms
Benchmarks
1
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 67 | 22.5 | 242 ms | Good |