llama3.2:3b
llama · 3.2B · Q4_K_M
2 benchmarks across different hardware
Avg Score
74 /100
74–74
Avg Speed
32.6 tok/s
21.1–44.1
Avg TTFT
605 ms
Benchmarks
2
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 74 | 44.1 | 178 ms | Good |
| Cortex-A78AE (NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super) | 7 GB | 74 | 21.1 | 1.0s | Good |