llama3.2:3b
llama · 3.2B · Q4_K_M
3 benchmarks across different hardware
Avg Score
72 /100
67–74
Avg Speed
25.1 tok/s
10–44.1
Avg TTFT
792 ms
Benchmarks
3
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Apple M4 (MacBook Air) | 32 GB | 74 | 44.1 | 178 ms | Good |
| Cortex-A78AE (NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super) | 7 GB | 74 | 21.1 | 1.0s | Good |
| Intel Core™ i5-10210U (LENOVO 20U30029MB) | 15 GB | 67 | 10.0 | 1.2s | Good |