llama3.2:1b
llama · 1.2B · Q8_0
2 benchmarks across different hardware
Avg Score
63 /100
62–63
Avg Speed
105.2 tok/s
40.2–170.2
Avg TTFT
614 ms
Benchmarks
2
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Cortex-A78AE (NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super) | 7 GB | 63 | 40.2 | 1.1s | Good |
| AMD Ryzen 9 8945HS (ASUSTeK COMPUTER INC. ROG Zephyrus G14 GA403UV_GA403UV) | 15 GB | 62 | 170.2 | 142 ms | Good |