llama3.2:latest
llama · 3.2B · Q4_K_M
2 benchmarks across different hardware
Avg Score
75 /100
73–76
Avg Speed
77.9 tok/s
57–98.9
Avg TTFT
194 ms
Benchmarks
2
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| AMD Ryzen 5 2600X Six-Core Processor (Micro-Star International Co., Ltd. MS-7B79) | 16 GB | 76 | 57.0 | 264 ms | Good |
| Apple M4 Pro (Mac Mini) | 64 GB | 73 | 98.9 | 125 ms | Good |