deepseek-r1:latest
qwen2 · 7.6B · Q4_K_M
2 benchmarks across different hardware
Avg Score
23 /100
22–23
Avg Speed
9.7 tok/s
9.6–9.8
Avg TTFT
1.3s
Benchmarks
2
| Hardware | RAM | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| Cortex-A78AE (NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super) | 7 GB | 23 | 9.8 | 1.2s | Not Rec. |
| Cortex-A78AE (NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super) | 7 GB | 22 | 9.6 | 1.3s | Not Rec. |