Cortex-A78AE
NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super
7 GB RAM · 17 models tested
Avg Score
53 /100
Avg Speed
22.5 tok/s
Models Tested
17
| Model | Size | Score | tok/s | TTFT | Verdict |
|---|---|---|---|---|---|
| qwen2.5:3b | 3.1B Q4_K_M | 77 | 21.4 | 1.0s | Good |
| gemma3:4b | 4.3B Q4_K_M | 76 | 15.0 | 2.4s | Good |
| llama3.2:3b | 3.2B Q4_K_M | 74 | 21.1 | 1.0s | Good |
| phi4-mini:latest | 3.8B Q4_K_M | 74 | 18.4 | 1.1s | Good |
| qwen2.5-coder:3b | 3.1B Q4_K_M | 73 | 21.3 | 969 ms | Good |
| llama3.2:1b | 1.2B Q8_0 | 63 | 40.2 | 1.1s | Good |
| deepseek-r1:1.5b | 1.8B Q4_K_M | 60 | 34.6 | 5.3s | Good |
| gemma3:1b | 999.89M Q4_K_M | 59 | 34.0 | 1.9s | Marginal |
| gemma3:1b | 999.89M Q4_K_M | 57 | 33.9 | 1.9s | Marginal |
| gemma3:1b | 999.89M Q4_K_M | 57 | 33.7 | 2.0s | Marginal |
| gemma3:4b | 4.3B Q4_K_M | 46 | 14.9 | 2.2s | Marginal |
| llama3.1:8b | 8.0B Q4_K_M | 46 | 7.8 | 1.6s | Marginal |
| starcoder2:3b | 3B Q4_0 | 35 | 31.5 | 392 ms | Not Rec. |
| qwen3:4b | 4.0B Q4_K_M | 32 | 17.9 | 950 ms | Not Rec. |
| qwen3:4b | 4.0B Q4_K_M | 29 | 17.9 | 6.4s | Not Rec. |
| deepseek-r1:latest | 7.6B Q4_K_M | 23 | 9.8 | 1.2s | Not Rec. |
| deepseek-r1:latest | 7.6B Q4_K_M | 22 | 9.6 | 1.3s | Not Rec. |