All Benchmarked Hardware

36 hardware configurations tested. Click any to see which models run best on it.

Apple M4

MacBook Air

32 GB RAM

143 benchmarks avg 66/100 42.6 tok/s

AMD Ryzen 7 7800X3D 8-Core Processor

ASUS

31 GB RAM

32 benchmarks avg 87/100 114.1 tok/s

Apple M4 Pro

Mac mini

64 GB RAM

32 benchmarks avg 66/100 31354.8 tok/s

AMD RYZEN AI MAX+ 395

AZW GTR Pro

125 GB RAM

27 benchmarks avg 80/100 57.6 tok/s

Intel Core™ i5-5300U

LENOVO 20BUS00700

16 GB RAM

26 benchmarks avg 46/100 12.9 tok/s

Intel Gen Intel® Core™ i9-11900H

Docker Container

15 GB RAM

24 benchmarks avg 78/100 10.4 tok/s

Cortex-X925

NVIDIA NVIDIA_DGX_Spark

122 GB RAM

22 benchmarks avg 80/100 36 tok/s

Apple M2 Max

Mac Studio

96 GB RAM

17 benchmarks avg 78/100 71.2 tok/s

Cortex-A78AE

NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super

7 GB RAM

17 benchmarks avg 53/100 22.5 tok/s

Apple M1 Max

MacBook Pro

32 GB RAM

8 benchmarks avg 72/100 36.2 tok/s

Apple M2 Pro

MacBook Pro

16 GB RAM

8 benchmarks avg 86/100 29.3 tok/s

Apple M5 Max

MacBook Pro

64 GB RAM

7 benchmarks avg 79/100 107.1 tok/s

Intel Core™ i5-14600KF

ASUS

32 GB RAM

6 benchmarks avg 82/100 73.9 tok/s

Intel Core™ i5-10400

Mac Pro

32 GB RAM

5 benchmarks avg 82/100 58.6 tok/s

Intel Core™ i5-8350U

LENOVO 20L7CTO1WW

23 GB RAM

5 benchmarks avg 40/100 15.5 tok/s

Intel Core™ Ultra 9 285K

ASUS

47 GB RAM

5 benchmarks avg 87/100 213.9 tok/s

AMD Ryzen 5 5500

ASUS

31 GB RAM

4 benchmarks avg 84/100 31.1 tok/s

AMD Ryzen 5 5600X 6-Core Processor

Gigabyte Technology Co., Ltd. B550M AORUS PRO

47 GB RAM

4 benchmarks avg 89/100 40.6 tok/s

Intel Gen Intel® Core™ i7-1355U

Dell Inc. Inspiron 15 3530

31 GB RAM

4 benchmarks avg 73/100 14.3 tok/s

AMD Ryzen 7 5800H

LENOVO 82JQ

16 GB RAM

3 benchmarks avg 73/100 33.4 tok/s

AMD RYZEN AI MAX+ 395 w/ Radeon 8060S

AZW GTR Pro

125 GB RAM

3 benchmarks avg 81/100 29.4 tok/s

Intel Core™ Ultra 9 285HX

Micro-Star International Co., Ltd. Titan 18 HX AI A2XWJG

63 GB RAM

3 benchmarks avg 78/100 82.6 tok/s

AMD Ryzen 5 2600X Six-Core Processor

Micro-Star International Co., Ltd. MS-7B79

16 GB RAM

2 benchmarks avg 75/100 44.3 tok/s

AMD Ryzen 5 5500U

HP HP Pavilion Laptop 15-eh1xxx

63 GB RAM

2 benchmarks avg 80/100 11.2 tok/s

Apple M4 Max

MacBook Pro

64 GB RAM

2 benchmarks avg 83/100 56.1 tok/s

Intel Core™ i5-6500

Gigabyte Technology Co., Ltd. H170M-D3H

16 GB RAM

2 benchmarks avg 64/100 35.6 tok/s

Intel Gen Intel® Core™ i7-13700K

ASUS

64 GB RAM

2 benchmarks avg 73/100 32.5 tok/s

Intel Xeon® Gold 6230

HP HP Z8 G4 Workstation

252 GB RAM

2 benchmarks avg 76/100 66.7 tok/s

AMD EPYC 9654P 96-Core Processor

Supermicro AS -2015HS-TNR

128 GB RAM

1 benchmarks avg 81/100 108.7 tok/s

AMD Ryzen 9 3900X 12-Core Processor

Micro-Star International Co., Ltd. MS-7C37

64 GB RAM

1 benchmarks avg 82/100 74.4 tok/s

AMD Ryzen 9 8945HS

ASUSTeK COMPUTER INC. ROG Zephyrus G14 GA403UV_GA403UV

15 GB RAM

1 benchmarks avg 62/100 170.2 tok/s

AMD Ryzen 9 9950X 16-Core Processor

Micro-Star International Co., Ltd. MS-7E47

125 GB RAM

1 benchmarks avg 87/100 42.4 tok/s

Apple M3 Pro

MacBook Pro

36 GB RAM

1 benchmarks avg 50/100 239.2 tok/s

Intel Core™ i7-4771

iMac

32 GB RAM

1 benchmarks avg 65/100 19.6 tok/s

Intel Gen Intel® Core™ i7-12700K

ASUS

96 GB RAM

1 benchmarks avg 80/100 14.7 tok/s

ZHAOXIN KaiXian KX-7000 KaiXian KX-7000

Shanghai Zhaoxin Semiconductor Co., Ltd. ZXE CRB

30 GB RAM

1 benchmarks avg 65/100 16.8 tok/s