All Benchmarked Hardware

52 hardware configurations tested. Click any to see which models run best on it.

Apple M4

MacBook Air

32 GB RAM

144 benchmarks avg 66/100 42.4 tok/s

Apple M1 Pro

MacBook Pro

16 GB RAM

63 benchmarks avg 70/100 39 tok/s

AMD RYZEN AI MAX+ 395

AZW GTR Pro

125 GB RAM

33 benchmarks avg 79/100 53.5 tok/s

AMD Ryzen 7 7800X3D 8-Core Processor

ASUS

31 GB RAM

32 benchmarks avg 87/100 114.1 tok/s

Apple M4 Pro

Mac mini

64 GB RAM

32 benchmarks avg 66/100 31354.8 tok/s

Intel Core™ i5-5300U

LENOVO 20BUS00700

16 GB RAM

26 benchmarks avg 46/100 12.9 tok/s

Cortex-X925

ASUSTeK COMPUTER INC. GX10

122 GB RAM

24 benchmarks avg 80/100 37.7 tok/s

Intel Gen Intel® Core™ i9-11900H

Docker Container

15 GB RAM

24 benchmarks avg 78/100 10.4 tok/s

AMD Ryzen 7 9700X 8-Core Processor

Micro-Star International Co., Ltd. MS-7E51

31 GB RAM

22 benchmarks avg 84/100 70.3 tok/s

Intel Core™ Ultra X7 358H

GMKtec NucBox EVO-T2S

64 GB RAM

18 benchmarks avg 76/100 55574 tok/s

Apple M2 Max

Mac Studio

96 GB RAM

17 benchmarks avg 78/100 71.2 tok/s

Cortex-A78AE

NVIDIA NVIDIA Jetson Orin Nano Engineering Reference Developer Kit Super

7 GB RAM

17 benchmarks avg 53/100 22.5 tok/s

Apple M4 Max

MacBook Pro

128 GB RAM

13 benchmarks avg 85/100 43.5 tok/s

Intel Xeon® E5-2637 v3

Dell Inc. Precision Tower 7910

96 GB RAM

12 benchmarks avg 79/100 35.8 tok/s

AMD Ryzen 9 9955HX3D 16-Core Processor

HP HyperX OMEN Gaming Laptop 16-ap1xxx

31 GB RAM

10 benchmarks avg 85/100 37 tok/s

Intel Core™ i7-14700F

HP OMEN 35L VALORANT Limited Edition Gaming Desktop PC

128 GB RAM

10 benchmarks avg 75/100 71.6 tok/s

Apple M5 Max

MacBook Pro

64 GB RAM

9 benchmarks avg 75/100 89 tok/s

Apple M1 Max

MacBook Pro

32 GB RAM

8 benchmarks avg 72/100 36.2 tok/s

Apple M2 Pro

MacBook Pro

16 GB RAM

8 benchmarks avg 86/100 29.3 tok/s

Intel Core™ i5-14600KF

ASUS

32 GB RAM

6 benchmarks avg 82/100 73.9 tok/s

Intel Core™ i9-14900K

Micro-Star International Co., Ltd. MS-7D98

128 GB RAM

6 benchmarks avg 58/100 18.1 tok/s

NVIDIA RTX Spark N1X (6144-core GPU, 20-core ) RTX Spark N1X (6144-core GPU, 20-core )

HP HyperX OMEN Transcend Gaming Laptop 14-ga0xxx5CD612DXML

55 GB RAM

6 benchmarks avg 87/100 53.8 tok/s

Intel Core™ i5-10210U

LENOVO 20U30029MB

15 GB RAM

5 benchmarks avg 65/100 11.1 tok/s

Intel Core™ i5-10400

Mac Pro

32 GB RAM

5 benchmarks avg 82/100 58.6 tok/s

Intel Core™ i5-8350U

LENOVO 20L7CTO1WW

23 GB RAM

5 benchmarks avg 40/100 15.5 tok/s

Intel Core™ Ultra 9 285K

ASUS

47 GB RAM

5 benchmarks avg 87/100 213.9 tok/s

Intel Xeon® E5-4620 0

Dell Inc. PowerEdge R820

256 GB RAM

5 benchmarks avg 52/100 2.9 tok/s

AMD Ryzen 5 5500

ASUS

31 GB RAM

4 benchmarks avg 84/100 31.1 tok/s

AMD Ryzen 5 5600X 6-Core Processor

Gigabyte Technology Co., Ltd. B550M AORUS PRO

47 GB RAM

4 benchmarks avg 89/100 40.6 tok/s

Intel Gen Intel® Core™ i7-1355U

Dell Inc. Inspiron 15 3530

31 GB RAM

4 benchmarks avg 73/100 14.3 tok/s

AMD EPYC 7713 64-Core Processor

Dell Inc. PowerEdge XE8545

1007 GB RAM

3 benchmarks avg 88/100 35.7 tok/s

AMD Ryzen 7 5800H

LENOVO 82JQ

16 GB RAM

3 benchmarks avg 73/100 33.4 tok/s

AMD Ryzen 9 3900X 12-Core Processor

Micro-Star International Co., Ltd. MS-7C37

64 GB RAM

3 benchmarks avg 75/100 42.7 tok/s

AMD RYZEN AI MAX+ 395 w/ Radeon 8060S

AZW GTR Pro

125 GB RAM

3 benchmarks avg 81/100 29.4 tok/s

Intel Core™ Ultra 9 285HX

Micro-Star International Co., Ltd. Titan 18 HX AI A2XWJG

63 GB RAM

3 benchmarks avg 78/100 82.6 tok/s

Intel Xeon® E5-4650 v2

Dell Inc. PowerEdge R820

256 GB RAM

3 benchmarks avg 71/100 4.2 tok/s

AMD Ryzen 5 2600X Six-Core Processor

Micro-Star International Co., Ltd. MS-7B79

16 GB RAM

2 benchmarks avg 75/100 44.3 tok/s

AMD Ryzen 5 5500U

HP HP Pavilion Laptop 15-eh1xxx

63 GB RAM

2 benchmarks avg 80/100 11.2 tok/s

Apple M2

Mac mini

8 GB RAM

2 benchmarks avg 53/100 24.7 tok/s

Intel Core™ i5-6500

Gigabyte Technology Co., Ltd. H170M-D3H

16 GB RAM

2 benchmarks avg 64/100 35.6 tok/s

Intel Gen Intel® Core™ i7-13700K

ASUS

64 GB RAM

2 benchmarks avg 73/100 32.5 tok/s

Intel Xeon® Gold 6230

HP HP Z8 G4 Workstation

252 GB RAM

2 benchmarks avg 76/100 66.7 tok/s

AMD EPYC 9654P 96-Core Processor

Supermicro AS -2015HS-TNR

128 GB RAM

1 benchmarks avg 81/100 108.7 tok/s

AMD Ryzen 9 8945HS

ASUSTeK COMPUTER INC. ROG Zephyrus G14 GA403UV_GA403UV

15 GB RAM

1 benchmarks avg 62/100 170.2 tok/s

AMD Ryzen 9 9950X 16-Core Processor

Micro-Star International Co., Ltd. MS-7E47

125 GB RAM

1 benchmarks avg 87/100 42.4 tok/s

Apple M3 Pro

MacBook Pro

36 GB RAM

1 benchmarks avg 50/100 239.2 tok/s

Intel Core™ i7-4771

iMac

32 GB RAM

1 benchmarks avg 65/100 19.6 tok/s

Intel Core™ i7-7700HQ

ASUSTeK COMPUTER INC. GL702VMK

16 GB RAM

1 benchmarks avg 87/100 24.7 tok/s

Intel Gen Intel® Core™ i5-12600K

31 GB RAM

1 benchmarks avg 90/100 39 tok/s

Intel Gen Intel® Core™ i7-12700K

ASUS

96 GB RAM

1 benchmarks avg 80/100 14.7 tok/s

Intel Gen Intel® Core™ i7-13620H

LENOVO 82XV

32 GB RAM

1 benchmarks avg 9/100 3.2 tok/s

ZHAOXIN KaiXian KX-7000 KaiXian KX-7000

Shanghai Zhaoxin Semiconductor Co., Ltd. ZXE CRB

30 GB RAM

1 benchmarks avg 65/100 16.8 tok/s