mistralai/devstral-small-2-2512

LM-STUDIO MLX

mistral3 · 24B · 4bit

Good

Oct 20, 2026 · Apple M1 Pro

orcarouter/Qwen3.8-27B-Uncensored:iq4_xs

OLLAMA GGUF

qwen35 · 27.3B · IQ4_XS

Excellent

Sep 11, 2026 · Intel Core™ i5-10400

Global Score

73 vs 88

Hardware Fit

64 vs 69

Quality Score

77 vs 96

Hardware

mistralai/devstral… orcarouter/Qwen3.8…

MachineMacBook ProASUS

CPUApple M1 ProIntel Core™ i5-10400

Cores1012

RAM32 GB16 GB

GPUApple M1 ProTodesk Virtual Display Adapter, AskLink Display Adapter (SDR), OrayIddDriver Device, NVIDIA GeForce RTX 3080

OSmacOS 15.6.1Microsoft Windows 10 专业版 10.0.19045

Archarm64x64

Power Modebalancedbalanced

Performance

mistralai/devstral… orcarouter/Qwen3.8…

Tokens/sec11.939.5

First chunk7 ms220 ms

TTFT1.1 s3.2 s

Load timeN/A13.7 s

Memory usage19.7 GB14.2 GB

Memory %62%89%

HW Fit Score Breakdown

mistralai/devstral-smal…

Speed

25/50

TTFT

20/20

Memory

19/30

orcarouter/Qwen3.8-27B-…

Speed

50/50

TTFT

14/20

Memory

5/30

Quality

mistralai/devstral-smal…

Reasoning

17/20

Coding

16/20

Instruction

13/20

Structured

14/15

Math

7/15

Multilingual

10/10

Reasoning: Strong Coding: Strong Instruction Following: Adequate Structured Output: Strong Math: Weak Multilingual: Strong

orcarouter/Qwen3.8-27B-…

Reasoning

19/20

Coding

19/20

Instruction

18/20

Structured

15/15

Math

15/15

Multilingual

10/10

Reasoning: Strong Coding: Strong Instruction Following: Strong Structured Output: Strong Math: Strong Multilingual: Strong

View mistralai/devstral… details | View orcarouter/Qwen3.8… details

Run yours and compare

$ npm install -g metrillm@latest

$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest