mistralai/devstral-small-2-2512

LM-STUDIO MLX

mistral3 · 24B · 4bit

Good

Mar 4, 2026 · Apple M4

qwen3.5-35b-a3b-t48-c8k:latest

OLLAMA GGUF

qwen35moe · 36.0B · Q4_K_M

Not Rec.

Sep 6, 2026 · Intel Xeon® E5-4650 v2

Global Score

69 vs 81

Hardware Fit

50 vs 63

Quality Score

77 vs 88

Hardware

mistralai/devstral… qwen3.5-35b-a3b-t4…

MachineMacBook AirDell Inc. PowerEdge R820

CPUApple M4Intel Xeon® E5-4650 v2

Cores1080

RAM32 GB256 GB

GPUApple M4Microsoft Remote Display Adapter, NVIDIA Tesla P4, NVIDIA Tesla P4, Microsoft Basic Display Adapter

OSmacOS 26.3Microsoft Windows Server 2022 Datacenter 10.0.20348

Archarm64x64

Power Modebalancedbalanced

Performance

mistralai/devstral… qwen3.5-35b-a3b-t4…

Tokens/sec5.717.2

First chunk5007 ms845 ms

TTFT5.0 s845 ms

Load timeN/A103.1 s

Memory usage13.2 GB21.9 GB

Memory %41%9%

HW Fit Score Breakdown

mistralai/devstral-smal…

Speed

11/50

TTFT

9/20

Memory

30/30

qwen3.5-35b-a3b-t48-c8k…

Speed

16/50

TTFT

17/20

Memory

30/30

Quality

mistralai/devstral-smal…

Reasoning

16/20

Coding

18/20

Instruction

13/20

Structured

14/15

Math

6/15

Multilingual

10/10

Reasoning: Strong Coding: Strong Instruction Following: Adequate Structured Output: Strong Math: Weak Multilingual: Strong

qwen3.5-35b-a3b-t48-c8k…

Reasoning

17/20

Coding

18/20

Instruction

16/20

Structured

15/15

Math

12/15

Multilingual

10/10

Reasoning: Strong Coding: Strong Instruction Following: Strong Structured Output: Strong Math: Strong Multilingual: Strong

View mistralai/devstral… details | View qwen3.5-35b-a3b-t4… details

Run yours and compare

$ npm install -g metrillm@latest

$ metrillm

Requires Node 20+ and Ollama or LM Studio running

Or run without installing: npx metrillm@latest