Best local LLMs for Mac Pro M2 Ultra 192GB in 2026

Use this page when your real query is the exact machine, not a generic “best Mac” article. The ranking below is machine-specific, and the supporting links show where the evidence is benchmark-backed, sparse, or still fit-limited.

Current coding-biased answer for Mac Pro M2 Ultra 192GB: Qwen3.6-27B. Use Fit and Bench to verify how much headroom remains once you move past the default answer.

1 benchmark on this exact machine across 1 model. Last benchmark: May 20, 2025. Catalog current through April 22, 2026.

Best local LLMs for this Mac

25 current modelsCatalog current through April 22, 2026Benchmark evidence through April 27, 2026

Mac Pro M2 Ultra 192GB ranked for coding with a most capable bias, using the best available runtime evidence. focused on the current market set.

Use the strongest current runtime evidence for each row.Largest fit: MiniMax M2.7 at 5bit (229B parameters)Fastest read: Qwen3.5-4B at 148.0 tok/s on MLXRanking evidence: Gemma 4 31B, Qwen3.6-27B, Qwen3.6-35B-A3B +1 are current candidates; sparse rows stay labeled until first-party evidence lands.Next featured Mac: Mac Studio M4 Ultra 256GB planned for June 2026; current default changes after arrival validation and clean first-party evidence.26 historical baseline rows hidden

Current ranking evidence

Fresh releases stay visible, but sparse evidence remains explicit.

Gemma 4 31B

released 2026-04-02 · 5 official specs captured · 4 benchmark rows · 6 Apple Silicon field sources · first-party measurement queued · Mac Studio M4 Ultra 256GB batch planned

Best field report is 28.0 tok/s; keep ranking movement provisional until Bench evidence hardens.

Bench: Mac Studio M4 Ultra 256GB batch planned
Qwen3.6-27B

released 2026-04-22 · 5 official specs captured · 1 benchmark row · 9 Apple Silicon field sources · first-party measurement queued · Mac Studio M4 Ultra 256GB batch planned

Best field report is 85.5 tok/s; keep ranking movement provisional until Bench evidence hardens.

Bench: Mac Studio M4 Ultra 256GB batch planned
Qwen3.6-35B-A3B

released 2026-04-15 · 5 official specs captured · 4 benchmark rows · 15 Apple Silicon field sources · first-party measurement queued · Mac Studio M4 Ultra 256GB batch planned

Best field report is 203.1 tok/s; keep ranking movement provisional until Bench evidence hardens.

Bench: Mac Studio M4 Ultra 256GB batch planned
Mistral Small 4 119B

released 2026-03-16 · 6 official specs captured · 3 benchmark rows · 1 Apple Silicon field source · first-party measurement queued · Mac Studio M4 Ultra 256GB batch planned

Best field report is 44.0 tok/s; keep ranking movement provisional until Bench evidence hardens.

Bench: Mac Studio M4 Ultra 256GB batch planned
RankModelScoreQuantTok/sRuntimeEvidenceHeadroomContextWhy it ranks here
1Gemma 4 31B30.7B parameters2908bit 22.0 tok/s Fastest evidence path: 8bit · 22.0 tok/s · MLX · EstimatedMLXEstimatedFirst-party M5 batch queued155.4 GB146kRecent frontier candidate in the current catalog. 8bit is the highest practical quality here. 22.0 tok/s estimated from nearby benchmark coverage, with MLX backend as the best runtime hint. 155.4 GB headroom leaves workable context margin.
2Qwen3.6-27B27B parameters2808bit 16.6 tok/s Fastest evidence path: 8bit · 16.6 tok/s · Ollama · EstimatedOllamaEstimatedFirst-party M5 batch queued164.4 GB262kRecent frontier candidate in the current catalog. 8bit is the highest practical quality here. 16.6 tok/s estimated from nearby benchmark coverage, with Ollama wrapper on llama.cpp as the best runtime hint. 164.4 GB headroom leaves workable context margin.
3Qwen3.5-27B27B parameters2778bit 16.1 tok/s Fastest evidence path: 8bit · 16.1 tok/s · llama.cpp · Estimatedllama.cppEstimatedFirst-party M5 batch queued164.4 GB262kRecent frontier candidate in the current catalog. 8bit is the highest practical quality here. 16.1 tok/s estimated from nearby benchmark coverage, with llama.cpp backend as the best runtime hint. 164.4 GB headroom leaves workable context margin.
4Devstral Small 2 24B24B parameters2748bit 23.4 tok/s Fastest evidence path: 8bit · 23.4 tok/s · llama.cpp · Estimatedllama.cppEstimatedFirst-party M5 batch queued167.9 GB262kRecent frontier candidate in the current catalog. 8bit is the highest practical quality here. 23.4 tok/s estimated from nearby benchmark coverage, with llama.cpp backend as the best runtime hint. 167.9 GB headroom leaves workable context margin.
5Qwen3.6-35B-A3B3B active / 35B total2528bit 48.0 tok/s Fastest evidence path: 8bit · 48.0 tok/s · MLX · EstimatedMLXEstimatedFirst-party M5 batch queued158.3 GB262kRecent frontier candidate in the current catalog. 8bit is the highest practical quality here. 48.0 tok/s estimated from nearby benchmark coverage, with MLX backend as the best runtime hint. 158.3 GB headroom leaves workable context margin.
6Mistral Small 4 119B6.5B active / 119B total1998bit 42.0 tok/s Fastest evidence path: 8bit · 42.0 tok/s · MLX · EstimatedMLXEstimatedFirst-party M5 batch queued76.2 GB94kRecent frontier candidate in the current catalog. 8bit is the highest practical quality here. 42.0 tok/s estimated from nearby benchmark coverage, with MLX backend as the best runtime hint. 76.2 GB headroom leaves workable context margin.
7MiniMax M2.7229B parameters4165bit Source-backed MLX MiniMax-M2.7-5bit - 172 GB minMeasure it Best availableFit-firstFirst-party M5 batch queued20.0 GB146kRecent model release in the current catalog. 5bit is the highest practical quality here. MiniMax-M2.7-5bit source profile lists 172 GB minimum memory on MLX; throughput still needs direct benchmark coverage. 20.0 GB headroom leaves workable context margin.
8Gemma 4 26B-A4B3.8B active / 25.2B total2528bit 40.0 tok/s Fastest evidence path: 8bit · 40.0 tok/s · MLX · EstimatedMLXEstimatedFirst-party M5 batch queued166.2 GB262kRecent model release in the current catalog. 8bit is the highest practical quality here. 40.0 tok/s estimated from nearby benchmark coverage, with MLX backend as the best runtime hint. 166.2 GB headroom leaves workable context margin.
9Nemotron Cascade 2 30B-A3B3B active / 30B total2508bit 28.0 tok/s Fastest evidence path: 8bit · 28.0 tok/s · Ollama · EstimatedOllamaEstimatedFirst-party M5 batch queued163.2 GB1000kRecent model release in the current catalog. 8bit is the highest practical quality here. 28.0 tok/s estimated from nearby benchmark coverage, with Ollama wrapper on llama.cpp as the best runtime hint. 163.2 GB headroom leaves workable context margin.
10Qwen3.5-35B-A3B3B active / 35B total2498bit 52.0 tok/s Fastest evidence path: 8bit · 52.0 tok/s · MLX · EstimatedMLXEstimatedFirst-party M5 batch queued158.3 GB262kRecent model release in the current catalog. 8bit is the highest practical quality here. 52.0 tok/s estimated from nearby benchmark coverage, with MLX backend as the best runtime hint. 158.3 GB headroom leaves workable context margin.
11GLM-4.7-Flash3B active / 30B total2478bit 58.0 tok/s Fastest evidence path: 8bit · 58.0 tok/s · llama.cpp · Estimatedllama.cppEstimatedFirst-party M5 batch queued156.2 GB150kRecent model release in the current catalog. 8bit is the highest practical quality here. 58.0 tok/s estimated from nearby benchmark coverage, with llama.cpp backend as the best runtime hint. 156.2 GB headroom leaves workable context margin.
12Nemotron-3-Nano-30B-A3B3.5B active / 30B total2468bit 43.7 tok/s Fastest evidence path: 8bit · 43.7 tok/s · llama.cpp · Estimatedllama.cppEstimatedFirst-party M5 batch queued163.2 GB1000kRecent model release in the current catalog. 8bit is the highest practical quality here. 43.7 tok/s estimated from nearby benchmark coverage, with llama.cpp backend as the best runtime hint. 163.2 GB headroom leaves workable context margin.
13Magistral Small24B parameters2428bit Measure it Best availableFit-firstFirst-party M5 batch queued167.9 GB41k8bit is the highest practical quality here. Speed still needs direct speed coverage. 167.9 GB headroom leaves workable context margin.
14Ministral 3 14B14B parameters2328bit 40.0 tok/s Fastest evidence path: 8bit · 40.0 tok/s · Ollama · EstimatedOllamaEstimatedFirst-party M5 batch queued177.2 GB262kRecent model release in the current catalog. 8bit is the highest practical quality here. 40.0 tok/s estimated from nearby benchmark coverage, with Ollama wrapper on llama.cpp as the best runtime hint. 177.2 GB headroom leaves workable context margin.
15Gemma 4 E4B8B parameters2308bit 78.0 tok/s Fastest evidence path: 8bit · 78.0 tok/s · Ollama · EstimatedOllamaEstimatedFirst-party M5 batch queued183.4 GB131kRecent model release in the current catalog. 8bit is the highest practical quality here. 78.0 tok/s estimated from nearby benchmark coverage, with Ollama wrapper on llama.cpp as the best runtime hint. 183.4 GB headroom leaves workable context margin.
16Qwen3.5-9B9B parameters2308bit 35.0 tok/s Fastest evidence path: 8bit · 35.0 tok/s · llama.cpp · Estimatedllama.cppEstimatedFirst-party M5 batch queued182.1 GB262kRecent model release in the current catalog. 8bit is the highest practical quality here. 35.0 tok/s estimated from nearby benchmark coverage, with llama.cpp backend as the best runtime hint. 182.1 GB headroom leaves workable context margin.
17Ministral 3 8B8B parameters2238bit 72.0 tok/s Fastest evidence path: 8bit · 72.0 tok/s · Ollama · EstimatedOllamaEstimatedFirst-party M5 batch queued183.0 GB262kRecent model release in the current catalog. 8bit is the highest practical quality here. 72.0 tok/s estimated from nearby benchmark coverage, with Ollama wrapper on llama.cpp as the best runtime hint. 183.0 GB headroom leaves workable context margin.
18gpt-oss 20B3.6B active / 21B total2178bit Measure it MLXFit-firstFirst-party M5 batch queued171.6 GB131k8bit is the highest practical quality here. Speed still needs direct speed coverage. 171.6 GB headroom leaves workable context margin.
19Qwen3.5-122B-A10B10B active / 122B total2038bit 57.0 tok/s Fastest evidence path: 8bit · 57.0 tok/s · MLX · EstimatedMLXEstimatedBitter Mill import queued77.1 GB262kRecent model release in the current catalog. 8bit is the highest practical quality here. 57.0 tok/s estimated from nearby benchmark coverage, with MLX backend as the best runtime hint. 77.1 GB headroom leaves workable context margin.
20Llama 4 Scout 17B-16E17B active / 109B total1968bit 26.0 tok/s Fastest evidence path: 8bit · 26.0 tok/s · MLX · EstimatedMLXEstimatedFirst-party M5 batch queued88.5 GB334k8bit is the highest practical quality here. 26.0 tok/s estimated from nearby benchmark coverage, with MLX backend as the best runtime hint. 88.5 GB headroom leaves workable context margin.
21Qwen3-Coder-Next3B active / 80B total1928bit 74.0 tok/s Fastest evidence path: 8bit · 74.0 tok/s · MLX · EstimatedMLXEstimatedFirst-party M5 batch queued116.2 GB262kRecent model release in the current catalog. 8bit is the highest practical quality here. 74.0 tok/s estimated from nearby benchmark coverage, with MLX backend as the best runtime hint. 116.2 GB headroom leaves workable context margin.
22GLM-4.5-Air12B active / 106B total1908bit 18.0 tok/s Fastest evidence path: 8bit · 18.0 tok/s · LM Studio · EstimatedLM StudioEstimatedFirst-party M5 batch queued91.3 GB131k8bit is the highest practical quality here. 18.0 tok/s estimated from nearby benchmark coverage, with LM Studio wrapper on mixed as the best runtime hint. 91.3 GB headroom leaves workable context margin.
23gpt-oss 120B5.1B active / 117B total1738bit 10.0 tok/s Fastest evidence path: 8bit · 10.0 tok/s · Ollama · EstimatedOllamaEstimatedFirst-party M5 batch queued82.0 GB131k8bit is the highest practical quality here. 10.0 tok/s estimated from nearby benchmark coverage, with Ollama wrapper on llama.cpp as the best runtime hint. 82.0 GB headroom leaves workable context margin.
24Gemma 4 E2B5.1B parameters1708bit 95.0 tok/s Fastest evidence path: 8bit · 95.0 tok/s · Ollama · EstimatedOllamaEstimatedFirst-party M5 batch queued186.5 GB131kRecent model release in the current catalog. 8bit is the highest practical quality here. 95.0 tok/s estimated from nearby benchmark coverage, with Ollama wrapper on llama.cpp as the best runtime hint. 186.5 GB headroom leaves workable context margin.
25Qwen3.5-4B4B parameters1678bit 148.0 tok/s Fastest evidence path: 8bit · 148.0 tok/s · MLX · EstimatedMLXEstimatedFirst-party M5 batch queued186.8 GB262kRecent model release in the current catalog. 8bit is the highest practical quality here. 148.0 tok/s estimated from nearby benchmark coverage, with MLX backend as the best runtime hint. 186.8 GB headroom leaves workable context margin.
192GBUnified memory
$6,999MSRP
mac_proForm factor