← Canonical rankings

M5 Max (128 GB) — benchmark record

M5 Max (128 GB) local LLM benchmarks on Apple Silicon Mac with 33 published rows across 23 models. Peak published speed is 158.0 tok/s on Gemma 4 E2B. Largest published fit uses 92.6 GB. Published runtimes include flash-moe, llama.cpp, MLX, Ollama.

33Benchmark rows
23Models tested
158.0Fastest avg tok/s (Gemma 4 E2B)
0Lab benchmarks

Best published speed here is 158.0 tok/s on Gemma 4 E2B at Q4_K - Medium. Largest published memory footprint is Qwen3-Coder-Next at 8bit, using 92.6 GB. Longest published context on this page is 66k. This page is evidence, not the full buying answer.

Based on 33 external benchmarks; no lab runs yet.

Published runtimes: flash-moe, llama.cpp, MLX, Ollama.

Published model coverage includes Gemma 4 E2B, Llama 3.1 8B, Gemma 4 E4B, Qwen 3 8B plus 19 more published models. Published runtime coverage on this chip includes flash-moe, llama.cpp, MLX, Ollama. Fastest published row is 158.0 tok/s on Gemma 4 E2B at Q4_K - Medium. Largest published footprint on this page is 92.6 GB for Qwen3-Coder-Next. Longest published context is 66k.

Other published M5 Max variants: 48 GB · 64 GB

This chip is part of a family. Compare all M5 Max RAM variants →

Raw benchmark rows for M5 Max (128 GB)

Rows sorted by avg tok/s descending. Click source badge to see original measurement page.

ModelQuantRAM req.ContextAvg tok/sPrompt tok/sRuntimeSource
Gemma 4 E2BQ4_K - Medium158.0 tok/sMLXref
Llama 3.1 8BQ4_K - Medium138.0 tok/sMLXref
Gemma 4 E4BQ4_K - Medium128.0 tok/sMLXref
Qwen 3 8BQ4_K - Medium98.0 tok/sOllamaref
Qwen3-Coder-Next8bit87.1 GB4k79.3 tok/s754.9 tok/sMLXref
Qwen3.5-9BQ8_078.0 tok/sMLXref
Qwen3-Coder-Next8bit88.2 GB16k74.3 tok/s1802.1 tok/sMLXref
Qwen3-Coder-Next8bit89.7 GB33k68.6 tok/s1887.2 tok/sMLXref
Qwen3.5-122B-A10B4bit71.9 GB4k65.9 tok/s881.5 tok/sMLXref
Qwen3.5-122B-A10B4bit73.8 GB16k60.6 tok/s1239.7 tok/sMLXref
Qwen3.6-35B-A3BQ4_K - Medium55.0 tok/sMLXref
Qwen3.5-122B-A10B4bit76.4 GB33k54.9 tok/s1067.8 tok/sMLXref
Gemma 4 26B-A4BQ4_K - Medium50.0 tok/sMLXref
Qwen3-Coder-Next8bit92.6 GB66k48.2 tok/s1432.7 tok/sMLXref
Qwen3.5-35B-A3BQ4_K - Medium48.0 tok/sOllamaref
Mistral Small 4 119BQ4_K - Medium42.0 tok/sMLXref
Qwen 3 14BQ8_042.0 tok/sMLXref
Mistral Small 4 119BQ4_K - Medium38.0 tok/sOllamaref
Qwen3.5-27B4bit31.6 tok/sMLXref
Qwen 3 32BQ4_K - Medium28.0 tok/sOllamaref
Gemma 4 31BQ4_K - Medium26.0 tok/sMLXref
Llama 4 Scout 17B-16EQ4_K - Medium26.0 tok/sMLXref
Llama 4 Scout 17B-16EQ4_K - Medium22.0 tok/sOllamaref
Gemma 3 27BQ6_K8k20.0 tok/s391.0 tok/sllama.cppref
Qwen 3 235B-A22BQ4_K - Medium18.0 tok/sMLXref
Qwen3.5-27BQ6_K8k16.5 tok/sllama.cppref
Llama 3.3 70BQ4_K - Medium15.0 tok/sMLXref
Qwen 3 235B-A22BQ4_K - Medium15.0 tok/sOllamaref
Qwen3.5-397B-A17B4bit13.0 tok/sflash-moeref
Llama 3.3 70BQ4_K - Medium12.0 tok/sOllamaref
DeepSeek R1 Distill Llama 70BQ4_K - Medium11.0 tok/sOllamaref
Qwen 2.5 72BQ4_K - Medium10.0 tok/sOllamaref
gpt-oss 120BQ4_K - Medium7.0 tok/sOllamaref

Use Rankings when you need the best overall answer for a Mac, and keep this page open when you need the evidence behind that recommendation.

If you are comparing local Apple Silicon against rented cloud hardware, use AI Data Center Index for current GPU rental context.

benchmarks.json — full dataset  ·  chips.json — chip summaries  ·  benchmarks.csv — CSV export

Data from in-house lab measurements plus community-published benchmarks. See all chip families →