M2 Max (38-core GPU) — benchmark record

M2 Max (38-core GPU) local LLM benchmarks across 32 GB, 64 GB, 96 GB RAM tiers on Apple Silicon Mac. 8 published rows across 5 models with explicit evidence state and RAM-tier comparison. Peak published speed is 153.0 tok/s.

8Benchmark rows

5Models tested

3RAM configurations

153.0Fastest avg tok/s

RAM configurations

Each configuration differs only in unified memory. More RAM = larger models fit. Throughput is similar across RAM tiers at the same model size.

32 GBM2 Max (38-core GPU, 32 GB)3 rows · 3 models153.0 tok/s peak 64 GBM2 Max (38-core GPU, 64 GB)2 rows · 2 models22.0 tok/s peak 96 GBM2 Max (38-core GPU, 96 GB)3 rows · 3 models46.4 tok/s peak

All benchmark rows — M2 Max (38-core GPU)

Sorted by avg tok/s descending. Click source badge to see original measurement.

Chip (RAM)	Model	Quant	RAM req.	Avg tok/s	Prompt tok/s	Runtime	Source
M2 Max (38-core GPU, 32 GB)	Llama 3.2 1B	Q4_K - Medium	—	153.0 tok/s	2551.4 tok/s	llamafile	ref
M2 Max (38-core GPU, 96 GB)	Llama 3.1 8B	Q4_K - Medium	—	46.4 tok/s	484.1 tok/s	llamafile	ref
M2 Max (38-core GPU, 32 GB)	Llama 3.1 8B	Q4_K - Medium	—	44.7 tok/s	473.7 tok/s	llamafile	ref
M2 Max (38-core GPU, 96 GB)	Qwen 2.5 14B	Q4_K - Medium	—	25.2 tok/s	252.5 tok/s	llamafile	ref
M2 Max (38-core GPU, 64 GB)	Qwen 2.5 14B	Q4_K - Medium	—	22.0 tok/s	222.8 tok/s	llamafile	ref
M2 Max (38-core GPU, 32 GB)	Qwen 2.5 14B	Q4_K - Medium	—	20.6 tok/s	225.6 tok/s	llamafile	ref
M2 Max (38-core GPU, 96 GB)	Qwen3.5-27B	8bit	30.0 GB	12.0 tok/s	—	MLX	ref
M2 Max (38-core GPU, 64 GB)	Llama 3.3 70B	4bit	—	8.8 tok/s	—	LM Studio	ref

Models tested on M2 Max (38-core GPU)

Llama 3.3 70B Llama 3.1 8B Llama 3.2 1B Qwen 2.5 14B Qwen3.5-27B

Data

benchmarks.json — full dataset · chips.json — chip summaries · benchmarks.csv — CSV export

Data from in-house lab measurements plus community-published benchmarks. See all chip families →