M2 Ultra (76-core GPU) — benchmark record

M2 Ultra (76-core GPU) local LLM benchmarks across 128 GB, 192 GB RAM tiers on Apple Silicon Mac. 2 published rows across 2 models with explicit evidence state and RAM-tier comparison. Peak published speed is 94.3 tok/s.

2Benchmark rows

2Models tested

2RAM configurations

94.3Fastest avg tok/s

RAM configurations

Each configuration differs only in unified memory. More RAM = larger models fit. Throughput is similar across RAM tiers at the same model size.

128 GBM2 Ultra (76-core GPU, 128 GB)1 rows · 1 models36.6 tok/s peak 192 GBM2 Ultra (76-core GPU, 192 GB)1 rows · 1 models94.3 tok/s peak

All benchmark rows — M2 Ultra (76-core GPU)

Sorted by avg tok/s descending. Click source badge to see original measurement.

Chip (RAM)	Model	Quant	RAM req.	Avg tok/s	Prompt tok/s	Runtime	Source
M2 Ultra (76-core GPU, 192 GB)	Llama 2 7B	Q4_0	3.6 GB	94.3 tok/s	1238.5 tok/s	llama.cpp	ref
M2 Ultra (76-core GPU, 128 GB)	Qwen 2.5 14B	Q4_K - Medium	—	36.6 tok/s	470.5 tok/s	llamafile	ref

Models tested on M2 Ultra (76-core GPU)

Llama 2 7B Qwen 2.5 14B

Data

benchmarks.json — full dataset · chips.json — chip summaries · benchmarks.csv — CSV export

Data from in-house lab measurements plus community-published benchmarks. See all chip families →