M3 Ultra (80-core GPU) — benchmark record

M3 Ultra (80-core GPU) local LLM benchmarks across 256 GB, 512 GB RAM tiers on Apple Silicon Mac. 6 published rows across 3 models with explicit evidence state and RAM-tier comparison. Peak published speed is 178.8 tok/s.

6Benchmark rows

3Models tested

2RAM configurations

178.8Fastest avg tok/s

RAM configurations

Each configuration differs only in unified memory. More RAM = larger models fit. Throughput is similar across RAM tiers at the same model size.

256 GBM3 Ultra (80-core GPU, 256 GB)3 rows · 3 models177.9 tok/s peak 512 GBM3 Ultra (80-core GPU, 512 GB)3 rows · 3 models178.8 tok/s peak

All benchmark rows — M3 Ultra (80-core GPU)

Sorted by avg tok/s descending. Click source badge to see original measurement.

Chip (RAM)	Model	Quant	RAM req.	Avg tok/s	Prompt tok/s	Runtime	Source
M3 Ultra (80-core GPU, 512 GB)	Llama 3.2 1B	Q4_K - Medium	—	178.8 tok/s	5601.0 tok/s	llamafile	ref
M3 Ultra (80-core GPU, 256 GB)	Llama 3.2 1B	Q4_K - Medium	—	177.9 tok/s	4999.5 tok/s	llamafile	ref
M3 Ultra (80-core GPU, 256 GB)	Llama 3.1 8B	Q4_K - Medium	—	63.3 tok/s	1062.2 tok/s	llamafile	ref
M3 Ultra (80-core GPU, 512 GB)	Llama 3.1 8B	Q4_K - Medium	—	62.7 tok/s	1109.5 tok/s	llamafile	ref
M3 Ultra (80-core GPU, 256 GB)	Qwen 2.5 14B	Q4_K - Medium	—	36.7 tok/s	568.3 tok/s	llamafile	ref
M3 Ultra (80-core GPU, 512 GB)	Qwen 2.5 14B	Q4_K - Medium	—	35.8 tok/s	577.4 tok/s	llamafile	ref

Models tested on M3 Ultra (80-core GPU)

Llama 3.1 8B Llama 3.2 1B Qwen 2.5 14B

Data

benchmarks.json — full dataset · chips.json — chip summaries · benchmarks.csv — CSV export

Data from in-house lab measurements plus community-published benchmarks. See all chip families →