M2 Ultra (76-core GPU, 192 GB) — benchmark record
M2 Ultra (76-core GPU, 192 GB) local LLM benchmarks on Apple Silicon Mac with 1 published rows across 1 models. Peak published speed is 94.3 tok/s on Llama 2 7B. Largest published fit uses 3.6 GB. Published runtimes include llama.cpp.
Quick take
Best published speed here is 94.3 tok/s on Llama 2 7B at Q4_0. Largest published memory footprint is Llama 2 7B at Q4_0, using 3.6 GB. Longest published context on this page is 512. This page is evidence, not the full buying answer.
Based on 1 external benchmark; no lab runs yet.
Published runtimes: llama.cpp.
Current published coverage
Published model coverage includes Llama 2 7B. Published runtime coverage on this chip includes llama.cpp. Fastest published row is 94.3 tok/s on Llama 2 7B at Q4_0. Largest published footprint on this page is 3.6 GB for Llama 2 7B. Longest published context is 512.
Other published M2 Ultra (76-core GPU) variants: 128 GB
This chip is part of a family. Compare all M2 Ultra (76-core GPU) RAM variants →
Raw benchmark rows for M2 Ultra (76-core GPU, 192 GB)
Rows sorted by avg tok/s descending. Click source badge to see original measurement page.
| Model | Quant | Avg tok/s | Runtime | Source |
|---|---|---|---|---|
| Llama 2 7B | Q4_0 | 94.3 tok/s | llama.cpp | ref |
Models tested on this chip
Next step
Use Rankings when you need the best overall answer for a Mac, and keep this page open when you need the evidence behind that recommendation.
If you are comparing local Apple Silicon against rented cloud hardware, use AI Data Center Index for current GPU rental context.
Data
benchmarks.json — full dataset · chips.json — chip summaries · benchmarks.csv — CSV export
Data from in-house lab measurements plus community-published benchmarks. See all chip families →