M4 (8-core GPU, 16 GB) — benchmark record

M4 (8-core GPU, 16 GB) local LLM benchmarks on Apple Silicon Mac with 3 published rows across 3 models. Peak published speed is 65.9 tok/s on Llama 3.2 1B. Published runtimes include llamafile.

3Benchmark rows

3Models tested

65.9Fastest avg tok/s (llama-3-2-1b-instruct)

0Lab benchmarks

Quick take

Best published speed here is 65.9 tok/s on Llama 3.2 1B at Q4_K - Medium. This page is evidence, not the full buying answer.

Based on 3 external benchmarks; no lab runs yet.

Published runtimes: llamafile.

Need a recommendation? Use Buy Checking a target model? Use Fit Want a setup answer? Use Run Browse Macs by exact hardware Need the full audit trail? Use Bench

Current published coverage

Published model coverage includes Llama 3.2 1B, Llama 3.1 8B, Qwen 2.5 14B. Published runtime coverage on this chip includes llamafile. Fastest published row is 65.9 tok/s on Llama 3.2 1B at Q4_K - Medium.

Llama 3.2 1B Llama 3.1 8B Qwen 2.5 14B

Raw benchmark rows for M4 (8-core GPU, 16 GB)

Rows sorted by avg tok/s descending. Click source badge to see original measurement page.

Model	Quant	RAM req.	Context	Avg tok/s	Prompt tok/s	Runtime	Source
Llama 3.2 1B	Q4_K - Medium	—	—	65.9 tok/s	897.0 tok/s	llamafile	ref
Llama 3.1 8B	Q4_K - Medium	—	—	15.3 tok/s	134.0 tok/s	llamafile	ref
Qwen 2.5 14B	Q4_K - Medium	—	—	7.2 tok/s	61.1 tok/s	llamafile	ref

Models tested on this chip

Llama 3.2 1B Llama 3.1 8B Qwen 2.5 14B

Next step

Use Rankings when you need the best overall answer for a Mac, and keep this page open when you need the evidence behind that recommendation.

If you are comparing local Apple Silicon against rented cloud hardware, use AI Data Center Index for current GPU rental context.

Data

benchmarks.json — full dataset · chips.json — chip summaries · benchmarks.csv — CSV export

Data from in-house lab measurements plus community-published benchmarks. See all chip families →