M4 (16 GB) — benchmark record
M4 (16 GB) local LLM benchmarks on Apple Silicon Mac with 14 published rows across 9 models. Peak published speed is 92.0 tok/s on Qwen3.5-4B. Published runtimes include llama.cpp, LM Studio, MLX, Ollama.
Quick take
Best published speed here is 92.0 tok/s on Qwen3.5-4B at Q4_K - Medium. This page is evidence, not the full buying answer.
Based on 14 external benchmarks; no lab runs yet.
Published runtimes: llama.cpp, LM Studio, MLX, Ollama.
Current published coverage
Published model coverage includes Qwen3.5-4B, DeepSeek R1 Distill Llama 8B, Llama 3.1 8B, Qwen3.5-9B plus 5 more published models. Published runtime coverage on this chip includes llama.cpp, LM Studio, MLX, Ollama. Fastest published row is 92.0 tok/s on Qwen3.5-4B at Q4_K - Medium.
Other published M4 variants: 32 GB
Macs shipping with the M4 (16 GB)
This chip is part of a family. Compare all M4 RAM variants →
Raw benchmark rows for M4 (16 GB)
Rows sorted by avg tok/s descending. Click source badge to see original measurement page.
| Model | Quant | Avg tok/s | Runtime | Source |
|---|---|---|---|---|
| Qwen3.5-4B | Q4_K - Medium | 92.0 tok/s | Ollama | ref |
| DeepSeek R1 Distill Llama 8B | Q4_K - Medium | 78.0 tok/s | MLX | ref |
| Llama 3.1 8B | Q4_K - Medium | 75.0 tok/s | Ollama | ref |
| Qwen3.5-9B | Q4_K - Medium | 72.0 tok/s | LM Studio | ref |
| Ministral 3 8B | Q4_K - Medium | 72.0 tok/s | MLX | ref |
| Phi-4 14B | Q4_K - Medium | 38.0 tok/s | Ollama | ref |
| Qwen3.5-9B | Q4_0 | 4.1 tok/s | llama.cpp | ref |
| Devstral Small 2 24B | Q4_0 | 3.4 tok/s | llama.cpp | ref |
| Qwen3.5-9B | Q4_K - Small | 3.1 tok/s | llama.cpp | ref |
| Qwen3.5-9B | Q6_K | 2.2 tok/s | llama.cpp | ref |
| Qwen3.5-35B-A3B | Q4_K - Medium | 1.3 tok/s | llama.cpp | ref |
| Devstral Small 2 24B | Q4_1 | 0.1 tok/s | llama.cpp | ref |
| Devstral Small 2 24B | Q4_K - Medium | 0.0 tok/s | llama.cpp | ref |
| Qwen3.5-27B | Q4_K - Medium | 0.0 tok/s | llama.cpp | ref |
Models tested on this chip
Next step
Use Rankings when you need the best overall answer for a Mac, and keep this page open when you need the evidence behind that recommendation.
If you are comparing local Apple Silicon against rented cloud hardware, use AI Data Center Index for current GPU rental context.
Data
benchmarks.json — full dataset · chips.json — chip summaries · benchmarks.csv — CSV export
Data from in-house lab measurements plus community-published benchmarks. See all chip families →