Start with the ranked Mac table above, then audit tokens per second, RAM fit, quantization, runtimes, and source links before trusting the model on your Mac.
Quantizations observed: Q4_K - Medium
Quick take
Fastest published result is 36.7 tok/s on M3 Ultra (80-core GPU, 256 GB) at Q4_K - Medium. Published runtimes include llamafile. Start with Rankings for the decision, then use the raw rows below to audit the evidence.
Based on 52 external benchmarks; no lab runs yet.
Published runtimes: llamafile.
Model search answers
qwen-2-5-14b-instruct currently has a fastest published Mac result of 36.7 tok/s on M3 Ultra (80-core GPU, 256 GB) at Q4_K - Medium. Check the raw rows on this page before comparing that number to a different runtime, quantization, or context length.
There is no direct best-Mac benchmark winner for qwen-2-5-14b-instruct yet. Use the ranking above to find the current Apple Silicon fit path and return to this page when direct rows land.
qwen-2-5-14b-instruct does not yet have a published minimum-RAM fit row on this page. Use Fit before assuming it will run cleanly on a specific Mac.
Current published coverage
Published chip coverage includes M3 Ultra (80-core GPU, 256 GB), M2 Ultra (76-core GPU, 128 GB), M3 Ultra (80-core GPU, 512 GB), M3 Ultra (60-core GPU, 96 GB), M5 Max (32-core GPU, 36 GB) plus 47 more chip tiers. Fastest published row is 36.7 tok/s on M3 Ultra (80-core GPU, 256 GB) at Q4_K - Medium.
Rows stay below the ranking because this page is answer-first. Use them to inspect exact chips, quantizations, runtimes, and sources.
| Chip | Quant | Avg tok/s | Runtime | Source |
|---|---|---|---|---|
| M3 Ultra (80-core GPU, 256 GB) | Q4_K - Medium | 36.7 tok/s | llamafile | ref |
| M2 Ultra (76-core GPU, 128 GB) | Q4_K - Medium | 36.6 tok/s | llamafile | ref |
| M3 Ultra (80-core GPU, 512 GB) | Q4_K - Medium | 35.8 tok/s | llamafile | ref |
| M3 Ultra (60-core GPU, 96 GB) | Q4_K - Medium | 34.4 tok/s | llamafile | ref |
| M5 Max (32-core GPU, 36 GB) | Q4_K - Medium | 34.3 tok/s | llamafile | ref |
| M2 Ultra (60-core GPU, 64 GB) | Q4_K - Medium | 34.2 tok/s | llamafile | ref |
| M1 Ultra (64-core GPU, 128 GB) | Q4_K - Medium | 32.4 tok/s | llamafile | ref |
| M4 Max (40-core GPU, 48 GB) | Q4_K - Medium | 30.1 tok/s | llamafile | ref |
| M4 Max (40-core GPU, 128 GB) | Q4_K - Medium | 28.7 tok/s | llamafile | ref |
| M1 Ultra (48-core GPU, 128 GB) | Q4_K - Medium | 27.8 tok/s | llamafile | ref |
| M4 Max (40-core GPU, 64 GB) | Q4_K - Medium | 25.9 tok/s | llamafile | ref |
| M3 Max (40-core GPU, 128 GB) | Q4_K - Medium | 25.5 tok/s | llamafile | ref |
| M2 Max (38-core GPU, 96 GB) | Q4_K - Medium | 25.2 tok/s | llamafile | ref |
| M4 Max (32-core GPU, 36 GB) | Q4_K - Medium | 24.6 tok/s | llamafile | ref |
| M2 Max (38-core GPU, 64 GB) | Q4_K - Medium | 22.0 tok/s | llamafile | ref |
| M3 Max (30-core GPU, 96 GB) | Q4_K - Medium | 20.8 tok/s | llamafile | ref |
| M2 Max (38-core GPU, 32 GB) | Q4_K - Medium | 20.6 tok/s | llamafile | ref |
| M1 Max (32-core GPU, 32 GB) | Q4_K - Medium | 20.1 tok/s | llamafile | ref |
| M3 Max (30-core GPU, 36 GB) | Q4_K - Medium | 19.8 tok/s | llamafile | ref |
| M1 Max (32-core GPU, 64 GB) | Q4_K - Medium | 19.0 tok/s | llamafile | ref |
| M4 Pro (20-core GPU, 64 GB) | Q4_K - Medium | 18.0 tok/s | llamafile | ref |
| M4 Pro (20-core GPU, 24 GB) | Q4_K - Medium | 18.0 tok/s | llamafile | ref |
| M4 Pro (20-core GPU, 48 GB) | Q4_K - Medium | 18.0 tok/s | llamafile | ref |
| M1 Max (24-core GPU, 32 GB) | Q4_K - Medium | 17.4 tok/s | llamafile | ref |
| M4 Pro (16-core GPU, 48 GB) | Q4_K - Medium | 16.8 tok/s | llamafile | ref |
| M4 Pro (16-core GPU, 64 GB) | Q4_K - Medium | 16.1 tok/s | llamafile | ref |
| M4 Pro (16-core GPU, 24 GB) | Q4_K - Medium | 15.2 tok/s | llamafile | ref |
| M1 Max (24-core GPU, 64 GB) | Q4_K - Medium | 15.1 tok/s | llamafile | ref |
| M2 Max (30-core GPU, 64 GB) | Q4_K - Medium | 14.5 tok/s | llamafile | ref |
| M2 Pro (19-core GPU, 32 GB) | Q4_K - Medium | 14.1 tok/s | llamafile | ref |
| M3 Max (40-core GPU, 64 GB) | Q4_K - Medium | 13.8 tok/s | llamafile | ref |
| M2 Pro (16-core GPU, 16 GB) | Q4_K - Medium | 13.4 tok/s | llamafile | ref |
| M3 Pro (14-core GPU, 36 GB) | Q4_K - Medium | 12.1 tok/s | llamafile | ref |
| M3 Pro (18-core GPU, 36 GB) | Q4_K - Medium | 12.0 tok/s | llamafile | ref |
| M1 Pro (16-core GPU, 16 GB) | Q4_K - Medium | 11.9 tok/s | llamafile | ref |
| M3 Pro (14-core GPU, 18 GB) | Q4_K - Medium | 11.9 tok/s | llamafile | ref |
| M3 Pro (18-core GPU, 18 GB) | Q4_K - Medium | 11.6 tok/s | llamafile | ref |
| M1 Pro (16-core GPU, 32 GB) | Q4_K - Medium | 11.6 tok/s | llamafile | ref |
| M5 (10-core GPU, 32 GB) | Q4_K - Medium | 11.5 tok/s | llamafile | ref |
| M1 Pro (14-core GPU, 16 GB) | Q4_K - Medium | 10.8 tok/s | llamafile | ref |
| M1 Pro (14-core GPU, 32 GB) | Q4_K - Medium | 10.4 tok/s | llamafile | ref |
| M4 (10-core GPU, 24 GB) | Q4_K - Medium | 9.2 tok/s | llamafile | ref |
| M4 (10-core GPU, 16 GB) | Q4_K - Medium | 8.7 tok/s | llamafile | ref |
| M4 (10-core GPU, 32 GB) | Q4_K - Medium | 8.6 tok/s | llamafile | ref |
| M2 (10-core GPU, 16 GB) | Q4_K - Medium | 8.1 tok/s | llamafile | ref |
| M1 Ultra (GPU count not published, 128 GB) | Q4_K - Medium | 8.0 tok/s | llamafile | ref |
| M2 (10-core GPU, 24 GB) | Q4_K - Medium | 7.3 tok/s | llamafile | ref |
| M4 (8-core GPU, 16 GB) | Q4_K - Medium | 7.2 tok/s | llamafile | ref |
| M2 (8-core GPU, 16 GB) | Q4_K - Medium | 7.0 tok/s | llamafile | ref |
| M3 (10-core GPU, 24 GB) | Q4_K - Medium | 6.1 tok/s | llamafile | ref |
| M1 (8-core GPU, 16 GB) | Q4_K - Medium | 5.4 tok/s | llamafile | ref |
| M1 (7-core GPU, 16 GB) | Q4_K - Medium | 4.8 tok/s | llamafile | ref |
Chips with published results for qwen-2-5-14b-instruct
Data
benchmarks.json — full dataset · models.json — model summaries · benchmarks.csv — CSV export