← All benchmarks

Qwen 2.5 14B Instruct — Apple Silicon Benchmarks

Measured inference speed for Qwen 2.5 14B Instruct across 52 Apple Silicon chips. Tokens per second at multiple quantization levels. Real runs, not estimates.

Quantizations measured: Q4_K - Medium

52Benchmark rows
52Chip tiers covered
36.7Fastest avg tok/s (M3 Ultra (80-core GPU, 256 GB))
Minimum RAM observed

Benchmark results for Qwen 2.5 14B Instruct

Rows sorted by avg tok/s descending. Click source badge to see original measurement page.

ChipQuantRAM req.ContextAvg tok/sPrompt tok/sRuntimeSource
M3 Ultra (80-core GPU, 256 GB)Q4_K - Medium36.7 tok/s568.3 tok/sref
M2 Ultra (76-core GPU, 128 GB)Q4_K - Medium36.6 tok/s470.5 tok/sref
M3 Ultra (80-core GPU, 512 GB)Q4_K - Medium35.8 tok/s577.4 tok/sref
M3 Ultra (60-core GPU, 96 GB)Q4_K - Medium34.4 tok/s444.6 tok/sref
M5 Max (32-core GPU, 36 GB)Q4_K - Medium34.3 tok/s343.2 tok/sref
M2 Ultra (60-core GPU, 64 GB)Q4_K - Medium34.2 tok/s381.1 tok/sref
M1 Ultra (64-core GPU, 128 GB)Q4_K - Medium32.4 tok/s371.7 tok/sref
M4 Max (40-core GPU, 48 GB)Q4_K - Medium30.1 tok/s347.0 tok/sref
M4 Max (40-core GPU, 128 GB)Q4_K - Medium28.7 tok/s326.6 tok/sref
M1 Ultra (48-core GPU, 128 GB)Q4_K - Medium27.8 tok/s289.9 tok/sref
M4 Max (40-core GPU, 64 GB)Q4_K - Medium25.9 tok/s286.7 tok/sref
M3 Max (40-core GPU, 128 GB)Q4_K - Medium25.5 tok/s302.4 tok/sref
M2 Max (38-core GPU, 96 GB)Q4_K - Medium25.2 tok/s252.5 tok/sref
M4 Max (32-core GPU, 36 GB)Q4_K - Medium24.6 tok/s273.4 tok/sref
M2 Max (38-core GPU, 64 GB)Q4_K - Medium22.0 tok/s222.8 tok/sref
M3 Max (30-core GPU, 96 GB)Q4_K - Medium20.8 tok/s238.8 tok/sref
M2 Max (38-core GPU, 32 GB)Q4_K - Medium20.6 tok/s225.6 tok/sref
M1 Max (32-core GPU, 32 GB)Q4_K - Medium20.1 tok/s195.8 tok/sref
M3 Max (30-core GPU, 36 GB)Q4_K - Medium19.8 tok/s226.2 tok/sref
M1 Max (32-core GPU, 64 GB)Q4_K - Medium19.0 tok/s185.9 tok/sref
M4 Pro (20-core GPU, 64 GB)Q4_K - Medium18.0 tok/s183.0 tok/sref
M4 Pro (20-core GPU, 24 GB)Q4_K - Medium18.0 tok/s190.4 tok/sref
M4 Pro (20-core GPU, 48 GB)Q4_K - Medium18.0 tok/s189.8 tok/sref
M1 Max (24-core GPU, 32 GB)Q4_K - Medium17.4 tok/s155.9 tok/sref
M4 Pro (16-core GPU, 48 GB)Q4_K - Medium16.8 tok/s161.1 tok/sref
M4 Pro (16-core GPU, 64 GB)Q4_K - Medium16.1 tok/s151.0 tok/sref
M4 Pro (16-core GPU, 24 GB)Q4_K - Medium15.2 tok/s144.3 tok/sref
M1 Max (24-core GPU, 64 GB)Q4_K - Medium15.1 tok/s140.2 tok/sref
M2 Max (30-core GPU, 64 GB)Q4_K - Medium14.5 tok/s149.0 tok/sref
M2 Pro (19-core GPU, 32 GB)Q4_K - Medium14.1 tok/s137.3 tok/sref
M3 Max (40-core GPU, 64 GB)Q4_K - Medium13.8 tok/s200.8 tok/sref
M2 Pro (16-core GPU, 16 GB)Q4_K - Medium13.4 tok/s119.0 tok/sref
M3 Pro (14-core GPU, 36 GB)Q4_K - Medium12.1 tok/s119.8 tok/sref
M3 Pro (18-core GPU, 36 GB)Q4_K - Medium12.0 tok/s147.4 tok/sref
M1 Pro (16-core GPU, 16 GB)Q4_K - Medium11.9 tok/s106.7 tok/sref
M3 Pro (14-core GPU, 18 GB)Q4_K - Medium11.9 tok/s117.0 tok/sref
M3 Pro (18-core GPU, 18 GB)Q4_K - Medium11.6 tok/s144.8 tok/sref
M1 Pro (16-core GPU, 32 GB)Q4_K - Medium11.6 tok/s104.5 tok/sref
M5 (10-core GPU, 32 GB)Q4_K - Medium11.5 tok/s110.4 tok/sref
M1 Pro (14-core GPU, 16 GB)Q4_K - Medium10.8 tok/s92.5 tok/sref
M1 Pro (14-core GPU, 32 GB)Q4_K - Medium10.4 tok/s88.9 tok/sref
M4 (10-core GPU, 24 GB)Q4_K - Medium9.2 tok/s93.3 tok/sref
M4 (10-core GPU, 16 GB)Q4_K - Medium8.7 tok/s83.1 tok/sref
M4 (10-core GPU, 32 GB)Q4_K - Medium8.6 tok/s79.3 tok/sref
M2 (10-core GPU, 16 GB)Q4_K - Medium8.1 tok/s74.8 tok/sref
M1 Ultra (GPU count not published, 128 GB)Q4_K - Medium8.0 tok/s38.8 tok/sref
M2 (10-core GPU, 24 GB)Q4_K - Medium7.3 tok/s70.3 tok/sref
M4 (8-core GPU, 16 GB)Q4_K - Medium7.2 tok/s61.1 tok/sref
M2 (8-core GPU, 16 GB)Q4_K - Medium7.0 tok/s60.0 tok/sref
M3 (10-core GPU, 24 GB)Q4_K - Medium6.1 tok/s65.8 tok/sref
M1 (8-core GPU, 16 GB)Q4_K - Medium5.4 tok/s53.3 tok/sref
M1 (7-core GPU, 16 GB)Q4_K - Medium4.8 tok/s40.6 tok/sref

benchmarks.json — full dataset  ·  models.json — model summaries  ·  benchmarks.csv — CSV export

See all models →