Fastest published Mac-family result
MacBook Pro M5 Max 128GB 16-inch maps to 42.0 tok/s from the strongest published chip-family row for Mistral Small 4 119B.
Mistral Small 4 119B ranked across the Mac lineup at the best practical quantization, using the best available runtime evidence. Model picker is focused on current-market choices.
| Rank | Mac | Score | Quant | Tok/s | Runtime | Fits | Headroom | Context | Evidence | Price | Why it ranks here |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Mac Studio M3 Ultra 256GB | 374 | 8bit | 42.0 tok/s Fastest evidence path: 8bit · 42.0 tok/s · MLX · Estimated | MLX | Fits | 140.2 GB | 193k | Estimated | $7,499 | 8bit is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 140.2 GB headroom remains at this quantization. |
| 2 | Mac Pro M2 Ultra 192GB | 310 | 8bit | 42.0 tok/s Fastest evidence path: 8bit · 42.0 tok/s · MLX · Estimated | MLX | Fits | 76.2 GB | 94k | Estimated | $6,999 | 8bit is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 76.2 GB headroom remains at this quantization. |
| 3 | Mac Studio M4 Max 128GB | 260 | Q6_K | 42.0 tok/s Fastest evidence path: Q6_K · 42.0 tok/s · MLX · Estimated | MLX | Fits | 32.1 GB | 32k | Estimated | $4,499 | Q6_K is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 32.1 GB headroom remains at this quantization. |
| 4 | MacBook Pro M5 Max 128GB 16-inch | 260 | Q6_K | 42.0 tok/s Fastest evidence path: Q6_K · 42.0 tok/s · Ollama · Estimated | Ollama | Fits | 32.1 GB | 32k | Estimated | $5,399 | Q6_K is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 32.1 GB headroom remains at this quantization. |
| 5 | MacBook Pro M4 Max 128GB 16-inch | 260 | Q6_K | 42.0 tok/s Fastest evidence path: Q6_K · 42.0 tok/s · MLX · Estimated | MLX | Fits | 32.1 GB | 32k | Estimated | $5,999 | Q6_K is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 32.1 GB headroom remains at this quantization. |
| 6 | Mac Studio M3 Ultra 96GB | 244 | 5bit | 42.0 tok/s Fastest evidence path: 5bit · 42.0 tok/s · MLX · Estimated | MLX | Fits | 21.7 GB | 22k | Estimated | $3,999 | 5bit is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 21.7 GB headroom remains at this quantization. |
| 7 | Mac Studio M4 Max 64GB | 209 | 3bit | 42.0 tok/s Fastest evidence path: 3bit · 42.0 tok/s · MLX · Estimated | MLX | Fits | 17.4 GB | 22k | Estimated | $2,999 | 3bit is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 17.4 GB headroom remains at this quantization. |
| 8 | MacBook Pro M4 Max 64GB 16-inch | 209 | 3bit | 42.0 tok/s Fastest evidence path: 3bit · 42.0 tok/s · MLX · Estimated | MLX | Fits | 17.4 GB | 22k | Estimated | $4,499 | 3bit is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 17.4 GB headroom remains at this quantization. |
| 9 | Mac Mini M4 Pro 48GB | 206 | IQ2_K_S | 42.0 tok/s Fastest evidence path: IQ2_K_S · 42.0 tok/s · MLX · Estimated | MLX | Fits | 13.9 GB | 20k | Estimated | $1,599 | IQ2_K_S is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 13.9 GB headroom remains at this quantization. |
| 10 | MacBook Pro M4 Pro 48GB 14-inch | 206 | IQ2_K_S | 42.0 tok/s Fastest evidence path: IQ2_K_S · 42.0 tok/s · MLX · Estimated | MLX | Fits | 13.9 GB | 20k | Estimated | $2,499 | IQ2_K_S is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 13.9 GB headroom remains at this quantization. |
| 11 | Mac Studio M4 Max 48GB | 206 | IQ2_K_S | 42.0 tok/s Fastest evidence path: IQ2_K_S · 42.0 tok/s · MLX · Estimated | MLX | Fits | 13.9 GB | 20k | Estimated | $2,499 | IQ2_K_S is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 13.9 GB headroom remains at this quantization. |
| 12 | MacBook Pro M4 Pro 48GB 16-inch | 206 | IQ2_K_S | 42.0 tok/s Fastest evidence path: IQ2_K_S · 42.0 tok/s · MLX · Estimated | MLX | Fits | 13.9 GB | 20k | Estimated | $2,999 | IQ2_K_S is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 13.9 GB headroom remains at this quantization. |
| 13 | MacBook Pro M4 Max 48GB 14-inch | 206 | IQ2_K_S | 42.0 tok/s Fastest evidence path: IQ2_K_S · 42.0 tok/s · MLX · Estimated | MLX | Fits | 13.9 GB | 20k | Estimated | $3,499 | IQ2_K_S is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 13.9 GB headroom remains at this quantization. |
| 14 | MacBook Pro M4 Max 48GB 16-inch | 206 | IQ2_K_S | 42.0 tok/s Fastest evidence path: IQ2_K_S · 42.0 tok/s · MLX · Estimated | MLX | Fits | 13.9 GB | 20k | Estimated | $3,999 | IQ2_K_S is the current best practical quantization. 42.0 tok/s is estimated from nearby benchmark coverage. 13.9 GB headroom remains at this quantization. |
| 15 | Mac Mini M4 16GB | 0 | F32 | — | MLX | No | -432.3 GB | — | Estimated | $499 | Mistral Small 4 119B does not fit on Mac Mini M4 16GB at the current practical quantization. |
| 16 | Mac Mini M4 24GB | 0 | F32 | — | MLX | No | -424.3 GB | — | Estimated | $599 | Mistral Small 4 119B does not fit on Mac Mini M4 24GB at the current practical quantization. |
| 17 | Mac Mini M4 32GB | 0 | F32 | — | MLX | No | -416.3 GB | — | Estimated | $799 | Mistral Small 4 119B does not fit on Mac Mini M4 32GB at the current practical quantization. |
| 18 | MacBook Air M4 16GB 13-inch | 0 | F32 | — | MLX | No | -432.3 GB | — | Estimated | $1,099 | Mistral Small 4 119B does not fit on MacBook Air M4 16GB 13-inch at the current practical quantization. |
| 19 | MacBook Air M4 24GB 13-inch | 0 | F32 | — | MLX | No | -424.3 GB | — | Estimated | $1,299 | Mistral Small 4 119B does not fit on MacBook Air M4 24GB 13-inch at the current practical quantization. |
| 20 | MacBook Air M4 16GB 15-inch | 0 | F32 | — | MLX | No | -432.3 GB | — | Estimated | $1,299 | Mistral Small 4 119B does not fit on MacBook Air M4 16GB 15-inch at the current practical quantization. |
| 21 | Mac Mini M4 Pro 24GB | 0 | F32 | — | MLX | No | -424.3 GB | — | Estimated | $1,399 | Mistral Small 4 119B does not fit on Mac Mini M4 Pro 24GB at the current practical quantization. |
| 22 | MacBook Air M4 32GB 13-inch | 0 | F32 | — | MLX | No | -416.3 GB | — | Estimated | $1,499 | Mistral Small 4 119B does not fit on MacBook Air M4 32GB 13-inch at the current practical quantization. |
| 23 | MacBook Air M4 24GB 15-inch | 0 | F32 | — | MLX | No | -424.3 GB | — | Estimated | $1,499 | Mistral Small 4 119B does not fit on MacBook Air M4 24GB 15-inch at the current practical quantization. |
| 24 | MacBook Air M4 32GB 15-inch | 0 | F32 | — | MLX | No | -416.3 GB | — | Estimated | $1,699 | Mistral Small 4 119B does not fit on MacBook Air M4 32GB 15-inch at the current practical quantization. |
| 25 | MacBook Pro M4 Pro 24GB 14-inch | 0 | F32 | — | MLX | No | -424.3 GB | — | Estimated | $1,999 | Mistral Small 4 119B does not fit on MacBook Pro M4 Pro 24GB 14-inch at the current practical quantization. |
| 26 | Mac Studio M4 Max 36GB | 0 | F32 | — | MLX | No | -412.3 GB | — | Estimated | $1,999 | Mistral Small 4 119B does not fit on Mac Studio M4 Max 36GB at the current practical quantization. |
| 27 | MacBook Pro M4 Pro 24GB 16-inch | 0 | F32 | — | MLX | No | -424.3 GB | — | Estimated | $2,499 | Mistral Small 4 119B does not fit on MacBook Pro M4 Pro 24GB 16-inch at the current practical quantization. |
| 28 | MacBook Pro M4 Max 36GB 14-inch | 0 | F32 | — | MLX | No | -412.3 GB | — | Estimated | $2,999 | Mistral Small 4 119B does not fit on MacBook Pro M4 Max 36GB 14-inch at the current practical quantization. |
| 29 | MacBook Pro M4 Max 36GB 16-inch | 0 | F32 | — | MLX | No | -412.3 GB | — | Estimated | $3,499 | Mistral Small 4 119B does not fit on MacBook Pro M4 Max 36GB 16-inch at the current practical quantization. |
Start with the ranked Mac table above, then audit tokens per second, RAM fit, quantization, runtimes, and source links before trusting the model on your Mac.
Quantizations observed: Q4_K - Medium
Quick take
Fastest published result is 45.0 tok/s on M4 Ultra (192 GB) at Q4_K - Medium. Published runtimes include MLX, Ollama. Start with Rankings for the decision, then use the raw rows below to audit the evidence.
Based on 3 external benchmarks; no lab runs yet.
Published runtimes: MLX, Ollama.
Best Mac shortlist
These are ranked by the fastest published Mistral Small 4 119B result available for each Mac's chip family. Use them as the search answer, then open the machine page before buying.
MacBook Pro M5 Max 128GB 16-inch maps to 42.0 tok/s from the strongest published chip-family row for Mistral Small 4 119B.
Model search answers
Mistral Small 4 119B currently has a fastest published Mac result of 45.0 tok/s on M4 Ultra (192 GB) at Q4_K - Medium. Check the raw rows on this page before comparing that number to a different runtime, quantization, or context length.
MacBook Pro M5 Max 128GB 16-inch is the fastest published Mac-family answer for Mistral Small 4 119B on this page right now, at 42.0 tok/s from its chip family. Treat that as a published benchmark starting point, not a universal buying recommendation.
Mistral Small 4 119B does not yet have a published minimum-RAM fit row on this page. Use Fit before assuming it will run cleanly on a specific Mac.
Catalog record
Official model cards tell you what the model is for and which software stacks it targets. Field reality below shows how much Apple Silicon evidence we have so far.
Official brief
MoE: 128 experts, 4 active. 119B parameters, with 6.5B activated per token. 256k context length. Multimodal input: Accepts both text and image input, with text output. Instruct and Reasoning functionalities with function calls (reasoning effort configurable per request).
Official source · Raw model card
Runtime support mentioned
Official specs
Official takeaways
Official model cards describe intent, capabilities, and supported stacks. They do not prove Apple Silicon speed by themselves.
Field reality on Apple Silicon
Mistral Small 4 119B: 2 Apple Silicon field reports; best reported generation ~44 tok/s; seen on MacBook Pro M5 PRO 64GB; via llama.cpp.
What practitioners keep saying
Apple Silicon field sources
The lower-bit Mistral Small 4 HomeSec-Bench row is fast on an M5 Pro 64GB laptop, but its domain score trails the stronger Q2_K_XL row from the same source.
Runtime/source notes to verify
Mistralai Hugging Face model cards
The official Mistral Small 4 card lists multiple local-serving paths, including llama.cpp and LM Studio, while recommending the Mistral API if local serving is subpar; that makes runtime choice a first-party reproduction question rather than a solved Apple Silicon benchmark.
Runtime mentions in the field
Hardware mentioned in reports
What would improve confidence
Current published coverage
Published chip coverage includes M4 Ultra (192 GB), M5 Max (128 GB). Fastest published row is 45.0 tok/s on M4 Ultra (192 GB) at Q4_K - Medium.
Rows stay below the ranking because this page is answer-first. Use them to inspect exact chips, quantizations, runtimes, and sources.
| Chip | Quant | Avg tok/s | Runtime | Source |
|---|---|---|---|---|
| M4 Ultra (192 GB) | Q4_K - Medium | 45.0 tok/s | MLX | ref |
| M5 Max (128 GB) | Q4_K - Medium | 42.0 tok/s | MLX | ref |
| M5 Max (128 GB) | Q4_K - Medium | 38.0 tok/s | Ollama | ref |
Chips with published results for Mistral Small 4 119B
Data
benchmarks.json — full dataset · models.json — model summaries · benchmarks.csv — CSV export