How fast is Magistral Small on Mac?
Magistral Small is tracked for Apple Silicon, but no direct Mac benchmark row is published yet. Use the ranking above for the current fit path, then watch Bench for the first direct Apple Silicon rows.
Canonical Rankings
Best Macs for this model
Magistral Small ranked across the Mac lineup at the best practical quantization, using the best available runtime evidence. Model picker is focused on current-market choices.
| Rank | Mac | Score | Quant | Tok/s | Runtime | Fits | Headroom | Context | Evidence | Price | Why it ranks here |
|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | Mac Studio M3 Ultra 256GB | 282 | 8bit | Measure it | Best available | Fits | 231.9 GB | 41k | Fit-first | $7,499 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 231.9 GB headroom remains at this quantization. |
| 2 | Mac Pro M2 Ultra 192GB | 218 | 8bit | Measure it | Best available | Fits | 167.9 GB | 41k | Fit-first | $6,999 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 167.9 GB headroom remains at this quantization. |
| 3 | Mac Studio M4 Max 128GB | 154 | 8bit | Measure it | Best available | Fits | 103.9 GB | 41k | Fit-first | $4,499 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 103.9 GB headroom remains at this quantization. |
| 4 | MacBook Pro M5 Max 128GB 16-inch | 154 | 8bit | Measure it | Best available | Fits | 103.9 GB | 41k | Fit-first | $5,399 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 103.9 GB headroom remains at this quantization. |
| 5 | MacBook Pro M4 Max 128GB 16-inch | 154 | 8bit | Measure it | Best available | Fits | 103.9 GB | 41k | Fit-first | $5,999 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 103.9 GB headroom remains at this quantization. |
| 6 | Mac Studio M3 Ultra 96GB | 122 | 8bit | Measure it | Best available | Fits | 71.9 GB | 41k | Fit-first | $3,999 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 71.9 GB headroom remains at this quantization. |
| 7 | Mac Studio M4 Max 64GB | 90 | 8bit | Measure it | Best available | Fits | 39.9 GB | 41k | Fit-first | $2,999 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 39.9 GB headroom remains at this quantization. |
| 8 | MacBook Pro M4 Max 64GB 16-inch | 90 | 8bit | Measure it | Best available | Fits | 39.9 GB | 41k | Fit-first | $4,499 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 39.9 GB headroom remains at this quantization. |
| 9 | Mac Mini M4 Pro 48GB | 74 | 8bit | Measure it | Best available | Fits | 23.9 GB | 41k | Fit-first | $1,599 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 23.9 GB headroom remains at this quantization. |
| 10 | MacBook Pro M4 Pro 48GB 14-inch | 74 | 8bit | Measure it | Best available | Fits | 23.9 GB | 41k | Fit-first | $2,499 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 23.9 GB headroom remains at this quantization. |
| 11 | Mac Studio M4 Max 48GB | 74 | 8bit | Measure it | Best available | Fits | 23.9 GB | 41k | Fit-first | $2,499 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 23.9 GB headroom remains at this quantization. |
| 12 | MacBook Pro M4 Pro 48GB 16-inch | 74 | 8bit | Measure it | Best available | Fits | 23.9 GB | 41k | Fit-first | $2,999 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 23.9 GB headroom remains at this quantization. |
| 13 | MacBook Pro M4 Max 48GB 14-inch | 74 | 8bit | Measure it | Best available | Fits | 23.9 GB | 41k | Fit-first | $3,499 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 23.9 GB headroom remains at this quantization. |
| 14 | MacBook Pro M4 Max 48GB 16-inch | 74 | 8bit | Measure it | Best available | Fits | 23.9 GB | 41k | Fit-first | $3,999 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 23.9 GB headroom remains at this quantization. |
| 15 | Mac Studio M4 Max 36GB | 62 | 8bit | Measure it | Best available | Fits | 11.9 GB | 41k | Fit-first | $1,999 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 11.9 GB headroom remains at this quantization. |
| 16 | MacBook Pro M4 Max 36GB 14-inch | 62 | 8bit | Measure it | Best available | Fits | 11.9 GB | 41k | Fit-first | $2,999 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 11.9 GB headroom remains at this quantization. |
| 17 | MacBook Pro M4 Max 36GB 16-inch | 62 | 8bit | Measure it | Best available | Fits | 11.9 GB | 41k | Fit-first | $3,499 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 11.9 GB headroom remains at this quantization. |
| 18 | Mac Mini M4 32GB | 58 | 8bit | Measure it | Best available | Fits | 7.9 GB | 28k | Fit-first | $799 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 7.9 GB headroom remains at this quantization. |
| 19 | MacBook Air M4 32GB 13-inch | 58 | 8bit | Measure it | Best available | Fits | 7.9 GB | 28k | Fit-first | $1,499 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 7.9 GB headroom remains at this quantization. |
| 20 | MacBook Air M4 32GB 15-inch | 58 | 8bit | Measure it | Best available | Fits | 7.9 GB | 28k | Fit-first | $1,699 | 8bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 7.9 GB headroom remains at this quantization. |
| 21 | Mac Mini M4 24GB | 48 | Q6_K | Measure it | Best available | Fits | 3.9 GB | 10k | Fit-first | $599 | Q6_K is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 3.9 GB headroom remains at this quantization. |
| 22 | MacBook Air M4 24GB 13-inch | 48 | Q6_K | Measure it | Best available | Fits | 3.9 GB | 10k | Fit-first | $1,299 | Q6_K is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 3.9 GB headroom remains at this quantization. |
| 23 | Mac Mini M4 Pro 24GB | 48 | Q6_K | Measure it | Best available | Fits | 3.9 GB | 10k | Fit-first | $1,399 | Q6_K is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 3.9 GB headroom remains at this quantization. |
| 24 | MacBook Air M4 24GB 15-inch | 48 | Q6_K | Measure it | Best available | Fits | 3.9 GB | 10k | Fit-first | $1,499 | Q6_K is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 3.9 GB headroom remains at this quantization. |
| 25 | MacBook Pro M4 Pro 24GB 14-inch | 48 | Q6_K | Measure it | Best available | Fits | 3.9 GB | 10k | Fit-first | $1,999 | Q6_K is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 3.9 GB headroom remains at this quantization. |
| 26 | MacBook Pro M4 Pro 24GB 16-inch | 48 | Q6_K | Measure it | Best available | Fits | 3.9 GB | 10k | Fit-first | $2,499 | Q6_K is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 3.9 GB headroom remains at this quantization. |
| 27 | Mac Mini M4 16GB | 41 | q4.1bit | Measure it | Best available | Fits | 2.8 GB | 11k | Fit-first | $499 | q4.1bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 2.8 GB headroom remains at this quantization. |
| 28 | MacBook Air M4 16GB 13-inch | 41 | q4.1bit | Measure it | Best available | Fits | 2.8 GB | 11k | Fit-first | $1,099 | q4.1bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 2.8 GB headroom remains at this quantization. |
| 29 | MacBook Air M4 16GB 15-inch | 41 | q4.1bit | Measure it | Best available | Fits | 2.8 GB | 11k | Fit-first | $1,299 | q4.1bit is the current best practical quantization. This Mac fits, but speed still needs direct speed coverage. 2.8 GB headroom remains at this quantization. |
Magistral Small Apple Silicon catalog and best Macs
Start with the ranked Mac table above, then audit tokens per second, RAM fit, quantization, runtimes, and source links before trusting the model on your Mac.
0Benchmark rows
0Chip tiers covered
—Fastest avg tok/s
—Minimum RAM observed
Quick take
Magistral Small is cataloged because Apple Silicon buyers are already searching for it. Magistral Small: 1 practitioner claim; 1 captured from fetched artifacts; hardware mentions: 32GB, Mac, MacBook; runtime mentions: llama.cpp, LM Studio, MLX, Ollama; themes: apple_silicon_viability, fit_and_memory, model_comparison, operational_caution, runtime_tuning. Use the ranking above for the current best Mac path, then open Bench when direct evidence lands.
1 practitioner signal tracked so far, no benchmarks yet.
Model search answers
What is the best Mac for Magistral Small?
There is no direct best-Mac benchmark winner for Magistral Small yet. Use the ranking above to find the current Apple Silicon fit path and return to this page when direct rows land.
Does Magistral Small fit on Apple Silicon?
Magistral Small does not yet have a published minimum-RAM fit row on this page. Use Fit before assuming it will run cleanly on a specific Mac.
Catalog record
24BTotal params
DenseActive params
40,960Context window
2025-06-04Release date
No Apple Silicon benchmark rows are published for this model yet.
What this model is, and what Apple Silicon users are actually seeing
Official model cards tell you what the model is for and which software stacks it targets. Field reality below shows how much Apple Silicon evidence we have so far.
Official brief
Building upon Mistral Small 3.1 (2503), with added reasoning capabilities, undergoing SFT from Magistral Medium traces and RL on top, it's a small, efficient reasoning model with 24B parameters.
Official source · Raw model card
reasoning
Runtime support mentioned
MLXllama.cppOllamavLLM
Official specs
- Total parameters: 24B.
- Context: 128k tokens; recommended max model length 40k tokens.
- License: Apache 2.0.
Official takeaways
- Building upon Mistral Small 3.1 (2503), with added reasoning capabilities, undergoing SFT from Magistral Medium traces and RL on top, it's a small, efficient reasoning model with 24B parameters.
- Reasoning: Capable of long chains of reasoning traces before providing an answer.
- We recommend using this model with the vLLM library to implement production-ready inference pipelines.
- We invite you to choose, depending on your use case and requirements, between keeping reasoning traces during multi-turn interactions or keeping only the final assistant response.
Deployment notes
- Official model card says Magistral Small can deploy locally and fit within a single RTX 4090 or a 32GB RAM MacBook once quantized.
- Official model card links community quantized paths for llama.cpp, LM Studio with llama.cpp or MLX, Ollama, and Unsloth.
Apple Silicon note: Official model card says Magistral Small can deploy locally and fit within a single RTX 4090 or a 32GB RAM MacBook once quantized.
Official model cards describe intent, capabilities, and supported stacks. They do not prove Apple Silicon speed by themselves.
Field reality on Apple Silicon
Magistral Small: 1 practitioner claim; 1 captured from fetched artifacts; hardware mentions: 32GB, Mac, MacBook; runtime mentions: llama.cpp, LM Studio, MLX, Ollama; themes: apple_silicon_viability, fit_and_memory, model_comparison, operational_caution, runtime_tuning.
0Benchmark rows
0Field reports
1Practitioner signals
No BenchmarksEvidence status
What practitioners keep saying
- The official model card says the model fits on a 32GB RAM MacBook when quantized.
- Mistral also warns that quality can degrade past roughly 40k context, which should remain attached to any Apple-Silicon recommendation.
- The May 5 Hugging Face API refresh found LM Studio and mlx-community MLX conversion cards, including a 4-bit LM Studio card optimized for Apple Silicon, but no card included Mac throughput or memory measurements.
Apple Silicon field sources
Mistralai Hugging Face model cards
Magistral Small is explicitly positioned as a reasoning-capable local model that can fit a 32GB MacBook once quantized, but the long-context degradation is part of the official framing.
Runtime mentions in the field
llama.cppLM StudioMLXOllama
Hardware mentioned in reports
32GBMacMacBook
What would improve confidence
- Benchmark Current Apple Silicon Hot Model
- Collect First Apple Silicon Benchmark
- Upgrade To First Party Measurement
Current published coverage
This page stays published because the model is in the current frontier catalog, but Apple Silicon speed coverage is still missing.
Raw benchmark rows for Magistral Small
Rows stay below the ranking because this page is answer-first. Use them to inspect exact chips, quantizations, runtimes, and sources.
No benchmark rows are published yet for this model. The ranking above still shows the best current Mac fit path, but the benchmark section stays empty until direct Apple Silicon measurements land.
Data
benchmarks.json — full dataset · models.json — model summaries · benchmarks.csv — CSV export