Silicon Score › Models › llama-3-1-8b-instruct

llama-3-1-8b-instruct — ranking first, raw rows below

Start with the ranked Mac table above. Use the rest of this page to inspect raw Apple Silicon coverage and model metadata.

Quantizations observed: Q4_K - Medium

Current published coverage

Published chip coverage includes M3 Ultra (80-core GPU, 256 GB), M3 Ultra (80-core GPU, 512 GB), M5 Max (32-core GPU, 36 GB), M2 Ultra (60-core GPU, 64 GB), M4 Max (40-core GPU, 48 GB) plus 47 more chip tiers. Fastest published row is 63.3 tok/s on M3 Ultra (80-core GPU, 256 GB) at Q4_K - Medium.

Raw benchmark rows for llama-3-1-8b-instruct

Rows stay below the ranking because this page is answer-first. Use them to inspect exact chips, quantizations, runtimes, and sources.

Chips with published results for llama-3-1-8b-instruct

Data

benchmarks.json — full dataset  ·  models.json — model summaries  ·  benchmarks.csv — CSV export

See all models →