Wellness

Holds a wellness app's output contract: format, voice, language, the user's numbers.

How to read this table
  • Rank. Models clearly ahead, plus one; = is a tie. A row can rank better than a higher-scoring row above it, marked *, when its wider interval is cleared by fewer models.
  • Contract score. Percent of rubric points over 160 cases; a fired safety gate zeroes the case.
  • Judge. An LLM grades every answer; not used to rank.
  • Memory and speed. Measured on one desktop machine, not a phone; GGUF memory at phone settings; ONNX runs on the CPU.
  • iPhone 17 Pro+. Needs a 12 GB phone; other ranked rows fit 8 GB phones.
  • Fine-tune. Trained on undisclosed data, so overlap with these cases cannot be ruled out; not evidence of generalisation.
Model leaderboard · sorted by official order (overall score, compared by interval)
RankModel
1=96.695.5–97.63.54 GB89.187.83.54 GB3.83 GiB111 tok/s
1=96.195.0–97.25.18 GB84.382.85.18 GB5.59 GiB87 tok/s
1=95.394.1–96.43.58 GB82.175.03.58 GB4.10 GiB124 tok/s
1=94.392.1–96.12.60 GB87.276.12.60 GB2.92 GiB106 tok/s
1=94.392.3–95.91.81 GB92.968.41.81 GB1.92 GiB148 tok/s
1=94.292.3–95.91.32 GB80.878.81.32 GB1.38 GiB99 tok/s
1=94.192.2–95.91.43 GB82.866.81.43 GB1.64 GiB165 tok/s
1=93.991.3–96.01.25 GB87.966.01.25 GB1.22 GiB203 tok/s
2=93.591.6–95.00.99 GB90.958.10.99 GB1.35 GiB246 tok/s
3=93.391.7–94.82.25 GB77.075.12.25 GB2.42 GiB157 tok/s
2=*93.290.8–95.12.68 GB93.692.62.68 GB3.39 GiB86 tok/s
3=92.389.8–94.51.60 GB89.369.41.60 GB1.87 GiB230 tok/s
491.990.2–93.51.75 GB79.544.61.75 GB2.18 GiB225 tok/s
1189.688.0–91.12.26 GB78.747.62.26 GB1.75 GiB157 tok/s
10*88.585.1–91.41.50 GB72.942.11.50 GB1.64 GiB354 tok/s
1388.085.8–90.10.79 GB63.644.60.79 GB0.70 GiB158 tok/s
14=87.585.2–89.62.07 GB87.176.12.07 GB2.13 GiB132 tok/s
14=87.184.5–89.51.56 GB81.065.51.56 GB1.61 GiB176 tok/s
14=86.984.0–89.51.82 GB75.446.61.82 GB2.05 GiB179 tok/s
15=84.581.4–87.32.72 GB97.174.02.72 GB3.17 GiB135 tok/s
15=83.681.5–85.81.45 GB59.226.11.45 GB1.55 GiB217 tok/s
1882.880.9–84.80.99 GB68.435.40.99 GB1.29 GiBCPU79 tok/sCPU
1982.280.2–84.11.45 GB78.043.11.45 GB5.02 GiBCPU52 tok/sCPU
20=80.578.1–82.82.19 GB34.19.02.19 GB2.53 GiB174 tok/s
20=79.877.0–82.40.66 GB56.511.30.66 GB0.81 GiB439 tok/s
2179.477.4–81.50.66 GB47.124.40.66 GB0.79 GiB409 tok/s
24=77.875.4–80.12.82 GB63.857.32.82 GB3.97 GiBCPU27 tok/sCPU
24=75.973.5–78.31.45 GB30.428.01.45 GB1.54 GiB183 tok/s
2970.468.6–72.20.66 GB20.27.80.66 GB0.80 GiB487 tok/s

What does compression cost?

Graded score by bits per weight: MLX solid, GGUF dashed, ONNX dotted; ring = build to ship, red = cliff, amber = isolated drop.

Gemma 4 E2B IT
608010016.07 bpw2.30 bpwGemma 4 E2B IT · 8-bit MLX · 9.19 bpw · 95.7% measured · 5.90 GB · reference rungGemma 4 E2B IT · 6-bit MLX · 7.38 bpw · 96.1% measured · 4.74 GBGemma 4 E2B IT · 5-bit MLX · 6.47 bpw · 95.7% measured · 4.16 GBGemma 4 E2B IT · 4-bit MLX · 5.56 bpw · 95.3% measured · 3.58 GB · build to shipGemma 4 E2B IT · INT4 ONNX · 5.54 bpw · 95.4% measured · 3.95 GB
Gemma 4 E4B IT
608010016.07 bpw2.30 bpwGemma 4 E4B IT · 8-bit MLX · 8.95 bpw · 96.3% measured · 8.91 GB · reference rungGemma 4 E4B IT · 6-bit MLX · 7.07 bpw · 95.9% measured · 7.05 GBGemma 4 E4B IT · 5-bit MLX · 6.13 bpw · 96.2% measured · 6.11 GBGemma 4 E4B IT · 4-bit MLX · 5.18 bpw · 96.1% measured · 5.18 GB · build to shipGemma 4 E4B IT · INT4 ONNX · 5.57 bpw · 96.1% measured · 5.94 GB
Granite 4.0 H Micro
608010016.07 bpw2.30 bpwGranite 4.0 H Micro · BF16 GGUF · 16.01 bpw · 90.4% measured · 6.39 GB · reference rungGranite 4.0 H Micro · Q8_0 GGUF · 8.51 bpw · 91.4% measured · 3.40 GBGranite 4.0 H Micro · Q6_K GGUF · 6.57 bpw · 91.1% measured · 2.63 GBGranite 4.0 H Micro · Q5_K_M GGUF · 5.69 bpw · 89.6% measured · 2.27 GBGranite 4.0 H Micro · Q4_K_M GGUF · 4.86 bpw · 89.4% measured · 1.94 GBGranite 4.0 H Micro · 8-bit MLX · 8.50 bpw · 92.2% measured · 3.40 GBGranite 4.0 H Micro · 6-bit MLX · 6.50 bpw · 93.0% measured · 2.60 GBGranite 4.0 H Micro · 4-bit MLX · 4.50 bpw · 94.3% measured · 1.81 GB · build to shipGranite 4.0 H Micro · INT4 ONNX · 5.40 bpw · 91.1% measured · 2.16 GB
LFM3 VL 2B
608010016.07 bpw2.30 bpwLFM3 VL 2B · BF16 MLX · 16.00 bpw · 93.4% measured · 3.85 GB · reference rungLFM3 VL 2B · 8-bit MLX · 9.24 bpw · 91.5% measured · 2.23 GBLFM3 VL 2B · 6-bit MLX · 7.44 bpw · 92.5% measured · 1.80 GBLFM3 VL 2B · 4-bit MLX · 6.63 bpw · 93.2% measured · 1.61 GBLFM3 VL 2B · 5-bit MLX · 6.54 bpw · 93.1% measured · 1.59 GBLFM3 VL 2B · BF16 GGUF · 15.27 bpw · 92.4% measured · 3.67 GBLFM3 VL 2B · Q8_0 GGUF · 8.51 bpw · 92.7% measured · 2.05 GBLFM3 VL 2B · Q6_K GGUF · 6.77 bpw · 92.7% measured · 1.63 GBLFM3 VL 2B · Q5_K_M GGUF · 6.06 bpw · 92.4% measured · 1.46 GBLFM3 VL 2B · Q4_K_M GGUF · 5.40 bpw · 93.1% measured · 1.30 GBLFM3 VL 2B · QAD-Q4_0 GGUF · 5.19 bpw · 93.9% measured · 1.25 GB · build to ship
MiniCPM5 2B
608010016.07 bpw2.30 bpwMiniCPM5 2B · F16 GGUF · 16.00 bpw · 93.2% measured · 5.04 GB · reference rungMiniCPM5 2B · Q8_0 GGUF · 8.50 bpw · 93.8% measured · 2.68 GBMiniCPM5 2B · Q4_K_M GGUF · 4.95 bpw · 92.7% measured · 1.56 GBMiniCPM5 2B · INT4-F16 ONNX · 5.72 bpw · 93.7% measured · 1.84 GBMiniCPM5 2B · 4-bit MLX · 4.50 bpw · 94.1% measured · 1.43 GB · build to ship
Spark X2.5 4B
608010016.07 bpw2.30 bpwSpark X2.5 4B · BF16 GGUF · 16.00 bpw · 95.1% measured · 8.23 GB · reference rungSpark X2.5 4B · Q8_0 GGUF · 8.50 bpw · 96.4% measured · 4.38 GBSpark X2.5 4B · Q4_K_M GGUF · 5.05 bpw · 94.3% measured · 2.60 GB · build to ship
Spark X2.6 4B
608010016.07 bpw2.30 bpwSpark X2.6 4B · BF16 GGUF · 16.00 bpw · 96.0% measured · 8.23 GB · reference rungSpark X2.6 4B · Q8_0 GGUF · 8.50 bpw · 96.0% measured · 4.38 GBSpark X2.6 4B · Q4_K_M GGUF · 6.36 bpw · 96.6% measured · 3.54 GB · build to ship
Ternary Bonsai 2 4B
608010016.07 bpw2.30 bpwTernary Bonsai 2 4B · 2-bit MLX · 3.30 bpw · 94.2% measured · 1.88 GB · reference rungTernary Bonsai 2 4B · Q2_0 GGUF · 2.76 bpw · 94.2% measured · 1.58 GBTernary Bonsai 2 4B · PQ2_0 GGUF · 2.65 bpw · 94.2% measured · 1.51 GBTernary Bonsai 2 4B · PTQ1_0 GGUF · 2.30 bpw · 94.2% measured · 1.32 GB · build to ship
LFM3 1.7B
608010016.07 bpw2.30 bpwLFM3 1.7B · BF16 GGUF · 16.00 bpw · 92.6% measured · 3.47 GB · reference rungLFM3 1.7B · Q8_0 GGUF · 8.51 bpw · 94.3% measured · 1.85 GBLFM3 1.7B · Q6_K GGUF · 6.57 bpw · 94.3% measured · 1.43 GBLFM3 1.7B · Q5_K_M GGUF · 5.79 bpw · 92.9% measured · 1.26 GBLFM3 1.7B · Q4_K_M GGUF · 5.05 bpw · 92.8% measured · 1.10 GBLFM3 1.7B · QAD-Q4_0 GGUF · 4.82 bpw · 92.5% measured · 1.05 GBLFM3 1.7B · BF16 MLX · 16.00 bpw · 93.6% measured · 3.48 GBLFM3 1.7B · 8-bit MLX · 8.50 bpw · 94.4% measured · 1.86 GBLFM3 1.7B · 6-bit MLX · 6.50 bpw · 92.1% measured · 1.42 GBLFM3 1.7B · 5-bit MLX · 5.50 bpw · 93.3% measured · 1.21 GBLFM3 1.7B · 4-bit MLX · 4.50 bpw · 93.5% measured · 0.99 GB · build to ship
Nanbeige4.2 3B
608010016.07 bpw2.30 bpwNanbeige4.2 3B · BF16 GGUF · 16.00 bpw · 93.9% measured · 8.34 GB · reference rungNanbeige4.2 3B · Q8_0 GGUF · 8.50 bpw · 93.4% measured · 4.43 GBNanbeige4.2 3B · Q6_K GGUF · 6.89 bpw · 93.6% measured · 3.60 GBNanbeige4.2 3B · Q5_K_M GGUF · 5.89 bpw · 94.1% measured · 3.08 GBNanbeige4.2 3B · Q4_K_M GGUF · 5.14 bpw · 93.2% measured · 2.68 GB · build to ship
LFM2.5 2.6B
608010016.07 bpw2.30 bpwLFM2.5 2.6B · Q8_0 GGUF · 8.50 bpw · 89.1% measured · 2.87 GB · reference rungLFM2.5 2.6B · Q6_K GGUF · 6.57 bpw · 90.9% measured · 2.22 GBLFM2.5 2.6B · Q5_K_M GGUF · 5.73 bpw · 91.9% measured · 1.94 GBLFM2.5 2.6B · Q4_K_M GGUF · 4.94 bpw · 92.9% measured · 1.67 GBLFM2.5 2.6B · 8-bit MLX · 8.50 bpw · 91.3% measured · 2.88 GBLFM2.5 2.6B · 6-bit MLX · 6.50 bpw · 92.2% measured · 2.21 GBLFM2.5 2.6B · 5-bit MLX · 5.60 bpw · 92.2% measured · 1.91 GBLFM2.5 2.6B · 4-bit MLX · 4.70 bpw · 92.3% measured · 1.60 GB · build to shipLFM2.5 2.6B · INT4 ONNX · 5.40 bpw · 92.7% measured · 1.87 GB
NVIDIA Nemotron 3 Nano 4B
608010016.07 bpw2.30 bpwNVIDIA Nemotron 3 Nano 4B · Q8_0 GGUF · 8.51 bpw · 94.2% measured · 4.23 GB · reference rungNVIDIA Nemotron 3 Nano 4B · Q6_K GGUF · 7.90 bpw · 93.8% measured · 3.93 GBNVIDIA Nemotron 3 Nano 4B · Q4_K_M GGUF · 5.70 bpw · 95.4% measured · 2.84 GBNVIDIA Nemotron 3 Nano 4B · 8-bit MLX · 8.50 bpw · 94.3% measured · 4.24 GBNVIDIA Nemotron 3 Nano 4B · 6-bit MLX · 6.50 bpw · 94.1% measured · 3.25 GBNVIDIA Nemotron 3 Nano 4B · 4-bit MLX · 4.50 bpw · 93.3% measured · 2.25 GB · build to shipNVIDIA Nemotron 3 Nano 4B · INT4 ONNX · 5.14 bpw · 95.4% measured · 2.57 GB
Qwen3.5 2B
608010016.07 bpw2.30 bpwQwen3.5 2B · BF16 GGUF · 16.02 bpw · 91.8% measured · 4.44 GB · reference rungQwen3.5 2B · Q8_0 GGUF · 9.65 bpw · 91.6% measured · 2.68 GBQwen3.5 2B · Q6_K GGUF · 8.07 bpw · 92.7% measured · 2.24 GBQwen3.5 2B · Q5_K_M GGUF · 7.56 bpw · 92.6% measured · 2.10 GBQwen3.5 2B · Q4_K_M GGUF · 7.01 bpw · 92.5% measured · 1.95 GBQwen3.5 2B · 8-bit MLX · 9.62 bpw · 93.0% measured · 2.69 GBQwen3.5 2B · 6-bit MLX · 7.92 bpw · 90.0% measured · 2.22 GBQwen3.5 2B · 5-bit MLX · 7.07 bpw · 92.4% measured · 1.98 GBQwen3.5 2B · 4-bit MLX · 6.22 bpw · 91.9% measured · 1.75 GB · build to shipQwen3.5 2B · INT4 ONNX · 6.32 bpw · 92.4% measured · 1.77 GB
LFM2.5 VL 1.6B
608010016.07 bpw2.30 bpwLFM2.5 VL 1.6B · BF16 MLX · 16.00 bpw · 87.3% measured · 3.20 GB · reference rungLFM2.5 VL 1.6B · 8-bit MLX · 10.44 bpw · 86.5% measured · 2.09 GBLFM2.5 VL 1.6B · 6-bit MLX · 8.96 bpw · 88.0% measured · 1.79 GBLFM2.5 VL 1.6B · 5-bit MLX · 8.21 bpw · 88.7% measured · 1.64 GBLFM2.5 VL 1.6B · 4-bit MLX · 7.47 bpw · 88.5% measured · 1.50 GB · build to shipLFM2.5 VL 1.6B · BF16 GGUF · 14.65 bpw · 88.9% measured · 2.93 GBLFM2.5 VL 1.6B · Q8_0 GGUF · 9.15 bpw · 87.7% measured · 1.83 GBLFM2.5 VL 1.6B · Q6_K GGUF · 7.73 bpw · 90.7% measured · 1.55 GB
LFM2.5 VL 3B
608010016.07 bpw2.30 bpwLFM2.5 VL 3B · BF16 MLX · 16.00 bpw · 87.5% measured · 6.27 GB · reference rungLFM2.5 VL 3B · 8-bit MLX · 9.52 bpw · 88.5% measured · 3.74 GBLFM2.5 VL 3B · 6-bit MLX · 7.80 bpw · 87.4% measured · 3.06 GBLFM2.5 VL 3B · 5-bit MLX · 7.02 bpw · 88.6% measured · 2.76 GBLFM2.5 VL 3B · 4-bit MLX · 6.07 bpw · 90.1% measured · 2.39 GBLFM2.5 VL 3B · INT4 + FP32 ONNX · 9.96 bpw · 87.8% measured · 3.94 GBLFM2.5 VL 3B · Q8_0 GGUF · 8.84 bpw · 88.7% measured · 3.46 GBLFM2.5 VL 3B · Q6_K GGUF · 7.16 bpw · 87.7% measured · 2.80 GBLFM2.5 VL 3B · Q5_K_M GGUF · 6.44 bpw · 88.7% measured · 2.52 GBLFM2.5 VL 3B · Q4_K_M GGUF · 5.76 bpw · 89.6% measured · 2.26 GB · build to ship
Ternary Bonsai 2 2B
608010016.07 bpw2.30 bpwTernary Bonsai 2 2B · 2-bit MLX · 4.34 bpw · 88.1% measured · 1.21 GB · reference rungTernary Bonsai 2 2B · Q2_0 GGUF · 3.25 bpw · 88.0% measured · 0.91 GBTernary Bonsai 2 2B · PQ2_0 GGUF · 3.15 bpw · 88.0% measured · 0.88 GBTernary Bonsai 2 2B · PTQ1_0 GGUF · 2.83 bpw · 88.0% measured · 0.79 GB · build to ship
Granite 4.2 3B
608010016.07 bpw2.30 bpwGranite 4.2 3B · BF16 GGUF · 16.00 bpw · 88.2% measured · 7.32 GB · reference rungGranite 4.2 3B · Q8_0 GGUF · 8.50 bpw · 89.0% measured · 3.89 GBGranite 4.2 3B · Q6_K GGUF · 6.56 bpw · 90.5% measured · 3.01 GBGranite 4.2 3B · Q5_K_M GGUF · 5.71 bpw · 90.9% measured · 2.61 GBGranite 4.2 3B · Q4_K_M GGUF · 4.90 bpw · 89.9% measured · 2.24 GBGranite 4.2 3B · BF16 MLX · 16.00 bpw · 88.9% measured · 7.33 GBGranite 4.2 3B · 8-bit MLX · 8.50 bpw · 87.7% measured · 3.90 GBGranite 4.2 3B · 4-bit MLX · 4.50 bpw · 87.5% measured · 2.07 GB · build to ship
LFM2 2.6Bisolated drop at INT4 + FP32
608010016.07 bpw2.30 bpwLFM2 2.6B · F16 GGUF · 16.00 bpw · 88.9% measured · 5.14 GB · reference rungLFM2 2.6B · Q8_0 GGUF · 8.50 bpw · 87.9% measured · 2.73 GBLFM2 2.6B · Q6_K GGUF · 6.57 bpw · 87.1% measured · 2.11 GBLFM2 2.6B · Q5_K_M GGUF · 5.69 bpw · 85.2% measured · 1.83 GBLFM2 2.6B · Q4_K_M GGUF · 4.86 bpw · 87.1% measured · 1.56 GB · build to shipLFM2 2.6B · 8-bit MLX · 8.50 bpw · 87.6% measured · 2.74 GBLFM2 2.6B · 4-bit MLX · 4.50 bpw · 85.0% measured · 1.45 GBLFM2 2.6B · INT4 + FP32 ONNX · 6.41 bpw · 81.3% measured · 2.10 GB · isolated drop (not a cliff: a narrower rung of this format holds)
Llama 3.2 3B Instruct
608010016.07 bpw2.30 bpwLlama 3.2 3B Instruct · BF16 MLX · 16.00 bpw · 84.8% measured · 6.43 GB · reference rungLlama 3.2 3B Instruct · 8-bit MLX · 8.50 bpw · 84.7% measured · 3.42 GBLlama 3.2 3B Instruct · 4-bit MLX · 4.50 bpw · 86.9% measured · 1.82 GB · build to shipLlama 3.2 3B Instruct · Q8_0 GGUF · 8.50 bpw · 85.2% measured · 3.42 GBLlama 3.2 3B Instruct · Q6_K GGUF · 6.56 bpw · 87.2% measured · 2.64 GBLlama 3.2 3B Instruct · Q5_K_M GGUF · 5.76 bpw · 87.6% measured · 2.32 GBLlama 3.2 3B Instruct · Q4_K_M GGUF · 5.01 bpw · 86.4% measured · 2.02 GBLlama 3.2 3B Instruct · INT4 + FP32 ONNX · 8.31 bpw · 84.8% measured · 3.42 GB
LFM2 2.6B Longevity
608010016.07 bpw2.30 bpwLFM2 2.6B Longevity · F16 GGUF · 16.00 bpw · 83.4% measured · 5.14 GB · reference rungLFM2 2.6B Longevity · Q8_0 GGUF · 8.50 bpw · 83.9% measured · 2.73 GBLFM2 2.6B Longevity · Q6_K GGUF · 6.57 bpw · 82.3% measured · 2.11 GBLFM2 2.6B Longevity · Q5_K_M GGUF · 5.69 bpw · 82.5% measured · 1.83 GBLFM2 2.6B Longevity · Q4_K_M GGUF · 4.86 bpw · 83.7% measured · 1.56 GBLFM2 2.6B Longevity · 8-bit MLX · 8.50 bpw · 83.3% measured · 2.73 GBLFM2 2.6B Longevity · 4-bit MLX · 4.50 bpw · 83.6% measured · 1.45 GB · build to shipLFM2 2.6B Longevity · INT4 mixed ONNX · 5.84 bpw · 83.2% measured · 1.92 GB
MedPsy 4B
608010016.07 bpw2.30 bpwMedPsy 4B · BF16 GGUF · 16.00 bpw · 87.7% measured · 8.83 GB · reference rungMedPsy 4B · Q8_0 GGUF · 8.50 bpw · 87.3% measured · 4.69 GBMedPsy 4B · Q5_K_M-imat GGUF · 5.71 bpw · 86.4% measured · 3.16 GBMedPsy 4B · Q4_K_M-imat GGUF · 4.91 bpw · 84.5% measured · 2.72 GB · build to shipMedPsy 4B · INT4 mixed ONNX · 6.28 bpw · 89.9% measured · 3.31 GB
MiniCPM V 4.7 1B
608010016.07 bpw2.30 bpwMiniCPM V 4.7 1B · F16 GGUF · 16.07 bpw · 85.1% measured · 3.13 GB · reference rungMiniCPM V 4.7 1B · Q8_0 GGUF · 11.22 bpw · 84.6% measured · 2.19 GBMiniCPM V 4.7 1B · Q6_K GGUF · 9.97 bpw · 85.1% measured · 1.95 GBMiniCPM V 4.7 1B · Q5_K_M GGUF · 9.53 bpw · 82.4% measured · 1.86 GBMiniCPM V 4.7 1B · Q4_K_M GGUF · 9.12 bpw · 86.8% measured · 1.78 GBMiniCPM V 4.7 1B · FP16, text only ONNX · 16.00 bpw · 85.1% measured · 2.07 GBMiniCPM V 4.7 1B · INT4-F16, text only ONNX · 7.41 bpw · 82.8% measured · 0.99 GB · build to shipMiniCPM V 4.7 1B · BF16 MLX · 16.00 bpw · 84.9% measured · 3.13 GBMiniCPM V 4.7 1B · 8-bit MLX · 14.51 bpw · 84.3% measured · 2.84 GBMiniCPM V 4.7 1B · 6-bit MLX · 14.12 bpw · 84.4% measured · 2.76 GBMiniCPM V 4.7 1B · 5-bit MLX · 13.92 bpw · 82.1% measured · 2.72 GBMiniCPM V 4.7 1B · 4-bit MLX · 13.72 bpw · 86.8% measured · 2.69 GB
MedPsy 1.7B
608010016.07 bpw2.30 bpwMedPsy 1.7B · BF16 GGUF · 16.00 bpw · 83.8% measured · 4.07 GB · reference rungMedPsy 1.7B · Q8_0 GGUF · 8.50 bpw · 82.2% measured · 2.17 GBMedPsy 1.7B · Q5_K_M-imat GGUF · 5.77 bpw · 81.6% measured · 1.47 GBMedPsy 1.7B · Q4_K_M-imat GGUF · 5.03 bpw · 79.4% measured · 1.28 GBMedPsy 1.7B · INT4 mixed ONNX · 6.58 bpw · 82.2% measured · 1.45 GB · build to ship
LFM2 1.2B Longevity
608010016.07 bpw2.30 bpwLFM2 1.2B Longevity · F16 GGUF · 16.00 bpw · 79.8% measured · 2.34 GB · reference rungLFM2 1.2B Longevity · Q8_0 GGUF · 8.50 bpw · 80.9% measured · 1.25 GBLFM2 1.2B Longevity · Q6_K GGUF · 6.57 bpw · 81.2% measured · 0.96 GBLFM2 1.2B Longevity · Q5_K_M GGUF · 5.75 bpw · 80.7% measured · 0.84 GBLFM2 1.2B Longevity · Q4_K_M GGUF · 4.98 bpw · 78.9% measured · 0.73 GBLFM2 1.2B Longevity · 8-bit MLX · 8.50 bpw · 79.1% measured · 1.25 GBLFM2 1.2B Longevity · 4-bit MLX · 4.50 bpw · 79.8% measured · 0.66 GB · build to shipLFM2 1.2B Longevity · INT4 mixed ONNX · 6.08 bpw · 77.8% measured · 0.93 GB
North Micro Vision Instruct
608010016.07 bpw2.30 bpwNorth Micro Vision Instruct · BF16 MLX · 16.00 bpw · 80.2% measured · 4.99 GB · reference rungNorth Micro Vision Instruct · 8-bit MLX · 10.13 bpw · 79.8% measured · 3.16 GBNorth Micro Vision Instruct · 6-bit MLX · 8.56 bpw · 80.3% measured · 2.68 GBNorth Micro Vision Instruct · 5-bit MLX · 7.78 bpw · 80.2% measured · 2.44 GBNorth Micro Vision Instruct · 4-bit MLX · 6.99 bpw · 80.5% measured · 2.19 GB · build to ship
LFM2.5 1.2B Instruct
608010016.07 bpw2.30 bpwLFM2.5 1.2B Instruct · BF16 GGUF · 16.00 bpw · 78.5% measured · 2.34 GB · reference rungLFM2.5 1.2B Instruct · Q8_0 GGUF · 8.50 bpw · 78.8% measured · 1.25 GBLFM2.5 1.2B Instruct · Q6_K GGUF · 6.57 bpw · 77.5% measured · 0.96 GBLFM2.5 1.2B Instruct · Q5_K_M GGUF · 5.75 bpw · 78.6% measured · 0.84 GBLFM2.5 1.2B Instruct · Q4_K_M GGUF · 4.98 bpw · 75.9% measured · 0.73 GBLFM2.5 1.2B Instruct · BF16 MLX · 16.00 bpw · 78.1% measured · 2.35 GBLFM2.5 1.2B Instruct · 8-bit MLX · 8.50 bpw · 78.5% measured · 1.25 GBLFM2.5 1.2B Instruct · 6-bit MLX · 6.50 bpw · 79.6% measured · 0.96 GBLFM2.5 1.2B Instruct · 5-bit MLX · 5.50 bpw · 80.2% measured · 0.81 GBLFM2.5 1.2B Instruct · 4-bit MLX · 4.50 bpw · 79.4% measured · 0.66 GB · build to shipLFM2.5 1.2B Instruct · INT4 ONNX · 5.59 bpw · 81.5% measured · 0.85 GB
LFM2 2.6B Exp
608010016.07 bpw2.30 bpwLFM2 2.6B Exp · F16 GGUF · 16.00 bpw · 78.5% measured · 5.41 GB · reference rungLFM2 2.6B Exp · Q8_0 GGUF · 8.50 bpw · 78.3% measured · 2.88 GBLFM2 2.6B Exp · Q6_K GGUF · 6.57 bpw · 78.9% measured · 2.22 GBLFM2 2.6B Exp · Q5_K_M GGUF · 5.68 bpw · 74.0% measured · 1.92 GBLFM2 2.6B Exp · Q4_K_M GGUF · 4.84 bpw · 81.0% measured · 1.64 GBLFM2 2.6B Exp · BF16 MLX · 16.00 bpw · 78.2% measured · 5.14 GBLFM2 2.6B Exp · 8-bit MLX · 8.50 bpw · 77.3% measured · 2.74 GBLFM2 2.6B Exp · 6-bit MLX · 6.50 bpw · 77.1% measured · 2.09 GBLFM2 2.6B Exp · 5-bit MLX · 5.50 bpw · 74.4% measured · 1.77 GBLFM2 2.6B Exp · 4-bit MLX · 4.50 bpw · 75.9% measured · 1.45 GB · build to shipLFM2 2.6B Exp · INT4 ONNX · 5.34 bpw · 74.7% measured · 1.75 GB
Ministral 3 3B Instruct 2512isolated drop at 4-bit
608010016.07 bpw2.30 bpwMinistral 3 3B Instruct 2512 · BF16 GGUF · 16.00 bpw · 79.6% measured · 7.71 GB · reference rungMinistral 3 3B Instruct 2512 · Q8_0 GGUF · 9.32 bpw · 81.0% measured · 4.49 GBMinistral 3 3B Instruct 2512 · Q5_K_M GGUF · 6.87 bpw · 78.6% measured · 3.32 GBMinistral 3 3B Instruct 2512 · Q4_K_M GGUF · 6.19 bpw · 79.3% measured · 2.99 GBMinistral 3 3B Instruct 2512 · BF16 MLX · 16.00 bpw · 80.1% measured · 7.73 GBMinistral 3 3B Instruct 2512 · 8-bit MLX · 9.29 bpw · 78.3% measured · 4.50 GBMinistral 3 3B Instruct 2512 · 6-bit MLX · 7.50 bpw · 79.4% measured · 3.64 GBMinistral 3 3B Instruct 2512 · 5-bit MLX · 6.60 bpw · 79.0% measured · 3.21 GBMinistral 3 3B Instruct 2512 · 4-bit MLX · 5.71 bpw · 74.5% measured · 2.78 GB · isolated drop (not a cliff: a narrower rung of this format holds)Ministral 3 3B Instruct 2512 · INT4 ONNX · 5.56 bpw · 77.8% measured · 2.82 GB · build to ship
LFM2.5 1.2B Thinking
608010016.07 bpw2.30 bpwLFM2.5 1.2B Thinking · BF16 MLX · 16.00 bpw · 70.1% measured · 2.35 GB · reference rungLFM2.5 1.2B Thinking · 8-bit MLX · 8.50 bpw · 70.0% measured · 1.25 GBLFM2.5 1.2B Thinking · 6-bit MLX · 6.50 bpw · 71.8% measured · 0.96 GBLFM2.5 1.2B Thinking · 5-bit MLX · 5.50 bpw · 69.7% measured · 0.81 GBLFM2.5 1.2B Thinking · 4-bit MLX · 4.50 bpw · 70.4% measured · 0.66 GB · build to ship · 4 of 160 answers cut off at the budgetLFM2.5 1.2B Thinking · INT4 ONNX · 5.59 bpw · 69.8% measured · 0.85 GB

What does a phone's budget buy?

Graded score by download size: ringed = the build each family ships, grey = its other builds, hollow = over 4 GB; hover to trace a family, drag to zoom.

657075808590951001 GB2 GB4 GB8 GB4 GB phone budgetGranite 4.0 H Micro · 4-bitSpark X2.5 4B · Q4_K_MSpark X2.6 4B · Q4_K_MTernary Bonsai 2 4B · PTQ1_0LFM3 VL 2B · QAD-Q4_0LFM3 1.7B · 4-bitTernary Bonsai 2 2B · PTQ1_0LFM2 1.2B Longevity · 4-bitdownload size (log scale), vision tower included