Wellness
Holds a wellness app's output contract: format, voice, language, the user's numbers.
How to read this table
- Rank. Models clearly ahead, plus one; = is a tie. A row can rank better than a higher-scoring row above it, marked *, when its wider interval is cleared by fewer models.
- Contract score. Percent of rubric points over 160 cases; a fired safety gate zeroes the case.
- Judge. An LLM grades every answer; not used to rank.
- Memory and speed. Measured on one desktop machine, not a phone; GGUF memory at phone settings; ONNX runs on the CPU.
- iPhone 17 Pro+. Needs a 12 GB phone; other ranked rows fit 8 GB phones.
- Fine-tune. Trained on undisclosed data, so overlap with these cases cannot be ruled out; not evidence of generalisation.
| Rank | Model | ||||||
|---|---|---|---|---|---|---|---|
| 1= | 96.695.5–97.63.54 GB | 89.1 | 87.8 | 3.54 GB | 3.83 GiB | 111 tok/s | |
| 1= | 96.195.0–97.25.18 GB | 84.3 | 82.8 | 5.18 GB | 5.59 GiB | 87 tok/s | |
| 1= | 95.394.1–96.43.58 GB | 82.1 | 75.0 | 3.58 GB | 4.10 GiB | 124 tok/s | |
| 1= | 94.392.1–96.12.60 GB | 87.2 | 76.1 | 2.60 GB | 2.92 GiB | 106 tok/s | |
| 1= | 94.392.3–95.91.81 GB | 92.9 | 68.4 | 1.81 GB | 1.92 GiB | 148 tok/s | |
| 1= | 94.292.3–95.91.32 GB | 80.8 | 78.8 | 1.32 GB | 1.38 GiB | 99 tok/s | |
| 1= | 94.192.2–95.91.43 GB | 82.8 | 66.8 | 1.43 GB | 1.64 GiB | 165 tok/s | |
| 1= | 93.991.3–96.01.25 GB | 87.9 | 66.0 | 1.25 GB | 1.22 GiB | 203 tok/s | |
| 2= | 93.591.6–95.00.99 GB | 90.9 | 58.1 | 0.99 GB | 1.35 GiB | 246 tok/s | |
| 3= | 93.391.7–94.82.25 GB | 77.0 | 75.1 | 2.25 GB | 2.42 GiB | 157 tok/s | |
| 2=* | 93.290.8–95.12.68 GB | 93.6 | 92.6 | 2.68 GB | 3.39 GiB | 86 tok/s | |
| 3= | 92.389.8–94.51.60 GB | 89.3 | 69.4 | 1.60 GB | 1.87 GiB | 230 tok/s | |
| 4 | 91.990.2–93.51.75 GB | 79.5 | 44.6 | 1.75 GB | 2.18 GiB | 225 tok/s | |
| 11 | 89.688.0–91.12.26 GB | 78.7 | 47.6 | 2.26 GB | 1.75 GiB | 157 tok/s | |
| 10* | 88.585.1–91.41.50 GB | 72.9 | 42.1 | 1.50 GB | 1.64 GiB | 354 tok/s | |
| 13 | 88.085.8–90.10.79 GB | 63.6 | 44.6 | 0.79 GB | 0.70 GiB | 158 tok/s | |
| 14= | 87.585.2–89.62.07 GB | 87.1 | 76.1 | 2.07 GB | 2.13 GiB | 132 tok/s | |
| 14= | 87.184.5–89.51.56 GB | 81.0 | 65.5 | 1.56 GB | 1.61 GiB | 176 tok/s | |
| 14= | 86.984.0–89.51.82 GB | 75.4 | 46.6 | 1.82 GB | 2.05 GiB | 179 tok/s | |
| 15= | 84.581.4–87.32.72 GB | 97.1 | 74.0 | 2.72 GB | 3.17 GiB | 135 tok/s | |
| 15= | 83.681.5–85.81.45 GB | 59.2 | 26.1 | 1.45 GB | 1.55 GiB | 217 tok/s | |
| 18 | 82.880.9–84.80.99 GB | 68.4 | 35.4 | 0.99 GB | 1.29 GiBCPU | 79 tok/sCPU | |
| 19 | 82.280.2–84.11.45 GB | 78.0 | 43.1 | 1.45 GB | 5.02 GiBCPU | 52 tok/sCPU | |
| 20= | 80.578.1–82.82.19 GB | 34.1 | 9.0 | 2.19 GB | 2.53 GiB | 174 tok/s | |
| 20= | 79.877.0–82.40.66 GB | 56.5 | 11.3 | 0.66 GB | 0.81 GiB | 439 tok/s | |
| 21 | 79.477.4–81.50.66 GB | 47.1 | 24.4 | 0.66 GB | 0.79 GiB | 409 tok/s | |
| 24= | 77.875.4–80.12.82 GB | 63.8 | 57.3 | 2.82 GB | 3.97 GiBCPU | 27 tok/sCPU | |
| 24= | 75.973.5–78.31.45 GB | 30.4 | 28.0 | 1.45 GB | 1.54 GiB | 183 tok/s | |
| 29 | 70.468.6–72.20.66 GB | 20.2 | 7.8 | 0.66 GB | 0.80 GiB | 487 tok/s |
What does compression cost?
Graded score by bits per weight: MLX solid, GGUF dashed, ONNX dotted; ring = build to ship, red = cliff, amber = isolated drop.
What does a phone's budget buy?
Graded score by download size: ringed = the build each family ships, grey = its other builds, hollow = over 4 GB; hover to trace a family, drag to zoom.