Clinical & Medical
Numeric reasoning, extraction, contract-holding and safety, measured on the file you ship.
How to read this table
- Rank. Models clearly ahead, plus one; = is a tie. A row can rank better than a higher-scoring row above it, marked *, when its wider interval is cleared by fewer models.
- Overall score. Percent of rubric points over 167 cases; a fired safety gate zeroes the case.
- Judge. An LLM grades the open-ended answers; not used to rank.
- Memory and speed. Measured on one desktop machine, not a phone; GGUF memory at phone settings; ONNX runs on the CPU.
- iPhone 17 Pro+. Needs a 12 GB phone; other ranked rows fit 8 GB phones.
- Fine-tune. Trained on undisclosed data, so overlap with these cases cannot be ruled out; not evidence of generalisation.
| Rank | Model | |||||
|---|---|---|---|---|---|---|
| 1= | 89.886.2–93.07.05 GB | 92.8 | 7.05 GB | 7.25 GiB | 76 tok/s | |
| 1= | 86.282.1–89.92.68 GB | 90.6 | 2.68 GB | 3.38 GiB | 85 tok/s | |
| 1= | 86.181.5–90.31.94 GB | 90.3 | 1.94 GB | 1.99 GiB | 183 tok/s | |
| 1= | 86.081.8–89.83.54 GB | 89.4 | 3.54 GB | 3.83 GiB | 111 tok/s | |
| 1= | 82.878.5–86.81.32 GB | 86.7 | 1.32 GB | 1.28 GiB | 98 tok/s | |
| 1= | 82.377.9–86.52.25 GB | 78.9 | 2.25 GB | 2.51 GiB | 141 tok/s | |
| 2= | 81.378.0–84.32.72 GB | 93.3 | 2.72 GB | 3.21 GiB | 138 tok/s | |
| 2= | 81.176.4–85.52.61 GB | 87.2 | 2.61 GB | 2.90 GiB | 118 tok/s | |
| 2= | 80.575.7–85.03.58 GB | 84.4 | 3.58 GB | 4.10 GiB | 129 tok/s | |
| 2= | 80.575.8–84.91.94 GB | 81.1 | 1.94 GB | 2.16 GiB | 93 tok/s | |
| 4= | 77.372.6–81.72.60 GB | 81.7 | 2.60 GB | 2.96 GiB | 100 tok/s | |
| 4= | 76.871.9–81.52.26 GB | 79.4 | 2.26 GB | 1.75 GiB | 168 tok/s | |
| 5= | 76.071.1–80.81.77 GB | 71.7 | 1.77 GB | 2.30 GiBCPU | 26 tok/sCPU | |
| 5= | 74.169.2–78.82.68 GB | 71.7 | 2.68 GB | 2.76 GiB | 132 tok/s | |
| 6 | 73.468.2–78.40.81 GB | 73.3 | 0.81 GB | 0.93 GiB | 435 tok/s | |
| 9 | 70.965.4–76.22.10 GB | 85.0 | 2.10 GB | 3.09 GiBCPU | 68 tok/sCPU | |
| 11= | 70.766.0–75.22.78 GB | 80.0 | 2.78 GB | 3.00 GiB | 118 tok/s | |
| 11= | 68.363.5–73.21.25 GB | 70.6 | 1.25 GB | 1.23 GiB | 206 tok/s | |
| 11= | 68.162.7–73.41.47 GB | 71.1 | 1.47 GB | 1.93 GiB | 192 tok/s | |
| 11= | 67.662.3–72.81.45 GB | 71.1 | 1.45 GB | 1.54 GiB | 222 tok/s | |
| 14 | 64.959.1–70.61.82 GB | 77.8 | 1.82 GB | 2.05 GiB | 175 tok/s | |
| 15 | 63.057.4–68.41.21 GB | 59.4 | 1.21 GB | 1.53 GiB | 171 tok/s | |
| 16 | 62.556.8–68.11.05 GB | 76.7 | 1.05 GB | 1.23 GiB | 229 tok/s | |
| 18= | 60.054.6–65.21.50 GB | 68.3 | 1.50 GB | 1.64 GiB | 334 tok/s | |
| 18= | 59.353.7–64.90.66 GB | 66.1 | 0.66 GB | 0.79 GiB | 424 tok/s | |
| 18= | 59.353.5–65.00.99 GB | 47.8 | 0.99 GB | 1.23 GiBCPU | 89 tok/sCPU | |
| 21 | 56.251.1–61.32.19 GB | 57.8 | 2.19 GB | 2.54 GiB | 157 tok/s | |
| 24 | 50.544.5–56.31.45 GB | 64.4 | 1.45 GB | 1.55 GiB | 207 tok/s | |
| 28 | 44.839.2–50.50.73 GB | 33.9 | 0.73 GB | 0.81 GiB | 355 tok/s |
What does compression cost?
Score by bits per weight: MLX solid, GGUF dashed, ONNX dotted; ring = build to ship, red = cliff, amber = isolated drop.
What does a phone's budget buy?
Score by download size: ringed = the build each family ships, grey = its other builds, hollow = over 4 GB; hover to trace a family, drag to zoom.