GMTKN55 (download) is a high-accuracy molecular benchmark that measures basic properties, reaction energies, and noncovalent interactions. The GMTKN55 benchmark comprises 55 subsets. Each subset contains a number of relative energy measurements computed at the CCSD(T) level of theory. When viewing subset-level results, the mean absolute deviation/error (MAD/MAE) in kcal/mol is shown. Each subset is assigned a difficulty weight (see Section 4). When viewing category-level results, the weighted total mean absolute deviation (using the WTMAD-2 weights) is shown. See all GMTKN55 results.
| Name | Incomplete Subsets | Benchmarked By | ||||||
|---|---|---|---|---|---|---|---|---|
| ωB97M-D3BJ/def2-QZVP | 2.86 | 5.77 | 2.34 | 4.54 | 3.63 | 4.04 | link | |
| B3LYP-D3BJ/def2-QZVP | 7.99 | 10.16 | 4.11 | 5.65 | 4.82 | 6.18 | link | |
| AIQM2 | 5.29 | 3.70 | 6.25 | 9.25 | 8.21 | 7.20 | 5 | link |
| AIQM1 | 2.84 | 6.34 | 13.29 | 10.42 | 7.06 | 8.79 | 5 | link |
| MACE-ANI-CC | 7.67 | 13.78 | 3.02 | 9.28 | 13 | |||
| OrbNet Denali | 11.97 | 4.62 | 10.49 | 8.36 | 14.06 | 9.89 | link | |
| B97-3c | 11.99 | 10.51 | 9.17 | 8.62 | 11.89 | 10.16 | link | |
| PBE-D3BJ/def2-QZVP | 11.25 | 10.61 | 13.16 | 9.95 | 9.89 | 10.58 | link | |
| AIMNet2 (ωB97M-D3, new) | 9.47 | 14.02 | 12.59 | 11.94 | 22.12 | 14.66 | ||
| AIMNet2 (ωB97M-D3, old) | 9.46 | 14.05 | 12.60 | 11.94 | 22.13 | 14.67 | ||
| MACE-OFF23(L) | 8.74 | 10.40 | 22.52 | 6.79 | 37.84 | 16.46 | 6 | I.B. 2024-11-28 |
| MACE-OFF23(M) | 9.08 | 10.50 | 21.49 | 9.12 | 41.58 | 18.23 | 6 | I.B. 2024-11-28 |
| MACE-OFF23(S) | 8.98 | 8.85 | 13.55 | 12.14 | 41.96 | 18.48 | 6 | I.B. 2024-11-28 |
| GFN2-xTB | 20.02 | 19.77 | 13.66 | 24.58 | 11.44 | 18.65 | link | |
| Orb-v3 (Conservative Inf. OMat) | 26.02 | 13.96 | 12.75 | 28.67 | 17.63 | 21.33 | ||
| ANI-1ccx | 14.14 | 24.71 | 28.20 | 22.42 | 13 | link | ||
| ANI-2x | 29.57 | 37.35 | 14.15 | 26.55 | 11.22 | 25.28 | 7 | link |
| Orb-v3 (Direct Inf. OMat) | 24.08 | 21.66 | 16.66 | 34.92 | 20.91 | 25.89 | ||
| MACE-MP-0b2(Large)-D3BJ | 32.92 | 19.74 | 15.53 | 36.10 | 20.71 | 26.76 | ||
| Orb-v3 (Conservative 20 OMat) | 21.03 | 14.91 | 15.23 | 35.62 | 32.72 | 27.60 | ||
| SO3LR | 35.96 | 57.77 | 20.79 | 19.00 | 13.03 | 27.67 | 7 | |
| MACE-MP-0b2(Large) | 32.35 | 25.82 | 13.75 | 37.04 | 33.91 | 31.09 | ||
| Orb-d3-v2 | 20.97 | 14.20 | 17.83 | 46.66 | 33.16 | 31.92 | ||
| MACE-MP-0(Large)-D3BJ | 29.67 | 34.16 | 25.74 | 40.44 | 22.60 | 31.96 | ||
| MACE-MP-0b2(Medium) | 31.32 | 45.90 | 20.82 | 31.24 | 32.32 | 32.44 | ||
| Orb-v2 | 22.70 | 33.08 | 19.35 | 42.78 | 32.38 | 33.57 | ||
| MACE-MP-0b2(Small) | 35.65 | 30.30 | 24.00 | 41.22 | 36.29 | 35.54 | ||
| MACE-MP-0(Large) | 29.04 | 40.44 | 26.13 | 44.27 | 34.04 | 37.19 | ||
| MACE-MP-0b(Medium) | 33.90 | 29.70 | 24.55 | 42.01 | 43.96 | 37.56 | ||
| Orb-v3 (Direct 20 OMat) | 26.43 | 54.43 | 16.54 | 41.10 | 41.69 | 38.62 | ||
| MACE-MP-0(Medium) | 41.57 | 65.19 | 29.25 | 58.55 | 33.94 | 47.81 | ||
| MACE-MP-0(Small) | 42.45 | 77.94 | 27.22 | 63.86 | 27.37 | 49.85 | ||
| MACE-MP-0b(Small) | 63.35 | 90.10 | 26.23 | 49.97 | 53.43 | 55.37 | ||
| OMat24 eqV2-L | 215.59 | 81.61 | 60.86 | 40.43 | 659.50 | 224.80 |