GMTKN55 (download) is a high-accuracy molecular benchmark that measures basic properties, reaction energies, and noncovalent interactions. The GMTKN55 benchmark comprises 55 subsets. Each subset contains a number of relative energy measurements computed at the CCSD(T) level of theory. When viewing subset-level results, the mean absolute deviation/error (MAD/MAE) in kcal/mol is shown. Each subset is assigned a difficulty weight (see Section 4). When viewing category-level results, the weighted total mean absolute deviation (using the WTMAD-2 weights) is shown. See all GMTKN55 results.
| Name | Benchmarked By | |||||||
|---|---|---|---|---|---|---|---|---|
| ωB97M-D3BJ/def2-QZVP | 2.86 | 5.77 | 2.34 | 4.54 | 3.63 | 4.04 | link | |
| UMA Small 1.1 (OMol task) | 8.23 | 3.34 | 2.87 | 5.15 | 3.06 | 4.38 | ||
| OMol25's eSEN Conserving Small | 8.67 | 3.41 | 2.89 | 5.23 | 2.79 | 4.40 | ||
| UMA Small (OMol task) | 7.70 | 3.32 | 2.88 | 5.30 | 3.21 | 4.41 | ||
| UMA Medium 1.1 (OMol task) | 12.18 | 3.80 | 2.96 | 4.96 | 2.44 | 4.65 | ||
| B3LYP-D3BJ/def2-QZVP | 7.99 | 10.16 | 4.11 | 5.65 | 4.82 | 6.18 | link | |
| AIQM2 | 5.29 | 3.70 | 6.25 | 9.25 | 8.21 | 7.20 | 5 | link |
| AIQM1 | 2.84 | 6.34 | 13.29 | 10.42 | 7.06 | 8.79 | 5 | link |
| MACE-ANI-CC | 7.67 | 13.78 | 3.02 | 9.28 | 13 | |||
| OrbNet Denali | 11.97 | 4.62 | 10.49 | 8.36 | 14.06 | 9.89 | link | |
| B97-3c | 11.99 | 10.51 | 9.17 | 8.62 | 11.89 | 10.16 | link | |
| PBE-D3BJ/def2-QZVP | 11.25 | 10.61 | 13.16 | 9.95 | 9.89 | 10.58 | link | |
| UMA Medium 1.1 (OMC task) | 12.64 | 8.72 | 7.74 | 9.66 | 18.92 | 11.93 | ||
| AIMNet2 (ωB97M-D3, new) | 9.47 | 14.02 | 12.59 | 11.94 | 22.12 | 14.66 | ||
| AIMNet2 (ωB97M-D3, old) | 9.46 | 14.05 | 12.60 | 11.94 | 22.13 | 14.67 | ||
| UMA Small 1.1 (OMC task) | 29.72 | 21.64 | 12.82 | 11.49 | 15.85 | 16.23 | ||
| MACE-OFF23(L) | 8.74 | 10.40 | 22.52 | 6.79 | 37.84 | 16.46 | 6 | link |
| Egret-1 | 8.61 | 10.10 | 16.55 | 6.98 | 41.81 | 16.88 | 6 | |
| Egret-1t | 8.00 | 10.19 | 13.15 | 7.76 | 42.41 | 16.97 | 6 | |
| Egret-1e | 4.23 | 7.34 | 32.84 | 8.25 | 39.28 | 18.05 | 3 | |
| MACE-OFF23(M) | 9.08 | 10.50 | 21.49 | 9.12 | 41.58 | 18.23 | 6 | link |
| MACE-OFF23(S) | 8.98 | 8.85 | 13.55 | 12.14 | 41.96 | 18.48 | 6 | link |
| GFN2-xTB | 20.02 | 19.77 | 13.66 | 24.58 | 11.44 | 18.65 | link | |
| Prescient's StrainRelief MACE | 16.03 | 21.90 | 18.70 | 12.99 | 30.43 | 19.55 | 6 | |
| Orb-v3 (Conservative Inf. OMat) | 26.02 | 13.96 | 12.75 | 28.67 | 17.63 | 21.33 | ||
| eSEN-OAM | 16.71 | 23.97 | 11.31 | 23.91 | 26.29 | 22.16 | ||
| ANI-1ccx | 14.14 | 24.71 | 28.20 | 22.42 | 13 | link | ||
| ANI-2x | 29.57 | 37.35 | 14.15 | 26.55 | 11.22 | 25.28 | 7 | link |
| Orb-v3 (Direct Inf. OMat) | 24.08 | 21.66 | 16.66 | 34.92 | 20.91 | 25.89 | ||
| MACE-MP-0b2(Large)-D3BJ | 32.92 | 19.74 | 15.53 | 36.10 | 20.71 | 26.76 | ||
| Orb-v3 (Conservative 20 OMat) | 21.03 | 14.91 | 15.23 | 35.62 | 32.72 | 27.60 | ||
| MACE-MP-0b2(Large) | 32.35 | 25.82 | 13.75 | 37.04 | 33.91 | 31.09 | ||
| Orb-d3-v2 | 20.97 | 14.20 | 17.83 | 46.66 | 33.16 | 31.92 | ||
| MACE-MP-0(Large)-D3BJ | 29.67 | 34.16 | 25.74 | 40.44 | 22.60 | 31.96 | ||
| MACE-MP-0b2(Medium) | 31.32 | 45.90 | 20.82 | 31.24 | 32.32 | 32.44 | ||
| Orb-v2 | 22.70 | 33.08 | 19.35 | 42.78 | 32.38 | 33.57 | ||
| MACE-MP-0b2(Small) | 35.65 | 30.30 | 24.00 | 41.22 | 36.29 | 35.54 | ||
| MACE-MP-0(Large) | 29.04 | 40.44 | 26.13 | 44.27 | 34.04 | 37.19 | ||
| MACE-MP-0b(Medium) | 33.90 | 29.70 | 24.55 | 42.01 | 43.96 | 37.56 | ||
| Orb-v3 (Direct 20 OMat) | 26.43 | 54.43 | 16.54 | 41.10 | 41.69 | 38.62 | ||
| MACE-MP-0(Medium) | 41.57 | 65.19 | 29.25 | 58.55 | 33.94 | 47.81 | ||
| MACE-MP-0(Small) | 42.45 | 77.94 | 27.22 | 63.86 | 27.37 | 49.85 | ||
| MACE-MP-0b(Small) | 63.35 | 90.10 | 26.23 | 49.97 | 53.43 | 55.37 | ||
| SO3LR | 46.24 | 75.18 | 32.09 | 95.06 | 36.79 | 69.98 | 7 | |
| OMat24 eqV2-L | 215.59 | 81.61 | 60.86 | 40.43 | 659.50 | 224.80 |