The Folmsbee conformers benchmark (GitHub) is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking conformer relative energies. The benchmark contains 708 subsets of 10 conformers each, 632 of which have energies computed at the DLPNO-CCSD(T) level of theory. DLPNO-CCSD(T) calculations were not finished for 76 subsets, so every level of theory will show at least 76 incomplete subsets. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all Folmsbee results.
Name | Incomplete Subsets | Benchmarked By | ||||
---|---|---|---|---|---|---|
ΟB97X-D/def2-TZVP | 0.24 | 0.30 | 0.83 | 0.85 | 80 | link |
B3LYP/def2-TZVP | 0.25 | 0.31 | 0.83 | 0.84 | 76 | link |
B97-3c | 0.30 | 0.37 | 0.80 | 0.82 | 77 | link |
MACE-ANI-CC | 0.32 | 0.40 | 0.77 | 0.79 | 437 | |
AIMNet2 (ΟB97M-D3, new) | 0.54 | 0.66 | 0.64 | 0.65 | 76 | |
AIMNet2 (ΟB97M-D3, old) | 0.54 | 0.66 | 0.64 | 0.65 | 76 | |
GFN2-xTB | 0.72 | 0.88 | 0.57 | 0.59 | 76 | link |
Orb-v3 (Conservative Inf. OMat) | 0.88 | 1.09 | 0.51 | 0.50 | 115 | |
MACE-MP-0b2(Large)-D3BJ | 0.81 | 1.01 | 0.49 | 0.47 | 115 | |
Orb-v3 (Conservative 20 OMat) | 1.05 | 1.28 | 0.49 | 0.44 | 115 | |
MACE-MP-0(Large)-D3BJ | 0.88 | 1.10 | 0.49 | 0.45 | 115 | |
MACE-MP-0b2(Medium) | 0.97 | 1.19 | 0.47 | 0.44 | 115 | |
OMat24 eqV2-L | 0.87 | 1.08 | 0.47 | 0.50 | 115 | |
MACE-MP-0b2(Small) | 1.03 | 1.27 | 0.46 | 0.41 | 115 | |
MACE-MP-0b2(Large) | 1.08 | 1.33 | 0.46 | 0.37 | 115 | |
MACE-MP-0b(Medium) | 1.02 | 1.25 | 0.46 | 0.43 | 115 | |
MACE-MP-0b(Small) | 1.25 | 1.55 | 0.45 | 0.40 | 115 | |
MACE-MP-0(Large) | 1.16 | 1.44 | 0.45 | 0.34 | 115 | |
MACE-MP-0(Medium) | 1.08 | 1.33 | 0.44 | 0.37 | 115 | |
Orb-v3 (Direct Inf. OMat) | 1.15 | 1.42 | 0.44 | 0.41 | 115 | |
Orb-d3-v2 | 0.94 | 1.17 | 0.43 | 0.41 | 115 | |
MACE-MP-0(Small) | 1.25 | 1.54 | 0.43 | 0.34 | 115 | |
Orb-v2 | 1.17 | 1.45 | 0.42 | 0.36 | 115 | |
Orb-v3 (Direct 20 OMat) | 1.30 | 1.62 | 0.40 | 0.36 | 115 | |
SO3LR | 0.55 | 0.67 | 0.38 | 0.35 | 82 |