Rowan Benchmarks

OMat24 eqV2

OMat24 eqV2 is a neural network potential (NNP) method from Luis Barroso-Luque and co-workers at Meta's FAIR Chemistry in 2024.

Read the OMat24 eqV2 preprint. See the OMat24 eqV2 code.

About OMat24 eqV2
ArchitectureEquiformer v2
DatasetMPtrj, Alexandria, and OMat24
Dataset Level of TheoryPBE+U
Dataset Size110M

OMat24 eqV2's GMTKN55 Results

GMTKN55 (download) is a high-accuracy molecular benchmark that measures basic properties, reaction energies, and noncovalent interactions. The GMTKN55 benchmark comprises 55 subsets. Each subset contains a number of relative energy measurements computed at the CCSD(T) level of theory. When viewing subset-level results, the mean absolute deviation/error (MAD/MAE) in kcal/mol is shown. Each subset is assigned a difficulty weight (see Section 4). When viewing category-level results, the weighted total mean absolute deviation (using the WTMAD-2 weights) is shown. See all GMTKN55 results.

NameBenchmarked By
ωB97M-D3BJ/def2-QZVP2.865.772.344.543.634.04link
B3LYP-D3BJ/def2-QZVP7.9910.164.115.654.826.18link
B97-3c11.9910.519.178.6211.8910.16link
GFN2-xTB20.0219.7713.6624.5811.4418.65link
OMat24 eqV2-L215.5981.6160.8640.43659.50224.80

OMat24 eqV2's Folmsbee Results

The Folmsbee conformers benchmark (GitHub) is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking conformer relative energies. The benchmark contains 708 subsets of 10 conformers each, 632 of which have energies computed at the DLPNO-CCSD(T) level of theory. DLPNO-CCSD(T) calculations were not finished for 76 subsets, so every level of theory will show at least 76 incomplete subsets. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all Folmsbee results.

NameBenchmarked By
ωB97X-D/def2-TZVP0.240.390.830.8580link
B3LYP/def2-TZVP0.250.410.830.8476link
B97-3c0.300.530.800.8277link
GFN2-xTB0.721.320.570.5976link
OMat24 eqV2-L0.871.440.470.50115

OMat24 eqV2's Optimization Results

Optimization is a simple test that evaluates a method's ability to optimize 25 drug-like molecules without producing imaginary frequencies. Optimizations are run using the sella optimizer, 0.01 eV/Å fmax, and max. 250 steps. See all optimization results. See our blog post testing NNP–optimizer pairings.

NameBenchmarked By
OMat24 eqV2-L791.2931.14

OMat24 eqV2's TorsionNet206 Results

TorsionNet206 is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking of dihedral energy profiles. The benchmark contains 206 subsets of 24 conformers each computed at the CCSD(T)/def2-TZVP level of theory. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all TorsionNet206 results.

NameBenchmarked By
ωB97M-D3BJ/vDZP0.150.180.990.98
B97-3c0.350.450.980.97
r²SCAN-3c0.420.540.970.97
B3LYP-D3BJ/6-31G(d)0.570.710.950.94
GFN2-xTB0.730.910.850.85
OMat24 eqV2-L1.481.840.770.81

OMat24 eqV2's Wiggle150 Results

Wiggle150 is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking of highly-strained conformers. The benchmark contains 150 highly-strained conformations of adenosine, benzylpenicillin, and efavirenz computed at the DLPNO–CCSD(T)/CBS level of theory. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all Wiggle150 results.

NameBenchmarked By
ωB97M-D3BJ/def2-QZVP1.181.59link
B3LYP-D3BJ/def2-QZVP1.411.84link
r²SCAN-3c1.722.19link
B97-3c2.322.96link
B3LYP-D3BJ/6-31G(d)3.464.01link
OMat24 eqV2-L6.367.73
GFN2-xTB14.6015.20link

OMat24 eqV2's X23b Results

X23b is a revised verison of X23, a periodic benchmark that evaluates the accuracy of reproducing experimental lattice energies and unit-cell volumes for 23 organic molecular crystals. Lattice energy (MAE) is shown in kcal/mol. Cell volume (MAPE, or mean average percent error) is shown in percentage. See all X23b results.

NameBenchmarked By
r²SCAN-3c0.973.68link
GFN2-xTB5.387.76
OMat24 eqV2 | Rowan Benchmarks