MACE-OFF23 is a neural network potential (NNP) method from Dávid Péter Kovács, J. Harry Moore, and co-workers in Gábor Csányi's lab at Cambridge in 2023.
MACE-OFF23 is released under the ASL license. Read the MACE-OFF23 preprint. See the MACE-OFF23 code.
| About MACE-OFF23 | |
|---|---|
| Architecture | MACE |
| Dataset | SPICE and additions |
| Dataset Level of Theory | ωB97M-D3BJ/def2-TZVPPD |
| Dataset Size | |
GMTKN55 (download) is a high-accuracy molecular benchmark that measures basic properties, reaction energies, and noncovalent interactions. The GMTKN55 benchmark comprises 55 subsets. Each subset contains a number of relative energy measurements computed at the CCSD(T) level of theory. When viewing subset-level results, the mean absolute deviation/error (MAD/MAE) in kcal/mol is shown. Each subset is assigned a difficulty weight (see Section 4). When viewing category-level results, the weighted total mean absolute deviation (using the WTMAD-2 weights) is shown. See all GMTKN55 results.
| Name | Benchmarked By | |||||||
|---|---|---|---|---|---|---|---|---|
| ωB97M-D3BJ/def2-QZVP | 2.86 | 5.77 | 2.34 | 4.54 | 3.63 | 4.04 | link | |
| B3LYP-D3BJ/def2-QZVP | 7.99 | 10.16 | 4.11 | 5.65 | 4.82 | 6.18 | link | |
| B97-3c | 11.99 | 10.51 | 9.17 | 8.62 | 11.89 | 10.16 | link | |
| MACE-OFF23(L) | 8.74 | 10.40 | 22.52 | 6.79 | 37.84 | 16.46 | 6 | link |
| MACE-OFF23(M) | 9.08 | 10.50 | 21.49 | 9.12 | 41.58 | 18.23 | 6 | link |
| MACE-OFF23(S) | 8.98 | 8.85 | 13.55 | 12.14 | 41.96 | 18.48 | 6 | link |
| GFN2-xTB | 20.02 | 19.77 | 13.66 | 24.58 | 11.44 | 18.65 | link |
The Folmsbee conformers benchmark (GitHub) is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking conformer relative energies. The benchmark contains 708 subsets of 10 conformers each, 632 of which have energies computed at the DLPNO-CCSD(T) level of theory. DLPNO-CCSD(T) calculations were not finished for 76 subsets, so every level of theory will show at least 76 incomplete subsets. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all Folmsbee results.
| Name | Benchmarked By | |||||
|---|---|---|---|---|---|---|
| ωB97X-D/def2-TZVP | 0.24 | 0.39 | 0.83 | 0.85 | 80 | link |
| B3LYP/def2-TZVP | 0.25 | 0.41 | 0.83 | 0.84 | 76 | link |
| B97-3c | 0.30 | 0.53 | 0.80 | 0.82 | 77 | link |
| GFN2-xTB | 0.72 | 1.32 | 0.57 | 0.59 | 76 | link |
TorsionNet206 is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking of dihedral energy profiles. The benchmark contains 206 subsets of 24 conformers each computed at the CCSD(T)/def2-TZVP level of theory. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all TorsionNet206 results.
| Name | Benchmarked By | |||||
|---|---|---|---|---|---|---|
| ωB97M-D3BJ/vDZP | 0.15 | 0.18 | 0.99 | 0.98 | ||
| B97-3c | 0.35 | 0.45 | 0.98 | 0.97 | ||
| r²SCAN-3c | 0.42 | 0.54 | 0.97 | 0.97 | ||
| B3LYP-D3BJ/6-31G(d) | 0.57 | 0.71 | 0.95 | 0.94 | ||
| GFN2-xTB | 0.73 | 0.91 | 0.85 | 0.85 |
Wiggle150 is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking of highly-strained conformers. The benchmark contains 150 highly-strained conformations of adenosine, benzylpenicillin, and efavirenz computed at the DLPNO–CCSD(T)/CBS level of theory. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all Wiggle150 results.
| Name | Benchmarked By | ||
|---|---|---|---|
| ωB97M-D3BJ/def2-QZVP | 1.18 | 1.59 | link |
| B3LYP-D3BJ/def2-QZVP | 1.41 | 1.84 | link |
| r²SCAN-3c | 1.72 | 2.19 | link |
| B97-3c | 2.32 | 2.96 | link |
| B3LYP-D3BJ/6-31G(d) | 3.46 | 4.01 | link |
| GFN2-xTB | 14.60 | 15.20 | link |
X23b is a revised verison of X23, a periodic benchmark that evaluates the accuracy of reproducing experimental lattice energies and unit-cell volumes for 23 organic molecular crystals. Lattice energy (MAE) is shown in kcal/mol. Cell volume (MAPE, or mean average percent error) is shown in percentage. See all X23b results.