Rowan Benchmarks

MACE-ANI-CC

MACE-ANI-CC is a neural network potential (NNP) method from Dávid Péter Kovács, Ilyes Batatia, and co-workers in Gábor Csányi's lab at Cambridge in 2023.

MACE-ANI-CC is released under the MIT license. Read the MACE-ANI-CC paper. See the MACE-ANI-CC code.

About MACE-ANI-CC
ArchitectureMACE
DatasetANI-1ccx
Dataset Level of TheoryCCSD(T)*/CBS
Dataset Size500k

MACE-ANI-CC's GMTKN55 Results

GMTKN55 (download) is a high-accuracy molecular benchmark that measures basic properties, reaction energies, and noncovalent interactions. The GMTKN55 benchmark comprises 55 subsets. Each subset contains a number of relative energy measurements computed at the CCSD(T) level of theory. When viewing subset-level results, the mean absolute deviation/error (MAD/MAE) in kcal/mol is shown. When viewing category-level results, the weighted total mean absolute deviation (WTMAD) is shown. WTMAD-2 (renormalized) corresponds to the function found in the 2025 GMTKN55 GitHub. The remaining WTMAD schemes are summarized in Bryenton and Johnson 2025. See all GMTKN55 results.

NameBenchmarked By
ωB97M-D3BJ/def2-QZVP2.855.862.384.623.694.11link
B3LYP-D3BJ/def2-QZVP8.0610.334.185.754.906.28link
MACE-ANI-CC7.7914.013.099.4413
B97-3c12.1510.699.348.7712.0910.33link
GFN2-xTB20.0720.1113.9225.0011.6418.94link

MACE-ANI-CC's Folmsbee Results

The Folmsbee conformers benchmark (GitHub) is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking conformer relative energies. The benchmark contains 708 subsets of 10 conformers each, 632 of which have energies computed at the DLPNO-CCSD(T) level of theory. DLPNO-CCSD(T) calculations were not finished for 76 subsets, so every level of theory will show at least 76 incomplete subsets. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all Folmsbee results.

NameBenchmarked By
ωB97X-D/def2-TZVP0.240.390.830.8580link
B3LYP/def2-TZVP0.250.410.830.8476link
B97-3c0.300.530.800.8277link
MACE-ANI-CC0.320.550.770.79437
GFN2-xTB0.721.320.570.5976link

MACE-ANI-CC's TorsionNet206 Results

TorsionNet206 is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking of dihedral energy profiles. The benchmark contains 206 subsets of 24 conformers each computed at the CCSD(T)/def2-TZVP level of theory. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all TorsionNet206 results.

NameBenchmarked By
ωB97M-D3BJ/vDZP0.150.180.990.98
B97-3c0.350.450.980.97
MACE-ANI-CC0.230.290.970.9759
r²SCAN-3c0.420.540.970.97
B3LYP-D3BJ/6-31G(d)0.570.710.950.94
GFN2-xTB0.730.910.850.85

MACE-ANI-CC's Wiggle150 Results

Wiggle150 is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking of highly-strained conformers. The benchmark contains 150 highly-strained conformations of adenosine, benzylpenicillin, and efavirenz computed at the DLPNO–CCSD(T)/CBS level of theory. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all Wiggle150 results.

NameBenchmarked By
MACE-ANI-CC1.041.30
ωB97M-D3BJ/def2-QZVP1.181.59link
B3LYP-D3BJ/def2-QZVP1.411.84link
r²SCAN-3c1.722.19link
B97-3c2.322.96link
B3LYP-D3BJ/6-31G(d)3.464.01link
GFN2-xTB14.6015.20link

MACE-ANI-CC's X23b Results

X23b is a revised verison of X23, a periodic benchmark that evaluates the accuracy of reproducing experimental lattice energies and unit-cell volumes for 23 organic molecular crystals. Lattice energy (MAE) is shown in kcal/mol. Cell volume (MAPE, or mean average percent error) is shown in percentage. See all X23b results.

NameBenchmarked By
r²SCAN-3c0.973.68link
GFN2-xTB5.387.76
MACE-ANI-CC | Rowan Benchmarks