Rowan Benchmarks

MACE-ANI-CC

MACE-ANI-CC is a neural network potential (NNP) method from Dávid Péter Kovács, Ilyes Batatia, and co-workers in Gábor Csányi's lab at Cambridge in 2023.

MACE-ANI-CC is released under the MIT license. Read the MACE-ANI-CC paper. See the MACE-ANI-CC code.

About MACE-ANI-CC
ArchitectureMACE
DatasetANI-1ccx
Dataset Level of TheoryCCSD(T)*/CBS
Dataset Size500k

MACE-ANI-CC's GMTKN55 Results

GMTKN55 (download) is a high-accuracy molecular benchmark that measures basic properties, reaction energies, and noncovalent interactions. The GMTKN55 benchmark comprises 55 subsets. Each subset contains a number of relative energy measurements computed at the CCSD(T) level of theory. When viewing subset-level results, the mean absolute deviation/error (MAD/MAE) in kcal/mol is shown. Each subset is assigned a difficulty weight (see Section 4). When viewing category-level results, the weighted total mean absolute deviation (using the WTMAD-2 weights) is shown. See all GMTKN55 results.

NameIncomplete SubsetsBenchmarked By
ωB97M-D3BJ/def2-QZVP2.865.772.344.543.634.04link
B3LYP-D3BJ/def2-QZVP7.9910.164.115.654.826.18link
MACE-ANI-CC7.6713.783.029.2813Ari 2024-12-23
B97-3c11.9910.519.178.6211.8910.16link
GFN2-xTB20.0219.7713.6624.5811.4418.65link

MACE-ANI-CC's Folmsbee Results

The Folmsbee conformers benchmark (GitHub) is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking conformer relative energies. The benchmark contains 708 subsets of 10 conformers each, 632 of which have energies computed at the DLPNO-CCSD(T) level of theory. DLPNO-CCSD(T) calculations were not finished for 76 subsets, so every level of theory will show at least 76 incomplete subsets. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all Folmsbee results.

NameIncomplete SubsetsBenchmarked By
ωB97X-D/def2-TZVP0.240.300.830.8580link
B97-3c0.300.370.800.8277link
MACE-ANI-CC0.320.400.770.7995Ari 2025-01-15
GFN2-xTB0.720.880.570.5976link

MACE-ANI-CC's TorsionNet206 Results

TorsionNet206 is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking of dihedral energy profiles. The benchmark contains 206 subsets of 24 conformers each computed at the CCSD(T)/def2-TZVP level of theory. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all TorsionNet206 results.

NameIncomplete SubsetsBenchmarked By
ωB97M-D3BJ/vDZP0.150.180.990.98C.W.
B97-3c0.350.450.980.97C.W.
MACE-ANI-CC0.230.290.970.9759Ari 2025-01-11
GFN2-xTB0.730.910.850.85C.W.

MACE-ANI-CC's Molecular Speed Results

This is a benchmark that evaluates the average speed of running energy and force calculations on 10-, 100-, and 1000-atom molecular systems. All calculations were run on Nvidia A10G GPUs through Modal. Click items in legend to show/hide. See all molecular speed results.

MACE-ANI-CC's Periodic Speed Results

This is a benchmark that evaluates the average speed of running energy and force calculations on 10-, 100-, and 1000-atom periodic systems. All calculations were run on Nvidia A10G GPUs through Modal. Click items in legend to show/hide. See all periodic speed results.