Rowan Benchmarks

Orb-v3

Orb-v3 is a neural network potential (NNP) method from Benjamin Rhodes and co-workers at Orbital Materials in 2025.

Orb-v3 is released under the Apache 2.0 license. Read the Orb-v3 preprint. See the Orb-v3 code.

Run Orb-v3 on Rowan

Use Orb-v3 to optimize structures, scan dihedrals, and much more with Rowan's simple GUI and cloud-based computing. We offer 500 free credits when you first sign up, and an additional 20 credits each week. Make a free account and get your first results within minutes!

Start computing →

Orb-v3's GMTKN55 Results

GMTKN55 (download) is a high-accuracy molecular benchmark that measures basic properties, reaction energies, and noncovalent interactions. The GMTKN55 benchmark comprises 55 subsets. Each subset contains a number of relative energy measurements computed at the CCSD(T) level of theory. When viewing subset-level results, the mean absolute deviation/error (MAD/MAE) in kcal/mol is shown. When viewing category-level results, the weighted total mean absolute deviation (WTMAD) is shown. WTMAD-2 (renormalized) corresponds to the function found in the 2025 GMTKN55 GitHub. The remaining WTMAD schemes are summarized in Bryenton and Johnson 2025. See all GMTKN55 results.

NameBenchmarked By
ωB97M-D3BJ/def2-QZVP2.855.862.384.623.694.11link
B3LYP-D3BJ/def2-QZVP8.0610.334.185.754.906.28link
B97-3c12.1510.699.348.7712.0910.33link
GFN2-xTB20.0720.1113.9225.0011.6418.94link
Orb-v3 (Conservative Inf. OMat)23.6914.2212.9829.2417.9421.44
Orb-v3 (Direct Inf. OMat)24.0222.0316.9735.5321.2726.28
Orb-v3 (Conservative 20 OMat)20.8115.1615.5136.2333.2828.02
Orb-v3 (Direct 20 OMat)26.1755.3616.8541.8142.4139.21

Orb-v3's Folmsbee Results

The Folmsbee conformers benchmark (GitHub) is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking conformer relative energies. The benchmark contains 708 subsets of 10 conformers each, 632 of which have energies computed at the DLPNO-CCSD(T) level of theory. DLPNO-CCSD(T) calculations were not finished for 76 subsets, so every level of theory will show at least 76 incomplete subsets. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all Folmsbee results.

NameBenchmarked By
ωB97X-D/def2-TZVP0.240.390.830.8580link
B3LYP/def2-TZVP0.250.410.830.8476link
B97-3c0.300.530.800.8277link
GFN2-xTB0.721.320.570.5976link
Orb-v3 (Conservative Inf. OMat)0.881.710.510.50115
Orb-v3 (Conservative 20 OMat)1.052.110.490.44115
Orb-v3 (Direct Inf. OMat)1.152.060.440.41115
Orb-v3 (Direct 20 OMat)1.302.330.400.36115

Orb-v3's Speed Results

This benchmark measures the speed of running molecular dynamics (MD) simulations on tacrolimus (126 atoms) through ASE with a 1 fs timestep at 300 K for 50 steps. All calculations were run on A10G GPUs through Modal. See all speed results.

Name

Orb-v3's TorsionNet206 Results

TorsionNet206 is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking of dihedral energy profiles. The benchmark contains 206 subsets of 24 conformers each computed at the CCSD(T)/def2-TZVP level of theory. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all TorsionNet206 results.

NameBenchmarked By
ωB97M-D3BJ/vDZP0.150.180.990.98
B97-3c0.350.450.980.97
r²SCAN-3c0.420.540.970.97
B3LYP-D3BJ/6-31G(d)0.570.710.950.94
GFN2-xTB0.730.910.850.85
Orb-v3 (Conservative Inf. OMat)0.971.200.830.83
Orb-v3 (Conservative 20 OMat)1.161.420.800.82
Orb-v3 (Direct Inf. OMat)1.822.310.750.76
Orb-v3 (Direct 20 OMat)1.602.010.720.74

Orb-v3's Wiggle150 Results

Wiggle150 is a high-accuracy molecular benchmark that evaluates the accuracy of predicting and ranking of highly-strained conformers. The benchmark contains 150 highly-strained conformations of adenosine, benzylpenicillin, and efavirenz computed at the DLPNO–CCSD(T)/CBS level of theory. Mean absolute error (MAE) and root mean square error (RMSE) are shown in kcal/mol. See all Wiggle150 results.

NameBenchmarked By
ωB97M-D3BJ/def2-QZVP1.181.59link
B3LYP-D3BJ/def2-QZVP1.411.84link
r²SCAN-3c1.722.19link
B97-3c2.322.96link
B3LYP-D3BJ/6-31G(d)3.464.01link
Orb-v3 (Conservative Inf. OMat)7.708.80
Orb-v3 (Conservative 20 OMat)8.279.60
Orb-v3 (Direct 20 OMat)9.0110.33
Orb-v3 (Direct Inf. OMat)10.5211.70
GFN2-xTB14.6015.20link

Orb-v3's X23b Results

X23b is a revised verison of X23, a periodic benchmark that evaluates the accuracy of reproducing experimental lattice energies and unit-cell volumes for 23 organic molecular crystals. Lattice energy (MAE) is shown in kcal/mol. Cell volume (MAPE, or mean average percent error) is shown in percentage. See all X23b results.

NameBenchmarked By
r²SCAN-3c0.973.68link
GFN2-xTB5.387.76
Orb-v3 (Conservative Inf. OMat)26.7912.30
Orb-v3 | Rowan Benchmarks