How to reproduce our results

This section has instructions for reproducing OpenMathInstruct-2: Accelerating AI for Math with Massive Open-Source Instruction Data.

Please note that unless you have an access to a large GPU cluster, it might take a very long time for some of the commands to complete!

• Model evaluation
• Dataset construction
• Model training

Note

If you want to reproduce results for OpenMathInstruct-1: A 1.8 Million Math Instruction Tuning Dataset please check out v0.1.1 branch of the NeMo-Skills repo and read the instructions in there.