This folder contains the source files for the following manuscript:
Kerr CC, Rosenfeld K, Lundin J, Stuart R, Abeysuriya R. Vibes, meet rigor: Evaluating and improving AI performance on complex scientific code. Proceedings of SciPy 2026.
Note that the manuscript used to live in the scipy2026_starsim_ai repository, and is also duplicated (for submission) in the scipy_proceedings repository.
- Code for generating the figures is in the
figuresfolder. - The manuscript itself is in the
paperfolder.
Note: To regenerate the figures requires the data in the scipy2026_starsim_exam repository. This repository is private to avoid leakage of solutions to subsequent evaluation runs.