Abstract Automated machine learning (AutoML) is positioned to democratize artificial intelligence (AI) by reducing the amount of human input and ML expertise needed to create prediction models. However, successful translation of ML in biomedicine requires moving beyond optimizing only for prediction accuracy and towards discovering reproducible clinical and biological inferences. Here, we present a model-agnostic framework to reinforce AutoML using strategies and tools of explainable and reproducible AI, including novel metrics for performance precision and feature instability. The framework enables clinicians to interpret AutoML-generated models for clinical and biological verifiability and consequently integrate domain expertise during model development. We applied the framework towards spinal cord injury prognostication and identified a detrimental relationship between intraoperative hypertension and patient outcome. Furthermore, our analysis captured evolving clinical practices such as faster time-to-surgery and blood pressure management that affected clinical model validation. Altogether, we illustrate how augmenting AutoML for inferential reproducibility empowers biomedical discovery and builds trust in AI processes towards effective clinical integration.

Expert-integrated automated machine learning uncovers hemodynamic predictors in spinal cord injury