Corpus ID: 211678428

The importance of transparency and reproducibility in artificial intelligence research

  title={The importance of transparency and reproducibility in artificial intelligence research},
  author={B. Haibe-Kains and George Adam and A. Hosny and F. Khodakarami and Maqc Society Board and L. Waldron and B. Wang and C. McIntosh and A. Kundaje and C. Greene and M. M. Hoffman and J. Leek and W. Huber and A. Brazma and Joelle Pineau and R. Tibshirani and T. Hastie and J. Ioannidis and John Quackenbush and H. Aerts},
  journal={arXiv: Applications},
In their study, McKinney et al. showed the high potential of artificial intelligence for breast cancer screening. However, the lack of detailed methods and computer code undermines its scientific value. We identify obstacles hindering transparent and reproducible AI research as faced by McKinney et al and provide solutions with implications for the broader field. 

Tables from this paper

Reproducible Research: A Retrospective.
Recommendations for machine learning validation in biology
Oncology Informatics: Status Quo and Outlook
Forecasting for Social Good


Artificial intelligence faces reproducibility crisis.
International evaluation of an AI system for breast cancer screening
Enhancing reproducibility for computational methods
Putting oncology patients at risk.
Exploration, Inference, and Prediction in Neuroscience and Biomedicine
Toward unrestricted use of public genomic data