The Road to Reproducibility

In a symposium chaired by APS Treasurer Roberta Klatzky, leaders in the area of reproducibility convened to review some of the steps currently being taken to shore up confidence in conclusions about psychological phenomena.The panelists discussed ways to make psychological science more robust in both the way experiments are designed and the way results are interpreted. These suggestions included philosophical recommendations, such as increasing skepticism and understanding how stochastic variability can contribute to failures to replicate, and more analytical adjustments, such as increasing statistical power without increasing sample size and using the Bayes factor to distinguish nonevidence from evidence in favor of the null hypothesis.