Complexity Explorer Santa Fe Institute

Your progress is not being saved! Enroll now or log in to track your progress or submit homework.

Introduction to Open Science

Lead instructor:


3.4 Unit 3 References » Unit 3 References

Ritchie, S. (2020). Science Fictions: How Fraud, Bias, Negligence, and Hype Undermine the Search
for Truth. Metropolitan Books.

Szollosi, A., Kellen, D., Navarro, D. J., Shiffrin, R., van Rooij, I., Van Zandt, T., & Donkin, C. (2019). Is
preregistration worthwhile. Trends in Cognitive Sciences, 24(2), 94-95.
(Talk version : https://www.youtube.com/watch?v=ThcGiZFg0O0&feature=emb_logo )

Wicherts, J. M., Veldkamp, C. L., Augusteijn, H. E., Bakker, M., Van Aert, R., & Van Assen, M. A.
(2016). Degrees of freedom in planning, running, analyzing, and reporting psychological studies: A
checklist to avoid p-hacking. Frontiers in psychology, 7, 1832.

Pre-registration for different types of research:
- L. Haven, T., & Van Grootel, D. L. (2019). Preregistering qualitative research. Accountability
in Research, 26(3), 229-244.


- Mertens, G., & Krypotos, A. M. (2019). Preregistration of analyses of preexisting
data. Psychologica Belgica, 59(1), 338.


- Johnson, A. H., & Cook, B. G. (2019). Preregistration in single-case design
research. Exceptional Children, 86(1), 95-112.


- Dirnagl, U. (2020). Preregistration of exploratory research: Learning from the golden age of
discovery. PLoS biology, 18(3), e3000690.


Platforms for preregistration:
- For clinical trials: http://clinicaltrials.gov/

- Open Science Framework (OSF): http://osf.io/prereg/

- Registry of Efficacy and Effectiveness Studies (REES): http://sreereg.icpsr.umich.edu/

- Declare Design: http://declaredesign.org/

- As predicted. org:http://https://aspredicted.org/

Bakker, M., Veldkamp, C. L., van Assen, M. A., Crompvoets, E. A., Ong, H. H., Nosek, B. A., &
Wicherts, J. M. (2020). Ensuring the quality and specificity of preregistrations. PLoS Biology, 18(12),
e3000937.


Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018). The preregistration revolution. Proceedings of the National Academy of Sciences, 115(11), 2600-2606.

Registered reports :
- Kaplan, R. M., & Irvin, V. L. (2015). Likelihood of null effects of large NHLBI clinical trials has increased over time. PloS one, 10(8), e0132382.
- Eric Wagenmakers’ selfish reasons for pre-reg:
https://www.psychologicalscience.org/observer/seven-selfish-reasons-for-preregistration


Claesen, A., Gomes, S. L. B. T., & Tuerlinckx, F. (2019). Preregistration: Comparing dream to reality.

Ikeda, A., Xu, H., Fuji, N., Zhu, S., & Yamada, Y. (2019). Questionable research practices following
pre-registration.


Miton, H., Sperber, D., & Hernik, M. (2020). A Forward Bias in Human Profile‐Oriented Portraits. Cognitive Science, 44(6), e12866. (for example of a pre-registered study)