Tutorial reproducibility
One of the following (or a linear combination):
Please fill out this survey on background and skills, to provide us with information on who you are. It will help us improve the presentation, and make it more relevant for you.
https://cornell.yul1.qualtrics.com/jfe/form/SV_bBqbJ9cSSJdOBw2
Results
Last updated: 25 June 2025, 16:46
| Degree | Frequency | Percent |
|---|---|---|
| graduate student (Ph.D.) | 3 | 25.00 |
| faculty member (tenured) | 4 | 33.33 |
| faculty member (untenured) | 1 | 8.33 |
| Other | 3 | 25.00 |
| NA | 1 | 8.33 |
One of the following (or a linear combination):
- Reproducibility when some data are confidential
- Advanced self-checking of reproducibility
- Preserving raw survey data early in research lifecycle (ethically!)
- Reproducibility for LLM and AI
To identify what we should be speaking about on Day 2, please fill out this other survey:
https://cornell.yul1.qualtrics.com/jfe/form/SV_cZqZCgBj6e3SCSq
Results
Last updated: 25 June 2025, 16:46
| Preferred_topic | Frequency | Percent |
|---|---|---|
| Reproducibility when some data are confidential | 3 | 100 |
Guidance
Some additional guidance can be found on the website of the Social Science Data Editors (URLs subject to change):
Examples of replication packages
With confidential data
- https://doi.org/10.3886/E154241V2 not only code, but faces the problem that IRS data cannot have variables revealed. Their workaround is not the same one as in this tutorial.
- https://doi.org/10.3886/E162581V1
Using containers:
- Kline et al (2024) “A Discrimination Report Card: primary replication package, with container specification, image on Docker Hub, and preserved image on Zenodo.
- Herbert et al (2024) “Reproduce to validate”: primary replication package, container specification and preserved image on Borealis.ca.
Extra info
- This document’s source: https://github.com/larsvilhuber/tutorial-reproducibility-2025
- Licensed under
