Tutorial reproducibility
Please fill out this survey on background and skills, to provide us with information on who you are. It will help us improve the presentation, and make it more relevant for you.
Last updated: 18 March 2026, 01:37
The results cover multiple workshops, and include all responses between 01 January 2025 and 19 March 2026.
Education
| Degree | Frequency | Frequency (Complete) | Percent |
|---|---|---|---|
| graduate student (Ph.D.) | 26 | 26 | 20.00 |
| graduate student (Masters) | 10 | 8 | 6.15 |
| faculty member (tenured) | 15 | 12 | 9.23 |
| faculty member (untenured) | 9 | 8 | 6.15 |
| Other | 61 | 52 | 40.00 |
| NA | 9 | 0 | 0.00 |
| Note: | |||
| Percent is calculated as the proportion of completed responses. |
Operating System by Educational Category
| OS | Academic | Other | Overall |
|---|---|---|---|
| Linux | 11.1% | 15.4% | 13.2% |
| Mac | 53.7% | 11.5% | 33.0% |
| Windows | 53.7% | 92.3% | 72.6% |
| Note: | |||
| Completed responses only. Multiple mentions possible. Cells show percent of OS mentions by group. |
Intermediate or Advanced Programming Language Usage
| Programming Language | Frequency | Percent |
|---|---|---|
| C | 18 | 16.98 |
| Matlab | 15 | 14.15 |
| Python | 33 | 31.13 |
| R | 53 | 50.00 |
| SAS | 9 | 8.49 |
| Stata | 63 | 59.43 |
| Note: | ||
| Completed responses only. Multiple mentions possible. |
Command Line Usage by Educational Category
| Feature | Academic | Other | Overall |
|---|---|---|---|
| Command line used often | 61.1% | 59.6% | 60.4% |
| Command line used once | 20.4% | 23.1% | 21.7% |
| System with >6 CPUs: often | 31.5% | 44.2% | 37.7% |
| System with >6 CPUs: once | 13.0% | 11.5% | 12.3% |
| Note: | |||
| Completed responses only. Cells show percent of feature mentions by group. |
One of the following (or a linear combination):
Guidance
Some additional guidance can be found on the website of the Social Science Data Editors (URLs subject to change):
Examples of replication packages
With confidential data
- https://doi.org/10.3886/E154241V2 not only code, but faces the problem that IRS data cannot have variables revealed. Their workaround is not the same one as in this tutorial.
- https://doi.org/10.3886/E162581V1
Using containers:
- Kline et al (2024) “A Discrimination Report Card: primary replication package, with container specification, image on Docker Hub, and preserved image on Zenodo.
- Herbert et al (2024) “Reproduce to validate”: primary replication package, container specification and preserved image on Borealis.ca.
Extra info
- This document’s source: https://github.com/larsvilhuber/tutorial-reproducibility-2025
- Licensed under
