Can a skill-based peer-referral system to recruit enumerators improve data quality in the Philippines?
How to cite
Dillon, Andrew; Karlan, Dean; Udry, Christopher. 2023. "Can a skill-based peer-referral system to recruit enumerators improve data quality in the Philippines?." AEA RCT Registry. AEARCTR-0011999. https://doi.org/10.1257/rct.11999-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Credible research relies significantly on the quality of data enumerators collect from households. However, evidence suggests that this data can vary based on enumerators’ demographic characteristics, and their skills and behaviors when conducting interviews. Poor data quality can lead to bias and limited validity across contexts. Enumerator skills, especially non-cognitive skills, can be difficult to recognize in a typical recruitment process. However, one’s peers have additional information about their skills, so recruiting through referrals holds the potential to diversify the skills profile of the applicant pool. This study aims to measure the impact of recruiting enumerators through skills-based referrals on data quality. Specifically, it asks if referrals change the skill profile in an enumerator applicant pool. It also asks what the return of two specific skills, active listening and conscientiousness, on data quality is. In the first phase, trusted enumerators identified by the IPA Philippines team will be randomized into referring individuals in their network on the basis of one of the two skills. In the second phase, referred enumerators will in turn be asked to refer individuals on the basis of the skill they were referred on. This will be a supplementary study to the Philippines Socioeconomic Panel Survey (PSPS) which is being implemented by IPA Philippines.
Intervention
The intervention tested in this study is skill-based peer referrals. Trusted enumerators who have previously worked with IPA are requested to refer candidates who they consider to have strong active listening skills or are conscientious. Then we conduct a second round of 'friends of friends' referrals, where previously referred candidates similarly refer other candidates in their network who they consider to have strong active listening skills or are conscientious.
Experimental design
The intervention will be implemented in three phases:
1. Phase 1 – Business as Usual Comparison group: In this phase, recruitment will be conducted as per usual, with an open application, without any skill-based recruitment. Advertising of the job will occur through social media, email announcements, etc. The job application will include language to encourage all eligible applicants to apply.
2. a. Phase 2 – Conscientiousness treatment group: Nine trusted enumerators (identified by the IPA Philippines team) will be invited to a skill-based recruitment meeting. The meaning of the specific-skill, conscientiousness, will be discussed and the trusted enumerators will be invited to recruit six enumerators from their network who have not yet applied for the job to apply. Trusted enumerators will be compensated for every individual they have a referral conversation with.
2. b. Phase 2 – Active listening treatment group: Nine trusted enumerators (identified by the IPA Philippines team) will be invited to a skill- based recruitment meeting. The specific-skill, active listening, will be discussed and the trusted enumerators will be invited to recruit six enumerators from their network who have not yet applied for the job to apply. Trusted enumerators will be compensated for every individual they have a referral conversation with.
The recruitment team will be blind to the referral status of a candidate (that is, if they were referred or not) to ensure that the outcome of their application remains unbiased. Applications by ‘business as usual’ applicants who apply without referrals will continue to be accepted and reviewed during Phase 2.
3. Phase 3 — 'Friends of Friends’ Recruitment: In Phase 3, applicants recruited from trusted enumerators during Phase 2 will be invited to a skill-specific (conscientiousness or active listening) ‘friends of friends’ recruitment meeting. One meeting for each specific skill group will be organized. During the ‘friends of friends’ recruitment meeting, the definition of the specific skill will be described to the group and they will be invited to recruit two additional enumerators from their network to apply. Those making ‘friends of friends’ referrals will be compensated for every individual they have a referral conversation with.
The recruitment team will be blind to the referral status of a candidate (that is, if they were referred or not) to ensure that the outcome of their application remains unbiased. Applications by ‘business as usual’ applicants who apply without referrals will continue to be accepted and reviewed during Phase 3.
Design details
Cited by
No citation data available for this registration yet.