Peer Reviews and Search Behavior on a Job Platform in Mexico

How to cite

Arriaga, Daniela Borja. 2026. "Peer Reviews and Search Behavior on a Job Platform in Mexico." AEA RCT Registry. AEARCTR-0019096. https://doi.org/10.1257/rct.19096-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Daniela Borja Arriaga*

* Primary investigator

Registry ID
AEARCTR-0019096
DOI
https://doi.org/10.1257/rct.19096-1.0
First registered
Last updated
Status
In development
Trial dates
2026-07-09 – 2026-08-17
Countries
Private
JEL codes
J64, D83
Registry record
http://www.socialscienceregistry.org/trials/19096

Abstract

Job seekers cannot easily verify what an employer is actually like before applying, and few platforms provide credible signals about employer quality. This trial evaluates the effect of disclosing verified, positive peer testimonials about employers on job seekers' search behavior on an online job-search platform in Mexico. All candidates active on the platform during the trial window are eligible for randomization, which occurs at the individual level via a deterministic hash of the candidate identifier. Candidates are assigned in a 1:1:1 ratio to control (standard platform experience), a testimonial arm emphasizing respectful treatment by the employer, and a testimonial arm emphasizing the employer's compliance with pay and benefit terms; testimonials are shown only on a pre-selected subset of vacancies for which a positive, verified review is available. The trial runs ten days beginning July 9, 2026, covering approximately 60,000 candidates (20,000 per arm). Primary outcomes are candidate-level application and search behavior: whether a candidate applies to any vacancy, applies to a reviewed employer, the share of applications directed to reviewed employers, and search intensity (return visits and browsing activity), motivated by the possibility that a credible positive signal raises candidates' perceived returns to searching and leads them to search more rather than settle. A secondary, exploratory analysis compares the two testimonial framings among the subset of employers where the respect/compliance distinction is clean.

Intervention

The intervention is the display of a verified positive peer testimonial on a job posting on an online job-search platform in Mexico. On eligible vacancies, treated candidates see a card reading "Un chambeador opina:" ("A worker says:") followed by an italicized quote drawn from a verified, positive employee review — no star ratings, counts, or averages are shown. Two testimonial variants are tested: a "Group 1" variant emphasizing respectful treatment by the employer, and a "Group 2" variant emphasizing the employer's compliance with pay and benefit terms; which variant a candidate sees depends on their assigned group (see Experimental Design for the full assignment structure). Control candidates see the standard vacancy listing with no testimonial. The intervention targets active job-seeking candidates on the platform and is intended to test whether credible third-party signals about employer quality redirect search behavior toward signaled employers, and separately, whether such signals change how intensively candidates search overall (e.g., returning to the platform more, browsing more vacancies).

Experimental design

This is a randomized controlled trial testing the effect of disclosing verified positive peer testimonials about employers on job seekers' application behavior on an online job-search platform in Mexico. All candidates active on the platform during the trial period are randomly assigned, at the individual level, to one of three arms using a deterministic hash of their candidate identifier (1:1:1 ratio): a control arm that sees the standard platform experience with no testimonial; a "Group 1" arm that, on eligible vacancies, sees a testimonial emphasizing respectful treatment by the employer; and a "Group 2" arm that sees a testimonial emphasizing the employer's compliance with pay and benefit terms. Assignment is fixed for each candidate for the duration of the trial. Testimonials are displayed only on vacancies from employers for which a positive, verified testimonial is available at the time a candidate views the posting; this set of eligible employers is expected to number in the low tens and may fluctuate over the trial period as employers enter or exit the platform's active client base. All other vacancies are unaffected for all arms. For a minority of eligible employers, the testimonial content differs meaningfully between Group 1 and Group 2 along the respect/compliance dimension; for the remaining eligible employers, both treatment arms see the same general positive testimonial, and these observations contribute only to the pooled treatment effect. The trial runs for 10 days. Approximately 60,000 candidates are expected to be randomized, of whom a minority are expected to view at least one eligible vacancy during the trial and thus be exposed to a testimonial if assigned to a treatment arm. Outcomes are measured using platform administrative data on views and applications for the full population of randomized candidates. This trial may be followed by a subsequent wave, incorporating additional employer reviews and design refinements informed by this first implementation; any such wave would be registered separately, with its own dates, sample, and design. If a subsequent wave is conducted, data may be pooled across waves in the eventual analysis, with wave fixed effects and attention to candidates who appear in more than one wave.

Design details

Randomization method
Each candidate is assigned to a group using a fixed calculation applied to their unique candidate ID, rather than a physical or one-time random draw. The calculation (MD5, a standard method for turning a piece of text into a long number) converts each candidate's ID into a large number; the remainder after dividing that number by 100 places the candidate into one of three groups: a remainder of 0–32 assigns them to control, 33–65 to Group 1 (respect-framed testimonial), and 66–99 to Group 2 (compliance-framed testimonial). Because the same ID always produces the same remainder, the assignment is fixed and can be independently recomputed and verified by anyone with the candidate ID list, while still being unpredictable in advance and evenly spread out — producing the intended, approximately equal three-way (1:1:1) split.
Randomization unit
Individual (candidate_id). Assignment is fixed for each candidate for the duration of the trial: a candidate sees the same arm across every eligible vacancy they view during the trial window.
Clusters
Approximately 60,000 candidates.
Observations
Approximately 60,000 candidates.
Arms
Control: ~20,000. Group 1 (respect): ~20,000. Group 2 (compliance): ~20,000.
Primary outcomes
1. Applied to at least one vacancy during the trial observation window (binary, candidate-level) 2. Applied to a reviewed/eligible employer (binary, candidate-level) 3. Share of a candidate's applications directed to reviewed employers (continuous, candidate-level) 4. Search intensity and platform engagement following exposure: number of return visits/sessions and browsing activity (e.g., vacancies viewed, "see more vacancies" interactions) during the trial window (candidate-level, counts)
Secondary outcomes
1. Applied to the specific reviewed vacancy, conditional on having viewed it (candidate-level, vacancy-conditional), examined two ways: (a) conditional on viewing at any point during the trial window, and (b) conditional on viewing within the candidate's first carousel of vacancies, in their first session after trial start — a stricter definition intended to be closer to treatment-independent 2. Interview attendance, where observed 3. Hire, where observed 4. Respect- vs. compliance-framed testimonial contrast on outcomes 1–3 above, restricted to the subset of treatment-eligible employers where the two dimensions are cleanly distinguished 5. Heterogeneity in Primary Outcomes 1–4 by candidate gender and by candidate occupation 6. Difference-in-differences comparing application rates to treatment-eligible employers versus non-eligible employers, across arms, to isolate redirection of applications toward reviewed employers from any general increase in application or search activity

Cited by

No citation data available for this registration yet.

Keywords