Gettin' 'Em Through the Door: A Conjoint Experiment on Bureaucratic Selection
How to cite
McCrea, Austin; Favero, Nathan. 2023. "Gettin' 'Em Through the Door: A Conjoint Experiment on Bureaucratic Selection." AEA RCT Registry. AEARCTR-0010060. https://doi.org/10.1257/rct.10060-1.1
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
Whether it is a parent deciding on what school district to send their child to, a daughter shopping between assisted living facilities for an elderly parent, or a Medicare patient choosing a primary care physician, citizens face myriad choices and tradeoffs in their interactions with bureaucracy. The once conventional depictions of citizens as passive participants in bureaucratic encounters are being replaced with depictions of citizens as active participants who express agency, preference, and choice. These recent theoretical and empirical developments emphasize that citizens are not monolithic, but rather that individual experiences, sociodemographic identities, and social constructions are all important characteristics that shape how citizens interact with bureaucracy, and who they choose to interact with. This research explores how citizens, when they have a choice, choose bureaucrats and the types of values, choices, and tradeoffs inherent to these decisions. Using a within-subjects conjoint survey experiment, this study examines how citizens weigh representation (e.g. race matching, gender matching) and efficiency (e.g. flexible modality, wait times) concerns when selecting a prospective mental health provider.
Intervention
The interventions consist of a within-subject conjoint experiment embedded in an electronic survey. The design is a paired profiles conjoint in which profiles for two therapists—A and B—are presented next to each other in a conjoint table.
The first column of the conjoint table lists a total of seven therapist attributes. The second and third columns list the therapist attribute values for therapists A and B, respectively. All therapist attribute values are assigned at random with equal probability for each attribute (with the restriction that Specialty 2 cannot take on the same value as Specialty 1, when specialty is shown, as explained below). The order of attributes is randomized by respondent (the order will not change from one conjoint to the next for the same respondent); the only constraint on order randomization is that when specialty is shown Specialty 2 always occurs directly after Specialty 1.
Each respondent is randomly assigned (with weights shown in parentheses) to one of three groups determining which set of attributes they will see: no specialty (50% probability), no session info (25% probability), or no professional info (25% probability).
For this study, responses from those selected into the "no session info" group will be dropped from the sample.
The exact text for the eight therapist attributes and their respective attribute values appear below. Attributes 1-3 are shown to all respondents, while attributes 4-9 are only shown to certain respondents.
Attribute 1: Overall Rating
Attribute values (2):
- 4 stars
- 4.5 stars
Attribute 2: Sex/Gender
Attribute values (3):
- Female
- Male
- Non-Binary
Attribute 3: Race/Ethnicity
Attribute values (4):
- Black/African American
- White
- Hispanic/Latino
- Asian
Attribute 4 (not displayed for respondents selected into "no specialty" group): Specialty 1
Attribute values (6):
- Women's Issues
- Racial Identity
- LGBTQ+
- Life Transitions
- Anxiety
- Depression
Attribute 5 (not displayed for respondents selected into "no specialty" group): Specialty 2
Attribute values (6 - but cannot take on same value as Attribute 4):
- Women's Issues
- Racial Identity
- LGBTQ+
- Life Transitions
- Anxiety
- Depression
Attribute 6 (not displayed for respondents selected into "no session info" group): Next Available Session
Attribute values (2):
- One Week
- Four Weeks
Attribute 7 (not displayed for respondents selected into "no session info" group): Session Format
Attribute values (3):
- Secure Online Meetings
- In-Person Meetings
- Choice of Online or In-Person
Attribute 8 (not displayed for respondents selected into "no professional info" group): Years of Experience
Attribute values (2):
- 5 years
- 20 years
Attribute 9 (not displayed for respondents selected into "no professional info" group): Professional Degree
Attribute values (3):
- Licensed Professional Counselor (LPC)
- Master of Social Work (MSW)
- PhD, Psychology
Experimental design
The conjoint survey experiment is carried out among a non-probability sample of US residents. Participants are recruited via Prolific, with enrollment limited to individuals with current residence in the US (using Prolific’s prescreening feature). In order to ensure a racially diverse sample of respondents, we will recruit 750 White respondents and 750 non-White respondents. This quota sampling approach is accomplished using Prolific’s prescreening feature. Specifically, two identical studies are created in Prolific, except that one study limits enrollment to only White participants (using Prolific’s demographic category “Ethnicity (Simplified)”) and the other study limits enrollment to non-White participants.
All survey respondents are tasked with selecting a prospective therapist. First, respondents are exposed to an introductory text describing the task and providing basic information about a new community health clinic offering a free initial consultation for mental health counseling. Next, respondents are exposed to a paired profiles conjoint in which two specific therapist profiles—A and B—are presented next to each other in a conjoint table.
The first column of the conjoint table lists seven therapist attributes. The second and third column list the attribute values (for those seven therapist attributes) for therapists A and B, respectively. All therapist attribute values are assigned at random.
The exact therapist attributes and values appear under ‘intervention (public)’.
As our outcome measures, all respondents are asked to indicate their choice between the two therapist profiles (“Which of the two therapists would you personally prefer?”). Response options are “Therapist A” and “Therapist B.” They are then asked how closely “Therapist A” and “Therapist B” reflect their ideal counselor on a scale from 1-7 ("Definitely not ideal" to "Definitely ideal").
Respondents are presented with similar paired profiles conjoints (i.e., involving the same attributes and random assignment of new attribute values for both therapist profiles) two more times. Thus, each respondent will see a total of three pairs of counselors.
We measure respondents' gender and race through simple single-item survey measures.
We test the following hypotheses:
H1 Symbolic representation preference:
H1a: Women respondents are more likely to select a woman provider
H1b: Respondents of color are more likely to select a co-ethnic provider
H2 Workload interfering with representation:
H2a: Women's preference for gender congruence will be weaker when the provider has a high workload
H2b: Respondents' of color preference for coethnic congruence will be weaker when the provider has a high workload
H3/4 How interactive intensity and flexibility moderate representation:
H3a: Women's preference for gender congruence will be weaker when the provider is only available to meet virtually
H3b: Respondents' of color preference for coethnic congruence will be weaker when the provider is only available to meet virtually
H4a: Women's preference for gender congruence will be stronger when the provider offers both virtual and in-person meeting options
H4b: Respondents' of color preference for coethnic congruence will be stronger when the provider offers both virtual and in-person meeting options
Design details
Cited by
No citation data available for this registration yet.