Applying Behavioral Science to Grant Evaluation in Local Governments

How to cite

Sasaki, Shusaku; Kuroki, Makoto. 2022. "Applying Behavioral Science to Grant Evaluation in Local Governments." AEA RCT Registry. AEARCTR-0008826. https://doi.org/10.1257/rct.8826-1.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Shusaku Sasaki* , Makoto Kuroki

* Primary investigator

Registry ID
AEARCTR-0008826
DOI
https://doi.org/10.1257/rct.8826-1.1
First registered
Last updated
Status
On going
Trial dates
2022-01-28 – 2023-03-31
Countries
Private
Registry record
http://www.socialscienceregistry.org/trials/8826

Abstract

We examine how to nudge administrators in local governments to evaluate grant applications from nonprofit organizations from long-term perspectives, not short-term ones. Prior studies show that there are two effective ways for nonprofits to win grants: A) providing information about outcomes of service programs such as short-term and long-term outcomes, and B) providing information on service efforts such as accounting efficiency. However, evaluators are more likely to highly evaluate short-term outcomes than long-term outcomes because of their high time-discounting rate in behavioral economics.

We conduct a field-based survey experiment toward 1,916 local governments in Japan. We randomly divide the local governments into four groups. We set in the survey a hypothetical question, where the survey respondents are asked to evaluate the contents and quality of grant applications from two non-profit organizations: one with good short-term outcomes and the other with good long-term outcomes. The four groups consist of three treatment groups and one control group. The three treatment groups add to the latter nonprofit organization the information on A) accounting efficiency, B) social comparison nudge, and C) both. After the hypothetical question, we ask administrators in the local governments to rate the grant applications from the two nonprofit organizations and make a decision on which application is more suitable for acceptance. We also investigate whether the effects are heterogeneous by local governments’ and administrators’ characteristics.

Intervention

We randomly assign local governments to either of one control group and three treatment groups. The treatment group A provides for one nonprofit organization with good long-term outcomes the information of accounting efficiency on its service programs (accounting). The treatment group B provides the information explaining that many other local governments have already accepted similar applications which would create long-term outcomes (social comparison). The treatment group C provides both information, and the group D is the control group.

Experimental design

We randomly assign local governments to either of one control group and three treatment groups. The treatment group A provides for one nonprofit organization with good long-term outcomes the information of accounting efficiency on its service programs (accounting). The treatment group B provides the information explaining that many other local governments have already accepted similar applications which would create long-term outcomes (social comparison). The treatment group C provides both information, and the group D is the control group.

Design details

Randomization method
Stratified randomization based on 8 types of Japanese local governments (Prefectures; wards; ordinance-designated cities; central core cities; cities; towns; villages; ordinance-designated city wards)
Randomization unit
Sections in charge of supporting civic activities at local governments
Clusters
1,916 sections in charge of supporting civic activities in local governments
Observations
1,916 administrators at the sections in charge of supporting civic activities in local governments
Arms
479 local governments in the control group, 479 local governments in the treatment group A, 479 local governments in the treatment group B, and 479 local governments in the treatment group C. These are the number of mailings to randomly assigned local governments, and the sample size finally collected will be smaller than the number of these mailings.
Primary outcomes
Rating the grant applications from the two nonprofit organizations
Secondary outcomes
1. Making a decision on which application is more suitable for acceptance 2. Subjective evaluation for outcomes and other information in the applications 3. How to refer outcome and other information in making the decision

Cited by

No citation data available for this registration yet.

Keywords