A Randomized Evaluation of the Impact of GenAI Training in a Relational Job at a Global Bank

How to cite

Mones, Antonio Roldan. 2026. "A Randomized Evaluation of the Impact of GenAI Training in a Relational Job at a Global Bank." AEA RCT Registry. AEARCTR-0019338. https://doi.org/10.1257/rct.19338-1.0

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Antonio Roldan Mones*

* Primary investigator

Registry ID
AEARCTR-0019338
DOI
https://doi.org/10.1257/rct.19338-1.0
First registered
Last updated
Status
In development
Trial dates
2026-08-06 – 2027-06-28
Countries
Spain (Madrid)
Registry record
http://www.socialscienceregistry.org/trials/19338

Abstract

This paper evaluates whether targeted training enables workers to translate access to generative artificial intelligence (GenAI) into improved performance in a relational job. We conduct a cluster-randomized controlled trial involving more than 700 relationship managers across approximately 300 branches of a large global bank in Mexico and Spain. All participants retain access to GenAI tools, while managers in treated branches receive a short, intensive training program designed around their day-to-day workflows. This design isolates the effect of targeted training relative to GenAI access alone. Using individual-level data on GenAI usage, administrative processes, client interactions, commercial opportunities, customer satisfaction, and incentive-based performance measures, we examine whether training increases the adoption and sophistication of GenAI use and whether it improves productivity. We investigate two principal mechanisms: the automation or streamlining of administrative tasks, which may free time for client-facing activities, and the augmentation of client interactions through better preparation and more tailored proposals. We also study whether effects differ according to workers’ prior performance, age, experience, previous GenAI use, and risk-taking profiles. The study contributes to the emerging literature on workplace GenAI by examining its deployment in a real-world relational occupation combining analytical, administrative, and interpersonal tasks. It also provides evidence on whether brief training can convert widespread access to GenAI into measurable organizational value and whether it narrows or widens performance differences across workers.

Intervention

The intervention consists of a short, intensive, in-person training program designed to improve relationship managers’ (RMs) ability to use generative artificial intelligence (GenAI) effectively in their daily work. The program lasts about three hours and focuses on practical applications of GenAI to the administrative, analytical, and client-facing tasks performed by relationship managers. The intervention will be implemented in two different countries (Spain and Mexico) in August, September and October in collaboration with a large Global Bank, BBVA.

Relationship managers assigned to the control group retain access to the bank’s existing GenAI tools but do not receive the additional training during the experimental period. The intervention therefore evaluates the effect of targeted GenAI training relative to GenAI access alone. The training will be offered to the control group after the experimental period /about six months later).

Experimental design

The study is a cluster-randomized controlled trial conducted with relationship managers at a large global bank. Participating bank branches are assigned either to a treatment group that receives a short, intensive GenAI training program or to a control group that continues business as usual. Control group branches are expected to receive the training about six months later. Relationship managers in both groups retain access to the bank’s existing GenAI tools.

Randomization is conducted at the branch level because relationship managers within the same branch work closely together and frequently exchange information. This design reduces potential contamination between treatment and control participants. Outcomes will be measured using internal administrative, CRM, GenAI usage, customer-experience, and performance data collected before and during an experimental period of approximately four months.

Design details

Randomization method
Randomization will be conducted in an office by computer. A computer-generated random assignment will allocate participating bank branches to the treatment or control group. Regarding stratification, in order to improve statistical power, in Spain we did it at the office-size level (by tertiles), while in Mexico we stratified by division and manager type - since the in-person trainings are being run at the division level (each of the 8 divisions comprises one or more offices).
Randomization unit
Bank branch. All participating relationship managers working in the same branch will be assigned to the same experimental condition.
Clusters
Approximately 300 bank branches.
Observations
More than 700 relationship managers.
Arms
Assuming equal allocation, approximately 150 branches and 350 relationship managers will be assigned to the GenAI-training group, and approximately 150 branches and 350 relationship managers will be assigned to the business-as-usual control group.
Primary outcomes
1. GenAI adoption and use. 2. Commercial and client-facing activity. 3. Duration of selected internal administrative processes. 4. Conversion of commercial opportunities. 5. Customer satisfaction and client-experience indicators. 6. Relationship-manager productivity and commercial performance.
Secondary outcomes
1. Allocation of commercial attention across the customer portfolio. 2. Quality and personalization of client interactions. 3. Customer retention and longer-term client attachment, where observable. 4. Communication-related and social-capital barriers. 5. Risk-taking and the preparation of client risk profiles. 6. Diffusion of GenAI practices and potential spillovers within treated branches.

Cited by

No citation data available for this registration yet.

Keywords