A Randomized Evaluation of the Impact of GenAI Training in a Relational Job at a Global Bank
How to cite
Mones, Antonio Roldan. 2026. "A Randomized Evaluation of the Impact of GenAI Training in a Relational Job at a Global Bank." AEA RCT Registry. AEARCTR-0019338. https://doi.org/10.1257/rct.19338-1.0
Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.
* Primary investigator
Abstract
This paper evaluates whether targeted training enables workers to translate access to generative artificial intelligence (GenAI) into improved performance in a relational job. We conduct a cluster-randomized controlled trial involving more than 700 relationship managers across approximately 300 branches of a large global bank in Mexico and Spain. All participants retain access to GenAI tools, while managers in treated branches receive a short, intensive training program designed around their day-to-day workflows. This design isolates the effect of targeted training relative to GenAI access alone. Using individual-level data on GenAI usage, administrative processes, client interactions, commercial opportunities, customer satisfaction, and incentive-based performance measures, we examine whether training increases the adoption and sophistication of GenAI use and whether it improves productivity. We investigate two principal mechanisms: the automation or streamlining of administrative tasks, which may free time for client-facing activities, and the augmentation of client interactions through better preparation and more tailored proposals. We also study whether effects differ according to workers’ prior performance, age, experience, previous GenAI use, and risk-taking profiles. The study contributes to the emerging literature on workplace GenAI by examining its deployment in a real-world relational occupation combining analytical, administrative, and interpersonal tasks. It also provides evidence on whether brief training can convert widespread access to GenAI into measurable organizational value and whether it narrows or widens performance differences across workers.
Intervention
The intervention consists of a short, intensive, in-person training program designed to improve relationship managers’ (RMs) ability to use generative artificial intelligence (GenAI) effectively in their daily work. The program lasts about three hours and focuses on practical applications of GenAI to the administrative, analytical, and client-facing tasks performed by relationship managers. The intervention will be implemented in two different countries (Spain and Mexico) in August, September and October in collaboration with a large Global Bank, BBVA.
Relationship managers assigned to the control group retain access to the bank’s existing GenAI tools but do not receive the additional training during the experimental period. The intervention therefore evaluates the effect of targeted GenAI training relative to GenAI access alone. The training will be offered to the control group after the experimental period /about six months later).
Experimental design
The study is a cluster-randomized controlled trial conducted with relationship managers at a large global bank. Participating bank branches are assigned either to a treatment group that receives a short, intensive GenAI training program or to a control group that continues business as usual. Control group branches are expected to receive the training about six months later. Relationship managers in both groups retain access to the bank’s existing GenAI tools.
Randomization is conducted at the branch level because relationship managers within the same branch work closely together and frequently exchange information. This design reduces potential contamination between treatment and control participants. Outcomes will be measured using internal administrative, CRM, GenAI usage, customer-experience, and performance data collected before and during an experimental period of approximately four months.
Design details
Cited by
No citation data available for this registration yet.