This randomized controlled trial investigates how artificial intelligence (AI) assistance influences strategic decision-making in mergers and acquisitions (M&A). The study tests whether managers trained in the Theory-Based View (TBV) of strategy produce more outcome-aligned acquisition decisions and show a higher confidence in their assessments when aided by general-purpose or agentic AI systems.
Three experimental arms are implemented with at least 400 experienced managers from the MedTech and Biotech industries: (1) Control – TBV training plus web search; (2) General AI – TBV training plus ChatGPT (GPT-5.4, reasoning effort set to medium); and (3) Agentic AI – TBV training plus ``Aristotle'', a multi-agent system developed at Bocconi University that applies TBV reasoning. Participants complete an online TBV training session, evaluate a real M&A opportunity, and submit an acquisition decision, probability assessments, a written strategic theory, and a maximum willingness-to-pay price.
Primary outcomes are (a) subjective probability of acquisition success and positive returns (0–100 scale), (b) confidence in probability assessments and strategic reasoning (7-point Likert), and (c) outcome alignment against a pre-registered deferred long-run. Secondary outcomes include a short-run benchmark to evaluate alignment with market expectations, a DAG-based measures of theory size, complexity, and within-graph diversity across M&A due diligence domains, as well as maximum willingness-to-pay. Randomization uses minimized allocation stratified by education field, M&A experience, and AI aversion.
The analysis estimates both Intention-to-Treat (ITT) effects for all three pairwise comparisons and Local Average Treatment Effects (LATE) via instrumental variables for each AI arm against control, capturing causal effects among compliers. Key hypotheses (two-sided) test whether: H1) GPT assignment improves outcomes relative to Control; H2) Aristotle assignment improves outcomes relative to Control; H3) GPT produces larger ITT effects than Aristotle, reflecting anticipated differential compliance. With N=400 allocated asymmetrically (100 Control, 120 GPT, 180 Aristotle) and anticipated compliance rates 0.90 for the GPT group and 0.80 for the Agentic AI group, the design achieves 80\% power for Cohen's d = 0.45 ( α =0.05, Bonferroni-adjusted across hypothesis families, Holm correction applied at analysis stage).
The study is approved by Bocconi University's IRB, conducted anonymously and online via Qualtrics, with all AI interactions logged for compliance and mechanism analysis. Results, data, and code will be made publicly available upon completion.
Intervention
The experiment implements a three-arm randomized controlled trial (RCT) with two parallel AI interventions and one control group. All participants first receive a short online training video introducing the Theory-Based View (TBV) of strategy, emphasizing causal reasoning in strategic decision-making. After viewing the training, participants complete an M&A decision challenge and develop a brief written acquisition strategy.
Arm 1 – Control (TBV + Web Search): Participants complete the TBV training and address the M&A challenge using only their own reasoning and publicly available information via Google Search. No AI assistance is provided.
Arm 2 – TBV + ChatGPT (General-Purpose LLM): Participants complete the TBV training and use OpenAI’s ChatGPT (GPT 5.4, reasoning effort set to medium) as a general-purpose large language model to assist them in researching, formulating, and refining their strategic theory before submitting their final decision. Participants are allowed to use web search as well.
Arm 3 – TBV + Aristotle (Agentic AI): Participants complete the TBV training and use "Aristotle", a specialized agentic AI system developed at Bocconi-IMSL that applies TBV reasoning principles. The agent autonomously supports causal reasoning and theory construction, providing targeted feedback and prompting to improve strategic coherence. Participants are allowed to use web search as well.
All other procedures, materials, and timing are identical across conditions. Total participation time is approximately 1 hour. Interventions are delivered online via the Qualtrics platform. Randomization is implemented automatically within the survey workflow using minimized allocation to maintain covariate balance across education, M&A experience, and baseline AI aversion.
Experimental design
The study is a three-arm randomized controlled trial (RCT) designed to test how different forms of AI assistance influence strategic reasoning quality and confidence among managers making M&A decisions.
All participants first receive a standardized short training video introducing the *Theory-Based View (TBV)* of strategy, which teaches causal reasoning and theory formulation principles. Immediately after training, participants complete an online M&A case challenge requiring them to develop a brief acquisition strategy and justify their reasoning.
Participants are randomly assigned (via minimized randomization) to one of three experimental arms:
1. Control Group – TBV + Google Search: Participants complete the M&A task using only web search and their own reasoning. 2. "Intervention 1 – TBV + LLM:" Participants use a general-purpose large language model to assist with information gathering, idea refinement, and theory formulation, other than standard web search. 3. "Intervention 2 – TBV + Agentic AI:" Participants use a specialized agentic AI that provides structured guidance and feedback grounded in causal reasoning principles, web search.
The experiment is conducted fully online using the Qualtrics platform. Total participation time is approximately 1 hour.
After completing the task, participants answer post-intervention surveys measuring subjective outcomes and provide qualitative feedback. Written responses are later coded blind to condition by expert judges and by an LLM-as-evaluator for objectivity and robustness checks.
The study design allows direct comparison of (a) general AI vs. no AI, (b) agentic AI vs. no AI, and (c) agentic AI vs. general AI. We compare both the effect of being assigned to a treatment condition (ITT) and the actual effect on compliers (LATE) through an IV analysis.
Design details
Randomization method
An asymmetric randomization is conducted and implemented via the Qualtrics platform, using stratified randomization on key covariates to ensure balanced groups. The allocation procedure follows a 1:1.2:1.8 ratio to ensure enough statistical power even in case of partial non-compliance to the treatments.
Intervention assignment:
Randomization is implemented via the Qualtrics platform, using purposely defined minimized
randomization algorithms based on three covariates: a) field of education (STEM or Non-
STEM); b) years of M&A experience (dichotomized); c) baseline AI aversion (di-
chotomized).
This provides the baseline allocation of participants to the experimental conditions by putting
them into eight strata. Within each stratum, an imbalance score is computed across the baseline
covariates, and each participant is assigned to the most-needed arm using a biased-coin probability
of p = 0.80 (rather than deterministically). This probabilistic covariate-adaptive randomization
preserves balance while avoiding the inferential problems of deterministic minimization in multi-
arm trials with unequal allocation. The minimization variables are included in the adjusted primary
analysis.
This minimized randomization approach within blocks prevents detectable imbalances in meaningful
observable characteristics while accommodating the practical constraints of field implementation,
ensuring enough statistical power to detect meaningful statistical effects across conditions.
All participants provide informed consent before randomization.
We will verify ex-post that the groups are balanced on baseline covariates within each block and
overall. If any notable imbalance arises despite minimization, we will control for those covariates
in the relevant econometric analyses.
We will record the randomization procedure with software logs, including assignment timestamps,
to ensure transparency.
The assignment method was already updated in the pre-analysis plan on the 10th of April, thus we register this as a minor change.
Randomization unit
Individual
Clusters
A minimum of 400 senior managers
Observations
400 participants
Arms
Our final target sample size is 400 participants in total: approximately 100 in the control group, 120 in Intervention 1 and 180 in Intervention 2
Primary outcomes
Subjective Probability of Acquisition Success (0–100 scale): The participant's self-assessed likelihood that the counterpart will accept their expressed willingness-to-pay or a lower price, elicited in 10-percentage-point increments.
Subjective Probability of Positive Returns (0–100 scale): The participant's self-assessed likelihood of achieving a positive return on the acquisition, conditional on deal completion, elicited on the same scale.
Confidence in Probability Assessments and Strategic Reasoning (7-point Likert): Three sub-constructs are measured: (a) confidence in the stated probability of acquisition success, (b) confidence in the stated probability of positive returns, and (c) confidence in the soundness of the strategic theory applied.
Outcome Alignment (Brier Score): The calibration of each participant's probability assessments against realized binary outcomes, computed using the Brier Score. Lower Brier scores indicate better-calibrated forecasts. Two evaluation horizons are pre-registered, however only the long-term evaluation benchmark represents a primary outcome: this is based on seven board-identified strategic objectives evaluated over a 36-month horizon from acquisition close (November 14, 2025), not observable before Q4 2028.
All outcomes are collected post-intervention within the same Qualtrics session. Outcomes 1–3 capture subjective assessments of decision quality; Outcome 4 anchors those assessments to ground-truth realized performance. The binary acquisition decision (proceed or decline) is reported alongside the Brier score as a complementary measure of forecast accuracy.
The primary treatment effects are estimated through pairwise contrasts between:
(a) ChatGPT vs. Control,
(b) Aristotle vs. Control, and
(c) ChatGPT vs. Aristotle (ITT only).
All tests are two-sided with family-wise error rate controlled at α=0.05 using Bonferroni correction, with the Holm procedure applied at the analysis stage for improved power. ITT effects are estimated for all three contrasts; LATE effects via instrumental variables are estimated separately for each AI arm against the control group, and are not directly compared across the two AI treatments.
Secondary outcomes
Outcome Alignment — Short-Run Market Benchmark (Brier Score, short-run): The calibration of each participant's probability assessments against Biogen's stock price abnormal returns in the announcement window around the acquisition date (September 18, 2025), treated as a market-based proxy for informed expectations about deal value creation. This benchmark is observable at the time of initial analysis and serves as the primary reference for classifying decision outcome alignment in the first publication.
Maximum Willingness-to-Pay (WTP, in $M): The highest price at which the participant would recommend proceeding with the acquisition. This outcome captures the participant's quantitative assessment of deal value and complements the binary acquisition decision and probability elicitations.
DAG Complexity and Size: Each participant's written strategic theory is processed through a semi-automated algorithm to extract a directed acyclic graph (DAG) representing its underlying causal structure. Three families of graph metrics are computed: (a) graph size (number of nodes and edges), (b) graph complexity(average-in-degree, maximum-in-degree, graph density), and (c)within-graph diversity, measured by the number of domain-relevant nodes spanning M&A due diligence categories identified in the literature (described in the pre-analysis plan Appendix A). These structural metrics operationalize the hypothesis that AI assistance expands the breadth and causal depth of participants' strategic theories.
Human–AI Interaction Quality (HIQ): For participants in the two AI treatment arms, all conversation threads are scored along four components using a structured rubric evaluated by a blinded LLM rater: (a)Domain-Specific Terminology, (b)Task-Relevant Specificity, (c)Input Delineation , and (d)Task Decomposition. Each component is entered individually as an ordinal variable in a correlational analysis linking interaction quality to primary outcomes. This analysis is explicitly non-causal: participants who prompt more skillfully may produce stronger theories independently of AI assistance, due to greater domain expertise or cognitive ability.
Cited by
No citation data available for this registration yet.