The method of Analysis and the development of cognitive skills

How to cite

Manghi, Riccardo; Bernardi, Luigi. 2021. "The method of Analysis and the development of cognitive skills." AEA RCT Registry. AEARCTR-0008409. https://doi.org/10.1257/rct.8409-2.1

Download: BibTeX · RIS — for reference managers without a browser translator. Zotero and most others pick up this page's citation metadata directly.

Riccardo Manghi* , Luigi Bernardi

* Primary investigator

Registry ID
AEARCTR-0008409
DOI
https://doi.org/10.1257/rct.8409-2.1
First registered
Last updated
Status
Completed
Trial dates
2021-11-14 – 2022-01-31
Countries
Cameroon (South West), Italy (Roma (RM))
JEL codes
I, Z
Registry record
http://www.socialscienceregistry.org/trials/8409

Abstract

In order to validate the main assumptions and the functional equations of our educational planning and job search model, we investigate the effects of the method of analysis, or broadly speaking investigation inquiry-based learning (or inductive learning), on the development of cognitive skills. Our idea is that an analysis-based approach has a substantial benefit in the development of cognitive skills relative to the common synthesis-based learning process, or broadly speaking deductive learning. The trial is designed as follows: we take two primary school classes with the same teachers, one is used as a control group and the other as a treatment group. The treatment consists of an educational path, designed according to the methodologies of investigation-based science education (IBSE), that it should provide an exogenous variation in the amount of analysis done by the children. Cognitive skills are measured before and after the treatment and compared between the control and the treatment class.
A first stage of this experiment has been conducted in Rome, Italy, last year. The RCT will continue both in the same classes of the roman primary school in which is conducted the first stage , and in another primary school in Cameroon. The educational path used as treatment are the BUL project in Italy and the TALES project in Cameroon. More details about these projects can be found here. https://it.oiler.education/scuola/materiali/primaria

Intervention

Considering the most universally accepted aspects andon which students of the philosophy of logic are in agreement, we can think of Analysis in the educational environment as inquiry-based learning, in which the students build knowledge and abilities from their own by trials and errors. The learning process is slow but the concepts are deeply understood since they are rebuilt from the interior. On the other hand, through synthesis students are guided through the concepts. It may result in a lack of grasp on the learned notions, but the process is fast and it works in various contexts, including large classes. Throughout an analysis-based approach, students are guided along a process that helps the development of the ability to ”build” their knowledge from testing ideas and approaches based on their previous knowledge and experience by applying these new situations and integrating the newly acquired knowledge with preexisting intellectual constructs. We refer to this ability as Constructive Skill. This concept contrasts with the one of Applied skill, which consists in practical skills, knowledge and tools related to a specific context needed to do some specific task. I present an RCT aimed to assess the causal effect of analysis on the development of Constructive Skill, validating one of the most important theoretical assumptions of the paper. The trial is structured as follows: I use an educational path based on the method of analysis, BUL, to produce an exogenous variation in the amount of Analisys which is done. This project is conducted in two classes of a Roman primary school. In the other exercise, the educational path choosen is called TALES and the treatment and the control groups are from a primary school in Cameroon. Then, Constructive skill is measured for every child of the class and for the children of the other class with the same main teacher but that are not undertaking the project, both before and after the period in which the project is undergone. To measure constructive skill, two different proxies are used: an IQ test for children(repeated both before and after the treatment) and a set of logical questions taken from INVALSI tests (different at each measurement, to capture mental elasticity). Concerning the first trial, the one already conducted in Rome, we built the IQ measure following the MENSA criteria. The results gave me a normal shape for the distribution of the IQs, with the average being near 100 (respectively 101, 100 and 104). From the balancing tests the covariates related to nationality of origin, sex and age result to have similar distribution between the control class and the treatment class. The first return test is conducted just two months after the first one and is likely to be strongly influenced by learning effects due to the memory of questions performed only two months earlier. The test will be repeated during the next year- where the treatment will also continue -, both to quantify the entity of these learning effects and isolate them, and to verify the effects of the treatment after more prolonged exposure. intelligence and nationality have a relevant and significant effect in both exercises. The impact of the second is not very surprising, as it is evident that children with parents of foreign nationalities face language barriers that slow down not only the learning possibilities but also the effectiveness of an IQ test as these children have to do a greater effort to understand some questions. Furthermore, this effect becomes greater if the language spoken at home is not Italian. As regards our variable of interest, we note that the effect on the treatment IQ is not significant. This is probably due to the persistence of memory effects, as discussed above, combined with the possibility that IQ measures a set of skills related to the g factor, while the Analysis method favors a particular component, the one close to the concept of measured mental elasticity. For both of these two reasons, in fact, the second exercise reveals a significant effect of the treatment. In order to distinguish the weight and relevance of each of these two topics, the subsequent return tests will be fundamental, which will allow isolating the memory effect. The trial in the primary school in Cameroon will be conducted with the same methodology.

Experimental design

The trial is structured as follows: I use an educational path based on the method of analysis, BUL, to produce an exogenous variation in the amount of Analisys which is done. This project is conducted in two classes of a Roman primary school. In the other exercise, the educational path choosen is called TALES and the treatment and the control groups are from a primary school in Cameroon. Then, Constructive skill is measured for every child of the class and for the children of the other class with the same main teacher but that are not undertaking the project, both before and after the period in which the project is undergone. To measure constructive skill, two different proxies are used: an IQ test for children(repeated both before and after the treatment) and a set of logical questions taken from INVALSI tests (different at each measurement, to capture mental elasticity).

Design details

Randomization method
Choice of the treatment class and control class random. The classes share the same teachers. Balancing tests show no ex-ante significant difference between the two classes
Randomization unit
Class
Clusters
2 classes for the trial in Rome, two classes for the trial in Cameroon
Observations
42 students for the trial in Rome, data still to collect for the trial in Cameroon
Arms
2 classes
Primary outcomes
Constructive\Cognitive Skill

Papers from this trial

  1. Bernardi, L. (2022). Bul Game: playing with knights and knaves. In Handbook of research on International Approaches and Practices for Gamifying Mathematics (pp. 170–188). IGI global. https://doi.org/10.4018/978-1-7998-9660-9.ch009 https://www.igi-global.com/chapter/bul-game/304152

Cited by

No citation data available for this registration yet.

Keywords