Students around the world experienced learning loss due to Covid-19 school shutdowns. In Puerto Rico, students had already experienced years of disruption due to Hurricane Maria in 2017, followed by earthquakes in 2019 and 2020. Their students’ standardized test scores in mathematics were of urgent concern to the Puerto Rico Department of Education (PRDE). According to the National Assessment of Educational Progress (NAEP),80 percent of fourth-grade students in the United States have a basic knowledge of mathematics, but only 15 percent of students in Puerto Rico could demonstrate that basic knowledge.
Aplicación de la Tecnología en la Enseñanza de las Matemáticas, or Technology Application in Mathematics Teaching (ATEMA) program, is one programmatic intervention PRDE took with the goal of improving math achievement. It is an approach dedicated to improving technology infrastructure, teacher training, mentoring, and applying low-cost interventions to improve mathematical education across Puerto Rico. Throughout the project’s process, the embedded research team has been and continues to monitor and evaluate its outcomes on teacher adoption and student achievement.
The project provides ongoing professional development opportunities for math teachers to use computer-assisted learning in the mathematics classroom. The first phase of the ATEMA program was implemented in a sample of grade 4-8 classrooms across Puerto Rico and tested through a randomized controlled trial (RCT).
During the same period, sixth graders at 16 different schools in 2022 also participated in The Khan Challenge as an addition or supplement to the ATEMA program. The challenge introduced a friendly competition between schools encouraging each student to spend two hours a week on the Khan Academy site. This one-off field experiment will showcase the short-term impacts of Khan Academy and teacher mentoring, as an example of computer-assisted learning (CAL) use in the classroom.
“Some schools were still working on setting up Internet access and computer distribution when we began to work on this project. The research partnership with the Department of Education is so strong and committed that we could revisit and refine the coordination strategy and look at the additional teaching supports that were needed. Throughout the project, the Department of Education team worked with us with flexibility and adaptability.”
Emily Goldman, Director of Research and Evaluation Partnerships in Puerto Rico, FOS