WWC Review of the Report "Longitudinal Evaluation of a Scale-up Model for Teaching Mathematics with Trajectories and Technologies." What Works Clearinghouse Single Study Review
The 2012 study, "Longitudinal Evaluation of a Scale-Up Model for Teaching Mathematics with Trajectories and Technologies," examined the effects of "Technology-enhanced, Research-based, Instruction, Assessment, and professional Development (TRIAD)," a math intervention for preschoolers that combines a curriculum, a software-based teaching tool, and in-person teacher professional development. "TRIAD" is designed for young children, particularly those at risk of low math achievement. The study also included an assessment of whether continuing the intervention through kindergarten improved math achievement at the end of kindergarten. To measure these effects, two versions of the intervention were delivered: (a) "TRIAD" no follow-through ("TRIAD-NFT"), where children only received "TRIAD" in preschool; and (b) "TRIAD" follow-through ("TRIAD-FT"), where children received "TRIAD" in both preschool and kindergarten. Forty-two schools from Buffalo, NY, and Boston, MA were included in this study. Within each city, schools were grouped by the previous year's fourth grade mathematics state assessment scores and then randomly assigned to either the "TRIAD-NFT" group (14 schools), the "TRIAD-FT" group (12 schools), or a comparison group that implemented neither intervention (16 schools). From each preschool classroom, researchers randomly selected up to 15 children to participate. Researchers assessed the math ability of these children at the start of preschool (prior to intervention), at the end of preschool (after 1 year of study participation), and at the end of kindergarten (after 2 years of study participation). Using these completed assessments, 963 students were included in the final analysis. To measure the intervention's effects, the researchers separately compared outcomes at the end of kindergarten for those in "TRIAD-NFT" and "TRIAD-FT" to those from the comparison group. The researchers further compared the end-of-kindergarten outcomes between "TRIAD-NFT" and "TRIAD-FT" to assess whether there were any differences due to the continuity of the "TRIAD" intervention into kindergarten. At the end of kindergarten, the authors found that both the "TRIAD-NFT" and "TRIAD-FT" interventions had a statistically significant positive effect on student performance on the Research-based Elementary Math Assessment (REMA) when compared to students attending comparison schools, and the WWC confirmed these findings. The authors found no difference in REMA performance when comparing students attending "TRIAD-NFT" schools to those attending "TRIAD-FT" schools. The research described in this report meets WWC group design standards with reservations This study is a randomized controlled trial with unknown levels of study attrition, and thus, this study does not pass the attrition standard. However, the study demonstrates the equivalence of the analytic samples for each comparison at baseline. Appended are: (1) Study details; (2) Outcome measure for the mathematics achievement domain; and (3) Study findings for the mathematics achievement domain. A glossary of terms is also included. [The following study is the focus of this review: Sarama, J., Clements, D. H., Wolfe, C. B., & Spitler, M. E. (2012). "Longitudinal Evaluation of a Scale-Up Model for Teaching Mathematics with Trajectories and Technologies." "Journal of Research on Educational Effectiveness," 5(2), 105-135 (EJ961450).]
. WWC Review of the Report "Longitudinal Evaluation of a Scale-up Model for Teaching Mathematics with Trajectories and Technologies." What Works Clearinghouse Single Study Review.