← शोध समाचार पर लौटें
Turkish high-school students solve mathematics problems in three classroom conditions while teachers compare assisted practice with a later unaided test
जर्नल पेपरPeer-reviewed study202531 जुल॰ 2026· 3 min

Unguarded GPT raised assisted practice scores but reduced unaided mathematics performance in a high-school RCT

Hamsa Bastani, Osbert Bastani, Alp Sungu, Haosen Ge, Özge Kabakcı, Rei Mariman

Proceedings of the National Academy of Sciences

500-शब्द सार

Turkish high-school students solve mathematics problems in three classroom conditions while teachers compare assisted practice with a later unaided test

Bastani and colleagues test whether the design of a generative-AI tutor changes what students learn, not only what they complete while assisted. Their preregistered cluster randomized controlled trial took place in one large Turkish high school during the 2023–24 school year. About 50 Grade 9, 10 and 11 classes, comprising nearly 1,000 students, completed four 90-minute mathematics sessions. Classes were assigned to ordinary textbooks and notes, a ChatGPT-like GPT-4 interface called GPT Base, or a guarded GPT Tutor.

Each session separated assisted practice from independent performance. Students first solved practice problems with their assigned resources, then completed a related exam without any resource. GPT Base used a general tutor prompt and could provide answers. GPT Tutor was instructed to give hints rather than direct solutions and received teacher-authored correct solutions, common errors and feedback guidance for each problem. That problem-specific information made the tutor more reliable but required substantial teacher preparation.

Both AI conditions improved visible practice performance. Relative to control, GPT Base raised practice scores by 48% and GPT Tutor by 127%. The unaided exam reversed the picture for the unguarded system: GPT Base students scored 17% below control. GPT Tutor students were statistically indistinguishable from control, meaning the guardrails largely removed the penalty but did not produce a significant positive exam gain.

System accuracy and student behaviour help explain the difference. When repeatedly asked for answers to the study's 57 practice problems, GPT Base was correct only 51% of the time, with 42% logical errors and 8% arithmetic errors. Yet the researchers find that errors alone do not explain the exam penalty. Chat logs show that GPT Base students often requested and copied solutions, while GPT Tutor students increasingly attempted answers and asked for help. Students also did not appear to recognise how superficial use could affect later performance.

The study should not be generalized into a claim that all generative AI harms learning. It covers one school, one subject, four sessions and a GPT-4-era configuration. The material represented about 15% of the semester curriculum. The guarded tutor was unusually well supplied with teacher-created problem knowledge and remained reactive rather than diagnosing misconceptions like an expert human tutor. Longer-term retention and transfer were not established.

For classroom design, the decisive outcome is what students can do after assistance is removed. A school can restrict direct answers, require a learner attempt before a hint, ground feedback in verified solutions and include a short unaided transfer problem. Logs can be used for aggregate design improvement rather than punitive surveillance.

For Hong Kong mathematics education, replication should test local curricula, bilingual interaction and varied achievement levels. The result gives a precise warning and a design direction: a fluent tool can raise immediate scores while weakening engagement, and pedagogical guardrails can mitigate harm only when teachers define the knowledge, hints and independent evidence that matter.

Future tutors should be compared on verified accuracy, the quality of elicited reasoning and delayed transfer, not only on practice scores. Teacher workload for building and maintaining guardrails must also be counted when assessing whether the design can scale.

संबंधित पेपर

Two educators and a learner compare circuit experiment sketches and written observations in a science classroom.
जर्नल पेपर2026
जर्नल पेपर 198

Evidence of impact and interpretational limits of generative AI in STEM education: A systematic review and meta-analysis on cognitive learning outcomes

Chiara Boolzen, Jochen Kuhn, Salome Flegr, Eva-Maria Rott, Niklas Stausberg, Stefan Küchemann

Artificial Intelligence Review

A STEM-focused review shows why a positive average effect can be a fragile guide to classroom decisions. Across 49 studies, the conventional pooled estimate favored generative AI, but a publication-bias adjustment moved the average close to zero with substantial uncertainty. Effects still varied widely across contexts. The result calls for better comparisons and clearer descriptions of what students actually do, rather than treating every AI-supported activity as the same intervention.

STEM EducationResearch MethodsGenerative AI
500-शब्द सार पढ़ें →
A teacher trainee writes a diagnostic justification while a tutor points to the evidence in a pupil case sheet beside a tablet displaying feedback
जर्नल पेपर2025
जर्नल पेपर 184

Adaptive AI feedback improved teachers-in-training’s written justifications, without improving decision accuracy

Annette Kinder, Fiona J. Briese, Marius Jacobs, Niclas Dern, Niels Glodny, Simon Jacobs, Samuel Leßmann

Computers and Education: Artificial Intelligence

In a randomized study of 269 German teachers-in-training, adaptive GPT-4 feedback produced a small improvement in the justification of a subsequent diagnostic decision compared with a standard expert response. It also led to longer answers and more favorable feedback ratings, but decision accuracy did not improve. The result supports examining different components of professional reasoning separately and does not establish that AI outperforms personalized feedback from a human teacher.

adaptive feedbackteacher educationdiagnostic reasoning
500-शब्द सार पढ़ें →
Three teachers revise an environmental science lesson using a water-cycle diagram, a river catchment map and annotated planning sheets in a sunlit classroom
जर्नल पेपर2026
जर्नल पेपर 170

Teachers used AI to develop science lessons, while keeping responsibility for evidence and local relevance

Won Jung Kim

Research in Science Education

A qualitative study of 23 teachers followed AI-assisted science lesson design through surveys, lesson documents, chat logs and instructor notes. Teachers used AI to develop concepts, refine activities and connect environmental learning with student action. They also had to verify claims and repeatedly adapt generic suggestions. The study documents a supervised design process; it does not establish that AI saved preparation time or improved pupils' learning.

teacher educationlesson planningenvironmental science agency
500-शब्द सार पढ़ें →