← العودة إلى أخبار البحث
Three diverse university science students compare three diagram drafts beside a text-free laptop feedback view linked by one cyan revision path
ورقة مجلةPeer-reviewed study202627 يوليو 2026· 3 min

Human-centered GenAI feedback design in higher education: a multisite experiment on direct, reflective, and hybrid approaches to scientific argumentation

Huseyin Ates

International Journal of Educational Technology in Higher Education

ملخص 500 كلمة

Three diverse university science students compare three diagram drafts beside a text-free laptop feedback view linked by one cyan revision path

Ates tests a question that is more useful than whether generative AI can produce feedback: which feedback design helps students revise now and perform later without AI? The 2026 open-access study used a multisite, cluster-randomized, longitudinal field experiment in introductory biology, chemistry, and physics courses. It compared peer feedback, direct GenAI feedback, reflective GenAI feedback, and a hybrid sequence of self-evaluation, peer feedback, and GenAI critique.

The analytic sample included 1,176 first-year undergraduates in 48 course sections across four universities. Sections, rather than individual students, were assigned to conditions. The four groups were broadly comparable at baseline on demographics, prior knowledge, argumentation, achievement, feedback literacy, and previous GenAI experience. Attrition did not differ significantly by condition, and implementation audits indicated that 95.8 percent of applicable instructional steps were delivered as planned.

Students completed three cycles of drafting and revision around scientific arguments. Quality was scored on claims, relevance and sufficiency of evidence, coherence of reasoning, and treatment of limitations or alternative explanations. The study also measured conceptual learning, feedback uptake, self-regulated learning during revision, and a delayed transfer task completed individually under supervision without the GenAI tool or internet-enabled devices.

Direct GenAI feedback outperformed peer feedback on immediate argument-quality gain. Yet both reflective and hybrid feedback produced stronger immediate gains than direct AI feedback, and the hybrid condition had the highest adjusted mean. The hybrid-versus-reflective difference was not statistically significant. Revision-depth analyses followed the same pattern, suggesting that improvements were not limited to surface editing.

The differences became more educationally consequential beyond the revised product. Hybrid feedback significantly outperformed direct GenAI feedback on conceptual learning. The reflective contrast was positive but did not remain statistically significant after adjustment. On delayed AI-free transfer, both reflective and hybrid conditions significantly outperformed direct GenAI feedback, with no significant difference between them.

Process evidence helps explain the pattern. Reflective and hybrid designs produced higher feedback uptake and self-regulated learning than direct GenAI feedback. Multilevel mediation models found significant indirect pathways through uptake, self-regulation, and their sequence for argument gain and delayed transfer. The results support the interpretation that students learned more when the design required them to judge and work with feedback rather than simply receive a polished critique.

The study is unusually strong for educational GenAI research because it spans institutions, randomizes clusters, checks implementation, uses manually scored disciplinary work, and includes a delayed AI-free outcome. It also preserves important boundaries: submitted work had to remain the student's own, students received guidance on ethical use and data-entry limits, and monitoring was restricted to the study platform.

Limits remain. Cluster assignment leaves only 48 randomized units, the author conducted all major study functions, and the intervention focused on first-year science argumentation. The paper cannot establish that the same sequence will transfer to other disciplines, age groups, commercial tools, or longer periods. Self-regulated learning was partly measured through self-report, even though revision traces provided complementary evidence.

For Hong Kong higher education, the strongest design implication is sequencing. Ask students to assess their draft against criteria before seeing AI critique, incorporate peer evidence, require a rationale for accepted and rejected suggestions, and test later on a new task without AI. The study suggests that feedback becomes learning when students retain evaluative judgment and ownership, not when the system merely produces more comments.

أوراق ذات صلة

Illustrative photograph of a teacher-education group discussing a short fictional tutoring exchange, with two alternative response cards on a seminar table.
أداة / مجموعة بيانات2026
أداة / مجموعة بيانات 249

Preprint: TutorCaseBench separates recognizing a strategy from responding to a learner

Yeon Su Park, Chanyoung Park, Tae Soo Kim, Seungju Kim, Hyunwoo Kim, Daho Jung, Jinsung Yoon, Juho Kim

arXiv preprint

A benchmark builds simulated tutoring cases from qualitative education studies. Models were more successful at choosing a proposed strategy than at generating a response adapted to the particular situation.

preprintAI tutor evaluationcase-based assessment
اقرأ ملخص 500 كلمة →
Illustrative photograph of campus support staff reviewing a classroom-equipment service ticket and a permissioned action flow on a workstation.
سياسة / أخلاقيات30 أكتوبر 2026
سياسة / أخلاقيات 250

Product news: OpenAI and ServiceNow connect workflow context with permissioned actions

OpenAI, ServiceNow

AI Product and Learning Report

An October 28 partnership update describes ServiceNow workflows in ChatGPT and planned Codex, security and voice capabilities. Universities can use the announcement to examine how an assistant moves from finding information to changing a record.

product newsChatGPTServiceNow
اقرأ ملخص 500 كلمة →
Illustrative photograph of a teacher and two learners exploring a layered cutaway of the Earth on a classroom display, with a matching student sketch.
سياسة / أخلاقيات29 أكتوبر 2026
سياسة / أخلاقيات 248

Product news: Gemini immersive explorations turn visual topics into layered learning journeys

Google

AI Product and Learning Report

Google’s October 28 release introduces interactive topic explorations through the Gemini app and student hub. Teachers can connect the visual layers to predictions and explanations while checking language availability and learning evidence.

product newsGemini for Educationimmersive explorations
اقرأ ملخص 500 كلمة →