← Back to Research News
Four diverse university students practise prompting and source checking with an instructor at a library learning table
Journal PaperPeer-reviewed study20268 Aug 2026· 2 min

A 90-minute GenAI literacy course improved knowledge, prompting, source checking and self-efficacy across 65 university sections

Allison E. Connell Pensky, Lydia E. Eckstein, Michael C. Melville, Laura O. Pottmeyer, Zach Mineroff, Avi Chawla, Judy Brooks, Chad Hershock, Marsha C. Lovett

Computers & Education

500-word summary

Four diverse university students practise prompting and source checking with an instructor at a library learning table

Listen to the paper summary

Audio summary

0:00/0:00

Connell Pensky and colleagues test a practical question for universities: can a short, reusable online course improve students' capacity to work with generative AI across disciplines? Their 2026 article in Computers & Education evaluates four asynchronous modules designed at Carnegie Mellon University. The approximately 90-minute sequence combined explanations, examples, practice and immediate feedback. It addressed how generative-AI systems work, why appropriate use depends on the person and task, ethical concerns, strategies for responsible educational use and students' confidence in applying those strategies.

The study involved 1,368 undergraduate and graduate students in 65 sections of 53 courses taught by 46 instructors. Course sections, rather than individual students, were assigned to complete the modules between a pre-test and post-test or to a wait-list control condition. That design reduced the chance that students in one section would receive different versions of the intervention, while the analysis accounted for students being nested within courses. Measures included knowledge questions, self-efficacy ratings and authentic tasks for prompt engineering and output evaluation. A randomly selected subset of 174 students had authentic-task responses scored independently without raters knowing the condition or testing time.

Students who completed the modules improved more than control students in knowledge of how large language models work, prompt-engineering skill and self-efficacy. The published abstract also reports gains in fact- and source-checking. Effects were not uniform across every outcome: the modules did not improve the skill of critically evaluating potential bias in generated output, and the university's study report found no added improvement in responsible-use knowledge or overall output analysis. This contrast is important. A concise module can build a useful foundation, but knowing model basics and writing a better prompt are not the same as judging fairness, omissions, evidence or downstream harm.

The authors report that improvements were equitable across the examined categories of birth sex, race and ethnicity, student level, first-generation status and academic discipline. That finding means the analysis did not detect differential benefits across those groups in this setting; it does not prove that one module will remove every access or participation gap. The study was conducted at one university with volunteer instructors, and the post-test followed soon after the intervention. It therefore does not establish long-term retention, transfer into real coursework, changes in academic performance or responsible behavior when tools and incentives differ. Generative-AI products also change quickly, so examples and assessments require maintenance.

For Hong Kong universities, the intervention offers a feasible starting architecture: a shared foundational module, embedded practice, immediate feedback and authentic tasks that require students to create prompts and inspect outputs. Institutions should add discipline-specific cases, multilingual examples and repeated source, bias and uncertainty checks across a semester. Evaluation should include delayed assessments, course artifacts and observed application, not completion rates alone. The result is encouraging precisely because it is bounded: short training can improve several competencies at scale, while critical judgment needs sustained, contextual practice.

Related papers

An East Asian female university student and a South Asian male language tutor compare bilingual economics notes and two AI explanations in a sunlit campus language centre
Tool / Dataset2026
Tool / Dataset 226

Preprint: Students’ access to generative AI did not ensure equally usable support across languages

Ming Li, Qin Xie, Ariunaa Enkhtur, Lilan Chen, Fei Cheng

arXiv preprint (work in progress)

Interviews with 42 undergraduates at universities in China, Japan, and Mongolia explored how students selected AI tools, chose interaction languages, and checked outputs. Participants described different routes from technical access to useful academic support, including switching languages when responses seemed inadequate. This work-in-progress preprint presents situated accounts rather than national comparisons or measured learning gains. It raises practical questions about evaluating an AI service in the languages students actually use.

preprintmultilingual educationAI access
Read 500-word summary →
A South Asian female lecturer and a White male university student examine two differently annotated statistics feedback sheets beside a hand-drawn confidence-interval diagram
Journal Paper2026
Journal Paper 216

Students’ feedback ratings reflected source credibility without consistently matching expert judgments

Tanya Nazaretsky, Hagit Gabbay, Tanja Käser

Computers and Education: Artificial Intelligence

Researchers compared human and AI feedback on 979 responses from six university STEM courses, then examined ratings from 472 students. Expert analysis found broadly similar pedagogical quality, while students’ judgments were associated with their views of the source’s credibility. The study did not measure feedback uptake or learning gains. For educators, it raises a practical question: how can students justify an evaluation of advice before deciding whether to use it?

feedback literacysource credibilityhigher education
Read 500-word summary →
A university student compares an AI explanation with handwritten concept notes while an instructor and peers work in a seminar room
Journal Paper2026
Journal Paper 50

Experimental evidence on the learning impact of generative AI: gains persisted when students used it for explanation rather than automation

Zara Contractor, Germán Reyes

arXiv working paper

A randomized, proctored experiment reported that undergraduate access to off-the-shelf generative AI raised immediate factual and conceptual test performance by 0.27 standard deviations and that the gains persisted one week later. The working paper also finds a consequential usage pattern: students who used AI to explain concepts showed stronger delayed gains than students who used it to automate drafting.

generative AIrandomized experimenthigher education
Read 500-word summary →