Exams with More Learning and Less Stress with a Computer-based Testing Facility

Speaker
Prof. Craig Zilles, University of Illinois at Urbana-Champaign
Host
Prof. Wouter Montfrooij
-
Physics 120

Abstract: Exams are an important tool for summative assessment, whose utility has only grown with the advent of large language models (LLMs) like ChatGPT, because they can be implemented in a trustworthy manner.  But exams are generally not well liked by either students or faculty.  Students find them stressful.  For faculty (and their course staff), they represent a large administrative burden to write, proctor, and grade.  This large burden means they are done infrequently in many classes, but this infrequent testing encourages cramming and leads to high test anxiety.

In this talk, I'll share (1) research on the benefits of frequent testing and "second-chance testing" (optional exam re-takes) on increased student learning and decreased test anxiety, (2) research on patterns of cheating on unproctored online assessments, and (3) how we've reduced the instructor workload at Illinois to implement frequent testing through our Computer-based Testing Facility (CBTF).  The CBTF is a collection of proctored computer labs that, in conjunction with the PrairieLearn open-source question-asking platform, enable our faculty to run sophisticated exams with almost no recurring effort even in the largest classrooms.  For example, our CS 1 course for majors (run by a single faculty member) ran weekly exams for 1,150 students.  Key enabling ideas for the CBTF include: (1) sophisticated auto-grading questions, (2) question generators, (3) asynchronous exams, and (4) dedicated testing space and proctors.  The CBTF has been running for over 10 years and proctored over 100,000 exams last semester.