An experimental analysis of assessor specific bias in a programming assessment in multi-assessor scenarios utilizing an eye tracker

Tanmoy Debnath, Manoranjan Paul, Subrata Chakraborty, Pallab Podder, Raj Gururajan, Abdul Hafeez-Baig

Research output: Book chapter/Published conference paperConference paper

5 Downloads (Pure)

Abstract

It has been experienced and reported by academic institutions around the globe that marking of most subject's assessment scripts vary when different assessors are utilized for a given subject. To understand the difference, we capture and analysis cognitive response of assessors through the visual pattern while they are marking the scripts. For this, a Java programming assessment from a real life university examination is marked by independent assessors. The assessors marked the scanned assessment scripts on a computer screen in front of an Eye tracker machine and their eye gaze data were recorded real time. Data indicate that different assessors marked the same answer script differently and their visual pattern are also varied although they were given the exact same instructions which demonstrates bias to a degree. For quality marking, several findings including the number of assessors needed are also presented in this manuscript.
Original languageEnglish
Title of host publicationEducation
Place of PublicationUnited Kingdom
PublisherLondon International Conference on Education
Pages1-6
Number of pages6
ISBN (Print)978190832076
Publication statusPublished - 2016
EventLondon International Conference on Education - United Kingdom, United Kingdom
Duration: 14 Nov 201617 Nov 2016

Conference

ConferenceLondon International Conference on Education
CountryUnited Kingdom
Period14/11/1617/11/16

Fingerprint Dive into the research topics of 'An experimental analysis of assessor specific bias in a programming assessment in multi-assessor scenarios utilizing an eye tracker'. Together they form a unique fingerprint.

  • Cite this

    Debnath, T., Paul, M., Chakraborty, S., Podder, P., Gururajan, R., & Hafeez-Baig, A. (2016). An experimental analysis of assessor specific bias in a programming assessment in multi-assessor scenarios utilizing an eye tracker. In Education (pp. 1-6). London International Conference on Education.