Rasch Analysis 1: A tool to evaluate efficacy and quality of exams

Research output: Other contribution to conferenceAbstract

Abstract

How do you know you've written a good exam (multiple choice)? Does it measure the student learning youdesire? Is it redundant? Does it balance difficulty of questions?Historically, academics have used various approaches to answer some or all of these questions, ranging fromprofessional experience, assessing the distribution of grades or more sophisticated approaches such asexploratory factor analysis. Although these approaches can provide information on the performance ofstudents, they seldom provide information on the performance of the exam.Rasch analysis (Rasch, 1960) is a statistical approach that allows examination of dichotomous (yes/no) andMCQ tests. It transforms the raw performance of students (termed 'persons') and exam questions (termed'items') into a common scale of measurement called 'logit'. It therefore allows the academic to compare theperformance of students versus that of the questions using a single understanding of 'performance'.The Rasch approach differs strongly from other approaches. As opposed to other statistical approaches Raschanalysis is suitable to measure a single 'construct' or constructs that are likely to be correlated. Whenmeasuring constructs that are not correlated, Factor Analysis is a more appropriate statistical approach(Tennant and Pallant, 2006). Furthermore, traditional statistical approached tend to fit a statistical model tothe data at hand. By contrast, Rasch fit the data to an expected probabilistic model. Unlike its counterparts,once validated, this approach is no longer sensitive to small student numbers, and is also insensitive to achange in student affordances (Bond and Fox, 2007).
Original languageEnglish
Pages31-32
Number of pages2
Publication statusPublished - 2015
EventCSU Ed 2015 - Charles Sturt University, Wagga Wagga, Australia
Duration: 19 Nov 201520 Nov 2015

Conference

ConferenceCSU Ed 2015
Abbreviated titleExploring the Borders: Learning and Teaching at CSU
CountryAustralia
CityWagga Wagga
Period19/11/1520/11/15

Fingerprint Dive into the research topics of 'Rasch Analysis 1: A tool to evaluate efficacy and quality of exams'. Together they form a unique fingerprint.

  • Cite this

    Guisard, Y., & Bedgood, D. (2015). Rasch Analysis 1: A tool to evaluate efficacy and quality of exams. 31-32. Abstract from CSU Ed 2015, Wagga Wagga, Australia.