Effects of rubric quality on marker variation in higher education

Subrata Chakraborty; Christopher  Dann; Anuradha Mandal; Beverley Dann; Manoranjan Paul; Abdul Hafeez-Baig

doi:10.1016/j.stueduc.2021.100997

Effects of rubric quality on marker variation in higher education

Subrata Chakraborty, Christopher Dann, Anuradha Mandal, Beverley Dann, Manoranjan Paul, Abdul Hafeez-Baig

Research output: Contribution to journal › Article › peer-review

4 Citations (Scopus)

Abstract

Variation among markers has the potential to disadvantage students by contributing to a discrepancy in assessments in higher education settings. In this study, we extended a previous study that analyzed first-year students’ results in a Business Faculty within an Australian university to understand the extent of variation within and between multiple markers and across multiple courses. The study investigated the potential influence of quality of rubrics and associated documentation provided as marker guidance. Results indicated that specific features of rubrics, such as the inclusion of clear indicators of quality, had an observable effect on marker variation.

Original language	English
Article number	100997
Pages (from-to)	1-12
Number of pages	12
Journal	Studies in Educational Evaluation
Volume	70
Early online date	03 Mar 2021
DOIs	https://doi.org/10.1016/j.stueduc.2021.100997
Publication status	Published - Sept 2021

Access to Document

10.1016/j.stueduc.2021.100997

Cite this

@article{c5b946a25e8d4d1db27cea373fff59f7,

title = "Effects of rubric quality on marker variation in higher education",

abstract = "Variation among markers has the potential to disadvantage students by contributing to a discrepancy in assessments in higher education settings. In this study, we extended a previous study that analyzed first-year students{\textquoteright} results in a Business Faculty within an Australian university to understand the extent of variation within and between multiple markers and across multiple courses. The study investigated the potential influence of quality of rubrics and associated documentation provided as marker guidance. Results indicated that specific features of rubrics, such as the inclusion of clear indicators of quality, had an observable effect on marker variation.",

keywords = "Higher education, Assessment bias, Marker bias reduction, Assessment validity, Rubric analysis",

author = "Subrata Chakraborty and Christopher Dann and Anuradha Mandal and Beverley Dann and Manoranjan Paul and Abdul Hafeez-Baig",

year = "2021",

month = sep,

doi = "10.1016/j.stueduc.2021.100997",

language = "English",

volume = "70",

pages = "1--12",

journal = "Studies in Educational Evaluation",

issn = "0191-491X",

publisher = "Elsevier",

}

TY - JOUR

T1 - Effects of rubric quality on marker variation in higher education

AU - Chakraborty, Subrata

AU - Dann, Christopher

AU - Mandal, Anuradha

AU - Dann, Beverley

AU - Paul, Manoranjan

AU - Hafeez-Baig, Abdul

PY - 2021/9

Y1 - 2021/9

N2 - Variation among markers has the potential to disadvantage students by contributing to a discrepancy in assessments in higher education settings. In this study, we extended a previous study that analyzed first-year students’ results in a Business Faculty within an Australian university to understand the extent of variation within and between multiple markers and across multiple courses. The study investigated the potential influence of quality of rubrics and associated documentation provided as marker guidance. Results indicated that specific features of rubrics, such as the inclusion of clear indicators of quality, had an observable effect on marker variation.

AB - Variation among markers has the potential to disadvantage students by contributing to a discrepancy in assessments in higher education settings. In this study, we extended a previous study that analyzed first-year students’ results in a Business Faculty within an Australian university to understand the extent of variation within and between multiple markers and across multiple courses. The study investigated the potential influence of quality of rubrics and associated documentation provided as marker guidance. Results indicated that specific features of rubrics, such as the inclusion of clear indicators of quality, had an observable effect on marker variation.

KW - Higher education

KW - Assessment bias

KW - Marker bias reduction

KW - Assessment validity

KW - Rubric analysis

U2 - 10.1016/j.stueduc.2021.100997

DO - 10.1016/j.stueduc.2021.100997

M3 - Article

SN - 0191-491X

VL - 70

SP - 1

EP - 12

JO - Studies in Educational Evaluation

JF - Studies in Educational Evaluation

M1 - 100997

ER -

Effects of rubric quality on marker variation in higher education

Abstract

Access to Document

Fingerprint

Cite this