Abstract
Academic integrity is a ‘wicked’ academic problem (Chugh et al., 2021) which has been further complicated by the widespread access to text-generative artificial intelligence tools (McKnight, 2021). The sophistication of the new tools diminishes the value of detection software (McKnight, 2021) in evaluating the originality of students’ written submissions; and its widespread availability demands a radical reorientation in assessment design and scaffolding. As advocated by (Rundle et al., 2020), this complex educational context requires a ‘Swiss cheese’ approach that involves multiple methods of prevention, especially in relation to assessment design and implementation.
This presentation demonstrates a constructive and workable assessment design approach, called Interactive Oral Assessment (IOA), that preserves academic integrity through sound learning principles rather than through detection and punitive measures. The IOA is a synchronous, unscripted conversation between the lecturer and student in an authentic scenario (Sotiriadou et al., 2020).
Since 2021, IOAs were implemented at a regional university in Australia, to enhance students’ engagement and outcomes, academic integrity, and employability skills. A 3-year mixed-method research project was established alongside to capture the experience of implementing IOAs. Data was collected across 25 subjects, through surveys of 172 students, interviews with 14 academic staff, and autoethnographic reflections from staff. Data was analysed quantitatively and thematically to distil the learning from implementing this innovative assessment approach.
Our findings align with Logan et al.’s (2017) conclusion in that IOA is a powerful assessment method to synchronously assess learners in an authentic, scaffolded and less stressful environment than written examinations, and capable of significantly minimising academic integrity breaches. Students also reported tangible benefits in the development of their problem-solving, analytical and communication skills through participation in IOA. While the education landscape constantly evolves with the changing technologies, IOAs offer a concrete means for educators to tackle academic integrity (AI) challenges posed by artificial intelligence (AI) tools.
This presentation demonstrates a constructive and workable assessment design approach, called Interactive Oral Assessment (IOA), that preserves academic integrity through sound learning principles rather than through detection and punitive measures. The IOA is a synchronous, unscripted conversation between the lecturer and student in an authentic scenario (Sotiriadou et al., 2020).
Since 2021, IOAs were implemented at a regional university in Australia, to enhance students’ engagement and outcomes, academic integrity, and employability skills. A 3-year mixed-method research project was established alongside to capture the experience of implementing IOAs. Data was collected across 25 subjects, through surveys of 172 students, interviews with 14 academic staff, and autoethnographic reflections from staff. Data was analysed quantitatively and thematically to distil the learning from implementing this innovative assessment approach.
Our findings align with Logan et al.’s (2017) conclusion in that IOA is a powerful assessment method to synchronously assess learners in an authentic, scaffolded and less stressful environment than written examinations, and capable of significantly minimising academic integrity breaches. Students also reported tangible benefits in the development of their problem-solving, analytical and communication skills through participation in IOA. While the education landscape constantly evolves with the changing technologies, IOAs offer a concrete means for educators to tackle academic integrity (AI) challenges posed by artificial intelligence (AI) tools.
| Original language | English |
|---|---|
| Publication status | Published - 08 Nov 2023 |
| Event | ISSOTL Conference 2023 - Railway Museum, Utrecht, Netherlands Duration: 08 Nov 2023 → 11 Nov 2023 https://issotl.com/issotl23/ https://www.uu.nl/sites/default/files/ISSOTL_programme%20book_V03%20%281%29.pdf (Program book) |
Conference
| Conference | ISSOTL Conference 2023 |
|---|---|
| Abbreviated title | Context Matters |
| Country/Territory | Netherlands |
| City | Utrecht |
| Period | 08/11/23 → 11/11/23 |
| Other | ISSOTL and Utrecht University proudly welcome the SoTL community to Utrecht, the Netherlands for ISSOTL23. Join the community at the Railway Museum from November 8-11, 2023. With your active contribution, we hope to establish an inspiring programme around the conference theme Context Matters. The conference will be in-person and will feature pre-conference workshops, thought-provoking plenary speakers, ample room to present and discuss scholarly work, inspirational workshops, energizing city walks and fun fringe sessions. |
| Internet address |