Browse by author
Lookup NU author(s): Dr Christopher PearsonORCiD, Dr Nigel Penna
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License (CC BY-NC-ND).
E-assessments are becoming increasingly common and progressively more complex. Consequently, how these longer, more complex questions are designed and marked is imperative. This article uses the NUMBAS e-assessment tool to investigate the best practice for creating longer questions and their mark schemes on surveying modules taken by engineering students at Newcastle University. Automated marking enables calculation of follow through marks when incorrect answers are used in subsequent parts. However, awarding follow through marks with no further penalty for solutions being fundamentally incorrect leads to non-normally distributed marks. Consequently, it was found that follow through marks should be awarded at 25% or 50% of the total available to produce a normal distribution. Appropriate question design is vital to enable automated method marking in longer style e-assessment with questions being split into multiple steps. Longer calculation questions split into too few parts led to all or nothing style questions and subsequently bi-modal mark distributions, whilst questions separated into too many parts provided too much guidance to students so did not adequately assess the learning outcomes, leading to unnaturally high marks. To balance these factors, we found that longer questions should be split into approximately 3–4 parts, although this is application dependent.
Author(s): Pearson C, Penna N
Publication type: Article
Publication status: Published
Journal: Assessment and Evaluation in Higher Education
Year: 2023
Volume: 48
Issue: 7
Pages: 915-925
Online publication date: 12/11/2022
Acceptance date: 02/11/2022
Date deposited: 12/11/2022
ISSN (print): 0260-2938
ISSN (electronic): 1469-297X
Publisher: Taylor and Francis
URL: https://doi.org/10.1080/02602938.2022.2144801
DOI: 10.1080/02602938.2022.2144801
Altmetrics provided by Altmetric
