Variability in assessor responses to undergraduate essays

An issue for assessment quality in higher education

,

• Publisher: Peter Lang AG, Internationaler Verlag der Wissenschaften
• Year: 2014
• Edition: 1
• eBook ISBN:
  9783035105056
• Topic: Education
• Subtopic: Education General

Academic standards in higher education depend on the judgements of individual academics assessing student work; it is in these micro-level practices that the validity and fairness of assessment is constituted. However, the quality of assessments of open-ended tasks like the coursework essay is difficult to ascertain because of the complex and subjective nature of the judgements involved. In view of current concerns about assessment quality and standards, this book is a timely reflection on the practices of academic judgement at university. It explores assessment quality through an empirical study of essay marking in an undergraduate discipline where large class sizes and significant numbers of second language students are common. The study shows that assessors vary in their interpretations of criteria and standards and that this results in inconsistent grading of essays. The book contributes to a growing scholarship of assessment with an evidence-based explanation of why assessors disagree and a discussion of the implications of this for the validity of assessment practices at university.

Table of contents

• Cover
• Contents
• Preface 9
• 1. Introduction 11
• 2. A review of the literature on writing assessment 23
• 3. Method 87
• 4. Results 151
• 5. Discussion 209
• 6. Conclusion 241
• Bibliography 255
• Appendix A: Verbal report characteristics 283
• Appendix B: Instructions to assessors 289
• Appendix C: Coding sub-categories 291
• Appendix D: Comment distributions by essay 299
• Appendix E: Comment distributions by assessor 305
• Appendix F: Post hoc analysis for chi-square tests of independence 315
• Appendix G: All essay marks 321