Designing Multiple Choice Questions

Giulia Forsythe
Getting the Most Out of Multiple-choice Questions

CONTENT ON THIS PAGE:

Part I: General Introduction

Part II: Self-Evaluation Quiz

Part III: Video Tutorial

Part IV: Guidelines to writing good questions

PART V: Tips for Timing Your Questions

Part VI: References

Part I: General Introduction

Description: A Multi-choice question is made up of two parts; (1) the question (or stem), and (2) a series of alternative or possible answers, where one of the answers is the correct answer, and the others serve as distractors. If students select the correct answer they get some marks, and if they select another answer they get no marks (or sometimes negative marking).

Why use multiple choice questions for testing?

  • Multiple choice test questions, also known as items, can be an effective and efficient way to assess learning outcomes granted that your test consists of effective items.
  • Can cover a lot of facts in a short space
  • “Easy” to construct
  • Can assess distinguishing fact and opinion
  • Can assess identifying cause and effect

What do I need to be mindful of?

  • Can usually only assess simple recall of facts
  • The “right” answer is often obvious
  • Not necessarily easy to construct “good” items
  • Ambiguity may promote merely “guessing.”

PART II: Self-Evaluation Quiz

Instructions: Check your multiple choice-related testing skills by taking the short self-evaluation quiz below.

Note that the navigation through the quiz pages are shown in the screenshot here:

This screenshot shows you how to navigate through the self-evaluation Quiz
Self-Evaluation Quiz:


Part III: Video Tutorial

In the video below, Dr. Richelle Marynowski takes you through the planning of good multiple choice questions, i.e. how to create good stems, alternatives (distractors) and the right answer.

Note that you can enlarge the video for a better viewing experience by clicking on the rectangular icon on the lower right of the video.


Part IV: Guidelines to writing good questions

Below you’ll find a list of suggestions. You can click on each of them if you need some more context.


PART V: Tips for Timing Your Questions

Planning for a multiple-Choice assessment, you should be aware of the following general recommendations (UCD Teaching and Learning) relating to the set-up of the overall assessment in a course. Also note the importance of communicating to students the relative effort required to successfully complete an assessment, which is the case of Multiple-Choice Test of an hour usually require of students an additional 9 hours of preparation.

  • Heavy assessment workloads may lead to surface learning (e.g. Entwistle and Ramsden, 1983; Kember and Leung, 1998).
  • In general, excessive student assessment workloads lead to excessive staff workloads and tend to lead to poor ratings for teachers (Trigwell and Prosser; 1991).
  • Fewer assessments create space for faster and better feedback.
  • Programme Reviews often highlight student workloads as a problem. For example: “there appears to be a lack of an effective mechanism to plan and monitor student assessment workload.

 


PART VI: More Resources

Feel free to browse the following guides on the preparation of multiple choice questions below:

1. Steven J. Burton et. al. How to Prepare Better Multiple Choice Test Items: Guidelines for University Faculty

2. Brigham Young University. 14 Rules for Writing Multiple Choice Questions

3. University of Waterloo. Designing Multiple Choice Questions

4. Jon Mueller. Authentic Assessment Toolbox

5. Duquesne University. Good, Better, Best Multiple Choice Exam Construction

6. University of Manitoba. Creating Multiple Choice Questions

Academic References:

DiBattista, D., & Kurzawa, L. (2011). Examination of the quality of multiple-choice items on classroom tests. The Canadian Journal for the Scholarship of Teaching and Learning, 2(2), Article 4 (23 pages). Free download at: http://ir.lib.uwo.ca/cjsotl_rcacea/vol2/iss2/4.

DiBattista, D. (2005). The Immediate Feedback Assessment Technique: A learner-centered multiple-choice response form. Canadian Journal of Higher Education, 35, 111-131.

DiBattista, D., Mitterer, J.O., and Gosse, L. (2004). Acceptance by undergraduates of the Immediate Feedback Assessment Technique for multiple-choice testing. Teaching in Higher Education, 9, 17-28.

Haladyna, T. M. (2004). Developing and Validating Multiple-Choice Test Items. 3rd edition. Mahwah, New Jersey: Lawrence Erlbaum Associates.

Haladyna, T. M. (1997). Writing Test Items to Evaluate Higher Order Thinking. Boston: Allyn and Bacon.

UCD Teaching and Learning. (n.d.). Assessment Workload and Equivalences. http://www.ucd.ie/teaching/t4media/assessment_workload_equivalences.pdf

 

License

Icon for the Creative Commons Attribution 4.0 International License

Digital Teaching and Learning at the UofL Copyright © by Joerdis Weilandt is licensed under a Creative Commons Attribution 4.0 International License, except where otherwise noted.

Share This Book