Article

Matrix Sampling of Items in Large-Scale Assessments

---

Abstract

Matrix sampling of items – that is, division of a set of items into different versions of a test form – is used by several large-scale testing programs. Like other test designs, matrixed designs have both advantages and disadvantages. For example, testing time per student is less than if each student received all the items, but the comparability of student scores may decrease. Also, curriculum coverage is maintained, but reporting of scores becomes more complex. In this paper, matrixed designs are compared with more traditional designs in nine categories of costs: development costs, materials costs, administration costs, educational costs, scoring costs, reliability costs, comparability costs, validity costs, and reporting costs. In choosing among test designs, a testing program should examine the costs in light of its mandate(s), the content of the tests, and the financial resources available, among other considerations. Accessed 33,800 times on https://pareonline.net from July 15, 2003 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right.

Keywords: Sampling, Test Items, Item Sampling, Matrix Sampling, Research Design

How to Cite:

Childs, R. A. & Jaciw, A. P., (2002) “Matrix Sampling of Items in Large-Scale Assessments”, Practical Assessment, Research, and Evaluation 8(1): 16. doi: https://doi.org/10.7275/gwvh-4z51