Article

Evaluating parent comprehension of measurement error information presented in score reports

Authors
  • Priya Kannan (Educational Testing Service)
  • Diego Zapata-Rivera (Educational Testing Service)
  • Andrew D Bryant (IBM, USA)

Abstract

Individual-student score reports sometimes include information about precision of scores (i.e., measurement error). In this study, we specifically investigated if parents understand this information when presented. We conducted an online experimental study where 196 parents of middle school children, from various parts of the country, were randomly assigned to three conditions with different amounts of measurement error information. Parents in all conditions answered a series of comprehension questions about a student’s performance on a hypothetical test. Results indicate that when information about error was presented, parents showed a significantly better understanding of score variability. Moreover, when asked about their preference for such information, parents across all three conditions indicated that they would like such information to be included in their child’s report. Results from this study highlight the importance of clear communication of technical information to stakeholders, particularly parents, who are a diverse stakeholder group.

Keywords: Score reports for parents, Measurement error, K-12 assessments

How to Cite:

Kannan, P., Zapata-Rivera, D. & Bryant, A. D., (2021) “Evaluating parent comprehension of measurement error information presented in score reports”, Practical Assessment, Research, and Evaluation 26(1): 12. doi: https://doi.org/10.7275/rgwg-t355

Downloads:
Download PDF
View PDF

227 Views

87 Downloads

Published on
10 Jun 2021