Article

Applying Tests of Equivalence for Multiple Group Comparisons: Demonstration of the Confidence Interval Approach

---

Abstract

Assessing the comparability of different groups is an issue facing many researchers and evaluators in a variety of settings. Commonly, null hypothesis significance testing (NHST) is incorrectly used to demonstrate comparability when a non-significant result is found. This is problematic because a failure to find a difference between groups is not equivalent to showing that the groups are comparable. This paper provides a comparison of the confidence interval approach to equivalency testing and the more traditional analysis of variance (ANOVA) method using both continuous and rating scale data from three geographically separate medical education teaching sites. Equivalency testing is recommended as a better alternative to demonstrating comparability through its examination of whether mean differences between two groups are small enough that these differences can be considered practically unimportant and thus, the groups can be treated as equivalent. Accessed 12,813 times on https://pareonline.net from April 25, 2011 to December 31, 2019. For downloads from January 1, 2020 forward, please click on the PlumX Metrics link to the right.

Keywords: Educational Research, Research Methodology, Statistical AnalysisEducational Research, Statistical Analysis

How to Cite:

Rusticus, S. A. & Lovato, C. Y., (2011) “Applying Tests of Equivalence for Multiple Group Comparisons: Demonstration of the Confidence Interval Approach”, Practical Assessment, Research, and Evaluation 16(1): 7. doi: https://doi.org/10.7275/d5wf-5p77