exactGMH: Exact and Permutation-Based Mantel Tests for Differential Item Functioning in Dichotomous and Polytomous Items

Screens dichotomous and polytomous test items for Differential Item Functioning (DIF) using an extension of the Mantel (1963) <doi:10.1080/01621459.1963.10500879> and generalized Mantel-Haenszel statistic, with statistical significance computed via permutation rather than the conventional asymptotic chi-square approximation. Following Hemerik and Goeman (2018) <doi:10.1007/s11749-017-0571-1>, the permutation p-value is exact at the nominal level rather than an approximation, even for a finite number of permutations. This makes the test valid for small samples (fewer than 200 examinees per group), a condition common in classroom-, program-, and institution-level assessment where existing exact-inference options in other software are restricted to dichotomous items only. An optional Benjamini-Hochberg or Bonferroni correction addresses multiple comparisons when screening many items at once.

Documentation:

Downloads:

Linking:

Please use the canonical form https://CRAN.R-project.org/package=exactGMH to link to this page.