You are here:

A Monte Carlo Comparison of Measures of Relative and Absolute Monitoring Accuracy
ARTICLE

, ,

Educational and Psychological Measurement Volume 66, Number 2, ISSN 0013-1644

Abstract

Researchers studying monitoring accuracy currently use two different indexes to estimate accuracy: relative accuracy and absolute accuracy. The authors compared the distributional properties of two measures of monitoring accuracy using Monte Carlo procedures that fit within these categories. They manipulated the accuracy of judgments (i.e., chance level or 60% and above) and the number of items per test (i.e., 20, 50, or 1,000) using 10,000 computer-generated cases. Gamma, an estimate of relative accuracy, yielded a skewed, leptokurtic distribution under the 50-item, 60% accuracy conditions. The Hamann coefficient, an estimate of absolute accuracy, yielded a normal distribution under the same conditions. Both statistics yielded normal distributions under the 1,000-item, 60% conditions, although parameter estimates differed widely. The two statistics were similar, and normally distributed, under the 50- and 1,000-item, chance conditions. Recommendations are made regarding the use of each measure in applied monitoring accuracy research. (Contains 1 figure and 1 table.)

Citation

Nietfeld, J.L., Enders, C.K. & Schraw, G. (2006). A Monte Carlo Comparison of Measures of Relative and Absolute Monitoring Accuracy. Educational and Psychological Measurement, 66(2), 258-271. Retrieved February 22, 2020 from .

This record was imported from ERIC on April 18, 2013. [Original Record]

ERIC is sponsored by the Institute of Education Sciences (IES) of the U.S. Department of Education.

Copyright for this record is held by the content creator. For more details see ERIC's copyright policy.

Keywords