Abstract

The three algorithms most frequently selected by behavior-analytic researchers to compute interobserver agreement with continuous recording were used to assess the accuracy of data recorded from video samples on handheld computers by 12 observers. Rate and duration of responding were recorded for three samples each. Data files were compared with criterion records to determine observer accuracy. Block-by-block and exact agreement algorithms were susceptible to inflated agreement and accuracy estimates at lower rates and durations. The exact agreement method appeared to be overly stringent for recording responding at higher rates (23.5 responses per minute) and for higher relative duration (72% of session). Time-window analysis appeared to inflate accuracy assessment at relatively high but not at low response rate and duration (4.8 responses per minute and 8% of session, respectively). (Contains 3 figures.)

Citation

Mudford, O.C., Martin, N.T., Hui, J.K.Y. & Taylor, S.A. (2009). Assessing Observer Accuracy in Continuous Recording of Rate and Duration: Three Algorithms Compared. Journal of Applied Behavior Analysis, 42(3), 527-539. Retrieved August 13, 2024 from https://www.learntechlib.org/p/72798/.

This record was imported from ERIC on July 1, 2013. [Original Record]

ERIC is sponsored by the Institute of Education Sciences (IES) of the U.S. Department of Education.

Copyright for this record is held by the content creator. For more details see ERIC's copyright policy.

Keywords

• adults
• Behavior Patterns
• computers
• Data Analysis
• Interrater Reliability
• Observation
• Time Factors (Learning)
• undergraduate students
• Video Technology