Journal ArticleDOI
Interobserver Agreement in Behavioral Research: Importance and Calculation
Marley W. Watkins,Miriam Pacheco +1 more
TLDR
In this article, Cohen's kappa has been proposed as the more psychometrically sound statistic for assessing interobserver agreement, despite repeated admonitions and empirical evidence indicating that it is not the most statistically sound statistic to determine inter-server agreement due to its inability to take chance into account.Abstract:
Behavioral researchers have developed a sophisticated methodology to evaluate behavioral change which is dependent upon accurate measurement of behavior. Direct observation of behavior has traditionally been the mainstay of behavioral measurement. Consequently, researchers must attend to the psychometric properties, such as interobserver agreement, of observational measures to ensure reliable and valid measurement. Of the many indices of interobserver agreement, percentage of agreement is the most popular. Its use persists despite repeated admonitions and empirical evidence indicating that it is not the most psychometrically sound statistic to determine interobserver agreement due to its inability to take chance into account. Cohen's (1960) kappa has long been proposed as the more psychometrically sound statistic for assessing interobserver agreement. Kappa is described and computational methods are presented.read more
Citations
More filters
Journal ArticleDOI
Prefrontal acetylcholine release controls cue detection on multiple timescales.
TL;DR: Cholinergic neurons originating from the basal forebrain innervate the entire cortical mantle and are regulated on multiple timescales to mediate the detection of behaviorally significant cues and to support cognitive performance.
MonographDOI
Wild Mammals in Captivity: Principles and Techniques for Zoo Management, Second Edition
TL;DR: The Wild Mammals in Captivity (WMC) as mentioned in this paper is a popular reference book for animal care and management in zoos and aquariums, and has been used for decades.
Journal ArticleDOI
BAUM-1: A Spontaneous Audio-Visual Face Database of Affective and Mental States
TL;DR: Baseline experimental results on the BAUM-1 database show that recognition of affective and mental states under naturalistic conditions is quite challenging, and the database is expected to enable further research on audio-visual affect and mental state recognition under close-to-real scenarios.
Journal ArticleDOI
The κ statistic in rehabilitation research: An examination
TL;DR: The K statistic is useful for assessing agreement among raters, and it is being used more frequently in rehabilitation research, including use of weighted K, methods of reporting K, the effect of bias and prevalence on K, and sample size and power requirements for K.
Journal ArticleDOI
A Review of Tier 2 Interventions Conducted within Multitiered Models of Behavioral Prevention.
TL;DR: To support students' academic, behavioral, and social needs, many schools have adopted multitiered models of prevention as discussed by the authors, which are costly in terms of time and resources, and therefore Tier 3 interventions are costly.
References
More filters
Journal ArticleDOI
The measurement of observer agreement for categorical data
J. R. Landis,Gary G. Koch +1 more
TL;DR: A general statistical methodology for the analysis of multivariate categorical data arising from observer reliability studies is presented and tests for interobserver bias are presented in terms of first-order marginal homogeneity and measures of interob server agreement are developed as generalized kappa-type statistics.
Journal ArticleDOI
A Coefficient of agreement for nominal Scales
TL;DR: In this article, the authors present a procedure for having two or more judges independently categorize a sample of units and determine the degree, significance, and significance of the units. But they do not discuss the extent to which these judgments are reproducible, i.e., reliable.
Book
Statistical methods for rates and proportions
TL;DR: In this paper, the basic theory of Maximum Likelihood Estimation (MLE) is used to detect a difference between two different proportions of a given proportion in a single proportion.
Journal ArticleDOI
Statistical Methods for Rates and Proportions.
B. S. Everitt,Joseph L. Fleiss +1 more