Journal ArticleDOI
Answering the Call for a Standard Reliability Measure for Coding Data
TLDR
This work proposes Krippendorff's alpha as the standard reliability measure, general in that it can be used regardless of the number of observers, levels of measurement, sample sizes, and presence or absence of missing data.Abstract:
In content analysis and similar methods, data are typically generated by trained human observers who record or transcribe textual, pictorial, or audible matter in terms suitable for analysis. Conclusions from such data can be trusted only after demonstrating their reliability. Unfortunately, the content analysis literature is full of proposals for so-called reliability coefficients, leaving investigators easily confused, not knowing which to choose. After describing the criteria for a good measure of reliability, we propose Krippendorff's alpha as the standard reliability measure. It is general in that it can be used regardless of the number of observers, levels of measurement, sample sizes, and presence or absence of missing data. To facilitate the adoption of this recommendation, we describe a freely available macro written for SPSS and SAS to calculate Krippendorff's alpha and illustrate its use with a simple example.read more
Citations
More filters
Proceedings ArticleDOI
Fairness and Decision-making in Collaborative Shift Scheduling Systems.
TL;DR: Fairness is explored as a central, human-oriented attribute of shift schedules as well as the scheduling process, and a sketch for fair scheduling systems is presented, summarizing key findings for designers in a readily usable way.
Journal ArticleDOI
Logging you, Logging me: A Replicable Study of Privacy and Sharing Behaviour in Groups of Visual Lifeloggers
Blaine A. Price,Avelie Stuart,Gul Calikli,Ciaran McCormick,Vikram Mehta,Luke Hutton,Arosha K. Bandara,Mark Levine,Bashar Nuseibeh +8 more
TL;DR: It is found that people were more willing to share images of people they were interacting with than of strangers, thatlifelogging in groups could change what defines a private space, and that lifelogging groups establish different rules to manage privacy for those inside and outside the group.
Proceedings ArticleDOI
Automatic Detection of Naturalistic Hand-over-Face Gesture Descriptors
TL;DR: This work makes the first attempt to automatically detect and classify hand-over-face gestures in natural expressions using multi-modal fusion of different state-of-the-art spatial and spatio-temporal features.
Dissertation
The relative information content of complementary and supplementary narrative commentary in UK interim reports
TL;DR: In this article, the relative information content of complementary and supplementary narrative commentaries in UK interim reports was investigated, and the results indicated that complementary narratives had higher but insignificant infonnation content than complementary narratives for the model based on disclosure variety.
Dissertation
Monitoring and Expressing Opinions on Social Networking Sites – Empirical Investigations based on the Spiral of Silence Theory
TL;DR: This article investigated the psychological mechanisms leading to the formation of opinion climates on social networking platforms, focusing on whether and how users monitor other people's opinions through these technologies and under which circumstances they are willing to contribute to these opinion climates by voicing their personal viewpoint on these platforms.
References
More filters
Journal ArticleDOI
Coefficient alpha and the internal structure of tests.
TL;DR: In this paper, a general formula (α) of which a special case is the Kuder-Richardson coefficient of equivalence is shown to be the mean of all split-half coefficients resulting from different splittings of a test, therefore an estimate of the correlation between two random samples of items from a universe of items like those in the test.
Book
An introduction to the bootstrap
Bradley Efron,Robert Tibshirani +1 more
TL;DR: This article presents bootstrap methods for estimation, using simple arguments, with Minitab macros for implementing these methods, as well as some examples of how these methods could be used for estimation purposes.
Book
Nonparametric statistics for the behavioral sciences
TL;DR: This is the revision of the classic text in the field, adding two new chapters and thoroughly updating all others as discussed by the authors, and the original structure is retained, and the book continues to serve as a combined text/reference.
Journal ArticleDOI
A Coefficient of agreement for nominal Scales
TL;DR: In this article, the authors present a procedure for having two or more judges independently categorize a sample of units and determine the degree, significance, and significance of the units. But they do not discuss the extent to which these judgments are reproducible, i.e., reliable.
Book
Content analysis: an introduction to its methodology
TL;DR: History Conceptual Foundations Uses and Kinds of Inference The Logic of Content Analysis Designs Unitizing Sampling Recording Data Languages Constructs for Inference Analytical Techniques The Use of Computers Reliability Validity A Practical Guide