Power estimation of tests in log-linear non-uniform association models for ordinal agreement.

Abstract : ABSTRACT: BACKGROUND: Log-linear association models have been extensively used to investigate the pattern of agreement between ordinal ratings. In 2007, log-linear non-uniform association models were introduced to estimate, from a cross-classification of two independent raters using an ordinal scale, varying degrees of distinguishability between distant and adjacent categories of the scale. METHODS: In this paper, a simple method based on simulations was proposed to estimate the power of non-uniform association models to detect heterogeneities across distinguishabilities between adjacent categories of an ordinal scale, illustrating some possible scale defects. RESULTS: Different scenarios of distinguishability patterns were investigated, as well as different scenarios of marginal heterogeneity within rater. For sample size of N=50, the probabilities of detecting heterogeneities within the tables are lower than .80, whatever the number of categories. In additition, even for large samples, marginal heterogeneities within raters led to a decrease in power estimates. CONCLUSION: This paper provided some issues about how many objects had to be classified by two independent observers (or by the same observer at two different times) to be able to detect a given scale structure defect. Our results also highlighted the importance of marginal homogeneity within raters, to ensure optimal power when using non-uniform association models.
Type de document :
Article dans une revue
BMC Medical Research Methodology, BioMed Central, 2011, 11 (1), pp.70. 〈10.1186/1471-2288-11-70〉
Liste complète des métadonnées

http://www.hal.inserm.fr/inserm-00601757
Contributeur : Ed. Bmc <>
Soumis le : lundi 20 juin 2011 - 14:03:11
Dernière modification le : vendredi 27 octobre 2017 - 16:54:11

Identifiants

Collections

Citation

Fabien Valet, Jean-Yves Mary. Power estimation of tests in log-linear non-uniform association models for ordinal agreement.. BMC Medical Research Methodology, BioMed Central, 2011, 11 (1), pp.70. 〈10.1186/1471-2288-11-70〉. 〈inserm-00601757〉

Partager

Métriques

Consultations de la notice

302

Téléchargements de fichiers

125