Articles |

Variability in the Classification of Radiographs Using the 1980 International Labor Organization Classification for Pneumoconioses FREE TO VIEW

Laura S. Welch; Katherine L. Hunting; John Balmes; Eddy A. Bresnitz; Tee L. Guidotti; James E. Lockey; Tony Myo-Lwin
Author and Funding Information

Affiliations: From the Department of Occupational/Environmental Medicine, Washington Hospital Center, Washington, DC,  From the George Washington University, Washington, DC,  From the University of California at San Francisco, San Francisco General Hospital, San Francisco, CA,  From the Department of Community and Preventive Medicine, Allegheny University of Health Sciences, MCP/Hahneman School of Medicine, Philadelphia, PA,  From the University of Alberta Faculty of Medicine, Edmonton, AR, Canada,  From the Division of Occupational and Environmental Medicine, Department of Environmental Health, University of Cincinnati, Cincinnati, OH,  From the Mt. Saint Joseph Hospital, Vancouver, BC, Canada

Laura S. Welch, MD, Occupational Environmental Medicine, Washington Hospital Center, 100 Irving St, NW, EB1114, Washington, DC 20010-2975

1998 by the American College of Chest Physicians

Chest. 1998;114(6):1740-1748. doi:10.1378/chest.114.6.1740
Text Size: A A A
Published online


This study describes the extent of agreement in classification of chest radiographs using the International Labor Organization (ILO) classification among six readers from the United States and Canada. A set of 119 radiographs was created and read by three Canadian and three US readers. The two ratings of interest were profusion (scored from 0/− to 3/+) and pleural abnormalities consistent with pneumoconiosis (scored with the ILO system, then collapsed into a yes/no). We used a number of approaches to evaluate interreader agreement on profusion and pleural changes, determining concordance, observed agreement, kappa statistic, and a new measure to approximate sensitivity and specificity. This study found that five of six readers had good fair to good agreement for pleural findings and for profusion as a dichotomous variable (≥ 1/0 vs ≤ 0/1) using the kappa statistic, while a sixth reader had poor agreement. We found that concordance, expressed as percent agreement, was higher for normal radiographs than for ones that showed disease, and describe the use of the kappa statistic to control for this finding. This analysis adds to the existing literature with the use of the kappa statistic, and by presenting a new measure for "underreading" and "overreading" tendencies.




Citing articles are presented as examples only. In non-demo SCM6 implementation, integration with CrossRef’s "Cited By" API will populate this tab (http://www.crossref.org/citedby.html).

Some tools below are only available to our subscribers or users with an online account.

Related Content

Customize your page view by dragging & repositioning the boxes below.

Find Similar Articles
CHEST Journal Articles
  • CHEST Journal
    Print ISSN: 0012-3692
    Online ISSN: 1931-3543