|
Sign In to gain access to subscriptions and/or personal tools.
|
Examiner Reliability in Dental Radiography
R.W. Valachovic
Harvard School of Dental Medicine, 188 Longwood Avenue, Boston, Massachusetts 02115
C.W. Douglass
Harvard School of Dental Medicine, 188 Longwood Avenue, Boston, Massachusetts 02115
C.S. Berkey
Harvard School of Dental Medicine, 188 Longwood Avenue, Boston, Massachusetts 02115
B.J. McNeil
Harvard Medical School and Brigham and Women's Hospital, Boston, Massachusetts 02115
H.H. Chauncey
Harvard School of Dental Medicine, 188 Longwood Avenue, Boston, Massachusetts 02115, Veterans Administration Outpatient Clinic, Boston, Massachusetts 02108
In long-term investigations involving a large number of study participants, it is frequently necessary to employ the use of multiple examiners who must exhibit high levels of inter- and intra-examiner reliability in order to minimize examiner bias, which can distort scientific findings. This report on the calibration of four examiners in a large project investigating the efficacy of dental radiography shows high levels of examiner reliability using various statistical measures of agreement. Levels of intra-examiner agreement using Cohen's Kappa index were 0.75 and higher at baseline, and remained at approximately the same level (0.80) throughout the 24-month period of the study. The Kappa index of inter-examiner agreement among the six pairings of the four examiners ranged from 0.68 to 0.80 for caries and 0.72 and 0.83 for periodontal disease. Values of four statistical measures of agreement (proportional agreement, Kendall's rank correlation, Cohen's Kappa index, and Cohen's weighted Kappa index) were determined to show the importance of using measures, such as the Kappa index, which take chance agreement into account.
REFERENCES
- Berggren, H. and Welander, E. (1960): The Unreliability of Caries Recording Methods, Acta Odontol Scand 18:409-420.[CrossRef]
- Cohen, J. (1960): A Coefficient of Agreement for Nominal Scales, Educational and Psychological Measurement 20:37-46.[CrossRef]
- Cohen, J. (1968): Weighted Kappa: Nominal Scale Agreement with Provision for Scaled Disagreement or Partial Credit, Psychol Bull 70:213-220.[CrossRef][Medline]
[Order article via Infotrieve]
- DePaola, P.F. and Alman, J. (1972): Assessment of the Reliability of Radiographic Diagnosis in a Clinical Caries Trial, J Dent Res 51:1431-1437.[Abstract/Free Full Text]
- Dice, L.R. (1945): Measures of the Amount of Ecologic Association Between Species, Ecology 26:297-302.[CrossRef]
- Douglass, C.W.; Valachovic, R.W.; Wijesinha, A.; Chauncey, H.H.; and McNeil, B.J. (1985): The Clinical Efficacy of Dental Radiography in the Detection of Dental Caries and Periodontal Disease, Oral Surg (in press).
- Feldman, R.S.; Douglass, C.W.; Loftus, E.R.; Kapur, K.K.; and Chauncey, H.H. (1982): Inter-Examiner Agreement in the Measurement of Periodontal Disease, J Periodont Res 17:80-89.[CrossRef][Medline]
[Order article via Infotrieve]
- Fleiss, J.L.; Fischman, S.L.; Chilton, N.W.; and Park, M.H. (1979): Reliability of Discrete Measurements in Caries Trials, Caries Res 13:23-31.[Medline]
[Order article via Infotrieve]
- Galagan, D.J. and Vermillion, J. (1956): Diagnosis of Caries by Radiographic Interpretation, J Dent Res 35:33-38.[Free Full Text]
- Grondahl, H.G. (1979a): Some Factors Influencing Observer Performance in Radiographic Caries Diagnosis, Swed Dent J 3:157-172.[Medline]
[Order article via Infotrieve]
- Grondahl, H.G. (1979b): Radiographic Caries Diagnosis: A Study of Caries Progression and Observer Performance, Swed Dent J (Suppl) 3:1-32.[Medline]
[Order article via Infotrieve]
- Haugejorden, O. and Slack, G.L. (1975): A Study of Intra-examiner Error Associated with Recording of Radiographic Caries at Different Diagnostic Levels, Acta Odontol Scand 33:169-181.[CrossRef][Medline]
[Order article via Infotrieve]
- Kapur, K.K.; Glass, R.L.; Loftus, E.R.; Alman, J.E.; and Feller, R.P. (1972): The Veterans Administration Longitudinal Study of Oral Health and Disease, Aging and Human Development 3:125-132.
- Kendall, M.G. (1971): Rank Correlation Methods, 4th ed. London: Charles Griffin and Company.
- Koran, L.M. (1975): The Reliability of Clinical Methods, Data and Judgments, I, NEJM 293:642-646, 695-701.
- Landis, J.R. and Koch, G.G. (1977): The Measurement of Observer Agreement for Categorical Data, Biometrics 33:159-174.[CrossRef][Medline]
[Order article via Infotrieve]
- Leijon, G. and Marken, K.E. (1968): Roentgenological Diagnosis of Proximal Caries: Deviations Between Observers and Comparison Between the Recordings from Periapical and Bite-wing Roentgenograms, Acta Odontol Scand 26:35-61.[CrossRef][Medline]
[Order article via Infotrieve]
- Light, R.J. (1971): Measures of Response Agreement for Qualitative Data: Some Generalizations and Alternatives, Psychol Bull 76:365-377.[CrossRef]
- Loftus, E.R.; Alman, J.E.; Feldman, R.S.; Wayler, A.A.; Kapur, K.K.; and Chauncey, H.H. (1982): Cross-sectional and Longitudinal Tooth Survival Characteristics of Healthy Male Populations, Spec Care Dent 2:8-16.[CrossRef]
- Marthaler, T.M. and Germann, M. (1970): Radiographic and Visual Appearance of Small Smooth Surface Caries Lesions Studied on Extracted Teeth, Caries Res 4:224-242.[Medline]
[Order article via Infotrieve]
- McNemar, Q. (1982): Psychological Statistics, 3rd ed. New York: Wiley.
- Mileman, P.; Purdell-Lewis, D.; and Van Der Weele, L. (1982): Variation in Radiographic Caries Diagnosis and Treatment Decisions among University Teachers, Community Dent Oral Epidemiol 10:327-334.
- Mileman, P.; Purdell-Lewis, D.; and Van Der Weele, L. (1983): Effect of Variation in Caries Diagnosis and Degree of Caries on Treatment Decisions by Dental Teachers Using Bitewing Radiographs, Community Dent Oral Epidemiol 11:356-362.[CrossRef][Medline]
[Order article via Infotrieve]
- Murray, J.J. and Majid, Z.A. (1978): The Prevalence and Progression of Approximal Caries in the Deciduous Dentition in British Children, Br Dent J 145:161-164.
- Murray, J.J. and Shaw, L. (1975): Errors in Diagnosis of Approximal Caries on Bitewing Radiographs, Community Dent Oral Epidemiol 3:276-282.[CrossRef][Medline]
[Order article via Infotrieve]
- Nuttall, N.M. and Paul, J.M. (1985): The Analysis of Inter-dentist Agreement in Caries Prevalence Studies, Community Dent Hlth 2:123-128.
- Pliskin, J.S.; Shwartz, M.; Grondahl, H.-G.; and Boffa, J. (1984): Reliability of Coding Depth of Approximal Carious Lesions From Non-Independent Interpretation of Serial Bitewing Radiographs, Community Dent Oral Epidemiol 12:366-370.[CrossRef][Medline]
[Order article via Infotrieve]
- Poulsen, S.; Bille, J.; and Rugg-Gunn, A.J. (1980): Evaluation of a Calibration Trial to Increase Interexaminer Reliability of Radiographic Diagnosis of Approximal Carious Lesions, Community Dent Oral Epidemiol 8:135-138.[CrossRef][Medline]
[Order article via Infotrieve]
- Richardson, A.S.; Hole, L.; and Williams, J.F. (1971): The Role of Radiographs in Clinical Studies of Caries-Inhibitory Agents, J Publ Hlth Dent 31:158-165.[CrossRef]
- Tanner, M.A. and Young, M.A. (1985): Modeling Agreement Among Raters, J Am Statist Assoc 80:175-180.[CrossRef]
Journal of Dental Research, Vol. 65, No. 3,
432-436 (1986)
DOI: 10.1177/00220345860650031201
 CiteULike  Complore  Connotea  Del.icio.us  Digg  Reddit  Technorati  Twitter What's this?
This article has been cited by other articles:
|
|
|
|
 
D. C. GAKENHEIMER
The efficacy of a computerized caries detector in intraoral digital radiography
J Am Dent Assoc,
July 1, 2002;
133(7):
883 - 890.
[Abstract]
[Full Text]
[PDF]
|
|
|
|
|
|
|
V.F. Flack, K.A. Atchison, E.R. Hewlett, and S.C. White
Relationships Between Clinician Variability and Radiographic Guidelines
Journal of Dental Research,
February 1, 1996;
75(2):
775 - 782.
[Abstract]
[PDF]
|
|
|
|
|
|
|
K.B. Wabeke, R.J. Spruijt, and J. van der Zaag
The Reliability of Clinical Methods for Recording Temporomandibular Joint Sounds
Journal of Dental Research,
June 1, 1994;
73(6):
1157 - 1162.
[Abstract]
[PDF]
|
|
|
|
|
