Abstract
The purpose of this study was to evaluate the inter-rater reliability of hand diagrams, which are commonly used in research case definitions of carpal tunnel syndrome (CTS). To evaluate the potential of non-random misclassification of cases, we also studied predictors of rater disagreement as a function of personal and work factors, and of hand symptoms not classic for CTS. Participants in a longitudinal study investigating the development of CTS completed repeated self-administered questionnaires. Three experienced clinicians, blind to subjects’ work or personal history, independently rated all hand diagrams on an ordinal scale from 0 to 3. Disagreements between ratings were resolved by consensus. Reliability was measured by the weighted kappa statistic. Logistic regression models evaluated predictors of disagreement. Three hundred and thirty-three subjects completed 494 hand diagrams. Eighty-five percent were completed by self-administered questionnaire and 15% by telephone interview. Weighted kappa values representing agreement among the three raters, were 0.83 (95% CI: 0.78, 0.87) for right hand diagrams and 0.88 (95% CI: 0.83, 0.91) for left hand diagrams. Ratings from hand diagrams obtained by telephone interview produced better agreement. Agreement among raters was not affected by subjects’ personal or work factors. Disagreement among raters was associated with the presence of hand/wrist symptoms other than classic CTS symptoms. Overall, high levels of agreement were attained by independent raters of hand diagrams. Personal factors did not affect agreement among raters, but presence of non-CTS symptoms seemed to affect results and should be considered in studies focused on diverse populations with heterogeneity of upper extremity symptoms.
Similar content being viewed by others
References
Atroshi I, Gummesson C, Johnsson R, Ornstein E, Ranstam J, Rosen I. Prevalence of carpal tunnel syndrome in a general population. JAMA. 1999;282:153–8. doi:10.1001/jama.282.2.153.
de Krom MC, Knipschild PG, Kester AD, Thijs CT, Boekkooi PF, Spaans F. Carpal tunnel syndrome: prevalence in the general population. J Clin Epidemiol. 1992;45:373–6. doi:10.1016/0895-4356(92)90038-O.
Papanicolaou GD, McCabe SJ, Firrell J. The prevalence and characteristics of nerve compression symptoms in the general population. J Hand Surg [Am]. 2001;26:460–6. doi:10.1053/jhsu.2001.24972.
Frost P, Andersen JH, Nielsen VK. Occurrence of carpal tunnel syndrome among slaughterhouse workers. Scand J Work Environ Health. 1998;24:285–92.
Homan MM, Franzblau A, Werner RA, Albers JW, Armstrong TJ, Bromberg MB. Agreement between symptom surveys, physical examination procedures and electrodiagnostic findings for the carpal tunnel syndrome. Scand J Work Environ Health. 1999;25:115–24.
Rosecrance JC, Cook TM, Anton DC, Merlino LA. Carpal tunnel syndrome among apprentice construction workers. Am J Ind Med. 2002;42:107–16. doi:10.1002/ajim.10093.
Daniell WE, Fulton-Kehoe D, Chiou LA, Franklin GM. Work-related carpal tunnel syndrome in Washington State workers’ compensation: temporal trends, clinical practices, and disability. Am J Ind Med. 2005;48:259–69. doi:10.1002/ajim.20203.
Palmer DH, Hanrahan LP. Social and economic costs of carpal tunnel surgery. Instr Course Lect. 1995;44:167–72.
Phalen GS. The carpal-tunnel syndrome. Seventeen years’ experience in diagnosis and treatment of six hundred fifty-four hands. J Bone Joint Surg Am. 1966;48:211–28.
Helliwell PS, Bennett RM, Littlejohn G, Muirden KD, Wigley RD. Towards epidemiological criteria for soft-tissue disorders of the arm. Occup Med (Lond). 2003;53:313–9. doi:10.1093/occmed/kqg034.
Haase J. Carpal tunnel syndrome – a comprehensive review. Adv Tech Stand Neurosurg. 2007;32:175–249. doi:10.1007/978-3-211-47423-5_7.
Brain W, Wright A, Wilkinson M. Spontaneous compression of both median nerves in the carpal tunnel six cases treated surgically. Lancet. 1947;249:277–82. doi:10.1016/S0140-6736(47)90093-7.
Rempel D, Evanoff B, Amadio PC, de Krom M, Franklin G, Franzblau A, et al. Consensus criteria for the classification of carpal tunnel syndrome in epidemiologic studies. Am J Public Health. 1998;88:1447–51.
Harrington JM, Carter JT, Birrell L, Gompertz D. Surveillance case definitions for work related upper limb pain syndromes. Occup Environ Med. 1998;55:264–71.
Sluiter JK, Rest KM, Frings-Dresen MH. Criteria document for evaluating the work-relatedness of upper-extremity musculoskeletal disorders. Scand J Work Environ Health. 2001;27(Suppl 1):1–102.
Bonfiglioli R, Mattioli S, Spagnolo MR, Violante FS. Course of symptoms and median nerve conduction values in workers performing repetitive jobs at risk for carpal tunnel syndrome. Occup Med (Lond). 2006;56:115–21. doi:10.1093/occmed/kqj007.
Gerr F, Letz R. The sensitivity and specificity of tests for carpal tunnel syndrome vary with the comparison subjects. J Hand Surg [Br]. 1998;23:151–5. doi:10.1016/S0266-7681(98)80163-0.
Werner RA, Franzblau A, Gell N, Hartigan AG, Ebersole M, Armstrong TJ. Incidence of carpal tunnel syndrome among automobile assembly workers and assessment of risk factors. J Occup Environ Med. 2005;47:1044–50. doi:10.1097/01.jom.0000171065.17288.a0.
Franzblau A, Werner R, Valle J, Johnston E. Workplace surveillance for carpal tunnel syndrome: a comparison of methods. J Occup Rehabil. 1993;3:1–14. doi:10.1007/BF01076738.
de Krom MC, Knipschild PG, Kester AD, Spaans F. Efficacy of provocative tests for diagnosis of carpal tunnel syndrome. Lancet. 1990;335:393–5. doi:10.1016/0140-6736(90)90218-T.
Szabo RM, Slater RR Jr, Farver TB, Stanton DB, Sharman WK. The value of diagnostic testing in carpal tunnel syndrome. J Hand Surg [Am]. 1999;24:704–14. doi:10.1053/jhsu.1999.0704.
Katz JN, Stirrat CR, Larson MG, Fossel AH, Eaton HM, Liang MH. A self-administered hand symptom diagram for the diagnosis and epidemiologic study of carpal tunnel syndrome. J Rheumatol. 1990;17:1495–8.
Katz JN, Stirrat CR. A self-administered hand diagram for the diagnosis of carpal tunnel syndrome. J Hand Surg [Am]. 1990;15:360–3. doi:10.1016/0363-5023(90)90124-A.
Franzblau A, Werner RA, Albers JW, Grant CL, Olinski D, Johnston E. Workplace surveillance for carpal tunnel syndrome using hand diagrams. J Occup Rehabil. 1994;4:185–98. doi:10.1007/BF02331615.
Atroshi I, Gummesson C, Johnsson R, Ornstein E. Diagnostic properties of nerve conduction tests in population-based carpal tunnel syndrome. BMC Musculoskelet Disord. 2003;4:9. doi:10.1186/1471-2474-4-9.
Ferry S, Silman AJ, Pritchard T, Keenan J, Croft P. The association between different patterns of hand symptoms and objective evidence of median nerve compression: a community-based survey. Arthritis Rheum 1998;41:720–4. doi:10.1002/1529-0131(199804)41:4<720::AID-ART20>3.0.CO;2-6
Walker-Bone KE, Palmer KT, Reading I, Cooper C. Criteria for assessing pain and nonarticular soft-tissue rheumatic disorders of the neck and upper limb. Semin Arthritis Rheum. 2003;33:168–84. doi:10.1016/S0049-0172(03)00129-X.
Katz JN, Lew RA, Bessette L, Punnett L, Fossel AH, Mooney N, Keller RB. Prevalence and predictors of long-term work disability due to carpal tunnel syndrome. Am J Ind Med. 1998;33:543–50. doi:10.1002/(SICI)1097-0274(199806)33:6<543::AID-AJIM4>3.0.CO;2-R
Nordstrom DL, Vierkant RA, Layde PM, Smith MJ. Comparison of self-reported and expert-observed physical activities at work in a general population. Am J Ind Med. 1998;34:29–35. doi:10.1002/(SICI)1097-0274(199807)34:1<29::AID-AJIM5>3.0.CO;2-L
Levine DW, Simmons BP, Koris MJ, Daltroy LH, Hohl GG, Fossel AH, et al. A self-administered questionnaire for the assessment of severity of symptoms and functional status in carpal tunnel syndrome. J Bone Joint Surg Am. 1993;75:1585–92.
Salerno DF, Franzblau A, Armstrong TJ, Werner RA, Becker MP. Test-retest reliability of the Upper Extremity Questionnaire among keyboard operators. Am J Ind Med. 2001;40:655–66. doi:10.1002/ajim.10024.
Franzblau A, Salerno DF, Armstrong TJ, Werner RA. Test-retest reliability of an upper-extremity discomfort questionnaire in an industrial population. Scand J Work Environ Health. 1997;23:299–307.
Katz JN, Punnett L, Simmons BP, Fossel AH, Mooney N, Keller RB. Workers’ compensation recipients with carpal tunnel syndrome: the validity of self-reported health measures. Am J Public Health. 1996;86:52–6.
Fleiss J, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Measure. 1973;33:613–9. doi:10.1177/001316447303300309.
Perneger TV. What’s wrong with Bonferroni adjustments. Br Med J. 1998;316:1236–8.
R Development Core Team. R: a language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria; 2007. http://www.R-project.org.
Nora DB, Becker J, Ehlers JA, Gomes I. Clinical features of 1039 patients with neurophysiological diagnosis of carpal tunnel syndrome. Clin Neurol Neurosurg. 2004;107:64–9. doi:10.1016/j.clineuro.2004.08.003.
Gunnarsson LG, Amilon A, Hellstrand P, Leissner P, Philipson L. The diagnosis of carpal tunnel syndrome. Sensitivity and specificity of some clinical and electrophysiological tests. J Hand Surg [Br]. 1997;22:34–7. doi:10.1016/S0266-7681(97)80011-3.
Leclerc A, Landre MF, Chastang JF, Niedhammer I, Roquelaure Y. Upper-limb disorders in repetitive work. Scand J Work Environ Health. 2001;27:268–78.
Silverstein BA, Fine LJ, Armstrong TJ. Hand wrist cumulative trauma disorders in industry. Br J Ind Med. 1986;43:779–84.
Feveile H, Olsen O, Hogh A. A randomized trial of mailed questionnaires versus telephone interviews: response patterns in a survey. BMC Med Res Methodol. 2007;7:27. doi:10.1186/1471-2288-7-27.
Brambilla DJ, McKinlay SM. A comparison of responses to mailed questionnaires and telephone interviews in a mixed mode health survey. Am J Epidemiol. 1987;126:962–71.
Acknowledgments
This study was supported by Centers for Disease Control and Prevention, National Institute for Occupational Safety and Health, Grant number R01OH008017-01.
Author information
Authors and Affiliations
Corresponding author
Appendix A
Appendix A
Rights and permissions
About this article
Cite this article
Dale, A.M., Strickland, J., Symanzik, J. et al. Reliability of Hand Diagrams for the Epidemiologic Case Definition of Carpal Tunnel Syndrome. J Occup Rehabil 18, 233–248 (2008). https://doi.org/10.1007/s10926-008-9139-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10926-008-9139-y