Assessing the Diagnostic Accuracy of Multimedia Messaging for the Diagnosis of Scaphoid Fractures

Introduction: Use of smartphone messaging applications, such as WhatsApp, for communication within clinical teams is widespread. Various studies have shown multiple uses for smartphones and multimedia messaging in orthopedic clinical practice for coordinating clinical duties and diagnosing various injuries but none have assessed scaphoid fractures. Our aims were to: (1) assess diagnostic accuracy (sensitivity, specificity, positive predictive value, and negative predictive value) of viewing scaphoid X-rays on smartphones compared with desktop computers by using radiologist reports on the same X-rays as a reference test and (2) assess the intra-observer reliability of these studies.

Methods: This was a prospective cross-sectional study of diagnostic accuracy using paired tests. The standard for reporting diagnostic accuracy (STARD) guidelines were used in its design. We asked orthopedic specialist registrars to interpret whether a scaphoid fracture was present on 20 scaphoid X-rays, obtained from the National Integrated Medical Imaging System (NIMIS). These were viewed on a desktop and on a smartphone. Data were then analyzed by using STATA 14 to run McNemar’s test and to compare the sensitivity and specificity of the two index tests.

Results: Phone and desktop interpretation had good sensitivity (72.7% and 78.2%) and specificity (75.2% and 77.9%) in assessing scaphoid fractures with no significant difference in sensitivity (p-value = 0.507) or specificity (p-value = 0.547). There was fair to moderate intra-observer reliability (kappa score 0.436; 95% confidence interval 0.295–0.577).

Discussion: The fair to moderate scores of intra-observer agreement reflect the difficulty of diagnosing scaphoid fractures on X-rays. This study supports the use of smartphones for the diagnosis of scaphoid fractures.