Introduction
The aim of this study was to determine the reliability and the measuring error (by means of the smallest detectable error) of 11 angular and 4 linear measurements commonly used for cephalometric analysis.
Methods
Twenty-five digital lateral cephalograms were randomly selected and traced with Viewbox software (version 3.1.1.13, dHAL Software, Kifissia, Greece). This was repeated 3 times by 2 observers during 3 sessions. There was at least 1 week between each session. Differences were analyzed with a repeated measurement analysis of variance (ANOVA). Intraobserver and interobserver reliabilities were calculated with intraclass correlation coefficients (ICC) based on absolute agreement. Measurement error was determined by means of the smallest detectable difference.
Results
The intraobserver agreement of the measurements was good (ICC >0.82). SNA, SNB, ANB, and ANS-Me had the smallest intraobserver errors for both observers (>1.86 mm or degrees). Except for SN-FH (ICC = 0.76), interobserver agreement was good (ICC >0.87).
Conclusions
Determining the appropriate measuring error of cephalometric measurements by means of the smallest detectable difference is necessary to find the true difference between the start and the end of active treatment. Depending on the magnitude of clinical significance, the measuring error was possibly clinically significant for all variables tested and, therefore, questions the use of these variables to detect the true treatment effect.
Editor’s comment
We orthodontists are, by necessity, very attentive to details. It is, therefore, only expected that we would be fussy about precision in cephalometrics, ascribing meaning even to the last significant digit that our computer reports. Fortunately, numerous studies have tempered this tendency by showing that cephalometric measurements have limited accuracy, repeatability, and even validity. This study further helps to put things in their proper perspective. Assume that mandibular length, as measured from condylion to gnathion (Co-Gn), has increased for a particular patient by 3 mm during treatment. Would anyone doubt that the patient has grown? The answer, according to the results of this research, might be surprising.
The authors used the concept of the smallest detectable difference (SDD) to present their findings. The SDD is the smallest difference between 2 measurements that gives us sufficient confidence to accept the change as actual and not just an accidental finding. It is obvious that a very small difference in Co-Gn could easily be attributed to measurement error. What is the threshold above which you would consider the change real?
It seems that the SDD for this specific measurement is greater than 3 mm and can exceed 4 mm if the pretreatment and posttreatment measurements are made by different observers. The errors inherent in cephalometric measurements, even if performed with the help of computer software, are so great that it makes no sense to claim evidence of a 2-mm mandibular growth change. Table IV of the article gives values for 14 commonly used measurements. When studying it, we should keep in mind that these SDDs apply to individual patients—ie, to measurements of 1 radiograph; they do not represent our limits when evaluating large samples of patients, when random errors tend to average out. Also, the SDD is the value that represents a 95% confidence limit, as is customary in statistics. It is up to you to decide whether you need such a high confidence, depending on the use of your data.
Demetrios Halazonetis
Intraobserver | ||||||||||
---|---|---|---|---|---|---|---|---|---|---|
Measurement | Unit | Observer 1 | Observer 2 | Mean observer 1 vs 2 | ||||||
ICC | SEM | SDD | ICC | SEM | SDD | ICC | SEM | SDD | ||
1. SNA | ° | 0.96 | 0.67 | 1.86 | 0.96 | 0.59 | 1.64 | 0.96 | 0.76 | 2.12 |
2. SNB | ° | 0.97 | 0.43 | 1.20 | 0.95 | 0.17 | 0.46 | 0.95 | 0.83 | 2.31 |
3. ANB | ° | 0.94 | 0.45 | 1.25 | 0.87 | 0.41 | 1.14 | 0.87 | 0.93 | 2.57 |
4. Wits | mm | 0.95 | 1.30 | 3.60 | 0.86 | 1.55 | 4.29 | 0.89 | 2.13 | 5.91 |
5. SN-FH | ° | 0.87 | 0.83 | 2.31 | 0.82 | 1.06 | 2.93 | 0.76 | 1.90 | 5.26 |
6. FH-NPog | ° | 0.96 | 0.48 | 1.34 | 0.89 | 1.14 | 3.16 | 0.91 | 0.64 | 1.77 |
7. GoGn-SN | ° | 0.92 | 1.07 | 2.97 | 0.89 | 0.60 | 1.66 | 0.87 | 2.25 | 6.24 |
8. U1-SN | ° | 0.98 | 1.48 | 4.09 | 0.97 | 1.59 | 4.40 | 0.95 | 2.21 | 6.12 |
9. L1-GoGn | ° | 0.97 | 1.59 | 4.40 | 0.93 | 1.45 | 4.02 | 0.94 | 2.41 | 6.68 |
10. L1-FH | ° | 0.98 | 1.72 | 4.76 | 0.96 | 2.09 | 5.78 | 0.93 | 2.49 | 6.91 |
11. Co-A | mm | 0.93 | 1.81 | 5.01 | 0.90 | 1.58 | 4.38 | 0.94 | 1.16 | 3.22 |
12. Co-Gn | mm | 0.97 | 1.45 | 4.02 | 0.95 | 1.15 | 3.19 | 0.92 | 1.73 | 4.80 |
13. ANS-Me | mm | 0.99 | 0.36 | 1.00 | 0.99 | 0.46 | 1.27 | 0.99 | 0.19 | 0.51 |
14. AFC | ° | 0.95 | 1.21 | 3.35 | 0.93 | 0.62 | 1.72 | 0.92 | 1.57 | 4.35 |