|
|
||||||||
|
J Am Dent Assoc, Vol 133, No 7, 883-890.
© 2002 American Dental Association | ![]() |
ADVANCES IN DENTAL PRODUCTS |
| ABSTRACT |
|---|
|
|
|---|
Methods. The manufacturer trained 18 dentists in private practices and one university clinic across the United States to use the Logicon Caries Detector software. The dentists diagnosed 175 surfaces with potential caries and adjacent teeth expected to be clean but included as control surfaces. The dentists first did a visual diagnosis only and then repeated the diagnosis using the software. If their final diagnosis called for it, a restoration was performed and the depth of caries was recorded.
Results. Effectiveness was gauged by calculating three measures of performancesensitivity, specificity and accuracyfor dentin caries diagnosis by each dentist both before and after using Logicon Caries Detector. Sensitivity among all dentists before using the Logicon software was 70.3 percent and afterward was 90.5 percent, an improvement of 20.2 percent. Dentists specificity was 88.6 percent before using the software and 88.3 percent afterward, with a difference of 0.3 percent. Dentists accuracy was 75.6 percent before using the software and 88.3 percent afterward, with an improvement of 12.7 percent.
Conclusions. Logicon Caries Detector enabled dentists to find 20 percent more cases of caries penetrating into dentin than they were able to find without it, while not causing them to mistreat any additional healthy teeth.
Clinical Implications. Digital radiography and smart software like Logicon Caries Detector will improve dentists diagnostic abilities and lead to better patient care.
Visually diagnosing radiographs for proximal caries is difficult because of variations in radiographs due to exposure level, tooth structure and tooth shape, and because the eye tends to smooth out shades of gray. A 1984 study by researchers at the University of California Los Angeles, or UCLA, School of Dentistry showed that dentists using film radiographs misdiagnosed the depth of caries up to 40 percent of the time and that healthy teeth were misdiagnosed as having caries up to 20 percent of the time.1 Other studies have similarly demonstrated the difficulties of visually diagnosing proximal surfaces using film radiographs.28
A more recent study with a digital radiography system showed no improvement in caries detection over film radiographs by visual evaluation alone.9 Wenzel10 did a thorough job of reviewing the long history of caries diagnosis with film and digital radiography systems through 1997 with similar conclusions. In March 2001, the National Institutes of Health, or NIH, published a consensus statement on diagnosis and management of dental caries, expressing a need for advances in radiographic methods of diagnosing noncavitated lesions and a need for both clinical trials and laboratory studies to evaluate the efficacy of new methods. The work reported in this article contributes to both of these needs as identified by the NIH panel of nonadvocate, nonfederal experts after hearing a number of presentations from prominent investigators in the field.11
The advent of digital radiography has brought new opportunities for smart software to aid the dentist. Logicon Inc. (now Northrop Grumman Information Technology, Herndon, Va.) developed a unique software tool to assist the dentist in the task of diagnosing proximal caries. (The Logicon Caries Detector is distributed worldwide by Trophy Radiologie, Croissy-Beaubourg, France, and in the United States by Trophy Dental Inc., Danbury, Conn.) The tool analyzes changes in radiographic density (directly related to the tooth density) to identify demineralized regions of the tooth and determines the probability that a carious lesion is present in the enamel and dentin. A graphic interface displays an enlarged radiographic image outlining the potential lesion site on the tooth in question with separate plots of tooth density variations and lesion probability.
Other researchers have developed software tools for caries detection that emphasize finding incipient caries in the enamel.1223 Logicon developed the first software tool to trace the caries from the surface through the enamel and into the dentin, to correlate the lesion features in the enamel and the dentin, and to produce probabilities that enamel and dentin lesions are present based on a comparison with a database of known caries cases developed at UCLA. Logicon received a U.S. patent for its process24 and demonstrated its effectiveness first in a laboratory study on extracted teeth and then in a clinical study during normal patient care. Because there was no predicate device, Logicon applied for and received premarket approval, or PMA, from the U.S. Food and Drug Administration, or FDA, for this software device.25 The results of the clinical study are presented in this article, while the results of the laboratory study can be found in an FDA report available in print and online.25 Caries detector software enabled dentists to find 20 percent more cases of caries penetrating into dentin than they were able to find without it.
![]()
MATERIALS AND METHODS
TOP
ABSTRACT
MATERIALS AND METHODS
RESULTS
DISCUSSION
CONCLUSION
REFERENCES
Hardware and software.
Logicon Caries Detector runs on a Pentium (Intel Corporation, Santa Clara, Calif.) personal computer. It is a stand-alone software program that has been interfaced with the Trophy RadioVisioGraphy, or RVG, digital radiography system (Trophy Radiologie). The study reported here used Trophys RVG-4 sensor. The dentist uses the Logicon software to inspect a potential lesion on a proximal surface to determine whether it penetrates deep enough to deserve treatment. After the dentist designates the region of interest with a custom computer mouse tool called the V-tool, the program runs automatically and produces three diagnostic aids, as shown in Figures 1
through 3![]()
. The program first finds the outer edge of the tooth and the dentinoenamel junction, or DEJ. (The software offers a manual mode in case the dentist prefers to trace these boundaries.) The radiographic density variation (that is, variations in shades of gray) and, hence, the density variation of the tooth then are analyzed along contours paralleling the tooth surface and the DEJ (Figure 1
). Changes in the radiographic density are determined along each contour and displayed for the dentist in a separate plot labeled "Tooth Density" (Figure 2
). Ten equally spaced contours are analyzed through the enamel and five in the dentin. (Figure 1
shows examples of the contours.) The program then looks for a correlation in the density dips that could be related to caries disease. If it finds such a pattern, it highlights the pattern on the density plot with red dots (Figure 2
), and outlines the edges of the density dips in red on the tooth image (Figure 1
).
|
|
|
Course of treatment.
Using Logicon Caries Detectors three diagnostic aidsthe image with the radiolucency outlined, the tooth density plot and the lesion probabilitiesthe dentist can decide on a course of treatment. The bar graph of lesion probabilities uses a yellow horizontal line to indicate the decision threshold (Figure 3
). The decision threshold is based on a 15 percent false-positive detection rate. If the probability bar for a dentinal lesion is well above this decision threshold, the dentist is advised to consider restorative treatment of the tooth. On the other hand, if the probability bar is near or below the decision threshold, the dentist is advised to wait and re-evaluate the case at a later date. The current analysis can be stored and compared with a later analysis. The dentist can change the decision threshold.
When the probability bar is above the decision threshold for an enamel lesion alone, the decision to treat is based more on the dentists judgment than on the softwares output. An enamel lesion, for example, may not progress or, alternatively, may recalcify. The dentist will decide on a case-by-case basis whether to perform a restoration or treat the tooth with fluoride and re-evaluate with another radiograph at a later date.
Dentist selection and training for clinical study. Eighteen dentists from throughout the eastern and western United States, including dentists in private practice and dentists in the faculty group practice at UCLA, volunteered to participate in the study. All were general practitioners. All had some experience with computers, and all the dentists in private practice had experience with the digital radiography system used in the study (Trophy RVG).
I headed the team of Logicon researchers who trained dentists in person in the use of Logicon Caries Detector, including how to start the software with the V-tool, interpret the highlighted features displayed on the radiographic image and interpret density variation plots and probability bar graphs. We asked dentists to analyze a set of images of teeth for which the lesion status was known, and dentists were accepted into the study only after they demonstrated proficiency with the software. (We advised them that the analyses were sensitive to exactly what tooth anatomy was included in the region being analyzed, and to repeat the analyses so that they could understand this sensitivity.) We reviewed accepted radiographic criteria for the presence of caries with each dentist.26 We advised dentists that we expected the software would be most helpful in determining whether lesions penetrated the dentin. All the dentists agreed that caries penetrating into dentin should be treated.
Patient inclusion criteria. We asked the dentists to impose no restrictions or bias on patient selection based on race or sex. In selecting teeth for analysis, we asked dentists to place no restriction on tooth type (that is, molar, premolar, canine or incisor). But in accordance with the products indications for use and contraindications, we asked the dentists to include only proximal surfaces on permanent teeth, and to work around previous restorations and overlapping contacts if possible (or avoid them if necessary).
We instructed the dentists to select proximal surfaces potentially requiring restorative treatment on a first-come, first-served basis, to avoid biasing toward any subclass of patients or tooth surfaces. Specifically, we told the dentists to include all cases ranging from incipient caries (caries penetrating less than halfway into the enamel) to moderate and advanced caries (penetrating up to halfway through the dentin). The dentists were to exclude only the obvious (severe) cases of caries where the lesion was readily seen radiographically to penetrate more than halfway through the dentin. Qualifying surfaces with lesions were identified by each participating dentist (according to the agreed-on criteria) as test surfaces. In addition, we asked the dentists to include, whenever possible, a control surface with each test surface. These were surfaces that initially were interpreted (before being analyzed with Logicon Caries Detector) to be caries-free and that would be exposed to direct visual and physical examination if the test surfaces were prepared for restoration. Generally, the control surfaces were the surfaces adjacent to the test surfaces.
Test and evaluation conditions and data collection. The study was performed in a normal clinical setting with dentists following their normal procedures (with the addition that they obtained written patient consent). Each dentist performed an initial evaluation of test and control surfaces without Logicon Caries Detector. This included a visual evaluation of the radiographs for the presence of a lesion in the enamel and dentin and an initial judgment regarding treating or not treating the lesion. The dentists then applied Logicon Caries Detector to the radiographic images of both test and control surfaces and performed a second evaluation of these surfaces. Treatment was based on this second evaluation. If a surface was not treated, then that surface and the associated control surface were not included in the study.
If a test surface was treated, then the dentist determined its true lesion status during cavity preparation. We asked each dentist to record the lesions percentage of penetration into the enamel and its depth, in millimeters, of penetration into the dentin. The dentist assessed the control surface exposed during the preparation of the test surface to be caries-free if it exhibited no signs of cavitation or surface demineralization as indicated by a catch with a dental explorer. (However, in the absence of surface preparation, the possibility of subsurface demineralization cannot be excluded.) If a control surface showed signs of cavitation and the dentist chose to restore the surface, then we asked the dentist to record the same lesion data as for the test surface. For validation purposes, the dentists took intraoral camera images of all prepared and exposed surfaces.
Endpoint of clinical study. The endpoint of the study for each tooth surface was either the completion of the final restoration (such as amalgam restoration, crown or composite) or the dentists decision not to restore the tooth because of lack of caries in the dentin. The determination of caries status for each surface was made once, and it was not the intention of this study to follow a given tooth surface over time.
The endpoint of the study as a whole was the point when a sufficient sample size was reached to obtain a statistically significant measure of the efficacy of Logicon Caries Detector in diagnosing dentinal lesions. To estimate the number of dentists and surfaces required, the Logicon researchers looked at the preliminary results from seven dentists. Each of these dentists looked at roughly 10 surfaces with an average improvement in diagnostic accuracy of about 20 percent and standard deviation of approximately 35 percent. Assuming similar results from additional dentists, each analyzing 10 surfaces, and assuming a t distribution for the difference between means,27 we estimated that a sample size of 10 dentists, each analyzing at least 10 surfaces, would be required to establish significance at the 5 percent level (P = .05). Ultimately, we obtained valid data on 175 surfaces from 18 dentists, each of whom analyzed an average of 9.7 surfaces, and this population proved to be adequate to obtain a statistically significant measure of efficacy.
Demographic data.
The demographic data for the clinical study are summarized in Tables 1
and 2
. The subjects represented a range of geographic locations, ages and races, while the sex distribution was nearly equal to that in the general population. Although the incidence of dental caries can depend on many factors, including diet (which generally changes with the patients age) and local water mineral content, as well as treatment methods, the dentists ability to detect caries generally is not dependent on these factors. As a result, we saw no reason to control for any of these demographic parameters except that, as mentioned above, all patients were to be of an age that they had permanent teeth (because our caries database includes only permanent teeth). Otherwise, we specifically wanted patients treated on a first-come, first-served basis to avoid any accidental bias due to patient selection. Our resulting data on caries detection, in fact, showed no dependence on the demographic parameters in Tables 1
and 2
.
|
|
| RESULTS |
|---|
|
|
|---|
We gauged effectiveness by calculating three measures of performancesensitivity, specificity and accuracyfor dentin caries diagnosis by each dentist both before and after using Logicon Caries Detector. As shown in Table 3
, the average (mean) sensitivity among all the dentists before they used Logicon Caries Detector was 70.3 percent; after they used the software, their sensitivity was 90.5 percent, with a difference of 20.2 percent. Considerable variation exists in the performance between dentists (as reflected in the large value of standard deviation), but we observed a strong trend toward improvement for most dentists (as reflected in the much smaller value of standard error of the mean).
|
One cannot make the same conclusion for specificity. As shown in Table 3
, the average (mean) specificity for all dentists before using Logicon Caries Detector was 88.6 percent and after using it was 88.3 percent, with a difference of 0.3 percent. The observed mean difference has a P value of 0.754 (based on the paired t test), and the observed median difference has a P value of .99 (based on the Wilcoxon test). That is, the observed result is consistent with the true mean (and median) difference being zero, and we can conclude that there is no change in specificity.
Finally, as shown in Table 3
, the average (mean) accuracy for all dentists before using Logicon Caries Detector was 75.6 percent and after using it was 88.3 percent, with a difference of 12.7 percent. The observed mean difference has a P value of .0428 (based on the paired t test), and the observed median difference has a P value of .0537 (based on the Wilcoxon test).
Thus our observed mean and median differences are significantly different from zero, and we can conclude there is a significant improvement in diagnostic accuracy associated with the use of Logicon Caries Detector. In view of the findings of this study, it is reasonable to conclude that the improvement in accuracy is due entirely to the improvement in sensitivity.
| DISCUSSION |
|---|
|
|
|---|
The performance of the dentists participating in the clinical study described in this article demonstrates that Logicon Caries Detector can help dentists find 20 percent more cases of caries penetrating into the dentin without causing them to misdiagnose additional healthy teeth. This improvement was found by 18 dentists who treated 175 surfaces with difficult-to-see caries problems (the obvious cases of dentin penetration were not included in the study). We found the results to be statistically significant using standard statistical tests. It would be of interest to collect additional clinical data with other sensors. Since the software analyzes shades of gray, there is no reason to believe that its performance would be different, but we would like to verify that. We also would like to apply the techniques used in this study to other caries problems, such as recurrent caries under existing restorations.
It is important to note that this improvement in caries detection was found in a clinical environment where dentists made decisions to treat or not treat and actually performed the treatment when appropriate. A recently published laboratory study involving use of Logicon Caries Detector concluded that the product did not improve the observers ability to detect caries.30 However, that study did not involve practicing dentists treating patients in a clinical setting. Thus, those testers received no feedback on how to use the tool. Another recent laboratory study found significant improvement using Logicon Caries Detector over visual diagnoses alone (by a factor of three), although the sensitivity of Logicon Caries Detector was below what is reported here (A.G. Farman, Ph.D., D.Sc., and B.C. Kang, D.D.S., Ph.D., University of Louisville, School of Dentistry, personal communication, March 2001).
| CONCLUSION |
|---|
|
|
|---|
| FOOTNOTES |
|---|
| REFERENCES |
|---|
|
|
|---|
This article has been cited by other articles:
![]() |
E. T. Parks Digital Radiographic Imaging: Is the Dental Practice Ready? J Am Dent Assoc, April 1, 2008; 139(4): 477 - 481. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. SPALLEK A resource guide for practice development through technology J Am Dent Assoc, October 1, 2004; 135(suppl_1): 38S - 44S. [Full Text] [PDF] |
||||
| ||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS |