Implementation of a software application in staging and grading of periodontitis cases

Objectives: The purpose of this study was to assess the diagnostic accuracy and the inter-rater agreement among general dentists when staging and grading periodontitis cases with the aid of a software application (SA) developed by the Italian Society of Periodontology and Implantology. Materials and methods: Ten general dentists were asked to independently assess 25 periodontitis cases using the SA. Accuracy was estimated using quadratic weighted kappa and examiners' percentage of agreement with a reference diagnosis provided by a gold standard examiner. Inter-rater agreement was evaluated using Fleiss kappa statistics. Results: The overall case definition agreed with the reference diagnosis in 53.6% of cases. The agreements for each general dentist's pairwise comparisons against the reference definition were at least substantial in 100% of cases for stage, in 70% of cases for grade and in none of the cases for extent. Fleiss kappa was 0.818, 0.608, and 0.632 for stage, extent, and grade, respectively. The study recognized possible reasons that could lead to decreased accuracy using the SA. Conclusions: Supported by the SA, general dentists have reached substantial inter-rater agreement and highly accurate assignments of stage and grade. However, complete case definitions were correctly diagnosed in slightly over half of the cases.