Assessing the need to update prevention guidelines: a comparison of two methods

Abstract

Background. An important concern for developers of clinical practice guidelines is how best to determine when guidelines require updating to ensure they remain current and evidence based. Because of the high costs associated with updating guidelines, recent attention has focused on approaches that can reliably assess the extent of updating required. Recently, Shekelle and colleagues proposed a model of limited literature searches with modest expert involvement as a way to reduce the cost and time requirements for assessing whether a guideline needs updating. Methods. The main objective of this study was to compare the Shekelle et al. assessment model (review approach) and a conventional process using typical systematic review methods (traditional approach) in terms of comprehensiveness and effort. We modeled the review approach on that by Shekelle and colleagues but refined it iteratively over three phases to achieve greater efficiency. Using both methods independently, we assessed the need to update six topics from the 1996 Guide to Clinical Preventive Services from the US Preventive Services Task Force. Main outcomes included completeness of study identification, importance of missed studies and the effort involved. Results. Although the review approach identified fewer eligible studies than the traditional approach, none of the studies missed was rated as important by task force members acting as liaisons to the project with respect to whether the topic required an update. On average, the review approach produced substantially fewer citations to review than the traditional approach. The effort involved and potential time saving depended largely on the scope of the topic. Conclusions. The revised review approach provides an efficient and acceptable method for judging whether a guideline requires updating.