|
|||||
|
|
||||||
© 1999 American Society for Clinical Oncology
Use of Hematopoietic Colony-Stimulating Factors: Comparison of the 1994 and 1997 American Society of Clinical Oncology Surveys Regarding ASCO Clinical Practice GuidelinesFrom the Health Services Research Committee, American Society of Clinical Oncology, Alexandria, VA. Address reprint requests to Thomas J. Smith, MD, Massey Cancer Center, Virginia Commonwealth University, 401 College Street, Richmond, VA 23290-0037; email tsmith{at}gems.vcu.edu ABSTRACT PURPOSE: The American Society of Clinical Oncology (ASCO) Health Services Research Committee sought to assess whether more appropriate patterns of colony-stimulating factor (CSF) use occurred after the publication of ASCO evidence-based practice guidelines in 1994 and 1996 for patients with solid tumors or lymphoma. METHODS: In 1994 and 1997, questionnaires describing clinical scenarios were mailed to ASCO members who practiced medical oncology. Physicians were asked the extent to which they preferred to use a CSF for primary prophylaxis, secondary prophylaxis, or treatment of neutropenic complications. Multiple regression analyses were used to determine predictors of overall propensity to use CSFs and, when using a CSF, propensity to support longer schedules of CSF use.
RESULTS: Decreased use of CSFs was shown in the following situations: (1) treatment for febrile neutropenia without localizing signs (39% in 1994 v 29% in 1997) or with a right lower lobe infiltrate (54% v 46%); (2) primary prophylaxis with paclitaxel for ovarian cancer (20% v 11%) or cyclophosphamide, doxorubicin, and vincristine chemotherapy for small-cell lung cancer (8.4% v 4.6%); and (3) secondary prophylaxis after afebrile neutropenia following chemotherapy for germ cell tumors (44.5% v 36.0%). One third fewer physicians supported the extended use of CSFs until an absolute neutrophil count CONCLUSION: Decreased use and more appropriate use of CSFs in accordance with ASCO guideline recommendations occurred from 1994 to 1997, but there remain many opportunities to reduce CSF use with no clinical harm. Many oncologists continue to support the use of CSFs in scenarios and with scheduling criteria that the guidelines and evidence do not support. ASCO's evidence-based guidelines should be linked with formal continuous quality improvement initiatives to substantially improve the quality of supportive oncology care. The hematopoietic colony stimulating factors (CSFs), granulocyte colony-stimulating factor (G-CSF) and granulocyte-macrophage colony stimulating factor (GM-CSF), decrease the likelihood of neutropenic complications that result from chemotherapy, but their high cost and limited clinical influence led to concern about their appropriate use. In 1994, the American Society of Clinical Oncology (ASCO) surveyed physicians regarding their preferences about the use of CSFs and shortly thereafter published evidence-based, clinical practice guidelines for the use of CSFs.1 Updated guidelines published in 1996 did not include any change in recommendations for the use of CSFs for patients who receive standard doses of chemotherapy.2 The guidelines supported CSF use for only a limited number of clinical situations, including primary prophylaxis of febrile neutropenia (CSF given after the completion of the chemotherapy cycle and before neutropenia is documented) when the expected incidence is greater than 40%; secondary prophylaxis (CSF given in later cycles after febrile neutropenia in a prior cycle has been documented) to maintain dose intensity when dose reduction is not appropriate; and as treatment (CSF given at the time of diagnosis of afebrile or febrile neutropenia) with antibiotics only for patients at high risk of septic complications. The 1994 survey of ASCO physicians performed before the publication of the initial CSF guidelines found that the majority of physicians supported patterns of use that were similar to those recommended in the subsequently published ASCO guidelines.3 However, overuse of CSFs appeared to be a problem in some situations. For example, more than half of the physicians chose to use CSFs in the treatment of uncomplicated febrile neutropenia, a condition for which CSF use was not supported by the evidence presented in the ASCO guidelines. The survey responses also showed some large variations, with physicians at academic medical centers and in health maintenance organization (HMO) practices more likely to prefer dose-reduction strategies, whereas fee-for-service physicians preferred the addition of CSFs. In 1997, the ASCO Health Services Committee surveyed random ASCO members to assess changes in patterns of CSF use that occurred after the publication of the ASCO guidelines. METHODS A random sample of 1,500 US physicians was selected from the ASCO membership list. Because physician identity was not included in the survey reply forms, it is not possible to know whether any physician participated in both surveys. The same firm that performed the earlier ASCO survey conducted the 1997 survey. Surveys were mailed to the members in early 1997. Subjects who failed to respond to the first mailing were sent a second mailing. Those who did not respond to either mailing were telephoned as a reminder; up to seven attempts were made to reach physicians. Subjects who described themselves as radiation or surgical oncologists were considered ineligible and were excluded from the calculation of the response rate and the analysis. The survey instructed potential respondents who spent fewer than 5 hours per week in clinical practice to return the questionnaire unanswered.
Survey
Statistical Methods To characterize an overall propensity to prescribe CSFs for all respondents across all survey items, Likert-scale CSF use-rate categories were assigned to responses for each of the multiple-choice survey items. A one-to-five coding of responses (never, rarely, sometimes, mostly, and always) was performed on the basis of each respondent's willingness to indicate CSF use for each scenario. Cronbach's alpha coefficient was computed to test the internal consistency of the scale items. The simple ordered utilization score was computed across all scenarios. Higher utilization scores indicated a tendency to be a higher CSF user, whereas lower utilization scores indicated a tendency to be a low user. Mean differences in overall utilization propensity scores between 1994 and 1997 were compared by use of the t test.
In addition, a multivariate regression model was used to predict overall utilization propensity, and for conditions in which CSF use would be preferred, a second (logistic) regression model was used to predict propensity to use longer schedules of CSFs (defined as the use of CSFs for more than 10 days or a CSF treatmentcessation criterion of an absolute neutrophil count (ANC) of RESULTS Demographic and practice characteristics of ASCO respondents for the 1994 and 1997 surveys are listed in Table 1. The response rate of 49.4% for the 1994 survey increased to 60.2% for the 1997 survey. The distribution of practice settings of the respondents was similar for the two surveys, with over half of the respondents in fee-for-service settings, approximately one third in academic practices, and between 10% and 15% in HMO practices (Table 1). The distribution of the year of graduation was also similar, with 22% of the respondents in both surveys having graduated before 1970. Less than one quarter of the respondents in both surveys worked with formal CSF guidelines or in practice settings where guidelines were perceived to influence practice. The 1997 respondents were more likely to provide care for more than five new cancer patients per week (68.0% for the 1997 survey respondents v 62.2% for the 1994 respondents; P < .04) and were more likely to have a specialty of hematology/oncology (56.3% v 47.0%; P = .002). CSFs were used in fewer than five patients per week by three quarters of the physicians in both surveys.
Physicians who responded in 1997 had a lower propensity to use CSFs than did those from 1994 (P < 0.001). Those in a fee-for-service setting (P < .001) and those who graduated from medical school before 1970 (P = .004) had a higher propensity to use CSFs. Factors associated with a lower propensity to use long schedules of CSFs included 1997 response (P > .001), not having CSF use or practice guidelines in the practice setting (P = .04), and being in an academic or HMO practice (P = .05).
General Patterns of Use
The ASCO guidelines offered no recommendation regarding the comparative clinical activity of G-CSF and GM-CSF. Although G-CSF was preferred to GM-CSF by over 80% of respondents in both surveys, support for GM-CSF over G-CSF increased from 1.7% in 1994 to 4.0% in 1997 (P = .05). Reimbursement considerations were less important in 1997. Only 20.9% of respondents indicated that choice of a particular CSF was dependent on prior experiences with denial of reimbursement (decreased from 27.8% in 1994; P < .005), and only 23.9% reported that their decisions about whether to use CSFs at all were influenced by anticipated denial of reimbursement (decreased from 34.7% in 1994; P < .005).
Primary Prophylaxis
Secondary Prophylaxis
There was even more support for CSF use for secondary prophylaxis of febrile neutropenia, especially for patients with curable diseases, with no statistically significant differences between 1994 and 1997. In the cycle after an episode of febrile neutropenia, 88.8% and 80.4% of respondents (1994 and 1997, respectively) would add a CSF to the same dose of chemotherapy in early and late cycles of cyclophosphamide, doxorubicin, vincristine, and prednisone treatment for non-Hodgkin's lymphoma (Table 4). Fifty-three percent of respondents would use a CSF to maintain doses of chemotherapy, and 14.0% would use a CSF in conjunction with a dose reduction for secondary prophylaxis in palliative chemotherapy for small-cell lung cancer. It is difficult to determine whether such uses of CSFs adhere to the guideline because the guideline did not clearly recommend either dose reduction or use of CSFs. However, the high rates of use do not seem consistent with the intent of the recommendation because no clinical benefit has been found from the small increase in dose intensity possible with CSFs.4,5
Treatment of Neutropenia
The rate of using a CSF for treatment of uncomplicated febrile neutropenia "always, usually, or sometimes" was even higher at 60.5% but had declined from 73.4% in 1994 (P < .05). This change is in the direction supported by the guidelines, which stated that ". . . for the majority of patients with febrile neutropenia, the available data do not clearly support the routine initiation of CSFs. . . ." The guidelines indicated that this use "may be reasonable in patients with prognostic factors that are predictive of clinical deterioration such as pneumonia, hypotension, multiorgan dysfunction . . . or fungal infection." The proportion of survey respondents who reported that they would use a CSF in the scenario that described a patient with febrile neutropenia and a right lower lobe infiltrate "always, usually, or sometimes" was 79.9%, a decrease from 84.4% in 1994 (P < .05).
Utilization Scores by Practice Setting DISCUSSION The main objective of evidence-based guidelines is to reduce the inappropriate use of scarce medical resources while providing support for appropriate use.6 On the basis of results from surveys conducted before and after the dissemination of ASCO CSF guidelines, we found evidence for both decreased use and more appropriate use of CSFs since the publication of the guidelines. In particular, the survey results indicated that there was a significant decrease in support for the use of CSFs in the 11 clinical settings that encompassed primary prophylaxis (four scenarios), secondary prophylaxis (four scenarios), and treatment of febrile neutropenia (three scenarios). There was also a small but significant decrease in support for the use of CSFs in primary prophylaxis with a regimen with a less than 40% rate of febrile neutropenia, secondary prophylaxis after afebrile neutropenia, and therapy for febrile neutropeniasettings in which CSF use was not recommended by ASCO guidelines. Finally, there was a 15% decrease in the odds of physicians supporting longer CSF schedules, including a routine use of 10 days of CSF treatment or use of a CSF treatmentcessation criterion of 10,000 WBCs/mm3 or an ANC of 10,000/mm3, changes that were supported by the ASCO guidelines. Although these improvements are heartening, a substantial number of oncologists would use CSFs in scenarios in which the ASCO guidelines do not recommend such use. Important examples include primary prophylaxis after moderate-intensity chemotherapy regimens, when 6% to 16% of respondents would use CSFs; secondary prophylaxis for patients at low risk for febrile neutropenia or those for whom dose reduction would give equivalent results, chosen by 50% to 80% of respondents; and treatment of afebrile and febrile neutropenia, for which 30% and 60.5% of respondents would use CSFs. Type of practice setting was the only factor significantly associated with variations in propensity to use CSFs as well as support for long CSF schedule regimens. Physicians who practiced in a fee-for-service setting were more likely to be users of CSFs and, when using a CSF, more likely to support long CSF schedule criteria than were those who practiced in academic or HMO settings. Whether this is due to differences in knowledge of the guidelines, clinical trial evidence, or some other factor is not known. However, our finding that having a CSF guideline in the practice setting was a significant predictor of shorter and more appropriate CSF schedule criteria suggests that guidelines may play some role in these improvements. The limitations of the ASCO CSF surveys are important. First, data on actual practice patterns are needed, because what physicians say they do and what they actually do may be different.7 Second, the survey involved only 11 scenarios, whereas the actual clinical situations in which CSFs could be used are much more numerous. However, the scenarios were written to specifically address situations covered by the guidelines and represented common patient problems. Third, the results are from a sample of only 672 oncologists and may not be representative of the entire oncology community. Our high response rate and the similarity of the demographic characteristics of the respondents to those for the entire ASCO membership make this unlikely. Finally, the modest improvements in CSF use between 1994 and 1997 are likely to be attributable to several factors, including increased physician experience with the agents, publicized evidence, education programs, and insurance denial. Without a randomized trial of guidelines versus no guidelines in a single practice setting, it would be impossible to attribute improvements in CSF use solely to the guidelines. The results from this survey provide reassurance that CSF use has modestly decreased in accordance with ASCO recommendations after the publication of the CSF guidelines and, for the most part, remains appropriate. The continued support for CSF use in cases of febrile and afebrile neutropenia for which data show no significant benefit,8,9 and high use of CSFs in situations in which no clinical benefit has been shown regarding mild increases in dose intensity4,5 suggest areas for improvement. The survey also indicates that financial considerations continue to be an important factor in determining the use of CSFs; fee-for-service physicians were significantly more likely to be high users of CSFs in 1994 and in 1997. Because no major improvement in disease or patient outcomes with standard chemotherapy regimens have been documented with the use of CSFs to date, more restricted use of these agents could result in equivalent outcomes at lower cost. Why were ASCO guidelines not more effective in reducing the inappropriate use of CSFs? Guidelines clearly work to reduce practice variations, standardize care, and improve outcomes,10,11 but changing practices can be difficult.12 Successful guidelines include at least some of the following attributes: a strong basis in clinical evidence13 and practicality,14 local development and support,15 widespread dissemination,16 ease of access,17,18 and linkage to accountability by audit of performance10 or reimbursement.19 ASCO's Health Service Research Committee has clearly demonstrated its ability to create evidence-based guidelines. The optimal strategy for the dissemination and implementation of the guidelines, determination of accountability for adherence to them, and determination of whether ASCO members or physicians at local practice sites should perform these tasks has not been determined.
ACKNOWLEDGMENTS Supported by an unrestricted grant from the American Society of Clinical Oncology NOTES Presented as an oral presentation at the Thirty-Fourth Annual Meeting of the American Society of Clinical Oncology, Los Angeles, CA, May 16-19, 1998. REFERENCES
1.
American Society of Clinical Oncology. American Society of Clinical Oncology recommendations for the use of hematopoietic colony stimulating factors: Evidence based clinical practice guidelines. J Clin Oncol12:2471-2508, 1994
2.
American Society of Clinical Oncology. Update of recommendations for the use of hematopoietic colony stimulating factors: Evidence-based clinical practice guidelines. J Clin Oncol14:1957-1960, 1996 3. Bennett C, Smith T, Weeks J, et al: Use of hematopoietic colony stimulating factors: The American Society of Clinical Oncology survey. J Clin Oncol14:2511-2520, 1996[Abstract] 4. Savarese DM, Hsieh C, Stewart FM: Clinical impact of chemotherapy dose escalation in patients with hematologic malignancies and solid tumors. J Clin Oncol15:2981-2995, 1997[Abstract]
5.
Phillips KA, Tannock IF: Design and interpretation of clinical trials that evaluate agents that may offer protection from the toxic effects of cancer chemotherapy. J Clin Oncol16:3179-3190, 1998
6.
Chassin MR: Improving the quality of care. N Engl J Med335:1060-1063, 1996 7. Lomas J, Anderson GM, Domnick-Pierre K, et al: Do practice guidelines change practice? The effect of consensus statement on the practice of physicians. N Engl J Med321:1306-1311, 1989[Abstract]
8.
Maher DW, Lieschke GJ, Green M, et al: Filgrastim in patients with chemotherapy-induced febrile neutropenia: A double-blind, placebo-controlled trial. Ann Intern Med121:492-501, 1994
9.
Hartmann LC, Tschetter LK, Habermann TM, et al: Granulocyte colony-stimulating factor in severe chemotherapy-induced afebrile neutropenia. N Engl J Med336:1776-1780, 1998 10. Grimshaw JM, Russell IT: Effect of clinical guidelines onmedical practice: A systematic review of rigorous evaluations. Lancet342:1317-1322, 1993[Medline] 11. Winn RJ: The role of oncology clinical practice guidelines in the managed care era. Oncology9:177-183, 1995 (suppl)[Medline] 12. Grol R. Beliefs and evidence in changing clinical practice. BMJ 315:418-421, 1997
13.
Cook DJ, Greengold NL, Ellrodt AG, et al: The relation between systematic reviews and practice guidelines. Ann Intern Med127:210-216, 1997 14. Grilli R, Lomas J: Evaluating the message: The relationship between compliance rate and the subject of a practice guideline. Med Care32:202-213, 1994[Medline] 15. Katterhagen G: Physician compliance with outcome-based guidelines and clinical pathways in oncology. Oncology (Huntingt)10:113-121, 1996 (suppl)[Medline] 16. Browman GP, Newman TE, Mohide EA, et al: Progress of clinical oncology guidelines development using the practice guidelines development cycles: The role of practitioner feedback. J Clin Oncol16:1226-1231, 1998[Abstract] 17. Ray-Coquard I, Philip T, De Laroche G, et al: Impact of a clinical guidelines program on medical practice in a French cancer network. Proc Am Soc Clin Oncol 17:421a, 1998 (abstr) 18. Ray-Coquard I, Philip T, Lehmann M, et al: Impact of a clinical guidelines program for breast and colon cancer in a French cancer center. JAMA278:1591-1595, 1997[Abstract] 19. Levine M, Browman G, Newman T, et al: The Ontario Cancer Treatment Practice Guidelines Initiative. Oncology (Huntingt)10:19-22, 1996 (suppl) [Medline] Submitted August 11, 1998; accepted July 7, 1999. This article has been cited by other articles:
|
||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
|
|||||||||||
|
Copyright © 1999 by the American Society of Clinical Oncology, Online ISSN: 1527-7755. Print ISSN: 0732-183X
|