Thomas V. Brogan, MD

Overutilization of resources is a significant, yet underappreciated, problem in medicine. Many interventions target underutilization (eg, immunizations) or misuse (eg, antibiotic prescribing for viral pharyngitis), yet overutilization remains as a significant contributor to healthcare waste.[1] In an effort to reduce waste, the Choosing Wisely campaign created a work group to highlight areas of overutilization, specifically noting both diagnostic tests and therapies for common pediatric conditions with no proven benefit and possible harm to the patient.[2] Respiratory illnesses have been a target of many quality‐improvement efforts, and pneumonia represents a common diagnosis in pediatrics.[3] The use of diagnostic testing for pneumonia is an area where care can be optimized and aligned with evidence.

Laboratory testing and diagnostic imaging are routinely used for the management of children with community‐acquired pneumonia (CAP). Several studies have documented substantial variability in the use of these resources for pneumonia management, with higher resource use associated with a higher chance of hospitalization after emergency department (ED) evaluation and a longer length of stay among those requiring hospitalization.[4, 5] This variation in diagnostic resource utilization has been attributed, at least in part, to a lack of consensus on the management of pneumonia. There is wide variability in diagnostic testing, and due to potential consequences for patients presenting with pneumonia, efforts to standardize care offer an opportunity to improve healthcare value.

In August 2011, the first national, evidence‐based consensus guidelines for the management of childhood CAP were published jointly by the Pediatric Infectious Diseases Society (PIDS) and the Infectious Diseases Society of America (IDSA).[6] A primary focus of these guidelines was the recommendation for the use of narrow spectrum antibiotics for the management of uncomplicated pneumonia. Previous studies have assessed the impact of the publication of the PIDS/IDSA guidelines on empiric antibiotic selection for the management of pneumonia.[7, 8] In addition, the guidelines provided recommendations regarding diagnostic test utilization, in particular discouraging blood tests (eg, complete blood counts) and radiologic studies for nontoxic, fully immunized children treated as outpatients, as well as repeat testing for children hospitalized with CAP who are improving.

Although single centers have demonstrated changes in utilization patterns based on clinical practice guidelines,[9, 10, 11, 12] whether these guidelines have impacted diagnostic test utilization among US children with CAP in a larger scale remains unknown. Therefore, we sought to determine the impact of the PIDS/IDSA guidelines on the use of diagnostic testing among children with CAP using a national sample of US children's hospitals. Because the guidelines discourage repeat diagnostic testing in patients who are improving, we also evaluated the association between repeat diagnostic studies and severity of illness.

METHODS

This retrospective cohort study used data from the Pediatric Health Information System (PHIS) (Children's Hospital Association, Overland Park, KS). The PHIS database contains deidentified administrative data, detailing demographic, diagnostic, procedure, and billing data from 47 freestanding, tertiary care children's hospitals. This database accounts for approximately 20% of all annual pediatric hospitalizations in the United States. Data quality is ensured through a joint effort between the Children's Hospital Association and participating hospitals.

RESULTS

There were 275,288 hospital admissions meeting study inclusion criteria of 1 to 18 years of age with a diagnosis of pneumonia from 2008 to 2014. Of these, 54,749 met exclusion criteria (1874 had pleural drainage procedure on day 0 or 1, 51,306 had complex chronic conditions, 1569 were hospitalized with pneumonia in the last 30 days). Characteristics of the remaining 220,539 patients in the final sample are shown in Table 1. The median age was 4 years (IQR, 27 years); a majority of the children were male (53%) and had public insurance (58%). There were 128,855 patients in the preguideline period (January 1, 2008 to July 31, 2011) and 91,684 in the post guideline period (August 1, 2011June 30, 2014).

Discharged From the ED

Throughout the study, utilization of CBC, blood cultures, and CRP was <20%, whereas CXR use was >75%. In segmented regression analysis, CRP utilization was relatively stable before the guidelines publication. However, by the end of the study period, the projected estimate of CRP utilization without guidelines (expected) was 2.9% compared with 4.8% with the guidelines (observed) (P < 0.05) (Figure 1). A similar pattern of higher rates of diagnostic utilization after the guidelines compared with projected estimates without the guidelines was also seen in the ED utilization of CBC, blood cultures, and CXR (Figure 1); however, these trends did not achieve statistical significance. Table 2 provides specific values. Using a standard cost of $19.52 for CRP testing, annual costs across all hospitals increased $11,783 for ED evaluation of CAP.

Table 2.Utilization Rates Over Study Period

	Baseline (%)	Preguideline Trend	Level Change at Guideline	Change in Trend After Guideline	Estimates at End of Study*
					Without Guideline (%)	With Guideline (%)	P
NOTE: Abbreviations: CBC, complete blood count; CRP, C‐reactive protein; ED, emergency department; NS, not significant (P > 0.05). *Estimates are based on pre and post guideline trends.
ED‐only encounters
Blood culture	14.6	0.1	0.8	0.1	5.5	8.6	NS
CBC	19.2	0.1	0.4	0.1	10.7	14.0	NS
CRP	5.4	0.0	0.6	0.1	2.9	4.8	<0.05
Chest x‐ray	85.4	0.1	0.1	0.0	80.9	81.1	NS
Inpatient encounters
Blood culture	50.6	0.0	1.7	0.2	49.2	41.4	<0.05
Repeat blood culture	6.5	0.0	1.0	0.1	8.9	5.8	NS
CBC	65.2	0.0	3.1	0.0	65.0	62.2	NS
Repeat CBC	23.4	0.0	4.2	0.0	20.8	16.0	NS
CRP	25.7	0.0	1.1	0.0	23.8	23.5	NS
Repeat CRP	12.5	0.1	2.2	0.1	7.1	7.3	NS
Chest x‐ray	89.4	0.1	0.7	0.0	85.4	83.9	NS
Repeat chest x‐ray	25.5	0.0	2.0	0.1	24.1	17.7	<0.05

Figure 1

Inpatient Encounters

In the segmented regression analysis of children hospitalized with CAP, guideline publication was associated with changes in the monthly use of some diagnostic tests. For example, by the end of the study period, the use of blood culture was 41.4% (observed), whereas the projected estimated use in the absence of the guidelines was 49.2% (expected) (P < 0.05) (Figure 2). Table 2 includes the data for the other tests, CBC, CRP, and CXR, in which similar patterns are noted with lower utilization rates after the guidelines, compared with expected utilization rates without the guidelines; however, these trends did not achieve statistical significance. Evaluating the utilization of repeat testing for inpatients, only repeat CXR achieved statistical significance (P < 0.05), with utilization rates of 17.7% with the guidelines (actual) compared with 24.1% without the guidelines (predicted).

Figure 2

To better understand the use of repeat testing, a comparison of severity outcomesLOS, ICU transfer, and pleural drainage procedureswas performed between patients with no repeat testing (70%) and patients with 1 or more repeat tests (30%). Patients with repeat testing had longer LOS (no repeat testing LOS 1 [IQR, 12]) versus 1 repeat test LOS 3 ([IQR, 24] vs 2+ repeat tests LOS 5 [IQR, 38]), higher rate of ICU transfer (no repeat testing 4.6% vs 1 repeat test 14.6% vs 2+ repeat test 35.6%), and higher rate of pleural drainage (no repeat testing 0% vs 1 repeat test 0.1% vs 2+ repeat test 5.9%] (all P < 0.001).

Using standard costs of $37.57 for blood cultures and $73.28 for CXR, annual costs for children with CAP across all hospitals decreased by $91,512 due to decreased utilization of blood cultures, and by $146,840 due to decreased utilization of CXR.

Hospital‐Level Variation in the Impact of the National Guideline

Figure 3 is a visual representation (heat map) of the impact of the guidelines at the hospital level at the end of the study from the individual interrupted time series. Based on this heat map (Figure 3), there was wide variability between hospitals in the impact of the guideline on each test in different settings (ED or inpatient). By diagnostic testing, 7 hospitals significantly decreased utilization of blood cultures for inpatients, and 5 hospitals significantly decreased utilization for repeat blood cultures and repeat CXR. Correlation between the number of positive improvements at a hospital and region (P = 0.974), number of CAP cases (P = 0.731), or percentage of public insurance (P = 0.241) were all nonsignificant.

Figure 3

DISCUSSION

This study complements previous assessments by evaluating the impact of the 2011 IDSA/PIDS consensus guidelines on the management of children with CAP cared for at US children's hospitals. Prior studies have shown increased use of narrow‐spectrum antibiotics for children with CAP after the publication of these guidelines.[7] The current study focused on diagnostic testing for CAP before and after the publication of the 2011 guidelines. In the ED setting, use of some diagnostic tests (blood culture, CBC, CXR, CRP) was declining prior to guideline publication, but appeared to plateau and/or increase after 2011. Among children admitted with CAP, use of diagnostic testing was relatively stable prior to 2011, and use of these tests (blood culture, CBC, CXR, CRP) declined after guideline publication. Overall, changes in diagnostic resource utilization 3 years after publication were modest, with few changes achieving statistical significance. There was a large variability in the impact of guidelines on test use between hospitals.

For outpatients, including those managed in the ED, the PIDS/IDSA guidelines recommend limited laboratory testing in nontoxic, fully immunized patients. The guidelines discourage the use of diagnostic testing among outpatients because of their low yield (eg, blood culture), and because test results may not impact management (eg, CBC).[6] In the years prior to guideline publication, there was already a declining trend in testing rates, including blood cultures, CBC, and CRP, for patients in the ED. After guideline publication, the rate of blood cultures, CBC, and CRP increased, but only the increase in CRP utilization achieved statistical significance. We would not expect utilization for common diagnostic tests (eg, CBC for outpatients with CAP) to be at or close to 0% because of the complexity of clinical decision making regarding admission that factors in aspects of patient history, exam findings, and underlying risk.[15] ED utilization of blood cultures was <10%, CBC <15%, and CRP <5% after guideline publication, which may represent the lowest testing limit that could be achieved.

CXRs obtained in the ED did not decrease over the entire study period. The rates of CXR use (close to 80%) seen in our study are similar to prior ED studies.[5, 16] Management of children with CAP in the ED might be different than outpatient primary care management because (1) unlike primary care providers, ED providers do not have an established relationship with their patients and do not have the opportunity for follow‐up and serial exams, making them less likely to tolerate diagnostic uncertainty; and (2) ED providers may see sicker patients. However, use of CXR in the ED does represent an opportunity for further study to understand if decreased utilization is feasible without adversely impacting clinical outcomes.

The CAP guidelines provide a strong recommendation to obtain blood culture in moderate to severe pneumonia. Despite this, blood culture utilization declined after guideline publication. Less than 10% of children hospitalized with uncomplicated CAP have positive blood cultures, which calls into question the utility of blood cultures for all admitted patients.[17, 18, 19] The recent EPIC (Epidemiology of Pneumonia in the Community) study showed that a majority of children hospitalized with pneumonia do not have growth of bacteria in culture, but there may be a role for blood cultures in patients with a strong suspicion of complicated CAP or in the patient with moderate to severe disease.[20] In addition to blood cultures, the guidelines also recommend CBC and CXR in moderate to severely ill children. This observed decline in testing in CBC and CXR may be related to individual physician assessments of which patients are moderately to severely ill, as the guidelines do not recommend testing for children with less severe disease. Our exclusion of patients requiring intensive care management or pleural drainage on admission might have selected children with a milder course of illness, although still requiring admission.

The guidelines discourage repeat diagnostic testing among children hospitalized with CAP who are improving. In this study, repeat CXR and CBC occurred in approximately 20% of patients, but repeat blood culture and CRP was much lower. As with initial diagnostic testing for inpatients with CAP, the rates of some repeat testing decreased with the guidelines. However, those with repeat testing had longer LOS and were more likely to require ICU transfer or a pleural drainage procedure compared to children without repeat testing. This suggests that repeat testing is used more often in children with a severe presentation or a worsening clinical course, and not done routinely on hospitalized patients.

The financial impact of decreased testing is modest, because the tests themselves are relatively inexpensive. However, the lack of substantial cost savings should not preclude efforts to continue to improve adherence to the guidelines. Not only is increased testing associated with higher hospitalization rates,[5] potentially yielding higher costs and family stress, increased testing may also lead to patient discomfort and possibly increased radiation exposure through chest radiography.

Many of the diagnostic testing recommendations in the CAP guidelines are based on weak evidence, which may contribute to the lack of substantial adoption. Nevertheless, adherence to guideline recommendations requires sustained effort on the part of individual physicians that should be encouraged through institutional support.[21] Continuous education and clinical decision support, as well as reminders in the electronic medical record, would make guideline recommendations more visible and may help overcome the inertia of previous practice.[15] The hospital‐level heat map (Figure 3) included in this study demonstrates that the impact of the guidelines was variable across sites. Although a few sites had decreased diagnostic testing in many areas with no increased testing in any category, there were several sites that had no improvement in any diagnostic testing category. In addition, hospital‐level factors like size, geography, and insurance status were not associated with number of improvements. To better understand drivers of change at individual hospitals, future studies should evaluate specific strategies utilized by the rapid guideline adopters.

This study is subject to several limitations. The use of ICD‐9 codes to identify patients with CAP may not capture all patients with this diagnosis; however, these codes have been previously validated.[13] Additionally, because patients were identified using ICD‐9 coding assigned at the time of discharge, testing performed in the ED setting may not reflect care for a child with known pneumonia, but rather may reflect testing for a child with fever or other signs of infection. PHIS collects data from freestanding children's hospitals, which care for a majority of children with CAP in the US, but our findings may not be generalizable to other hospitals. In addition, we did not examine drivers of trends within individual institutions. We did not have detailed information to examine whether the PHIS hospitals in our study had actively worked to adopt the CAP guidelines. We were also unable to assess physician's familiarity with guidelines or the level of disagreement with the recommendations. Furthermore, the PHIS database does not permit detailed correlation of diagnostic testing with clinical parameters. In contrast to the diagnostic testing evaluated in this study, which is primarily discouraged by the IDSA/PIDS guidelines, respiratory viral testing for children with CAP is recommended but could not be evaluated, as data on such testing are not readily available in PHIS.

CONCLUSION

Publication of the IDSA/PIDS evidence‐based guidelines for the management of CAP was associated with modest, variable changes in use of diagnostic testing. Further adoption of the CAP guidelines should reduce variation in care and decrease unnecessary resource utilization in the management of CAP. Our study demonstrates that efforts to promote decreased resource utilization should target specific situations (eg, repeat testing for inpatients who are improving). Adherence to guidelines may be improved by the adoption of local practices that integrate and improve daily workflow, like order sets and clinical decision support tools.

Disclosure: Nothing to report.

Overutilization of resources is a significant, yet underappreciated, problem in medicine. Many interventions target underutilization (eg, immunizations) or misuse (eg, antibiotic prescribing for viral pharyngitis), yet overutilization remains as a significant contributor to healthcare waste.[1] In an effort to reduce waste, the Choosing Wisely campaign created a work group to highlight areas of overutilization, specifically noting both diagnostic tests and therapies for common pediatric conditions with no proven benefit and possible harm to the patient.[2] Respiratory illnesses have been a target of many quality‐improvement efforts, and pneumonia represents a common diagnosis in pediatrics.[3] The use of diagnostic testing for pneumonia is an area where care can be optimized and aligned with evidence.

Laboratory testing and diagnostic imaging are routinely used for the management of children with community‐acquired pneumonia (CAP). Several studies have documented substantial variability in the use of these resources for pneumonia management, with higher resource use associated with a higher chance of hospitalization after emergency department (ED) evaluation and a longer length of stay among those requiring hospitalization.[4, 5] This variation in diagnostic resource utilization has been attributed, at least in part, to a lack of consensus on the management of pneumonia. There is wide variability in diagnostic testing, and due to potential consequences for patients presenting with pneumonia, efforts to standardize care offer an opportunity to improve healthcare value.

In August 2011, the first national, evidence‐based consensus guidelines for the management of childhood CAP were published jointly by the Pediatric Infectious Diseases Society (PIDS) and the Infectious Diseases Society of America (IDSA).[6] A primary focus of these guidelines was the recommendation for the use of narrow spectrum antibiotics for the management of uncomplicated pneumonia. Previous studies have assessed the impact of the publication of the PIDS/IDSA guidelines on empiric antibiotic selection for the management of pneumonia.[7, 8] In addition, the guidelines provided recommendations regarding diagnostic test utilization, in particular discouraging blood tests (eg, complete blood counts) and radiologic studies for nontoxic, fully immunized children treated as outpatients, as well as repeat testing for children hospitalized with CAP who are improving.

Although single centers have demonstrated changes in utilization patterns based on clinical practice guidelines,[9, 10, 11, 12] whether these guidelines have impacted diagnostic test utilization among US children with CAP in a larger scale remains unknown. Therefore, we sought to determine the impact of the PIDS/IDSA guidelines on the use of diagnostic testing among children with CAP using a national sample of US children's hospitals. Because the guidelines discourage repeat diagnostic testing in patients who are improving, we also evaluated the association between repeat diagnostic studies and severity of illness.

METHODS

This retrospective cohort study used data from the Pediatric Health Information System (PHIS) (Children's Hospital Association, Overland Park, KS). The PHIS database contains deidentified administrative data, detailing demographic, diagnostic, procedure, and billing data from 47 freestanding, tertiary care children's hospitals. This database accounts for approximately 20% of all annual pediatric hospitalizations in the United States. Data quality is ensured through a joint effort between the Children's Hospital Association and participating hospitals.

RESULTS

There were 275,288 hospital admissions meeting study inclusion criteria of 1 to 18 years of age with a diagnosis of pneumonia from 2008 to 2014. Of these, 54,749 met exclusion criteria (1874 had pleural drainage procedure on day 0 or 1, 51,306 had complex chronic conditions, 1569 were hospitalized with pneumonia in the last 30 days). Characteristics of the remaining 220,539 patients in the final sample are shown in Table 1. The median age was 4 years (IQR, 27 years); a majority of the children were male (53%) and had public insurance (58%). There were 128,855 patients in the preguideline period (January 1, 2008 to July 31, 2011) and 91,684 in the post guideline period (August 1, 2011June 30, 2014).

Discharged From the ED

Throughout the study, utilization of CBC, blood cultures, and CRP was <20%, whereas CXR use was >75%. In segmented regression analysis, CRP utilization was relatively stable before the guidelines publication. However, by the end of the study period, the projected estimate of CRP utilization without guidelines (expected) was 2.9% compared with 4.8% with the guidelines (observed) (P < 0.05) (Figure 1). A similar pattern of higher rates of diagnostic utilization after the guidelines compared with projected estimates without the guidelines was also seen in the ED utilization of CBC, blood cultures, and CXR (Figure 1); however, these trends did not achieve statistical significance. Table 2 provides specific values. Using a standard cost of $19.52 for CRP testing, annual costs across all hospitals increased $11,783 for ED evaluation of CAP.

Table 2.Utilization Rates Over Study Period

	Baseline (%)	Preguideline Trend	Level Change at Guideline	Change in Trend After Guideline	Estimates at End of Study*
					Without Guideline (%)	With Guideline (%)	P
NOTE: Abbreviations: CBC, complete blood count; CRP, C‐reactive protein; ED, emergency department; NS, not significant (P > 0.05). *Estimates are based on pre and post guideline trends.
ED‐only encounters
Blood culture	14.6	0.1	0.8	0.1	5.5	8.6	NS
CBC	19.2	0.1	0.4	0.1	10.7	14.0	NS
CRP	5.4	0.0	0.6	0.1	2.9	4.8	<0.05
Chest x‐ray	85.4	0.1	0.1	0.0	80.9	81.1	NS
Inpatient encounters
Blood culture	50.6	0.0	1.7	0.2	49.2	41.4	<0.05
Repeat blood culture	6.5	0.0	1.0	0.1	8.9	5.8	NS
CBC	65.2	0.0	3.1	0.0	65.0	62.2	NS
Repeat CBC	23.4	0.0	4.2	0.0	20.8	16.0	NS
CRP	25.7	0.0	1.1	0.0	23.8	23.5	NS
Repeat CRP	12.5	0.1	2.2	0.1	7.1	7.3	NS
Chest x‐ray	89.4	0.1	0.7	0.0	85.4	83.9	NS
Repeat chest x‐ray	25.5	0.0	2.0	0.1	24.1	17.7	<0.05

Figure 1

Inpatient Encounters

In the segmented regression analysis of children hospitalized with CAP, guideline publication was associated with changes in the monthly use of some diagnostic tests. For example, by the end of the study period, the use of blood culture was 41.4% (observed), whereas the projected estimated use in the absence of the guidelines was 49.2% (expected) (P < 0.05) (Figure 2). Table 2 includes the data for the other tests, CBC, CRP, and CXR, in which similar patterns are noted with lower utilization rates after the guidelines, compared with expected utilization rates without the guidelines; however, these trends did not achieve statistical significance. Evaluating the utilization of repeat testing for inpatients, only repeat CXR achieved statistical significance (P < 0.05), with utilization rates of 17.7% with the guidelines (actual) compared with 24.1% without the guidelines (predicted).

Figure 2

To better understand the use of repeat testing, a comparison of severity outcomesLOS, ICU transfer, and pleural drainage procedureswas performed between patients with no repeat testing (70%) and patients with 1 or more repeat tests (30%). Patients with repeat testing had longer LOS (no repeat testing LOS 1 [IQR, 12]) versus 1 repeat test LOS 3 ([IQR, 24] vs 2+ repeat tests LOS 5 [IQR, 38]), higher rate of ICU transfer (no repeat testing 4.6% vs 1 repeat test 14.6% vs 2+ repeat test 35.6%), and higher rate of pleural drainage (no repeat testing 0% vs 1 repeat test 0.1% vs 2+ repeat test 5.9%] (all P < 0.001).

Using standard costs of $37.57 for blood cultures and $73.28 for CXR, annual costs for children with CAP across all hospitals decreased by $91,512 due to decreased utilization of blood cultures, and by $146,840 due to decreased utilization of CXR.

Hospital‐Level Variation in the Impact of the National Guideline

Figure 3 is a visual representation (heat map) of the impact of the guidelines at the hospital level at the end of the study from the individual interrupted time series. Based on this heat map (Figure 3), there was wide variability between hospitals in the impact of the guideline on each test in different settings (ED or inpatient). By diagnostic testing, 7 hospitals significantly decreased utilization of blood cultures for inpatients, and 5 hospitals significantly decreased utilization for repeat blood cultures and repeat CXR. Correlation between the number of positive improvements at a hospital and region (P = 0.974), number of CAP cases (P = 0.731), or percentage of public insurance (P = 0.241) were all nonsignificant.

Figure 3

DISCUSSION

This study complements previous assessments by evaluating the impact of the 2011 IDSA/PIDS consensus guidelines on the management of children with CAP cared for at US children's hospitals. Prior studies have shown increased use of narrow‐spectrum antibiotics for children with CAP after the publication of these guidelines.[7] The current study focused on diagnostic testing for CAP before and after the publication of the 2011 guidelines. In the ED setting, use of some diagnostic tests (blood culture, CBC, CXR, CRP) was declining prior to guideline publication, but appeared to plateau and/or increase after 2011. Among children admitted with CAP, use of diagnostic testing was relatively stable prior to 2011, and use of these tests (blood culture, CBC, CXR, CRP) declined after guideline publication. Overall, changes in diagnostic resource utilization 3 years after publication were modest, with few changes achieving statistical significance. There was a large variability in the impact of guidelines on test use between hospitals.

For outpatients, including those managed in the ED, the PIDS/IDSA guidelines recommend limited laboratory testing in nontoxic, fully immunized patients. The guidelines discourage the use of diagnostic testing among outpatients because of their low yield (eg, blood culture), and because test results may not impact management (eg, CBC).[6] In the years prior to guideline publication, there was already a declining trend in testing rates, including blood cultures, CBC, and CRP, for patients in the ED. After guideline publication, the rate of blood cultures, CBC, and CRP increased, but only the increase in CRP utilization achieved statistical significance. We would not expect utilization for common diagnostic tests (eg, CBC for outpatients with CAP) to be at or close to 0% because of the complexity of clinical decision making regarding admission that factors in aspects of patient history, exam findings, and underlying risk.[15] ED utilization of blood cultures was <10%, CBC <15%, and CRP <5% after guideline publication, which may represent the lowest testing limit that could be achieved.

CXRs obtained in the ED did not decrease over the entire study period. The rates of CXR use (close to 80%) seen in our study are similar to prior ED studies.[5, 16] Management of children with CAP in the ED might be different than outpatient primary care management because (1) unlike primary care providers, ED providers do not have an established relationship with their patients and do not have the opportunity for follow‐up and serial exams, making them less likely to tolerate diagnostic uncertainty; and (2) ED providers may see sicker patients. However, use of CXR in the ED does represent an opportunity for further study to understand if decreased utilization is feasible without adversely impacting clinical outcomes.

The CAP guidelines provide a strong recommendation to obtain blood culture in moderate to severe pneumonia. Despite this, blood culture utilization declined after guideline publication. Less than 10% of children hospitalized with uncomplicated CAP have positive blood cultures, which calls into question the utility of blood cultures for all admitted patients.[17, 18, 19] The recent EPIC (Epidemiology of Pneumonia in the Community) study showed that a majority of children hospitalized with pneumonia do not have growth of bacteria in culture, but there may be a role for blood cultures in patients with a strong suspicion of complicated CAP or in the patient with moderate to severe disease.[20] In addition to blood cultures, the guidelines also recommend CBC and CXR in moderate to severely ill children. This observed decline in testing in CBC and CXR may be related to individual physician assessments of which patients are moderately to severely ill, as the guidelines do not recommend testing for children with less severe disease. Our exclusion of patients requiring intensive care management or pleural drainage on admission might have selected children with a milder course of illness, although still requiring admission.

The guidelines discourage repeat diagnostic testing among children hospitalized with CAP who are improving. In this study, repeat CXR and CBC occurred in approximately 20% of patients, but repeat blood culture and CRP was much lower. As with initial diagnostic testing for inpatients with CAP, the rates of some repeat testing decreased with the guidelines. However, those with repeat testing had longer LOS and were more likely to require ICU transfer or a pleural drainage procedure compared to children without repeat testing. This suggests that repeat testing is used more often in children with a severe presentation or a worsening clinical course, and not done routinely on hospitalized patients.

The financial impact of decreased testing is modest, because the tests themselves are relatively inexpensive. However, the lack of substantial cost savings should not preclude efforts to continue to improve adherence to the guidelines. Not only is increased testing associated with higher hospitalization rates,[5] potentially yielding higher costs and family stress, increased testing may also lead to patient discomfort and possibly increased radiation exposure through chest radiography.

Many of the diagnostic testing recommendations in the CAP guidelines are based on weak evidence, which may contribute to the lack of substantial adoption. Nevertheless, adherence to guideline recommendations requires sustained effort on the part of individual physicians that should be encouraged through institutional support.[21] Continuous education and clinical decision support, as well as reminders in the electronic medical record, would make guideline recommendations more visible and may help overcome the inertia of previous practice.[15] The hospital‐level heat map (Figure 3) included in this study demonstrates that the impact of the guidelines was variable across sites. Although a few sites had decreased diagnostic testing in many areas with no increased testing in any category, there were several sites that had no improvement in any diagnostic testing category. In addition, hospital‐level factors like size, geography, and insurance status were not associated with number of improvements. To better understand drivers of change at individual hospitals, future studies should evaluate specific strategies utilized by the rapid guideline adopters.

This study is subject to several limitations. The use of ICD‐9 codes to identify patients with CAP may not capture all patients with this diagnosis; however, these codes have been previously validated.[13] Additionally, because patients were identified using ICD‐9 coding assigned at the time of discharge, testing performed in the ED setting may not reflect care for a child with known pneumonia, but rather may reflect testing for a child with fever or other signs of infection. PHIS collects data from freestanding children's hospitals, which care for a majority of children with CAP in the US, but our findings may not be generalizable to other hospitals. In addition, we did not examine drivers of trends within individual institutions. We did not have detailed information to examine whether the PHIS hospitals in our study had actively worked to adopt the CAP guidelines. We were also unable to assess physician's familiarity with guidelines or the level of disagreement with the recommendations. Furthermore, the PHIS database does not permit detailed correlation of diagnostic testing with clinical parameters. In contrast to the diagnostic testing evaluated in this study, which is primarily discouraged by the IDSA/PIDS guidelines, respiratory viral testing for children with CAP is recommended but could not be evaluated, as data on such testing are not readily available in PHIS.

CONCLUSION

Publication of the IDSA/PIDS evidence‐based guidelines for the management of CAP was associated with modest, variable changes in use of diagnostic testing. Further adoption of the CAP guidelines should reduce variation in care and decrease unnecessary resource utilization in the management of CAP. Our study demonstrates that efforts to promote decreased resource utilization should target specific situations (eg, repeat testing for inpatients who are improving). Adherence to guidelines may be improved by the adoption of local practices that integrate and improve daily workflow, like order sets and clinical decision support tools.

Disclosure: Nothing to report.

Overutilization of resources is a significant, yet underappreciated, problem in medicine. Many interventions target underutilization (eg, immunizations) or misuse (eg, antibiotic prescribing for viral pharyngitis), yet overutilization remains as a significant contributor to healthcare waste.[1] In an effort to reduce waste, the Choosing Wisely campaign created a work group to highlight areas of overutilization, specifically noting both diagnostic tests and therapies for common pediatric conditions with no proven benefit and possible harm to the patient.[2] Respiratory illnesses have been a target of many quality‐improvement efforts, and pneumonia represents a common diagnosis in pediatrics.[3] The use of diagnostic testing for pneumonia is an area where care can be optimized and aligned with evidence.

Laboratory testing and diagnostic imaging are routinely used for the management of children with community‐acquired pneumonia (CAP). Several studies have documented substantial variability in the use of these resources for pneumonia management, with higher resource use associated with a higher chance of hospitalization after emergency department (ED) evaluation and a longer length of stay among those requiring hospitalization.[4, 5] This variation in diagnostic resource utilization has been attributed, at least in part, to a lack of consensus on the management of pneumonia. There is wide variability in diagnostic testing, and due to potential consequences for patients presenting with pneumonia, efforts to standardize care offer an opportunity to improve healthcare value.

In August 2011, the first national, evidence‐based consensus guidelines for the management of childhood CAP were published jointly by the Pediatric Infectious Diseases Society (PIDS) and the Infectious Diseases Society of America (IDSA).[6] A primary focus of these guidelines was the recommendation for the use of narrow spectrum antibiotics for the management of uncomplicated pneumonia. Previous studies have assessed the impact of the publication of the PIDS/IDSA guidelines on empiric antibiotic selection for the management of pneumonia.[7, 8] In addition, the guidelines provided recommendations regarding diagnostic test utilization, in particular discouraging blood tests (eg, complete blood counts) and radiologic studies for nontoxic, fully immunized children treated as outpatients, as well as repeat testing for children hospitalized with CAP who are improving.

Although single centers have demonstrated changes in utilization patterns based on clinical practice guidelines,[9, 10, 11, 12] whether these guidelines have impacted diagnostic test utilization among US children with CAP in a larger scale remains unknown. Therefore, we sought to determine the impact of the PIDS/IDSA guidelines on the use of diagnostic testing among children with CAP using a national sample of US children's hospitals. Because the guidelines discourage repeat diagnostic testing in patients who are improving, we also evaluated the association between repeat diagnostic studies and severity of illness.

METHODS

This retrospective cohort study used data from the Pediatric Health Information System (PHIS) (Children's Hospital Association, Overland Park, KS). The PHIS database contains deidentified administrative data, detailing demographic, diagnostic, procedure, and billing data from 47 freestanding, tertiary care children's hospitals. This database accounts for approximately 20% of all annual pediatric hospitalizations in the United States. Data quality is ensured through a joint effort between the Children's Hospital Association and participating hospitals.

RESULTS

There were 275,288 hospital admissions meeting study inclusion criteria of 1 to 18 years of age with a diagnosis of pneumonia from 2008 to 2014. Of these, 54,749 met exclusion criteria (1874 had pleural drainage procedure on day 0 or 1, 51,306 had complex chronic conditions, 1569 were hospitalized with pneumonia in the last 30 days). Characteristics of the remaining 220,539 patients in the final sample are shown in Table 1. The median age was 4 years (IQR, 27 years); a majority of the children were male (53%) and had public insurance (58%). There were 128,855 patients in the preguideline period (January 1, 2008 to July 31, 2011) and 91,684 in the post guideline period (August 1, 2011June 30, 2014).

Discharged From the ED

Throughout the study, utilization of CBC, blood cultures, and CRP was <20%, whereas CXR use was >75%. In segmented regression analysis, CRP utilization was relatively stable before the guidelines publication. However, by the end of the study period, the projected estimate of CRP utilization without guidelines (expected) was 2.9% compared with 4.8% with the guidelines (observed) (P < 0.05) (Figure 1). A similar pattern of higher rates of diagnostic utilization after the guidelines compared with projected estimates without the guidelines was also seen in the ED utilization of CBC, blood cultures, and CXR (Figure 1); however, these trends did not achieve statistical significance. Table 2 provides specific values. Using a standard cost of $19.52 for CRP testing, annual costs across all hospitals increased $11,783 for ED evaluation of CAP.

Table 2.Utilization Rates Over Study Period

	Baseline (%)	Preguideline Trend	Level Change at Guideline	Change in Trend After Guideline	Estimates at End of Study*
					Without Guideline (%)	With Guideline (%)	P
NOTE: Abbreviations: CBC, complete blood count; CRP, C‐reactive protein; ED, emergency department; NS, not significant (P > 0.05). *Estimates are based on pre and post guideline trends.
ED‐only encounters
Blood culture	14.6	0.1	0.8	0.1	5.5	8.6	NS
CBC	19.2	0.1	0.4	0.1	10.7	14.0	NS
CRP	5.4	0.0	0.6	0.1	2.9	4.8	<0.05
Chest x‐ray	85.4	0.1	0.1	0.0	80.9	81.1	NS
Inpatient encounters
Blood culture	50.6	0.0	1.7	0.2	49.2	41.4	<0.05
Repeat blood culture	6.5	0.0	1.0	0.1	8.9	5.8	NS
CBC	65.2	0.0	3.1	0.0	65.0	62.2	NS
Repeat CBC	23.4	0.0	4.2	0.0	20.8	16.0	NS
CRP	25.7	0.0	1.1	0.0	23.8	23.5	NS
Repeat CRP	12.5	0.1	2.2	0.1	7.1	7.3	NS
Chest x‐ray	89.4	0.1	0.7	0.0	85.4	83.9	NS
Repeat chest x‐ray	25.5	0.0	2.0	0.1	24.1	17.7	<0.05

Figure 1

Inpatient Encounters

In the segmented regression analysis of children hospitalized with CAP, guideline publication was associated with changes in the monthly use of some diagnostic tests. For example, by the end of the study period, the use of blood culture was 41.4% (observed), whereas the projected estimated use in the absence of the guidelines was 49.2% (expected) (P < 0.05) (Figure 2). Table 2 includes the data for the other tests, CBC, CRP, and CXR, in which similar patterns are noted with lower utilization rates after the guidelines, compared with expected utilization rates without the guidelines; however, these trends did not achieve statistical significance. Evaluating the utilization of repeat testing for inpatients, only repeat CXR achieved statistical significance (P < 0.05), with utilization rates of 17.7% with the guidelines (actual) compared with 24.1% without the guidelines (predicted).

Figure 2

To better understand the use of repeat testing, a comparison of severity outcomesLOS, ICU transfer, and pleural drainage procedureswas performed between patients with no repeat testing (70%) and patients with 1 or more repeat tests (30%). Patients with repeat testing had longer LOS (no repeat testing LOS 1 [IQR, 12]) versus 1 repeat test LOS 3 ([IQR, 24] vs 2+ repeat tests LOS 5 [IQR, 38]), higher rate of ICU transfer (no repeat testing 4.6% vs 1 repeat test 14.6% vs 2+ repeat test 35.6%), and higher rate of pleural drainage (no repeat testing 0% vs 1 repeat test 0.1% vs 2+ repeat test 5.9%] (all P < 0.001).

Using standard costs of $37.57 for blood cultures and $73.28 for CXR, annual costs for children with CAP across all hospitals decreased by $91,512 due to decreased utilization of blood cultures, and by $146,840 due to decreased utilization of CXR.

Hospital‐Level Variation in the Impact of the National Guideline

Figure 3 is a visual representation (heat map) of the impact of the guidelines at the hospital level at the end of the study from the individual interrupted time series. Based on this heat map (Figure 3), there was wide variability between hospitals in the impact of the guideline on each test in different settings (ED or inpatient). By diagnostic testing, 7 hospitals significantly decreased utilization of blood cultures for inpatients, and 5 hospitals significantly decreased utilization for repeat blood cultures and repeat CXR. Correlation between the number of positive improvements at a hospital and region (P = 0.974), number of CAP cases (P = 0.731), or percentage of public insurance (P = 0.241) were all nonsignificant.

Figure 3

DISCUSSION

This study complements previous assessments by evaluating the impact of the 2011 IDSA/PIDS consensus guidelines on the management of children with CAP cared for at US children's hospitals. Prior studies have shown increased use of narrow‐spectrum antibiotics for children with CAP after the publication of these guidelines.[7] The current study focused on diagnostic testing for CAP before and after the publication of the 2011 guidelines. In the ED setting, use of some diagnostic tests (blood culture, CBC, CXR, CRP) was declining prior to guideline publication, but appeared to plateau and/or increase after 2011. Among children admitted with CAP, use of diagnostic testing was relatively stable prior to 2011, and use of these tests (blood culture, CBC, CXR, CRP) declined after guideline publication. Overall, changes in diagnostic resource utilization 3 years after publication were modest, with few changes achieving statistical significance. There was a large variability in the impact of guidelines on test use between hospitals.

For outpatients, including those managed in the ED, the PIDS/IDSA guidelines recommend limited laboratory testing in nontoxic, fully immunized patients. The guidelines discourage the use of diagnostic testing among outpatients because of their low yield (eg, blood culture), and because test results may not impact management (eg, CBC).[6] In the years prior to guideline publication, there was already a declining trend in testing rates, including blood cultures, CBC, and CRP, for patients in the ED. After guideline publication, the rate of blood cultures, CBC, and CRP increased, but only the increase in CRP utilization achieved statistical significance. We would not expect utilization for common diagnostic tests (eg, CBC for outpatients with CAP) to be at or close to 0% because of the complexity of clinical decision making regarding admission that factors in aspects of patient history, exam findings, and underlying risk.[15] ED utilization of blood cultures was <10%, CBC <15%, and CRP <5% after guideline publication, which may represent the lowest testing limit that could be achieved.

CXRs obtained in the ED did not decrease over the entire study period. The rates of CXR use (close to 80%) seen in our study are similar to prior ED studies.[5, 16] Management of children with CAP in the ED might be different than outpatient primary care management because (1) unlike primary care providers, ED providers do not have an established relationship with their patients and do not have the opportunity for follow‐up and serial exams, making them less likely to tolerate diagnostic uncertainty; and (2) ED providers may see sicker patients. However, use of CXR in the ED does represent an opportunity for further study to understand if decreased utilization is feasible without adversely impacting clinical outcomes.

The CAP guidelines provide a strong recommendation to obtain blood culture in moderate to severe pneumonia. Despite this, blood culture utilization declined after guideline publication. Less than 10% of children hospitalized with uncomplicated CAP have positive blood cultures, which calls into question the utility of blood cultures for all admitted patients.[17, 18, 19] The recent EPIC (Epidemiology of Pneumonia in the Community) study showed that a majority of children hospitalized with pneumonia do not have growth of bacteria in culture, but there may be a role for blood cultures in patients with a strong suspicion of complicated CAP or in the patient with moderate to severe disease.[20] In addition to blood cultures, the guidelines also recommend CBC and CXR in moderate to severely ill children. This observed decline in testing in CBC and CXR may be related to individual physician assessments of which patients are moderately to severely ill, as the guidelines do not recommend testing for children with less severe disease. Our exclusion of patients requiring intensive care management or pleural drainage on admission might have selected children with a milder course of illness, although still requiring admission.

The guidelines discourage repeat diagnostic testing among children hospitalized with CAP who are improving. In this study, repeat CXR and CBC occurred in approximately 20% of patients, but repeat blood culture and CRP was much lower. As with initial diagnostic testing for inpatients with CAP, the rates of some repeat testing decreased with the guidelines. However, those with repeat testing had longer LOS and were more likely to require ICU transfer or a pleural drainage procedure compared to children without repeat testing. This suggests that repeat testing is used more often in children with a severe presentation or a worsening clinical course, and not done routinely on hospitalized patients.

The financial impact of decreased testing is modest, because the tests themselves are relatively inexpensive. However, the lack of substantial cost savings should not preclude efforts to continue to improve adherence to the guidelines. Not only is increased testing associated with higher hospitalization rates,[5] potentially yielding higher costs and family stress, increased testing may also lead to patient discomfort and possibly increased radiation exposure through chest radiography.

Many of the diagnostic testing recommendations in the CAP guidelines are based on weak evidence, which may contribute to the lack of substantial adoption. Nevertheless, adherence to guideline recommendations requires sustained effort on the part of individual physicians that should be encouraged through institutional support.[21] Continuous education and clinical decision support, as well as reminders in the electronic medical record, would make guideline recommendations more visible and may help overcome the inertia of previous practice.[15] The hospital‐level heat map (Figure 3) included in this study demonstrates that the impact of the guidelines was variable across sites. Although a few sites had decreased diagnostic testing in many areas with no increased testing in any category, there were several sites that had no improvement in any diagnostic testing category. In addition, hospital‐level factors like size, geography, and insurance status were not associated with number of improvements. To better understand drivers of change at individual hospitals, future studies should evaluate specific strategies utilized by the rapid guideline adopters.

This study is subject to several limitations. The use of ICD‐9 codes to identify patients with CAP may not capture all patients with this diagnosis; however, these codes have been previously validated.[13] Additionally, because patients were identified using ICD‐9 coding assigned at the time of discharge, testing performed in the ED setting may not reflect care for a child with known pneumonia, but rather may reflect testing for a child with fever or other signs of infection. PHIS collects data from freestanding children's hospitals, which care for a majority of children with CAP in the US, but our findings may not be generalizable to other hospitals. In addition, we did not examine drivers of trends within individual institutions. We did not have detailed information to examine whether the PHIS hospitals in our study had actively worked to adopt the CAP guidelines. We were also unable to assess physician's familiarity with guidelines or the level of disagreement with the recommendations. Furthermore, the PHIS database does not permit detailed correlation of diagnostic testing with clinical parameters. In contrast to the diagnostic testing evaluated in this study, which is primarily discouraged by the IDSA/PIDS guidelines, respiratory viral testing for children with CAP is recommended but could not be evaluated, as data on such testing are not readily available in PHIS.

CONCLUSION

Publication of the IDSA/PIDS evidence‐based guidelines for the management of CAP was associated with modest, variable changes in use of diagnostic testing. Further adoption of the CAP guidelines should reduce variation in care and decrease unnecessary resource utilization in the management of CAP. Our study demonstrates that efforts to promote decreased resource utilization should target specific situations (eg, repeat testing for inpatients who are improving). Adherence to guidelines may be improved by the adoption of local practices that integrate and improve daily workflow, like order sets and clinical decision support tools.

Disclosure: Nothing to report.

Community‐acquired pneumonia, the most common serious bacterial infection in childhood, may be complicated by parapneumonic effusion (ie, complicated pneumonia).1 Children with complicated pneumonia require prolonged hospitalization and frequently undergo multiple pleural fluid drainage procedures.2 Additionally, the incidence of complicated pneumonia has increased,37 making the need to define appropriate therapy even more pressing. Defining appropriate therapy is challenging for the individual physician as a result of inconsistent and insufficient evidence, and wide variation in treatment practices.2, 8

Historically, thoracotomy was performed only if initial chest tube placement did not lead to clinical improvement.9, 10 Several authors, noting the rapid resolution of symptoms in children undergoing earlier thoracotomy, advocated for the use of thoracotomy as initial therapy rather than as a procedure of last resort.114 The advent of less invasive techniques such as video‐assisted thoracoscopic surgery (VATS) has served as an additional impetus to consider surgical drainage as the initial treatment strategy.1518 Few well‐designed studies have examined the relative efficacy of these interventions.2, 1922 Published randomized trials were single center, enrolled few patients, and arrived at different conclusions.19, 21, 22 In addition, these trials did not examine other important outcomes such as requirement for additional pleural fluid drainage procedures and hospital readmission. Two large retrospective multicenter studies found modest reductions in length of stay (LOS) and substantial decreases in the requirement for additional pleural fluid drainage procedures in children undergoing initial VATS compared with initial chest tube placement.2, 20 However, Shah et al2 included relatively few patients undergoing VATS. Li et al20 combined patients undergoing initial thoracentesis, initial chest tube placement, late pleural fluid drainage (by any method), and no pleural fluid drainage into a single non‐operative management category, precluding conclusions about the relative benefits of chest tube placement compared with VATS. Neither study2, 20 examined the role of chemical fibrinolysis, a therapy which has been associated with outcomes comparable to VATS in two small randomized trials.21, 22

The objectives of this multicenter study were to describe the variation in the initial management strategy along with associated outcomes of complicated pneumonia in childhood and to determine the comparative effectiveness of different pleural fluid drainage procedures.

Methods

Results

Initial Pleural Fluid Drainage Procedures

The primary procedures included chest tube without fibrinolysis (47.8%); chest tube with fibrinolysis (17.8%); thoracotomy (22.8%); and VATS (11.7%) (Table 1). The proportion of patients undergoing primary chest tube placement with fibrinolysis increased over time from 14.2% in 2004 to 30.0% in 2009 (P < 0.001; chi‐squared test for trend). The initial procedure varied by hospital with the greatest proportion of patients undergoing primary chest tube placement without fibrinolysis at 28 (70.0%) hospitals, chest tube placement with fibrinolysis at 5 (12.5%) hospitals, thoracotomy at 5 (12.5%) hospitals, and VATS at 2 (5.0%) hospitals (Figure 1). The median proportion of patients undergoing primary VATS across all hospitals was 11.5% (IQR: 3.9%‐26.5%) (Figure 1). The median time to first procedure was 1 day (IQR: 03 days).

Figure 1

Discussion

This multicenter study is the largest to evaluate the management of children hospitalized with complicated pneumonia. We found considerable variation in initial management and outcomes across hospitals. Differences in timing of the initial drainage procedure explained only a small amount of the variability in outcomes. Children undergoing initial VATS less commonly required additional drainage procedures while children undergoing initial chest tube placement with fibrinolysis less commonly required readmission. Differences in total and post‐procedure LOS were not statistically significant. Differences in cost, while statistically significant, were of marginal relevance.

Previous studies have also shown significant variation in treatment and outcomes of children with complicated pneumonia across hospitals.2, 8 Our study provides data from additional hospitals, includes a substantially larger number of patients undergoing initial VATS, distinguishes between fibrinolysis recipients and nonrecipients, and is the first to compare outcomes between four different initial drainage strategies. The creation of national consensus guidelines might reduce variability in initial management strategies, although the variability in outcomes across hospitals in the current study could not be explained simply by differences in the type or timing of the initial drainage procedure. Thus, future studies examining hospital‐level factors may play an important role in improving quality of care for children with complicated pneumonia.

Patients with initial thoracotomy or chest tube placement with or without fibrinolysis more commonly received additional drainage procedures than patients with initial VATS. This difference remained when patients with CCCs were excluded from the analysis and when the analysis was limited to patients undergoing pleural fluid drainage within 2 days of hospitalization. Several small, randomized trials demonstrated conflicting results when comparing initial chest tube placement with fibrinolysis and VATS. St. Peter et al22 reported that 3 (17%) of 18 patients undergoing initial chest tube placement with fibrinolysis and none of the 18 patients undergoing initial VATS received additional pleural drainage procedures. Sonnappa et al21 found no differences between the two groups. Kurt et al19 did not state the proportion of patients receiving additional procedures. However, the mean number of drainage procedures was 2.25 among the 8 patients undergoing initial chest tube placement while none of the 10 patients with VATS received additional drainage.19

Thoracotomy is often perceived as a definitive procedure for treatment of complicated pneumonia. However, several possibilities exist to explain why additional procedures were performed less frequently in patients undergoing initial VATS compared with initial thoracotomy. The limited visual field in thoracotomy may lead to greater residual disease post‐operatively in those receiving thoracotomy compared with VATS.31 Additionally, thoracotomy substantially disrupts the integrity of the chest wall and is consequently associated with complications such as bleeding and air leak into the pleural cavity more often than VATS.31, 32 It is thus possible that some of the additional procedures in patients receiving initial thoracotomy were necessary for management of thoracotomy‐associated complications rather than for failure of the initial drainage procedure.

Similar to the randomized trials by Sonnappa et al21 and St. Peter et al,22 differences in the overall and post‐procedure LOS were not significant among patients undergoing initial VATS compared with initial chest tube placement with fibrinolysis. However, chest tube placement without fibrinolysis did not result in significant differences in LOS compared with initial VATS. In the only pediatric randomized trial, the 29 intrapleural urokinase recipients had a 2 day shorter LOS compared with the 29 intrapleural saline recipients.33 Several small, randomized controlled trials of adults with complicated pneumonia reported improved pleural fluid drainage among intrapleural fibrinolysis recipients compared with non‐recipients.3436 However, a large multicenter randomized trial in adults found no differences in mortality, requirement for surgical drainage, or LOS between intrapleural streptokinase and placebo recipients.37 Subsequent meta‐analyses of randomized trials in adults also demonstrated no benefit to fibrinolysis.38, 39 In the context of the increasing use of intrapleural fibrinolysis in children with complicated pneumonia, our results highlight the need for a large, multicenter randomized controlled trial to determine whether chest tube with fibrinolysis is superior to chest tube alone.

Two small randomized trials21, 22 and a decision analysis40 identified chest tube with fibrinolysis as the most economical approach to children with complicated pneumonia. However, the costs did not differ significantly between patients undergoing initial VATS or initial chest tube placement with fibrinolysis in our study. The least costly approach was initial chest tube placement without fibrinolysis. Unlike the randomized controlled trials, we considered costs associated with readmissions in determining the total costs. Shah et al41 found no difference in total charges for patients undergoing initial VATS compared with initial chest tube placement; however, patients undergoing initial VATS were concentrated in a few centers, making it difficult to determine the relative importance of procedural and hospital factors.

This multicenter observational study has several limitations. First, discharge diagnosis coding may be unreliable for specific diseases. However, our rigorous definition of complicated pneumonia, supported by the high positive predictive value as verified by medical record review, minimizes the likelihood of misclassification.

Second, unmeasured confounding or residual confounding by indication for the method of pleural drainage may occur, potentially influencing our results in two disparate ways. If patients with more severe systemic illness were too unstable for operative interventions, then our results would be biased towards worse outcomes for children undergoing initial chest tube placement. We adjusted for several variables associated with a greater systemic severity of illness, including intensive care unit admission, making this possibility less likely. We also could not account for some factors associated with more severe local disease such as the size and character of the effusion. We suspect that patients with more extensive local disease (ie, loculated effusions) would have worse outcomes than other patients, regardless of initial procedure, and that these patients would also be more likely to undergo primary surgical drainage. Thus, this study may have underestimated the benefit of initial surgical drainage (eg, VATS) compared with nonsurgical drainage (ie, chest tube placement).

Third, misclassification of the method of initial pleural drainage may have occurred. Patients transferred from another institution following chest tube placement could either be classified as not receiving pleural drainage and thus excluded from the study or classified as having initial VATS or thoracotomy if the reason for transfer was chest tube treatment failure. Additionally, we could not distinguish routine use of fibrinolysis from fibrinolysis to maintain chest tube patency. Whether such misclassification would falsely minimize or maximize differences in outcomes between the various groups remains uncertain. Fourth, because this study only included tertiary care children's hospitals, these data are not generalizable to community settings. VATS requires specialized surgical training that may be unavailable in some areas. Finally, this study demonstrates the relative efficacy of various pleural fluid drainage procedures on short‐term clinical outcomes and resource utilization. However, long‐term functional outcomes should be measured in future prospective studies.

Conclusions

In conclusion, emphasis on evidence driven treatment to optimize care has led to an increasing examination of unwarranted practice variation.42 The lack of evidence for best practice makes it difficult to define unwarranted variation in the treatment of complicated pneumonia. Our study demonstrates the large variability in practice and raises additional questions regarding the optimal drainage strategies. Published randomized trials have focused on comparisons between chest tube placement with fibrinolysis and VATS. However, our data suggest that future randomized trials should include chest tube placement without fibrinolysis as a treatment strategy. In determining the current best treatment for patients with complicated pneumonia, a clinician must weigh the impact of needing an additional procedure in approximately one‐quarter of patients undergoing initial chest tube placement (with or without fibrinolysis) with the risks of general anesthesia and readmission in patients undergoing initial VATS.

Community‐acquired pneumonia, the most common serious bacterial infection in childhood, may be complicated by parapneumonic effusion (ie, complicated pneumonia).1 Children with complicated pneumonia require prolonged hospitalization and frequently undergo multiple pleural fluid drainage procedures.2 Additionally, the incidence of complicated pneumonia has increased,37 making the need to define appropriate therapy even more pressing. Defining appropriate therapy is challenging for the individual physician as a result of inconsistent and insufficient evidence, and wide variation in treatment practices.2, 8

Historically, thoracotomy was performed only if initial chest tube placement did not lead to clinical improvement.9, 10 Several authors, noting the rapid resolution of symptoms in children undergoing earlier thoracotomy, advocated for the use of thoracotomy as initial therapy rather than as a procedure of last resort.114 The advent of less invasive techniques such as video‐assisted thoracoscopic surgery (VATS) has served as an additional impetus to consider surgical drainage as the initial treatment strategy.1518 Few well‐designed studies have examined the relative efficacy of these interventions.2, 1922 Published randomized trials were single center, enrolled few patients, and arrived at different conclusions.19, 21, 22 In addition, these trials did not examine other important outcomes such as requirement for additional pleural fluid drainage procedures and hospital readmission. Two large retrospective multicenter studies found modest reductions in length of stay (LOS) and substantial decreases in the requirement for additional pleural fluid drainage procedures in children undergoing initial VATS compared with initial chest tube placement.2, 20 However, Shah et al2 included relatively few patients undergoing VATS. Li et al20 combined patients undergoing initial thoracentesis, initial chest tube placement, late pleural fluid drainage (by any method), and no pleural fluid drainage into a single non‐operative management category, precluding conclusions about the relative benefits of chest tube placement compared with VATS. Neither study2, 20 examined the role of chemical fibrinolysis, a therapy which has been associated with outcomes comparable to VATS in two small randomized trials.21, 22

The objectives of this multicenter study were to describe the variation in the initial management strategy along with associated outcomes of complicated pneumonia in childhood and to determine the comparative effectiveness of different pleural fluid drainage procedures.

Methods

Results

Initial Pleural Fluid Drainage Procedures

The primary procedures included chest tube without fibrinolysis (47.8%); chest tube with fibrinolysis (17.8%); thoracotomy (22.8%); and VATS (11.7%) (Table 1). The proportion of patients undergoing primary chest tube placement with fibrinolysis increased over time from 14.2% in 2004 to 30.0% in 2009 (P < 0.001; chi‐squared test for trend). The initial procedure varied by hospital with the greatest proportion of patients undergoing primary chest tube placement without fibrinolysis at 28 (70.0%) hospitals, chest tube placement with fibrinolysis at 5 (12.5%) hospitals, thoracotomy at 5 (12.5%) hospitals, and VATS at 2 (5.0%) hospitals (Figure 1). The median proportion of patients undergoing primary VATS across all hospitals was 11.5% (IQR: 3.9%‐26.5%) (Figure 1). The median time to first procedure was 1 day (IQR: 03 days).

Figure 1

Discussion

This multicenter study is the largest to evaluate the management of children hospitalized with complicated pneumonia. We found considerable variation in initial management and outcomes across hospitals. Differences in timing of the initial drainage procedure explained only a small amount of the variability in outcomes. Children undergoing initial VATS less commonly required additional drainage procedures while children undergoing initial chest tube placement with fibrinolysis less commonly required readmission. Differences in total and post‐procedure LOS were not statistically significant. Differences in cost, while statistically significant, were of marginal relevance.

Previous studies have also shown significant variation in treatment and outcomes of children with complicated pneumonia across hospitals.2, 8 Our study provides data from additional hospitals, includes a substantially larger number of patients undergoing initial VATS, distinguishes between fibrinolysis recipients and nonrecipients, and is the first to compare outcomes between four different initial drainage strategies. The creation of national consensus guidelines might reduce variability in initial management strategies, although the variability in outcomes across hospitals in the current study could not be explained simply by differences in the type or timing of the initial drainage procedure. Thus, future studies examining hospital‐level factors may play an important role in improving quality of care for children with complicated pneumonia.

Patients with initial thoracotomy or chest tube placement with or without fibrinolysis more commonly received additional drainage procedures than patients with initial VATS. This difference remained when patients with CCCs were excluded from the analysis and when the analysis was limited to patients undergoing pleural fluid drainage within 2 days of hospitalization. Several small, randomized trials demonstrated conflicting results when comparing initial chest tube placement with fibrinolysis and VATS. St. Peter et al22 reported that 3 (17%) of 18 patients undergoing initial chest tube placement with fibrinolysis and none of the 18 patients undergoing initial VATS received additional pleural drainage procedures. Sonnappa et al21 found no differences between the two groups. Kurt et al19 did not state the proportion of patients receiving additional procedures. However, the mean number of drainage procedures was 2.25 among the 8 patients undergoing initial chest tube placement while none of the 10 patients with VATS received additional drainage.19

Thoracotomy is often perceived as a definitive procedure for treatment of complicated pneumonia. However, several possibilities exist to explain why additional procedures were performed less frequently in patients undergoing initial VATS compared with initial thoracotomy. The limited visual field in thoracotomy may lead to greater residual disease post‐operatively in those receiving thoracotomy compared with VATS.31 Additionally, thoracotomy substantially disrupts the integrity of the chest wall and is consequently associated with complications such as bleeding and air leak into the pleural cavity more often than VATS.31, 32 It is thus possible that some of the additional procedures in patients receiving initial thoracotomy were necessary for management of thoracotomy‐associated complications rather than for failure of the initial drainage procedure.

Similar to the randomized trials by Sonnappa et al21 and St. Peter et al,22 differences in the overall and post‐procedure LOS were not significant among patients undergoing initial VATS compared with initial chest tube placement with fibrinolysis. However, chest tube placement without fibrinolysis did not result in significant differences in LOS compared with initial VATS. In the only pediatric randomized trial, the 29 intrapleural urokinase recipients had a 2 day shorter LOS compared with the 29 intrapleural saline recipients.33 Several small, randomized controlled trials of adults with complicated pneumonia reported improved pleural fluid drainage among intrapleural fibrinolysis recipients compared with non‐recipients.3436 However, a large multicenter randomized trial in adults found no differences in mortality, requirement for surgical drainage, or LOS between intrapleural streptokinase and placebo recipients.37 Subsequent meta‐analyses of randomized trials in adults also demonstrated no benefit to fibrinolysis.38, 39 In the context of the increasing use of intrapleural fibrinolysis in children with complicated pneumonia, our results highlight the need for a large, multicenter randomized controlled trial to determine whether chest tube with fibrinolysis is superior to chest tube alone.

Two small randomized trials21, 22 and a decision analysis40 identified chest tube with fibrinolysis as the most economical approach to children with complicated pneumonia. However, the costs did not differ significantly between patients undergoing initial VATS or initial chest tube placement with fibrinolysis in our study. The least costly approach was initial chest tube placement without fibrinolysis. Unlike the randomized controlled trials, we considered costs associated with readmissions in determining the total costs. Shah et al41 found no difference in total charges for patients undergoing initial VATS compared with initial chest tube placement; however, patients undergoing initial VATS were concentrated in a few centers, making it difficult to determine the relative importance of procedural and hospital factors.

This multicenter observational study has several limitations. First, discharge diagnosis coding may be unreliable for specific diseases. However, our rigorous definition of complicated pneumonia, supported by the high positive predictive value as verified by medical record review, minimizes the likelihood of misclassification.

Second, unmeasured confounding or residual confounding by indication for the method of pleural drainage may occur, potentially influencing our results in two disparate ways. If patients with more severe systemic illness were too unstable for operative interventions, then our results would be biased towards worse outcomes for children undergoing initial chest tube placement. We adjusted for several variables associated with a greater systemic severity of illness, including intensive care unit admission, making this possibility less likely. We also could not account for some factors associated with more severe local disease such as the size and character of the effusion. We suspect that patients with more extensive local disease (ie, loculated effusions) would have worse outcomes than other patients, regardless of initial procedure, and that these patients would also be more likely to undergo primary surgical drainage. Thus, this study may have underestimated the benefit of initial surgical drainage (eg, VATS) compared with nonsurgical drainage (ie, chest tube placement).

Third, misclassification of the method of initial pleural drainage may have occurred. Patients transferred from another institution following chest tube placement could either be classified as not receiving pleural drainage and thus excluded from the study or classified as having initial VATS or thoracotomy if the reason for transfer was chest tube treatment failure. Additionally, we could not distinguish routine use of fibrinolysis from fibrinolysis to maintain chest tube patency. Whether such misclassification would falsely minimize or maximize differences in outcomes between the various groups remains uncertain. Fourth, because this study only included tertiary care children's hospitals, these data are not generalizable to community settings. VATS requires specialized surgical training that may be unavailable in some areas. Finally, this study demonstrates the relative efficacy of various pleural fluid drainage procedures on short‐term clinical outcomes and resource utilization. However, long‐term functional outcomes should be measured in future prospective studies.

Conclusions

In conclusion, emphasis on evidence driven treatment to optimize care has led to an increasing examination of unwarranted practice variation.42 The lack of evidence for best practice makes it difficult to define unwarranted variation in the treatment of complicated pneumonia. Our study demonstrates the large variability in practice and raises additional questions regarding the optimal drainage strategies. Published randomized trials have focused on comparisons between chest tube placement with fibrinolysis and VATS. However, our data suggest that future randomized trials should include chest tube placement without fibrinolysis as a treatment strategy. In determining the current best treatment for patients with complicated pneumonia, a clinician must weigh the impact of needing an additional procedure in approximately one‐quarter of patients undergoing initial chest tube placement (with or without fibrinolysis) with the risks of general anesthesia and readmission in patients undergoing initial VATS.

Community‐acquired pneumonia, the most common serious bacterial infection in childhood, may be complicated by parapneumonic effusion (ie, complicated pneumonia).1 Children with complicated pneumonia require prolonged hospitalization and frequently undergo multiple pleural fluid drainage procedures.2 Additionally, the incidence of complicated pneumonia has increased,37 making the need to define appropriate therapy even more pressing. Defining appropriate therapy is challenging for the individual physician as a result of inconsistent and insufficient evidence, and wide variation in treatment practices.2, 8

Historically, thoracotomy was performed only if initial chest tube placement did not lead to clinical improvement.9, 10 Several authors, noting the rapid resolution of symptoms in children undergoing earlier thoracotomy, advocated for the use of thoracotomy as initial therapy rather than as a procedure of last resort.114 The advent of less invasive techniques such as video‐assisted thoracoscopic surgery (VATS) has served as an additional impetus to consider surgical drainage as the initial treatment strategy.1518 Few well‐designed studies have examined the relative efficacy of these interventions.2, 1922 Published randomized trials were single center, enrolled few patients, and arrived at different conclusions.19, 21, 22 In addition, these trials did not examine other important outcomes such as requirement for additional pleural fluid drainage procedures and hospital readmission. Two large retrospective multicenter studies found modest reductions in length of stay (LOS) and substantial decreases in the requirement for additional pleural fluid drainage procedures in children undergoing initial VATS compared with initial chest tube placement.2, 20 However, Shah et al2 included relatively few patients undergoing VATS. Li et al20 combined patients undergoing initial thoracentesis, initial chest tube placement, late pleural fluid drainage (by any method), and no pleural fluid drainage into a single non‐operative management category, precluding conclusions about the relative benefits of chest tube placement compared with VATS. Neither study2, 20 examined the role of chemical fibrinolysis, a therapy which has been associated with outcomes comparable to VATS in two small randomized trials.21, 22

The objectives of this multicenter study were to describe the variation in the initial management strategy along with associated outcomes of complicated pneumonia in childhood and to determine the comparative effectiveness of different pleural fluid drainage procedures.

Methods

Results

Initial Pleural Fluid Drainage Procedures

The primary procedures included chest tube without fibrinolysis (47.8%); chest tube with fibrinolysis (17.8%); thoracotomy (22.8%); and VATS (11.7%) (Table 1). The proportion of patients undergoing primary chest tube placement with fibrinolysis increased over time from 14.2% in 2004 to 30.0% in 2009 (P < 0.001; chi‐squared test for trend). The initial procedure varied by hospital with the greatest proportion of patients undergoing primary chest tube placement without fibrinolysis at 28 (70.0%) hospitals, chest tube placement with fibrinolysis at 5 (12.5%) hospitals, thoracotomy at 5 (12.5%) hospitals, and VATS at 2 (5.0%) hospitals (Figure 1). The median proportion of patients undergoing primary VATS across all hospitals was 11.5% (IQR: 3.9%‐26.5%) (Figure 1). The median time to first procedure was 1 day (IQR: 03 days).

Figure 1

Discussion

This multicenter study is the largest to evaluate the management of children hospitalized with complicated pneumonia. We found considerable variation in initial management and outcomes across hospitals. Differences in timing of the initial drainage procedure explained only a small amount of the variability in outcomes. Children undergoing initial VATS less commonly required additional drainage procedures while children undergoing initial chest tube placement with fibrinolysis less commonly required readmission. Differences in total and post‐procedure LOS were not statistically significant. Differences in cost, while statistically significant, were of marginal relevance.

Previous studies have also shown significant variation in treatment and outcomes of children with complicated pneumonia across hospitals.2, 8 Our study provides data from additional hospitals, includes a substantially larger number of patients undergoing initial VATS, distinguishes between fibrinolysis recipients and nonrecipients, and is the first to compare outcomes between four different initial drainage strategies. The creation of national consensus guidelines might reduce variability in initial management strategies, although the variability in outcomes across hospitals in the current study could not be explained simply by differences in the type or timing of the initial drainage procedure. Thus, future studies examining hospital‐level factors may play an important role in improving quality of care for children with complicated pneumonia.

Patients with initial thoracotomy or chest tube placement with or without fibrinolysis more commonly received additional drainage procedures than patients with initial VATS. This difference remained when patients with CCCs were excluded from the analysis and when the analysis was limited to patients undergoing pleural fluid drainage within 2 days of hospitalization. Several small, randomized trials demonstrated conflicting results when comparing initial chest tube placement with fibrinolysis and VATS. St. Peter et al22 reported that 3 (17%) of 18 patients undergoing initial chest tube placement with fibrinolysis and none of the 18 patients undergoing initial VATS received additional pleural drainage procedures. Sonnappa et al21 found no differences between the two groups. Kurt et al19 did not state the proportion of patients receiving additional procedures. However, the mean number of drainage procedures was 2.25 among the 8 patients undergoing initial chest tube placement while none of the 10 patients with VATS received additional drainage.19

Thoracotomy is often perceived as a definitive procedure for treatment of complicated pneumonia. However, several possibilities exist to explain why additional procedures were performed less frequently in patients undergoing initial VATS compared with initial thoracotomy. The limited visual field in thoracotomy may lead to greater residual disease post‐operatively in those receiving thoracotomy compared with VATS.31 Additionally, thoracotomy substantially disrupts the integrity of the chest wall and is consequently associated with complications such as bleeding and air leak into the pleural cavity more often than VATS.31, 32 It is thus possible that some of the additional procedures in patients receiving initial thoracotomy were necessary for management of thoracotomy‐associated complications rather than for failure of the initial drainage procedure.

Similar to the randomized trials by Sonnappa et al21 and St. Peter et al,22 differences in the overall and post‐procedure LOS were not significant among patients undergoing initial VATS compared with initial chest tube placement with fibrinolysis. However, chest tube placement without fibrinolysis did not result in significant differences in LOS compared with initial VATS. In the only pediatric randomized trial, the 29 intrapleural urokinase recipients had a 2 day shorter LOS compared with the 29 intrapleural saline recipients.33 Several small, randomized controlled trials of adults with complicated pneumonia reported improved pleural fluid drainage among intrapleural fibrinolysis recipients compared with non‐recipients.3436 However, a large multicenter randomized trial in adults found no differences in mortality, requirement for surgical drainage, or LOS between intrapleural streptokinase and placebo recipients.37 Subsequent meta‐analyses of randomized trials in adults also demonstrated no benefit to fibrinolysis.38, 39 In the context of the increasing use of intrapleural fibrinolysis in children with complicated pneumonia, our results highlight the need for a large, multicenter randomized controlled trial to determine whether chest tube with fibrinolysis is superior to chest tube alone.

Two small randomized trials21, 22 and a decision analysis40 identified chest tube with fibrinolysis as the most economical approach to children with complicated pneumonia. However, the costs did not differ significantly between patients undergoing initial VATS or initial chest tube placement with fibrinolysis in our study. The least costly approach was initial chest tube placement without fibrinolysis. Unlike the randomized controlled trials, we considered costs associated with readmissions in determining the total costs. Shah et al41 found no difference in total charges for patients undergoing initial VATS compared with initial chest tube placement; however, patients undergoing initial VATS were concentrated in a few centers, making it difficult to determine the relative importance of procedural and hospital factors.

This multicenter observational study has several limitations. First, discharge diagnosis coding may be unreliable for specific diseases. However, our rigorous definition of complicated pneumonia, supported by the high positive predictive value as verified by medical record review, minimizes the likelihood of misclassification.

Second, unmeasured confounding or residual confounding by indication for the method of pleural drainage may occur, potentially influencing our results in two disparate ways. If patients with more severe systemic illness were too unstable for operative interventions, then our results would be biased towards worse outcomes for children undergoing initial chest tube placement. We adjusted for several variables associated with a greater systemic severity of illness, including intensive care unit admission, making this possibility less likely. We also could not account for some factors associated with more severe local disease such as the size and character of the effusion. We suspect that patients with more extensive local disease (ie, loculated effusions) would have worse outcomes than other patients, regardless of initial procedure, and that these patients would also be more likely to undergo primary surgical drainage. Thus, this study may have underestimated the benefit of initial surgical drainage (eg, VATS) compared with nonsurgical drainage (ie, chest tube placement).

Third, misclassification of the method of initial pleural drainage may have occurred. Patients transferred from another institution following chest tube placement could either be classified as not receiving pleural drainage and thus excluded from the study or classified as having initial VATS or thoracotomy if the reason for transfer was chest tube treatment failure. Additionally, we could not distinguish routine use of fibrinolysis from fibrinolysis to maintain chest tube patency. Whether such misclassification would falsely minimize or maximize differences in outcomes between the various groups remains uncertain. Fourth, because this study only included tertiary care children's hospitals, these data are not generalizable to community settings. VATS requires specialized surgical training that may be unavailable in some areas. Finally, this study demonstrates the relative efficacy of various pleural fluid drainage procedures on short‐term clinical outcomes and resource utilization. However, long‐term functional outcomes should be measured in future prospective studies.

Conclusions

In conclusion, emphasis on evidence driven treatment to optimize care has led to an increasing examination of unwarranted practice variation.42 The lack of evidence for best practice makes it difficult to define unwarranted variation in the treatment of complicated pneumonia. Our study demonstrates the large variability in practice and raises additional questions regarding the optimal drainage strategies. Published randomized trials have focused on comparisons between chest tube placement with fibrinolysis and VATS. However, our data suggest that future randomized trials should include chest tube placement without fibrinolysis as a treatment strategy. In determining the current best treatment for patients with complicated pneumonia, a clinician must weigh the impact of needing an additional procedure in approximately one‐quarter of patients undergoing initial chest tube placement (with or without fibrinolysis) with the risks of general anesthesia and readmission in patients undergoing initial VATS.