Affiliations
Division of Education Administration, Mayo Clinic, Scottsdale, Arizona
Given name(s)
Keith J.
Family name
Cannon
Degrees
MD

An Automated Electronic Tool to Assess the Risk of 30-Day Readmission: Validation of Predictive Performance

Article Type
Changed
Mon, 04/23/2018 - 11:58
Display Headline
An Automated Electronic Tool to Assess the Risk of 30-Day Readmission: Validation of Predictive Performance

From the Divisions of Hospital Medicine (Drs. Dawson, Chirila, Bhide, and Burton) and Biomedical Statistics and Informatics (Ms. Thomas), Mayo Clinic, Jacksonville, FL, and the Division of Hospital Medicine, Mayo Clinic, Phoenix, AZ (Dr. Cannon).

 

Abstract

  • Objective: To validate an electronic tool created to identify inpatients who are at risk of readmission within 30 days and quantify the predictive performance of the readmission risk score (RRS).
  • Methods: Retrospective cohort study including inpa-tients who were discharged between 1 Nov 2012 and 31 Dec 2012. The ability of the RRS to discriminate between those who did and did not have a 30-day urgent readmission was quantified by the c statistic. Calibration was assessed by plotting the observed and predicted probability of 30-day urgent readmission. Predicted probabilities were obtained from generalized estimating equations, clustering on patient.
  • Results: Of 1689 hospital inpatient discharges (1515 patients), 159 (9.4%) had a 30-day urgent readmission. The RRS had some discriminative ability (c statistic: 0.612; 95% confidence interval: 0.570–0.655) and good calibration.
  • Conclusions: Our study shows that the RRS has some discriminative ability. The automated tool can be used to estimate the probability of a 30-day urgent readmission.

 

Hospital readmissions are increasingly scrutinized by the Center for Medicare and Medicaid Services and other payers due to their frequency and high cost. It is estimated that up to 25% of all patients discharged from acute care hospitals are readmitted within 30 days [1]. To address this problem, the Center for Medicare and Medicaid Services is using these rates as one of the benchmarks for quality for hospitals and health care organizations and has begun to assess penalties to those institutions with the highest rates. This scrutiny and the desire for better patient care transitions has resulted in most hospitals implementing various initiatives to reduce potentially avoidable readmissions.

Multiple interventions have been shown to reduce readmissions [2,3]. These interventions have varying effectiveness and are often labor intensive and thus costly to the institutions implementing them. In fact, no one intervention has been shown to be effective alone [4], and it may take several concurrent interventions targeting the highest risk patients to improve transitions of care at discharge that result in reduced readmissions. Many experts do recommend risk stratifying patients in order to target interventions to the highest risk patients for effective use of resources [5,6]. Several risk factor assessments have been proposed with varying success [7–13]. Multiple factors can limit the effectiveness of these risk stratification profiles. They may have low sensitivity and specificity, be based solely on retrospective data, be limited to certain populations, or be created from administrative data only without taking psychosocial factors into consideration [14].

An effective risk assessment ideally would encompass multiple known risk factors including certain comorbidities such as malignancy and heart failure, psychosocial factors such as health literacy and social support, and administrative data including payment source and demographics. All of these have been shown in prior studies to contribute to readmissions [7–13]. In addition, availability of the assessment early in the hospitalization would allow for interventions throughout the hospital stay to mitigate the effect of these factors where possible. To address these needs, our institution formed a readmission task force in January 2010 to review published literature on hospital 30-day readmissions and create a readmission risk score (RRS). The aim of this study was to quantify the predictive performance of the RRS after it was first implemented into the electronic medical record (EMR) in November 2012.

Methods

Study Design and Cohort

The Mayo Clinic institutional review board approved this study. The study was conducted at Mayo Clinic in Jacksonville, Florida, a tertiary care hospital in a community setting. The RRS (Table 1) was created as a modification of 2 published studies [9,15]. Using AMALGA software (Microsoft, Redmond, WA), an automated electronic tool was developed to collect the necessary clinical, psychosocial, and financial information on hospital admission to calculate the RRS. This initial risk score was run retrospectively on a data set of approximately 2000 patients who had been readmitted 2 years prior to the study to determine the cut-off values for high, medium, and low risk prior to the implementation of the electronic tool.

All consecutive adult inpatients who were discharged between 1 November 2012 and 31 December 2012 were included in this retrospective cohort study. This narrow time frame corresponded to the period from RRS tool implementation to the start of readmission interventions. We excluded hospitalizations if the patient died in the hospital.

Outcome Measures

The primary outcome was a 30-day urgent readmission, which included readmissions categorized as either emergency, urgent, or semi-urgent. Secondary outcomes included any 30-day readmission and 30-day death. Only readmissions to Mayo Clinic were examined.

Predictors

In collaboration with the information technology department, an algorithm was written to extract data from the EMR for each patient within 24 hours of admission to the hospital. This data was retrieved from existing repositories of patient information, such as demographic information, payer source, medication list, problem list, and past medical history. In addition, each patient was interviewed by a nurse at the time of admission, and the nurse completed an “admission profile” in the EMR that confirmed or entered past medical history, medications, social support at home, depression symptoms, and learning styles, among other information (Table 1). The algorithm was able to extract data from this evaluation also, so that each element of the risk score was correlated to at least one data source in the EMR. The algorithm then assigned the correct value to each element, and the total score was electronically calculated and placed in a discrete cell in each patient’s record. The algorithm was automatically run again 48 hours after the initial scoring in order to assure completeness of the information. If the patient had a length of stay greater than 5 days, an additional score was generated to include the length of stay component.

Statistical Analysis

The predictive performance of the RRS was assessed by evaluating the discrimination and calibration. Discrimination is the ability of the RRS to separate those who had a 30-day urgent readmission and those who did not. Discrimination was quantified by the c statistic, which is equivalent to the area under the receiver operating characteristic curve in this study owing to the use of binary endpoints. A c statistic of 1.0 would indicate that the RRS perfectly predicts 30-day urgent readmission while a c statistic of 0.5 would indicate the RRS has no apparent accuracy in predicting 30-day urgent readmission. Calibration assesses how closely predicted outcomes agree with observed outcomes. The predicted probability of 30-day urgent readmission was estimated utilizing a generalized estimating equation model, clustering on patient, with RRS as the only predictor variable. Inpatient discharges were divided into deciles of the predicted probabilities for 30-day urgent readmission. Agreement of the predicted and observed outcomes was displayed graphically according to decile of the predicted outcomes. All analyses were performed using SAS (version 9.3, SAS Institute, Cary, NC) and R statistical software (version 3.1.1, R Foundation for Statistical Computing, Vienna, Austria).

 

 

Results

There were 1689 hospital inpatient discharges for 1515 patients during the study period. In this population, the mean age was 64 ± 17 years, 50% were female, and 87% were Caucasian. Additional characteristics are reported in Table 2. Of the 1689 hospital inpatient discharges, 159 (9.4%) resulted in a 30-day urgent readmission and 190 (11.2%) resulted in any 30-day readmission. Among the 1515 patients, 57 (3.8%) died within 30 days of discharge.

The RRS was significantly associated with 30-day urgent readmission (odds ratio [OR] for 1-point increase in the RRS, 1.07 [95% confidence interval {CI} 1.05–1.10]; P < 0.001). A c statistic of 0.612 (95% CI 0.570–0.655) indicates that the RRS has some ability to discriminate between those with and without a 30-day urgent readmission (FigureTable 3). The expected and observed probabilities of 30-day urgent readmission were similar in each decile of the RRS. The calibration (Table 4) shows that although there is some deviation between the observed and expected probabilities, 

the calibration is fairly good, particularly at the higher risk levels, making the tool more valuable for the high-risk patients.

The RRS was also significantly associated with each of the secondary outcome measures. The odds ratios for a 1-point increase in the RRS for any 30-day readmission was 1.06 (95% CI 1.03–1.09, P < 0.001) and the c statistic was 0.591 (95% CI 0.551–0.631, Table 2). The odds ratios for a 1-point increase in the 

RRS for 30-day death was 1.13 (95% CI 1.08–1.18, P < 0.001) and the c statistic was 0.696 (95% CI 0.633–0.758, Table 2). The odds ratios for a 1-point increase in the RRS for 30-day death or 30-day urgent readmission was 1.09 (95% CI 1.07–1.12, P < 0.001) and the c statistic was 0.639 (95% CI 0.601–0.676, Table 2).

 

Discussion

Our study provides evidence that the RRS has some ability to discriminate between patients who did and did not have a 30-day urgent readmission (c statistic 0.612 [95% CI 0.570–0.655]). More importantly the calibration appears to be good particularly in the higher risk patients, which are the most crucial to identify in order to target interventions.

In addition to predicting the risk of readmission, our method of risk evaluation has several other advantages. First, the risk score is assigned to each patient within 24 to 48 hours of admission by using elements available at the time of, or soon after, admission. This early evaluation during the hospitalization identifies patients who could benefit from interventions throughout the stay that could help mitigate the risks and allow for a safer transition. Other studies have used elements available only at discharge, such as lab values and length of stay [7,11]. Donze et al used 7 elements in a validated scoring system, but several of the elements were discharge values and the risk assessment system had a fair discriminatory value with a c statistic of 0.71, similar to our results. The advantage to having the score available at admission is that several of the factors used to compose the RRS could be addressed during the hospitalization, including increased education for those with greater than 7 medications, intensive care management intervention for those with a lack of social support, and increased or modified education for those with low health literacy.

Second, the score is derived entirely from elements available in the EMR, thus the score is calculated automatically within 24 hours of admission and displayed in the chart for all providers to access. This eliminates any need for individual chart review or patient evaluation outside the normal admission process, making this system extremely efficient. Van Walraven et al [9] devised a scoring system using length of stay, acuity of admission, comorbidities and emergency department use (LACE index), with a validation c statistic of 0.684, which again is similar to our results. However, the LACE index uses the Charlson comorbidity index as a measure of patient comorbidity and this can be cumbersome to calculate in clinical practice. Having the score automatically available to all providers caring for the patient increases their awareness of the patient’s level of risk. Allaudeen and colleagues showed that providers are unable to intuitively predict those patients who are at high-risk for readmission [15]; therefore, an objective, readily available risk stratification is necessary to inform the providers.

 

 

Third, the risk scoring system uses elements from varied sources to include social, medical, and individual factors, all of which have been shown to increase risk of 30-day readmissions [9,15]. An accurate risk scoring system, ideally, should include elements from multiple sources, and use of the EMR allows for this varied compilation. The risk evaluation is done on every patient, regardless of admitting diagnosis, and in spite of this heterogeneous population, it was still found to be significantly accurate. Prior studies have looked at individual populations [7,10,12,13,16]; however, this can miss many patient populations that are also high-risk. Tailoring individual risk algorithms by diagnosis can also be labor intensive.

Our study has limitations. It is a retrospective study and included a relatively short study period of 2 months. This period was chosen because it represented the time from when the RRS was first implemented to when interventions to reduce readmission according to the RRS began, however, it still encompassed a significant number of discharges. We were only able to evaluate readmissions to our own facility; therefore, patients readmitted to other facilities were not included. Although readmission to any facility is undesirable, having a risk scoring system that can reliably predict readmission to the index admission hospital is still helpful. In addition, we only validated the risk score on patients in our own facility. A larger population from multiple facilities would be helpful for further validation. In spite of this limitation we would expect that most of our readmissions return to our own facility given our community setting. In fact, based on Medicare data for readmissions to all facilities, the difference in readmission rate between our facility and all facilities differs by less than 4%.

In summary, we developed a comprehensive risk scoring system that proved to be moderately predictive of readmission that encompasses multiple factors, is available to all providers early in a hospitalization, and is completely automated via the EMR. Further studies are ongoing to refine this score and improve the predictive performance.

 

Corresponding author: Nancy L. Dawson, MD, Division of Hospital Medicine, Mayo Clinic, 4500 San Pablo Road, Jacksonville, FL 32224, [email protected].

Financial disclosures: None.

References

1. Elixhauser A, Steiner C. Statistical Brief #153: Readmissions to U.S. hospitals by diagnosis, 2010. Agency for Healthcare Research and Quality; 2013. Available at www.hcup-us.ahrq.gov/reports/statbriefs/sb153.pdf.

2. Jack BW, Chetty VK, Anthony D, et al. A reengineered hospital discharge program to decrease rehospitalization: a randomized trial. Ann Intern Med 2009;150:178–87.

3. Boutwell A, Hwu S. Effective interventions to reduce rehospitalizations: a survey of the published evidence. Cambridge, MA: Institute for Healthcare Improvement; 2009. Available at www.ihi.org/resources/Pages/Publications/EffectiveInterventionsReduceRehospitalizationsASurveyPublishedEvidence.aspx.

4. Hansen LO, Young RS, Hinami K, et al. Interventions to reduce 30-day rehospitalization: a systematic review. Ann Intern Med 2011;155:520–8.

5. Kripalani S, Theobald CN, Anctil B, Vasilevskis EE. Reducing hospital readmission rates: current strategies and future directions. Ann Rev Med 2014;65:471–85.

6. Osei-Anto A, Joshi M, Audet AM, et al. Health care leader action guide to reduce avoidable readmissions. Chicago: Health Research & Educational Trust; 2010. Available at www.hret.org/care/projects/resources/readmissions_cp.pdf.

7. Zaya M, Phan A, Schwarz ER. Predictors of re-hospitalization in patients with chronic heart failure. World J Cardiol  2012;4:23–30.

8. Hu J, Gonsahn MD, Nerenz DR. Socioeconomic status and readmissions: evidence from an urban teaching hospital. Health Aff (Millwood) 2014;33:778–85.

9. van Walraven C, Dhalla IA, Bell C, et al. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ 2010;182:551–7.

10. Rana S, Tran T, Luo W, et al. Predicting unplanned readmission after myocardial infarction from routinely collected administrative hospital data. Aust Health Rev 2014;38:377–82.

11. Donze J, Aujesky D, Williams D, Schnipper JL. Potentially avoidable 30-day hospital readmissions in medical patients: derivation and validation of a prediction model. JAMA Intern Med 2013;173:632–8.

12. Kogon B, Jain A, Oster M, et al. Risk factors associated with readmission after pediatric cardiothoracic surgery. Ann Thorac Surg 2012;94:865–73.

13. Harhay M, Lin E, Pai A, et al. Early rehospitalization after kidney transplantation: assessing preventability and prognosis. Am J Transplant 2013;13:3164–72.

14. Preventing unnecessary readmissions: transcending the hospital’s four walls to achieve collaborative care coordination. The Advisory Board Company; 2010. Available at www.advisory.com/research/physician-executive-council/studies/2010/preventing-unnecessary-readmissions.

15. Allaudeen N, Schnipper JL, Orav EJ, et al. Inability of providers to predict unplanned readmissions. J Gen Intern Med 2011;26:771–6.

16. Calvillo-King L, Arnold D, Eubank KJ, et al. Impact of social factors on risk of readmission or mortality in pneumonia and heart failure: systematic review. J Gen Intern Med 2013;28:269–82.

Issue
Journal of Clinical Outcomes Management - OCTOBER 2016, VOL. 23, NO. 10
Publications
Sections

From the Divisions of Hospital Medicine (Drs. Dawson, Chirila, Bhide, and Burton) and Biomedical Statistics and Informatics (Ms. Thomas), Mayo Clinic, Jacksonville, FL, and the Division of Hospital Medicine, Mayo Clinic, Phoenix, AZ (Dr. Cannon).

 

Abstract

  • Objective: To validate an electronic tool created to identify inpatients who are at risk of readmission within 30 days and quantify the predictive performance of the readmission risk score (RRS).
  • Methods: Retrospective cohort study including inpa-tients who were discharged between 1 Nov 2012 and 31 Dec 2012. The ability of the RRS to discriminate between those who did and did not have a 30-day urgent readmission was quantified by the c statistic. Calibration was assessed by plotting the observed and predicted probability of 30-day urgent readmission. Predicted probabilities were obtained from generalized estimating equations, clustering on patient.
  • Results: Of 1689 hospital inpatient discharges (1515 patients), 159 (9.4%) had a 30-day urgent readmission. The RRS had some discriminative ability (c statistic: 0.612; 95% confidence interval: 0.570–0.655) and good calibration.
  • Conclusions: Our study shows that the RRS has some discriminative ability. The automated tool can be used to estimate the probability of a 30-day urgent readmission.

 

Hospital readmissions are increasingly scrutinized by the Center for Medicare and Medicaid Services and other payers due to their frequency and high cost. It is estimated that up to 25% of all patients discharged from acute care hospitals are readmitted within 30 days [1]. To address this problem, the Center for Medicare and Medicaid Services is using these rates as one of the benchmarks for quality for hospitals and health care organizations and has begun to assess penalties to those institutions with the highest rates. This scrutiny and the desire for better patient care transitions has resulted in most hospitals implementing various initiatives to reduce potentially avoidable readmissions.

Multiple interventions have been shown to reduce readmissions [2,3]. These interventions have varying effectiveness and are often labor intensive and thus costly to the institutions implementing them. In fact, no one intervention has been shown to be effective alone [4], and it may take several concurrent interventions targeting the highest risk patients to improve transitions of care at discharge that result in reduced readmissions. Many experts do recommend risk stratifying patients in order to target interventions to the highest risk patients for effective use of resources [5,6]. Several risk factor assessments have been proposed with varying success [7–13]. Multiple factors can limit the effectiveness of these risk stratification profiles. They may have low sensitivity and specificity, be based solely on retrospective data, be limited to certain populations, or be created from administrative data only without taking psychosocial factors into consideration [14].

An effective risk assessment ideally would encompass multiple known risk factors including certain comorbidities such as malignancy and heart failure, psychosocial factors such as health literacy and social support, and administrative data including payment source and demographics. All of these have been shown in prior studies to contribute to readmissions [7–13]. In addition, availability of the assessment early in the hospitalization would allow for interventions throughout the hospital stay to mitigate the effect of these factors where possible. To address these needs, our institution formed a readmission task force in January 2010 to review published literature on hospital 30-day readmissions and create a readmission risk score (RRS). The aim of this study was to quantify the predictive performance of the RRS after it was first implemented into the electronic medical record (EMR) in November 2012.

Methods

Study Design and Cohort

The Mayo Clinic institutional review board approved this study. The study was conducted at Mayo Clinic in Jacksonville, Florida, a tertiary care hospital in a community setting. The RRS (Table 1) was created as a modification of 2 published studies [9,15]. Using AMALGA software (Microsoft, Redmond, WA), an automated electronic tool was developed to collect the necessary clinical, psychosocial, and financial information on hospital admission to calculate the RRS. This initial risk score was run retrospectively on a data set of approximately 2000 patients who had been readmitted 2 years prior to the study to determine the cut-off values for high, medium, and low risk prior to the implementation of the electronic tool.

All consecutive adult inpatients who were discharged between 1 November 2012 and 31 December 2012 were included in this retrospective cohort study. This narrow time frame corresponded to the period from RRS tool implementation to the start of readmission interventions. We excluded hospitalizations if the patient died in the hospital.

Outcome Measures

The primary outcome was a 30-day urgent readmission, which included readmissions categorized as either emergency, urgent, or semi-urgent. Secondary outcomes included any 30-day readmission and 30-day death. Only readmissions to Mayo Clinic were examined.

Predictors

In collaboration with the information technology department, an algorithm was written to extract data from the EMR for each patient within 24 hours of admission to the hospital. This data was retrieved from existing repositories of patient information, such as demographic information, payer source, medication list, problem list, and past medical history. In addition, each patient was interviewed by a nurse at the time of admission, and the nurse completed an “admission profile” in the EMR that confirmed or entered past medical history, medications, social support at home, depression symptoms, and learning styles, among other information (Table 1). The algorithm was able to extract data from this evaluation also, so that each element of the risk score was correlated to at least one data source in the EMR. The algorithm then assigned the correct value to each element, and the total score was electronically calculated and placed in a discrete cell in each patient’s record. The algorithm was automatically run again 48 hours after the initial scoring in order to assure completeness of the information. If the patient had a length of stay greater than 5 days, an additional score was generated to include the length of stay component.

Statistical Analysis

The predictive performance of the RRS was assessed by evaluating the discrimination and calibration. Discrimination is the ability of the RRS to separate those who had a 30-day urgent readmission and those who did not. Discrimination was quantified by the c statistic, which is equivalent to the area under the receiver operating characteristic curve in this study owing to the use of binary endpoints. A c statistic of 1.0 would indicate that the RRS perfectly predicts 30-day urgent readmission while a c statistic of 0.5 would indicate the RRS has no apparent accuracy in predicting 30-day urgent readmission. Calibration assesses how closely predicted outcomes agree with observed outcomes. The predicted probability of 30-day urgent readmission was estimated utilizing a generalized estimating equation model, clustering on patient, with RRS as the only predictor variable. Inpatient discharges were divided into deciles of the predicted probabilities for 30-day urgent readmission. Agreement of the predicted and observed outcomes was displayed graphically according to decile of the predicted outcomes. All analyses were performed using SAS (version 9.3, SAS Institute, Cary, NC) and R statistical software (version 3.1.1, R Foundation for Statistical Computing, Vienna, Austria).

 

 

Results

There were 1689 hospital inpatient discharges for 1515 patients during the study period. In this population, the mean age was 64 ± 17 years, 50% were female, and 87% were Caucasian. Additional characteristics are reported in Table 2. Of the 1689 hospital inpatient discharges, 159 (9.4%) resulted in a 30-day urgent readmission and 190 (11.2%) resulted in any 30-day readmission. Among the 1515 patients, 57 (3.8%) died within 30 days of discharge.

The RRS was significantly associated with 30-day urgent readmission (odds ratio [OR] for 1-point increase in the RRS, 1.07 [95% confidence interval {CI} 1.05–1.10]; P < 0.001). A c statistic of 0.612 (95% CI 0.570–0.655) indicates that the RRS has some ability to discriminate between those with and without a 30-day urgent readmission (FigureTable 3). The expected and observed probabilities of 30-day urgent readmission were similar in each decile of the RRS. The calibration (Table 4) shows that although there is some deviation between the observed and expected probabilities, 

the calibration is fairly good, particularly at the higher risk levels, making the tool more valuable for the high-risk patients.

The RRS was also significantly associated with each of the secondary outcome measures. The odds ratios for a 1-point increase in the RRS for any 30-day readmission was 1.06 (95% CI 1.03–1.09, P < 0.001) and the c statistic was 0.591 (95% CI 0.551–0.631, Table 2). The odds ratios for a 1-point increase in the 

RRS for 30-day death was 1.13 (95% CI 1.08–1.18, P < 0.001) and the c statistic was 0.696 (95% CI 0.633–0.758, Table 2). The odds ratios for a 1-point increase in the RRS for 30-day death or 30-day urgent readmission was 1.09 (95% CI 1.07–1.12, P < 0.001) and the c statistic was 0.639 (95% CI 0.601–0.676, Table 2).

 

Discussion

Our study provides evidence that the RRS has some ability to discriminate between patients who did and did not have a 30-day urgent readmission (c statistic 0.612 [95% CI 0.570–0.655]). More importantly the calibration appears to be good particularly in the higher risk patients, which are the most crucial to identify in order to target interventions.

In addition to predicting the risk of readmission, our method of risk evaluation has several other advantages. First, the risk score is assigned to each patient within 24 to 48 hours of admission by using elements available at the time of, or soon after, admission. This early evaluation during the hospitalization identifies patients who could benefit from interventions throughout the stay that could help mitigate the risks and allow for a safer transition. Other studies have used elements available only at discharge, such as lab values and length of stay [7,11]. Donze et al used 7 elements in a validated scoring system, but several of the elements were discharge values and the risk assessment system had a fair discriminatory value with a c statistic of 0.71, similar to our results. The advantage to having the score available at admission is that several of the factors used to compose the RRS could be addressed during the hospitalization, including increased education for those with greater than 7 medications, intensive care management intervention for those with a lack of social support, and increased or modified education for those with low health literacy.

Second, the score is derived entirely from elements available in the EMR, thus the score is calculated automatically within 24 hours of admission and displayed in the chart for all providers to access. This eliminates any need for individual chart review or patient evaluation outside the normal admission process, making this system extremely efficient. Van Walraven et al [9] devised a scoring system using length of stay, acuity of admission, comorbidities and emergency department use (LACE index), with a validation c statistic of 0.684, which again is similar to our results. However, the LACE index uses the Charlson comorbidity index as a measure of patient comorbidity and this can be cumbersome to calculate in clinical practice. Having the score automatically available to all providers caring for the patient increases their awareness of the patient’s level of risk. Allaudeen and colleagues showed that providers are unable to intuitively predict those patients who are at high-risk for readmission [15]; therefore, an objective, readily available risk stratification is necessary to inform the providers.

 

 

Third, the risk scoring system uses elements from varied sources to include social, medical, and individual factors, all of which have been shown to increase risk of 30-day readmissions [9,15]. An accurate risk scoring system, ideally, should include elements from multiple sources, and use of the EMR allows for this varied compilation. The risk evaluation is done on every patient, regardless of admitting diagnosis, and in spite of this heterogeneous population, it was still found to be significantly accurate. Prior studies have looked at individual populations [7,10,12,13,16]; however, this can miss many patient populations that are also high-risk. Tailoring individual risk algorithms by diagnosis can also be labor intensive.

Our study has limitations. It is a retrospective study and included a relatively short study period of 2 months. This period was chosen because it represented the time from when the RRS was first implemented to when interventions to reduce readmission according to the RRS began, however, it still encompassed a significant number of discharges. We were only able to evaluate readmissions to our own facility; therefore, patients readmitted to other facilities were not included. Although readmission to any facility is undesirable, having a risk scoring system that can reliably predict readmission to the index admission hospital is still helpful. In addition, we only validated the risk score on patients in our own facility. A larger population from multiple facilities would be helpful for further validation. In spite of this limitation we would expect that most of our readmissions return to our own facility given our community setting. In fact, based on Medicare data for readmissions to all facilities, the difference in readmission rate between our facility and all facilities differs by less than 4%.

In summary, we developed a comprehensive risk scoring system that proved to be moderately predictive of readmission that encompasses multiple factors, is available to all providers early in a hospitalization, and is completely automated via the EMR. Further studies are ongoing to refine this score and improve the predictive performance.

 

Corresponding author: Nancy L. Dawson, MD, Division of Hospital Medicine, Mayo Clinic, 4500 San Pablo Road, Jacksonville, FL 32224, [email protected].

Financial disclosures: None.

From the Divisions of Hospital Medicine (Drs. Dawson, Chirila, Bhide, and Burton) and Biomedical Statistics and Informatics (Ms. Thomas), Mayo Clinic, Jacksonville, FL, and the Division of Hospital Medicine, Mayo Clinic, Phoenix, AZ (Dr. Cannon).

 

Abstract

  • Objective: To validate an electronic tool created to identify inpatients who are at risk of readmission within 30 days and quantify the predictive performance of the readmission risk score (RRS).
  • Methods: Retrospective cohort study including inpa-tients who were discharged between 1 Nov 2012 and 31 Dec 2012. The ability of the RRS to discriminate between those who did and did not have a 30-day urgent readmission was quantified by the c statistic. Calibration was assessed by plotting the observed and predicted probability of 30-day urgent readmission. Predicted probabilities were obtained from generalized estimating equations, clustering on patient.
  • Results: Of 1689 hospital inpatient discharges (1515 patients), 159 (9.4%) had a 30-day urgent readmission. The RRS had some discriminative ability (c statistic: 0.612; 95% confidence interval: 0.570–0.655) and good calibration.
  • Conclusions: Our study shows that the RRS has some discriminative ability. The automated tool can be used to estimate the probability of a 30-day urgent readmission.

 

Hospital readmissions are increasingly scrutinized by the Center for Medicare and Medicaid Services and other payers due to their frequency and high cost. It is estimated that up to 25% of all patients discharged from acute care hospitals are readmitted within 30 days [1]. To address this problem, the Center for Medicare and Medicaid Services is using these rates as one of the benchmarks for quality for hospitals and health care organizations and has begun to assess penalties to those institutions with the highest rates. This scrutiny and the desire for better patient care transitions has resulted in most hospitals implementing various initiatives to reduce potentially avoidable readmissions.

Multiple interventions have been shown to reduce readmissions [2,3]. These interventions have varying effectiveness and are often labor intensive and thus costly to the institutions implementing them. In fact, no one intervention has been shown to be effective alone [4], and it may take several concurrent interventions targeting the highest risk patients to improve transitions of care at discharge that result in reduced readmissions. Many experts do recommend risk stratifying patients in order to target interventions to the highest risk patients for effective use of resources [5,6]. Several risk factor assessments have been proposed with varying success [7–13]. Multiple factors can limit the effectiveness of these risk stratification profiles. They may have low sensitivity and specificity, be based solely on retrospective data, be limited to certain populations, or be created from administrative data only without taking psychosocial factors into consideration [14].

An effective risk assessment ideally would encompass multiple known risk factors including certain comorbidities such as malignancy and heart failure, psychosocial factors such as health literacy and social support, and administrative data including payment source and demographics. All of these have been shown in prior studies to contribute to readmissions [7–13]. In addition, availability of the assessment early in the hospitalization would allow for interventions throughout the hospital stay to mitigate the effect of these factors where possible. To address these needs, our institution formed a readmission task force in January 2010 to review published literature on hospital 30-day readmissions and create a readmission risk score (RRS). The aim of this study was to quantify the predictive performance of the RRS after it was first implemented into the electronic medical record (EMR) in November 2012.

Methods

Study Design and Cohort

The Mayo Clinic institutional review board approved this study. The study was conducted at Mayo Clinic in Jacksonville, Florida, a tertiary care hospital in a community setting. The RRS (Table 1) was created as a modification of 2 published studies [9,15]. Using AMALGA software (Microsoft, Redmond, WA), an automated electronic tool was developed to collect the necessary clinical, psychosocial, and financial information on hospital admission to calculate the RRS. This initial risk score was run retrospectively on a data set of approximately 2000 patients who had been readmitted 2 years prior to the study to determine the cut-off values for high, medium, and low risk prior to the implementation of the electronic tool.

All consecutive adult inpatients who were discharged between 1 November 2012 and 31 December 2012 were included in this retrospective cohort study. This narrow time frame corresponded to the period from RRS tool implementation to the start of readmission interventions. We excluded hospitalizations if the patient died in the hospital.

Outcome Measures

The primary outcome was a 30-day urgent readmission, which included readmissions categorized as either emergency, urgent, or semi-urgent. Secondary outcomes included any 30-day readmission and 30-day death. Only readmissions to Mayo Clinic were examined.

Predictors

In collaboration with the information technology department, an algorithm was written to extract data from the EMR for each patient within 24 hours of admission to the hospital. This data was retrieved from existing repositories of patient information, such as demographic information, payer source, medication list, problem list, and past medical history. In addition, each patient was interviewed by a nurse at the time of admission, and the nurse completed an “admission profile” in the EMR that confirmed or entered past medical history, medications, social support at home, depression symptoms, and learning styles, among other information (Table 1). The algorithm was able to extract data from this evaluation also, so that each element of the risk score was correlated to at least one data source in the EMR. The algorithm then assigned the correct value to each element, and the total score was electronically calculated and placed in a discrete cell in each patient’s record. The algorithm was automatically run again 48 hours after the initial scoring in order to assure completeness of the information. If the patient had a length of stay greater than 5 days, an additional score was generated to include the length of stay component.

Statistical Analysis

The predictive performance of the RRS was assessed by evaluating the discrimination and calibration. Discrimination is the ability of the RRS to separate those who had a 30-day urgent readmission and those who did not. Discrimination was quantified by the c statistic, which is equivalent to the area under the receiver operating characteristic curve in this study owing to the use of binary endpoints. A c statistic of 1.0 would indicate that the RRS perfectly predicts 30-day urgent readmission while a c statistic of 0.5 would indicate the RRS has no apparent accuracy in predicting 30-day urgent readmission. Calibration assesses how closely predicted outcomes agree with observed outcomes. The predicted probability of 30-day urgent readmission was estimated utilizing a generalized estimating equation model, clustering on patient, with RRS as the only predictor variable. Inpatient discharges were divided into deciles of the predicted probabilities for 30-day urgent readmission. Agreement of the predicted and observed outcomes was displayed graphically according to decile of the predicted outcomes. All analyses were performed using SAS (version 9.3, SAS Institute, Cary, NC) and R statistical software (version 3.1.1, R Foundation for Statistical Computing, Vienna, Austria).

 

 

Results

There were 1689 hospital inpatient discharges for 1515 patients during the study period. In this population, the mean age was 64 ± 17 years, 50% were female, and 87% were Caucasian. Additional characteristics are reported in Table 2. Of the 1689 hospital inpatient discharges, 159 (9.4%) resulted in a 30-day urgent readmission and 190 (11.2%) resulted in any 30-day readmission. Among the 1515 patients, 57 (3.8%) died within 30 days of discharge.

The RRS was significantly associated with 30-day urgent readmission (odds ratio [OR] for 1-point increase in the RRS, 1.07 [95% confidence interval {CI} 1.05–1.10]; P < 0.001). A c statistic of 0.612 (95% CI 0.570–0.655) indicates that the RRS has some ability to discriminate between those with and without a 30-day urgent readmission (FigureTable 3). The expected and observed probabilities of 30-day urgent readmission were similar in each decile of the RRS. The calibration (Table 4) shows that although there is some deviation between the observed and expected probabilities, 

the calibration is fairly good, particularly at the higher risk levels, making the tool more valuable for the high-risk patients.

The RRS was also significantly associated with each of the secondary outcome measures. The odds ratios for a 1-point increase in the RRS for any 30-day readmission was 1.06 (95% CI 1.03–1.09, P < 0.001) and the c statistic was 0.591 (95% CI 0.551–0.631, Table 2). The odds ratios for a 1-point increase in the 

RRS for 30-day death was 1.13 (95% CI 1.08–1.18, P < 0.001) and the c statistic was 0.696 (95% CI 0.633–0.758, Table 2). The odds ratios for a 1-point increase in the RRS for 30-day death or 30-day urgent readmission was 1.09 (95% CI 1.07–1.12, P < 0.001) and the c statistic was 0.639 (95% CI 0.601–0.676, Table 2).

 

Discussion

Our study provides evidence that the RRS has some ability to discriminate between patients who did and did not have a 30-day urgent readmission (c statistic 0.612 [95% CI 0.570–0.655]). More importantly the calibration appears to be good particularly in the higher risk patients, which are the most crucial to identify in order to target interventions.

In addition to predicting the risk of readmission, our method of risk evaluation has several other advantages. First, the risk score is assigned to each patient within 24 to 48 hours of admission by using elements available at the time of, or soon after, admission. This early evaluation during the hospitalization identifies patients who could benefit from interventions throughout the stay that could help mitigate the risks and allow for a safer transition. Other studies have used elements available only at discharge, such as lab values and length of stay [7,11]. Donze et al used 7 elements in a validated scoring system, but several of the elements were discharge values and the risk assessment system had a fair discriminatory value with a c statistic of 0.71, similar to our results. The advantage to having the score available at admission is that several of the factors used to compose the RRS could be addressed during the hospitalization, including increased education for those with greater than 7 medications, intensive care management intervention for those with a lack of social support, and increased or modified education for those with low health literacy.

Second, the score is derived entirely from elements available in the EMR, thus the score is calculated automatically within 24 hours of admission and displayed in the chart for all providers to access. This eliminates any need for individual chart review or patient evaluation outside the normal admission process, making this system extremely efficient. Van Walraven et al [9] devised a scoring system using length of stay, acuity of admission, comorbidities and emergency department use (LACE index), with a validation c statistic of 0.684, which again is similar to our results. However, the LACE index uses the Charlson comorbidity index as a measure of patient comorbidity and this can be cumbersome to calculate in clinical practice. Having the score automatically available to all providers caring for the patient increases their awareness of the patient’s level of risk. Allaudeen and colleagues showed that providers are unable to intuitively predict those patients who are at high-risk for readmission [15]; therefore, an objective, readily available risk stratification is necessary to inform the providers.

 

 

Third, the risk scoring system uses elements from varied sources to include social, medical, and individual factors, all of which have been shown to increase risk of 30-day readmissions [9,15]. An accurate risk scoring system, ideally, should include elements from multiple sources, and use of the EMR allows for this varied compilation. The risk evaluation is done on every patient, regardless of admitting diagnosis, and in spite of this heterogeneous population, it was still found to be significantly accurate. Prior studies have looked at individual populations [7,10,12,13,16]; however, this can miss many patient populations that are also high-risk. Tailoring individual risk algorithms by diagnosis can also be labor intensive.

Our study has limitations. It is a retrospective study and included a relatively short study period of 2 months. This period was chosen because it represented the time from when the RRS was first implemented to when interventions to reduce readmission according to the RRS began, however, it still encompassed a significant number of discharges. We were only able to evaluate readmissions to our own facility; therefore, patients readmitted to other facilities were not included. Although readmission to any facility is undesirable, having a risk scoring system that can reliably predict readmission to the index admission hospital is still helpful. In addition, we only validated the risk score on patients in our own facility. A larger population from multiple facilities would be helpful for further validation. In spite of this limitation we would expect that most of our readmissions return to our own facility given our community setting. In fact, based on Medicare data for readmissions to all facilities, the difference in readmission rate between our facility and all facilities differs by less than 4%.

In summary, we developed a comprehensive risk scoring system that proved to be moderately predictive of readmission that encompasses multiple factors, is available to all providers early in a hospitalization, and is completely automated via the EMR. Further studies are ongoing to refine this score and improve the predictive performance.

 

Corresponding author: Nancy L. Dawson, MD, Division of Hospital Medicine, Mayo Clinic, 4500 San Pablo Road, Jacksonville, FL 32224, [email protected].

Financial disclosures: None.

References

1. Elixhauser A, Steiner C. Statistical Brief #153: Readmissions to U.S. hospitals by diagnosis, 2010. Agency for Healthcare Research and Quality; 2013. Available at www.hcup-us.ahrq.gov/reports/statbriefs/sb153.pdf.

2. Jack BW, Chetty VK, Anthony D, et al. A reengineered hospital discharge program to decrease rehospitalization: a randomized trial. Ann Intern Med 2009;150:178–87.

3. Boutwell A, Hwu S. Effective interventions to reduce rehospitalizations: a survey of the published evidence. Cambridge, MA: Institute for Healthcare Improvement; 2009. Available at www.ihi.org/resources/Pages/Publications/EffectiveInterventionsReduceRehospitalizationsASurveyPublishedEvidence.aspx.

4. Hansen LO, Young RS, Hinami K, et al. Interventions to reduce 30-day rehospitalization: a systematic review. Ann Intern Med 2011;155:520–8.

5. Kripalani S, Theobald CN, Anctil B, Vasilevskis EE. Reducing hospital readmission rates: current strategies and future directions. Ann Rev Med 2014;65:471–85.

6. Osei-Anto A, Joshi M, Audet AM, et al. Health care leader action guide to reduce avoidable readmissions. Chicago: Health Research & Educational Trust; 2010. Available at www.hret.org/care/projects/resources/readmissions_cp.pdf.

7. Zaya M, Phan A, Schwarz ER. Predictors of re-hospitalization in patients with chronic heart failure. World J Cardiol  2012;4:23–30.

8. Hu J, Gonsahn MD, Nerenz DR. Socioeconomic status and readmissions: evidence from an urban teaching hospital. Health Aff (Millwood) 2014;33:778–85.

9. van Walraven C, Dhalla IA, Bell C, et al. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ 2010;182:551–7.

10. Rana S, Tran T, Luo W, et al. Predicting unplanned readmission after myocardial infarction from routinely collected administrative hospital data. Aust Health Rev 2014;38:377–82.

11. Donze J, Aujesky D, Williams D, Schnipper JL. Potentially avoidable 30-day hospital readmissions in medical patients: derivation and validation of a prediction model. JAMA Intern Med 2013;173:632–8.

12. Kogon B, Jain A, Oster M, et al. Risk factors associated with readmission after pediatric cardiothoracic surgery. Ann Thorac Surg 2012;94:865–73.

13. Harhay M, Lin E, Pai A, et al. Early rehospitalization after kidney transplantation: assessing preventability and prognosis. Am J Transplant 2013;13:3164–72.

14. Preventing unnecessary readmissions: transcending the hospital’s four walls to achieve collaborative care coordination. The Advisory Board Company; 2010. Available at www.advisory.com/research/physician-executive-council/studies/2010/preventing-unnecessary-readmissions.

15. Allaudeen N, Schnipper JL, Orav EJ, et al. Inability of providers to predict unplanned readmissions. J Gen Intern Med 2011;26:771–6.

16. Calvillo-King L, Arnold D, Eubank KJ, et al. Impact of social factors on risk of readmission or mortality in pneumonia and heart failure: systematic review. J Gen Intern Med 2013;28:269–82.

References

1. Elixhauser A, Steiner C. Statistical Brief #153: Readmissions to U.S. hospitals by diagnosis, 2010. Agency for Healthcare Research and Quality; 2013. Available at www.hcup-us.ahrq.gov/reports/statbriefs/sb153.pdf.

2. Jack BW, Chetty VK, Anthony D, et al. A reengineered hospital discharge program to decrease rehospitalization: a randomized trial. Ann Intern Med 2009;150:178–87.

3. Boutwell A, Hwu S. Effective interventions to reduce rehospitalizations: a survey of the published evidence. Cambridge, MA: Institute for Healthcare Improvement; 2009. Available at www.ihi.org/resources/Pages/Publications/EffectiveInterventionsReduceRehospitalizationsASurveyPublishedEvidence.aspx.

4. Hansen LO, Young RS, Hinami K, et al. Interventions to reduce 30-day rehospitalization: a systematic review. Ann Intern Med 2011;155:520–8.

5. Kripalani S, Theobald CN, Anctil B, Vasilevskis EE. Reducing hospital readmission rates: current strategies and future directions. Ann Rev Med 2014;65:471–85.

6. Osei-Anto A, Joshi M, Audet AM, et al. Health care leader action guide to reduce avoidable readmissions. Chicago: Health Research & Educational Trust; 2010. Available at www.hret.org/care/projects/resources/readmissions_cp.pdf.

7. Zaya M, Phan A, Schwarz ER. Predictors of re-hospitalization in patients with chronic heart failure. World J Cardiol  2012;4:23–30.

8. Hu J, Gonsahn MD, Nerenz DR. Socioeconomic status and readmissions: evidence from an urban teaching hospital. Health Aff (Millwood) 2014;33:778–85.

9. van Walraven C, Dhalla IA, Bell C, et al. Derivation and validation of an index to predict early death or unplanned readmission after discharge from hospital to the community. CMAJ 2010;182:551–7.

10. Rana S, Tran T, Luo W, et al. Predicting unplanned readmission after myocardial infarction from routinely collected administrative hospital data. Aust Health Rev 2014;38:377–82.

11. Donze J, Aujesky D, Williams D, Schnipper JL. Potentially avoidable 30-day hospital readmissions in medical patients: derivation and validation of a prediction model. JAMA Intern Med 2013;173:632–8.

12. Kogon B, Jain A, Oster M, et al. Risk factors associated with readmission after pediatric cardiothoracic surgery. Ann Thorac Surg 2012;94:865–73.

13. Harhay M, Lin E, Pai A, et al. Early rehospitalization after kidney transplantation: assessing preventability and prognosis. Am J Transplant 2013;13:3164–72.

14. Preventing unnecessary readmissions: transcending the hospital’s four walls to achieve collaborative care coordination. The Advisory Board Company; 2010. Available at www.advisory.com/research/physician-executive-council/studies/2010/preventing-unnecessary-readmissions.

15. Allaudeen N, Schnipper JL, Orav EJ, et al. Inability of providers to predict unplanned readmissions. J Gen Intern Med 2011;26:771–6.

16. Calvillo-King L, Arnold D, Eubank KJ, et al. Impact of social factors on risk of readmission or mortality in pneumonia and heart failure: systematic review. J Gen Intern Med 2013;28:269–82.

Issue
Journal of Clinical Outcomes Management - OCTOBER 2016, VOL. 23, NO. 10
Issue
Journal of Clinical Outcomes Management - OCTOBER 2016, VOL. 23, NO. 10
Publications
Publications
Article Type
Display Headline
An Automated Electronic Tool to Assess the Risk of 30-Day Readmission: Validation of Predictive Performance
Display Headline
An Automated Electronic Tool to Assess the Risk of 30-Day Readmission: Validation of Predictive Performance
Sections
Disallow All Ads
Content Gating
No Gating (article Unlocked/Free)
Alternative CME
Disqus Comments
Default
Use ProPublica

Physician Burnout Meta‐analysis

Article Type
Changed
Mon, 01/02/2017 - 19:34
Display Headline
Burnout in inpatient‐based versus outpatient‐based physicians: A systematic review and meta‐analysis

Hospital medicine is a rapidly growing field of US clinical practice.[1] Almost since its advent, concerns have been expressed about the potential for hospitalists to burn out.[2] Hospitalists are not unique in this; similar concerns heralded the arrival of other location‐defined specialties, including emergency medicine[3] and the full‐time intensivist model,[4] a fact that has not gone unnoted in the literature about hospitalists.[5]

The existing international literature on physician burnout provides good reason for this concern. Inpatient‐based physicians tend to work unpredictable schedules, with substantial impact on home life.[6] They tend to be young, and much burnout literature suggests a higher risk among younger, less‐experienced physicians.[7] When surveyed, hospitalists have expressed more concerns about their potential for burnout than their outpatient‐based colleagues.[8]

In fact, data suggesting a correlation between inpatient practice and burnout predate the advent of the US hospitalist movement. Increased hospital time was reported to correlate with higher rates of burnout in internists,[9] family practitioners,[10] palliative physicians,[11] junior doctors,[12] radiologists,[13] and cystic fibrosis caregivers.[14] In 1987, Keinan and Melamed[15] noted, Hospital work by its very nature, as compared to the work of a general practitioner, deals with the more severe and complicated illnesses, coupled with continuous daily contacts with patients and their anxious families. In addition, these physicians may find themselves embroiled in the power struggles and competition so common in their work environment.

There are other features, however, that may protect inpatient physicians from burnout. Hospital practice can facilitate favorable social relations involving colleagues, co‐workers, and patients,[16] a factor that may be protective.[17] A hospitalist schedule also can allow more focused time for continuing medical education, research, and teaching,[18] which have all been associated with reduced risk of burnout in some studies.[17] Studies of psychiatrists[19] and pediatricians[20] have shown a lower rate of burnout among physicians with more inpatient duties. Finally, a practice model involving a seemingly stable cadre of inpatient physicians has existed in Europe for decades,[2] indicating at least a degree of sustainability.

Information suggesting a higher rate of burnout among inpatient physicians could be used to target therapeutic interventions and to adjust schedules, whereas the opposite outcome could refute a pervasive myth. We therefore endeavored to summarize the literature on burnout among inpatient versus outpatient physicians in a systematic fashion, and to include data not only from the US hospitalist experience but also from other countries that have used a similar model for decades. Our primary hypothesis was that inpatient physicians experience more burnout than outpatient physicians.

It is important to distinguish burnout from depression, job dissatisfaction, and occupational stress, all of which have been studied extensively in physicians. Burnout, as introduced by Freudenberger[21] and further characterized by Maslach,[22] is a condition in which emotional exhaustion, depersonalization, and a low sense of personal accomplishment combine to negatively affect work life (as opposed to clinical depression, which affects all aspects of life). Job satisfaction can correlate inversely with burnout, but it is a separate process[23] and the subject of a recent systematic review.[24] The importance of distinguishing burnout from job dissatisfaction is illustrated by a survey of head and neck surgeons, in which 97% of those surveyed indicated satisfaction with their jobs and 34% of the same group answered in the affirmative when asked if they felt burned out.[25]

One obstacle to the meaningful comparison of burnout prevalence across time, geography, and specialty is the myriad ways in which burnout is measured and reported. The oldest and most commonly used instrument to measure burnout is the Maslach Burnout Inventory (MBI), which contains 22 items assessing 3 components of burnout (emotional exhaustion, depersonalization, and low personal accomplishment).[26] Other measures include the Copenhagen Burnout Inventory[27] (19 items with the components personal burnout, work‐related burnout, and client‐related burnout), Utrecht Burnout Inventory[28] (20‐item modification of the MBI), Boudreau Burnout Questionnaire[29] (30 items), Arbeitsbezogenes Verhaltens und Erlebensmuster[30] (66‐item questionnaire assessing professional commitment, resistance to stress, and emotional well‐being), Shirom‐Melamed Burnout Measure[31] (22 items with subscales for physical fatigue, cognitive weariness, tension, and listlessness), and a validated single‐item questionnaire.[32]

METHODS

Electronic searches of MEDLINE, EMBASE, PsycINFO, SCOPUS, and PubMed were undertaken for articles published from January 1, 1974 (the year in which burnout was first described by Freudenberger[21]) to 2012 (last accessed, September 12, 2012) using the Medical Subject Headings (MeSH) terms stress, psychological; burnout, professional; adaptation, psychological; and the keyword burnout. The same sources were searched to create another set for the MeSH terms hospitalists, physician's practice patterns, physicians/px, professional practice location, and the keyword hospitalist#. Where exact subject headings did not exist in databases, comparable subject headings or keywords were used. The 2 sets were then combined using the operator and. Abstracts from the Society of Hospital Medicine annual conferences were hand‐searched, as were reference lists from identified articles. To ensure that pertinent international literature was captured, there was no language restriction in the search.

A 2‐stage screening process was used. The titles and abstracts of all articles identified in the search were independently reviewed by 2 investigators (D.L.R. and K.J.C.) who had no knowledge of each other's results. An article was obtained when either reviewer deemed it worthy of full‐text review.

All full‐text articles were independently reviewed by the same 2 investigators. The inclusion criterion was the measurement of burnout in physicians who are stated to or can be reasonably assumed to spend the substantial majority of their clinical practice exclusively in either the inpatient or the outpatient setting. Studies of emergency department physicians or specialists who invariably spend substantial amounts of time in both settings (eg, surgeons, anesthesiologists) were excluded. Studies limited to trainees or nonphysicians were also excluded. For both stages of review, agreement between the 2 investigators was assessed by calculating the statistic. Disagreements about inclusion were adjudicated by a third investigator (A.I.B.).

Because our goal was to establish and compare the rate of burnout among US hospitalists and other inpatient physicians around the world, we included studies of hospitalists according to the definition in use at the time of the individual study, noting that the formal definition of a hospitalist has changed over the years.[33] Because practice patterns for physicians described as primary care physicians, family doctors, hospital doctors, and others differ substantially from country to country, we otherwise included only the studies where the practice location was stated explicitly or where the authors confirmed that their study participants either are known or can be reasonably assumed to spend more than 75% of their time caring for hospital inpatients, or are known or can be reasonably assumed to spend the vast majority of their time caring for outpatients.

Data were abstracted using a standardized form and included the measure of burnout used in the study, results, practice location of study subjects, and total number of study subjects. When data were not clear (eg, burnout measured but not reported by the authors, practice location of study subjects not clear), authors were contacted by email, or when no current email address could be located or no response was received, by telephone or letter. In instances where burnout was measured repeatedly over time or before and after a specific intervention, only the baseline measurement was recorded. Because all studies were expected to be nonrandomized, methodological quality was assessed using a version of the tool of Downs and Black,[34] adapted where necessary by omitting questions not applicable to the specific study type (eg randomization for survey studies)[35] and giving a maximum of 1 point for the inclusion of a power calculation.

Two a priori analyses were planned: (1) a statistical comparison of articles directly comparing burnout among inpatient and outpatient physicians, and (2) a statistical comparison of articles measuring burnout among inpatient physicians with articles measuring burnout among outpatient physicians by the most frequently reported measuremean subset scores for emotional exhaustion, depersonalization, and personal accomplishment on the MBI.

The primary outcome measures were the differences between mean subset scores for emotional exhaustion, depersonalization, and personal accomplishment on the MBI. All differences are expressed as (outpatient meaninpatient mean). The variance of each outcome was calculated with standard formulas.[36] To calculate the overall estimate, each study was weighted by the reciprocal of its variance. Studies with fewer than 10 subjects were excluded from statistical analysis but retained in the systematic review.

For studies that reported data for both inpatient and outpatient physicians (double‐armed studies), Cochran Q test and the I2 value were used to assess heterogeneity.[37, 38] Substantial heterogeneity was expected because these individual studies were conducted for different populations in different settings with different study designs, and this expectation was confirmed statistically. Therefore, we used a random effects model to estimate the overall effect, providing a conservative approach that accounted for heterogeneity among studies.[39]

To assess the durability of our findings, we performed separate multivariate meta‐regression analyses by including single‐armed studies only and including both single‐armed and double‐armed studies. For these meta‐regressions, means were again weighted by the reciprocal of their variances, and the arms of 2‐armed studies were considered separately. This approach allowed us to generate an estimate of the differences between MBI subset scores from studies that did not include such an estimate when analyzed separately.[40]

We examined the potential for publication bias in double‐armed studies by constructing a funnel plot, in which mean scores were plotted against their standard errors.[41] The trim‐and‐fill method was used to determine whether adjustment for publication bias was necessary. In addition, Begg's rank correlation test[42] was completed to test for statistically significant publication bias.

Stata 10.0 statistical software (StataCorp, College Station, TX) was used for data analyses. A P value of 0.05 or less was deemed statistically significant. The Preferred Reporting Items for Systematic Reviews and Meta‐analysis checklist was used for the design and execution of the systematic review and meta‐analysis.[43]

Subgroup analyses based on location were undertaken a posteriori. All data (double‐armed meta‐analysis, meta‐regression of single‐armed studies, and meta‐regression of single‐ and double‐armed studies) were analyzed by location (United States vs other; United States vs Europe vs other).

RESULTS

The search results are outlined in Figure 1. In total, 1704 articles met the criteria for full‐text review. A review of pertinent reference lists and author contacts led to the addition of 149 articles. Twenty‐nine references could not be located by any means, despite repeated attempts. Therefore, 1824 articles were subjected to full‐text review by the 2 investigators.

Figure 1
Flow chart of study selection.

Initially, 57 articles were found that met criteria for inclusion. Of these, 2 articles reported data in formats that could not be interpreted.[44, 45] When efforts to clarify the data with the authors were unsuccessful, these studies were excluded. A study specifically designed to assess the response of physicians to a recent series of terrorist attacks[46] was excluded a posteriori because of lack of generalizability. Of the other 54 studies, 15 reported burnout data on both outpatient physicians and inpatient physicians, 22 reported data on outpatient physicians only, and 17 reported data on inpatient physicians only. Table 1 summarizes the results of the 37 studies involving outpatient physicians; Table 2 summarizes the 32 studies involving inpatient physicians.

Summaries of Studies of Outpatient‐Based Physicians Meeting Inclusion Criteria
Lead Author, Publication Year Study Population and Location Instrument No. of Participants EE Score (SD)a DP Score (SD) PA Score (SD) Other Results
  • NOTE: Abbreviations: AVEM, Arbeitsbezogenes Verhaltens und Erlebensmuster; DP, depersonalization subset of MBI; EE, emotional exhaustion subset of MBI; MBI, Maslach Burnout Inventory; PA, personal accomplishment subset of MBI; SMBM, Shirom‐Melamad Burnout Measure; SD, standard deviation.

  • High scores of EE and DP and low scores of PA are features of burnout.

  • Data obtained directly from authors 20102012.

  • SDs calculated from published standard errors. Personal accomplishment scale reversed to match other studies.

  • SDs calculated from published CIs.

Schweitzer, 1994[12] Young physicians of various specialties in South Africa Single‐item survey 7 6 (83%) endorsed burnout
Aasland, 1997 [54]b General practitioners in Norway Modified MBI (22 items; scale, 15) 298 2.65 (0.80) 1.90 (0.59) 3.45 (0.40)
Grassi, 2000 [58] General practitioners in Italy MBI 182 18.49 (11.49) 6.11 (5.86) 38.52 (7.60)
McManus, 2000 [59]b General practitioners in United Kingdom Modified MBI (9 items; scale, 06) 800 8.34 (4.39) 3.18 (3.40) 14.16 (2.95)
Yaman, 2002 [60] General practitioners in 8 European nations MBI 98 25.1 (8.50) 7.3 (4.92) 34.5 (7.67)
Cathbras, 2004 [61] General practitioners in France MBI 306 21.85 (12.4) 9.13 (6.7) 38.7 (7.1)
Goehring, 2005 [63] General practitioners, general internists, pediatricians in Switzerland MBI 1755 17.9 (9.8) 6.5 (4.7) 39.6 (6.5)
Esteva, 2006 [64] General practitioners, pediatricians in Spain MBI 261 27.4 (11.8) 10.07 (6.4) 35.9 (7.06)
Gandini, 2006 [65]b Physicians of various specialties in Argentina MBI 67 31.0 (13.8) 10.2 (6.6) 38.4 (6.8)
Ozyurt, 2006 [66] General practitioners in Turkey Modified MBI (22 items; scale, 04) 55 15.23 (5.80) 4.47 (3.31) 23.38 (4.29)
Deighton, 2007 [67]b Psychiatrists in several German‐speaking nations MBI 19 30.68 (9.92) 13.42 (4.23) 37.16 (3.39)
Dunwoodie, 2007 [68]b Palliative care physicians in Australia MBI 21 14.95 (9.14) 3.95 (3.40) 38.90 (2.88)
Srgaard, 2007 [69]b Psychiatrists in 5 European nations MBI 22 19.41 (8.08) 6.68 (4.93) 39.00 (4.40)
Sosa Oberlin, 2007 [56]b Physicians of various specialties in Argentina Author‐designed instrument 33 26 (78.8%) had 4 burnout symptoms, 6.15 symptoms per physician
Voltmer, 2007 [57]b Physicians of various specialties in Germany AVEM 46 11 (23.9%) exhibited burnout (type B) pattern
dm, 2008 [70]b Physicians of various specialties in Hungary MBI 163 17.45 (11.12) 4.86 (4.91) 36.56 (7.03)
Di Iorio, 2008 [71]b Dialysis physicians in Italy Author‐designed instrument 54 Work: 2.6 (1.5), Material: 3.1 (2.1), Climate: 3.0 (1.1), Objectives: 3.4 (1.6), Quality: 2.2 (1.5), Justification: 3.2 (2.0)
Lee, 2008 [49]b Family physicians in Canada MBI 123 26.26 (9.53) 10.20 (5.22) 38.43 (7.34)
Truchot, 2008 [72] General practitioners in France MBI 259 25.4 (11.7) 7.5 (5.5) 36.5 (7.1)
Twellaar, 2008 [73]b General practitioners in the Netherlands Utrecht Burnout Inventory 349 2.06 (1.11) 1.71 (1.05) 5.08 (0.77)
Arigoni, 2009 [17] General practitioners, pediatricians in Switzerland MBI 258 22.8 (12.0) 6.9 (6.1) 39.0 (7.2)
Bernhardt, 2009 [75] Clinical geneticists in United States MBI 72 25.8 (10.01)c 10.9 (4.16)c 34.8 (5.43)c
Bressi, 2009 [76]b Psychiatrists in Italy MBI 53 23.15 (11.99) 7.02 (6.29) 36.41 (7.54)
Krasner, 2009 [77] General practitioners in United States MBI 60 26.8 (10.9)d 8.4 (5.1)d 40.2 (5.3)d
Lasalvia, 2009 [55]b Psychiatrists in Italy Modified MBI (16 items; scale, 06) 38 2.37 (1.27) 1.51 (1.15) 4.46 (0.87)
Peisah, 2009 [79]b Physicians of various specialties in Australia MBI 28 13.92 (9.24) 3.66 (3.95) 39.34 (8.55)
Shanafelt, 2009 [80]b Physicians of various specialties in United States MBI 408 20.5 (11.10) 4.3 (4.74) 40.8 (6.26)
Zantinge, 2009 [81] General practitioners in the Netherlands Utrecht Burnout Inventory 126 1.58 (0.79) 1.32 (0.72) 4.27 (0.77)
Voltmer, 2010 [83]b Psychiatrists in Germany AVEM 526 114 (21.7%) exhibited burnout (type B) pattern
Maccacaro, 2011 [85]b Physicians of various specialties in Italy MBI 42 14.31 (11.98) 3.62 (4.95) 38.24 (6.22)
Lucas, 2011 [84]b Outpatient physicians periodically staffing an academic hospital teaching service in United States MBI (EE only) 30 24.37 (14.95)
Shanafelt, 2012 [87]b General internists in United States MBI 447 25.4 (14.0) 7.5 (6.3) 41.4 (6.0)
Kushnir, 2004 [62] General practitioners and pediatricians in Israel MBI (DP only) and SMBM 309 9.15 (3.95) SMBM mean (SD), 2.73 per item (0.86)
Vela‐Bueno, 2008 [74]b General practitioners in Spain MBI 240 26.91 (11.61) 9.20 (6.35) 35.92 (7.92)
Lesic, 2009 [78]b General practitioners in Serbia MBI 38 24.71 (10.81) 7.47 (5.51) 37.21 (7.44)
Demirci, 2010 [82]b Medical specialists related to oncology practice in Hungary MBI 26 23.31 (11.2) 6.46 (5.7) 37.7 (8.14)
Putnik, 2011 [86]b General practitioners in Hungary MBI 370 22.22 (11.75) 3.66 (4.40) 41.40 (6.85)
Summary of Studies of Inpatient Physicians Meeting Inclusion Criteria
Lead Author, Publication Year Study Population and Location Instrument No. of Participants EE Score (SD)a DP Score (SD) PA Score (SD) Other Results
  • NOTE: Abbreviations: AVEM, Arbeitsbezogenes Verhaltens und Erlebensmuster; DP, depersonalization subset of MBI; EE, emotional exhaustion subset of MBI; MBI, Maslach Burnout Inventory; PA, personal accomplishment subset of MBI; SD, standard deviation.

  • High scores of EE and DP and low scores of PA are features of burnout.

  • SDs not available; study therefore excluded from statistical comparisons.

  • Different survey item than other studies in this table using a single‐item, 5‐point burnout measure.

  • Data obtained directly from authors 20102012.

  • Personal accomplishment scale reversed to match other studies.

Varga, 1996 [88] Hospital doctors in Spain MBI 179 21.61b 7.33b 35.28b
Aasland, 1997 [54] Hospital doctors in Norway Modified MBI (22 items; scale, 15) 582 2.39 (0.80) 1.81 (0.65) 3.51 (0.46)
Bargellini, 2000 [89] Hospital doctors in Italy MBI 51 17.45 (9.87) 7.06 (5.54) 35.33 (7.90)
Grassi, 2000 [58] Hospital doctors in Italy MBI 146 16.17 (9.64) 5.32 (4.76) 38.71 (7.28)
Hoff, 2001 [33] Hospitalists in United States Single‐item surveyc 393 12.9% burned out (>4/5), 24.9% at risk for burnout (34/5), 62.2% at no current risk (mean, 2.86 on 15 scale)
Trichard, 2005 [90] Hospital doctors in France MBI 199 16 (10.7) 6.6 (5.7) 38.5 (6.5)
Gandini, 2006 [65]d Hospital doctors in Argentina MBI 290 25.0 (12.7) 7.9 (6.2) 40.1 (7.0)
Dunwoodie, 2007 [68]d Palliative care doctors in Australia MBI 14 18.29 (14.24) 5.29 (5.89) 38.86 (3.42)
Srgaard, 2007 [69]d Psychiatrists in 5 European nations MBI 18 18.56 (9.32) 5.50 (3.79) 39.08 (5.39)
Sosa Oberlin, 2007 [56]d Hospital doctors in Argentina Author‐designed instrument 3 3 (100%) had 4 burnout symptoms, 8.67 symptoms per physician
Voltmer, 2007 [57]d Hospital doctors in Germany AVEM 271 77 (28.4%) exhibited burnout (type B) pattern
dm, 2008 [70]b Physicians of various specialties in Hungary MBI 194 19.23 (10.79) 4.88 (4.61) 35.26 (8.42)
Di Iorio, 2008 [71]d Dialysis physicians in Italy Author‐designed instrument 62 Work, mean (SD), 3.1 (1.4); Material, mean (SD), 3.3 (1.5); Climate, mean (SD), 2.9 (1.1); Objectives, mean (SD), 2.5 (1.5); Quality, mean (SD), 3.0 (1.1); Justification, mean (SD), 3.1 (2.1)
Fuss, 2008 [91]d Hospital doctors in Germany Copenhagen Burnout Inventory 292 Mean Copenhagen Burnout Inventory, mean (SD), 46.90 (18.45)
Marner, 2008 [92]d Psychiatrists and 1 generalist in United States MBI 9 20.67 (9.75) 7.78 (5.14) 35.33 (6.44)
Shehabi, 2008 [93]d Intensivists in Australia Modified MBI (6 items; scale, 15) 86 2.85 (0.93) 2.64 (0.85) 2.58 (0.83)
Bressi, 2009 [76]d Psychiatrists in Italy MBI 28 17.89 (14.46) 5.32 (7.01) 34.57 (11.27)
Brown, 2009 [94] Hospital doctors in Australia MBI 12 22.25 (8.59) 6.33 (2.71) 39.83 (7.31)
Lasalvia, 2009 [55]d Psychiatrists in Italy Modified MBI (16 items; scale, 06) 21 1.95 (1.04) 1.35 (0.85) 4.46 (1.04)
Peisah, 2009 [79]d Hospital doctors in Australia MBI 62 20.09 (9.91) 6.34 (4.90) 35.06 (7.33)
Shanafelt, 2009 [80]d Hospitalists and intensivists in United States MBI 19 25.2 (11.59) 4.4 (3.79) 38.5 (8.04)
Tunc, 2009 [95] Hospital doctors in Turkey Modified MBI (22 items; scale, 04) 62 1.18 (0.78) 0.81 (0.73) 3.10 (0.59)e
Cocco, 2010 [96]d Hospital geriatricians in Italy MBI 38 16.21 (11.56) 4.53 (4.63) 39.13 (7.09)
Doppia, 2011 [97]d Hospital doctors in France Copenhagen Burnout Inventory 1,684 Mean work‐related burnout score, 2.72 (0.75)
Glasheen, 2011 [98] Hospitalists in United States Single‐item survey 265 Mean, 2.08 on 15 scale 62 (23.4%) burned out
Lucas, 2011 [84]d Academic hospitalists in United States MBI (EE only) 26 19.54 (12.85)
Thorsen, 2011 [99] Hospital doctors in Malawi MBI 2 25.5 (4.95) 8.5 (6.36) 25.0 (5.66)
Hinami, 2012 [50]d Hospital doctors in United States Single‐item survey 793 Mean, 2.24 on 15 scale 261 (27.2%) burned out
Quenot, 2012 [100]d Intensivists in France MBI 4 33.25 (4.57) 13.50 (5.45) 35.25 (4.86)
Ruitenburg, 2012 [101] Hospital doctors in the Netherlands MBI (EE and DP only) 214 13.3 (8.0) 4.5 (4.1)
Seibt, 2012 [102]d Hospital doctors in Germany Modified MBI (16 items; scale, 06, reported per item rather than totals) 2,154 2.2 (1.4) 1.4 (1.2) 5.1 (0.9)
Shanafelt, 2012 [87]d Hospitalists in United States MBI 130 24.7 (12.5) 9.1 (6.9) 39.0 (7.6)

Table 3 summarizes the results of the 15 studies that reported burnout data for both inpatient and outpatient physicians, allowing direct comparisons to be made. Nine studies reported MBI subset totals with standard deviations, 2 used different modifications of the MBI, 2 used different author‐derived measures, 1 used only the emotional exhaustion subscale of the MBI, and 1 used the Arbeitsbezogenes Verhaltens und Erlebensmuster. Therefore, statistical comparison was attempted only for the 9 studies reporting comparable MBI data, comprising burnout data on 1390 outpatient physicians and 899 inpatient physicians.

Summary of Studies Including Both Inpatient‐Based and Outpatient‐Based Physicians Meeting Inclusion Criteria
Lead Author, Publication Year Location Instrument Inpatient‐Based Physicians Outpatient‐Based Physicians
No. Results, Score (SD)a No. Results, Score (SD)a
  • NOTE: Abbreviations: AVEM, Arbeitsbezogenes Verhaltens und Erlebensmuster; DP, depersonalization subset of MBI; EE, emotional exhaustion subset of MBI; MBI, Maslach Burnout Inventory; PA, personal accomplishment subset of MBI; SD, standard deviation.

  • High scores of EE and DP and low scores of PA are features of burnout.

  • Data obtained directly from authors from 20102012.

Aasland, 1997 [54]b Norway Modified MBI (22 items; scale, 15) 582 EE, 2.39 (0.80); DP, 1.81 (0.65); PA, 3.51 (0.46) 298 EE, 2.65 (0.80); DP, 1.90 (0.59); PA, 3.45 (0.40)
Grassi, 2000 [58] Italy MBI 146 EE, 16.17 (9.64); DP, 5.32 (4.76); PA, 38.71 (7.28) 182 EE, 18.49 (11.49); DP, 6.11 (5.86); PA, 38.52 (7.60)
Gandini, 2006 [65]b Argentina MBI 290 EE, 25.0 (12.7);DP, 7.9 (6.2); PA, 40.1 (7.0) 67 EE, 31.0 (13.8); DP, 10.2 (6.6); PA, 38.4 (6.8)
Dunwoodie, 2007 [68]b Australia MBI 14 EE, 18.29 (14.24); DP, 5.29 (5.89); PA, 38.86 (3.42) 21 EE, 14.95 (9.14); DP, 3.95 (3.40); PA, 38.90 (2.88)
Srgaard, 2007 [69]b 5 European nations MBI 18 EE, 18.56 (9.32); DP, 5.50 (3.79); PA, 39.08 (5.39) 22 EE, 19.41 (8.08); DP, 6.68 (4.93); PA, 39.00 (4.40)
Sosa Oberlin, 2007 [56]b Argentina Author‐designed instrument 3 3 (100%) had 4 burnout symptoms, 8.67 symptoms per physician 33 26 (78.8%) had 4 burnout symptoms, 6.15 symptoms per physician
Voltmer, 2007 [57]b Germany AVEM 271 77 (28.4%) exhibited burnout (type B) pattern 46 11 (23.9%) exhibited burnout (type B) pattern
dm, 2008 [70]b Hungary MBI 194 EE, 19.23 (10.79); DP, 4.88 (4.61); PA, 35.26 (8.42) 163 EE, 17.45 (11.12); DP, 4.86 (4.91); PA, 36.56 (7.03)
Di Iorio, 2008 [71]b Italy Author‐designed instrument 62 Work: 3.1 (1.4); material: 3.3 (1.5); climate: 2.9 (1.1); objectives: 2.5 (1.5); quality: 3.0 (1.1); justification: 3.1 (2.1) 54 Work: 2.6 (1.5); material: 3.1 (2.1); climate: 3.0 (1.1); objectives: 3.4 (1.6); quality: 2.2 (1.5); justification: 3.2 (2.0)
Bressi, 2009 [76]b Italy MBI 28 EE, 17.89 (14.46); DP, 5.32 (7.01); PA, 34.57 (11.27) 53 EE, 23.15 (11.99); DP, 7.02 (6.29); PA, 36.41 (7.54)
Lasalvia, 2009[55]b Italy Modified MBI (16 items; scale, 06) 21 EE, 1.95 (1.04); DP, 1.35 (0.85); PA, 4.46 (1.04) 38 EE, 2.37 (1.27); DP, 1.51 (1.15); PA, 4.46 (0.87)
Peisah, 2009 [79]b Australia MBI 62 EE, 20.09 (9.91); DP, 6.34 (4.90); PA, 35.06 (7.33) 28 EE, 13.92 (9.24); DP, 3.66 (3.95); PA, 39.34 (8.55)
Shanafelt, 2009 [80]b United States MBI 19 EE, 25.2 (11.59); DP, 4.4 (3.79); PA, 38.5 (8.04) 408 EE, 20.5 (11.10); DP, 4.3 (4.74); PA, 40.8 (6.26)
Lucas, 2011 [84]b United States MBI (EE only) 26 EE, 19.54 (12.85) 30 EE, 24.37 (14.95)
Shanafelt, 2012 [87]b United States MBI 130 EE, 24.7 (12.5); DP, 9.1 (6.9); PA, 39.0 (7.6) 447 EE, 25.4 (14.0); DP, 7.5 (6.3); PA, 41.4 (6.0)

Figure 2 shows that no significant difference existed between the groups regarding emotional exhaustion (mean difference, 0.11 points on a 54‐point scale; 95% confidence interval [CI], 2.40 to 2.61; P=0.94). In addition, there was no significant difference between the groups regarding depersonalization (Figure 3; mean difference, 0.00 points on a 30‐point scale; 95% CI, 1.03 to 1.02; P=0.99) and personal accomplishment (Figure 4; mean difference, 0.93 points on a 48‐point scale; 95% CI, 0.23 to 2.09; P=0.11).

Figure 2
Forest plot for double‐armed studies reporting Maslach Burnout Inventory scores for emotional exhaustion. The size of the square represents study size, and the bars represent the 95% confidence interval (CI).
Figure 3
Forest plot for double‐armed studies reporting Maslach Burnout Inventory scores for depersonalization. The size of the square represents study size and the bars represent the 95% confidence interval (CI).
Figure 4
Forest plot for double‐armed studies reporting Maslach Burnout Inventory scores for personal accomplishment. The size of the square represents study size and the bars represent the 95% confidence interval (CI). The direction of the y‐axis has been reversed so that greater burnout in outpatient physicians remains to the right.

We used meta‐regression to allow the incorporation of single‐armed MBI studies. Whether single‐armed studies were analyzed separately (15 outpatient studies comprising 3927 physicians, 4 inpatient studies comprising 300 physicians) or analyzed with double‐armed studies (24 outpatient arms comprising 5318 physicians, 13 inpatient arms comprising 1301 physicians), the lack of a significant difference between the groups persisted for the depersonalization and personal accomplishment scales (Figure 5). Emotional exhaustion was significantly higher in outpatient physicians when single‐armed studies were considered separately (mean difference, 6.36 points; 95% CI, 2.24 to 10.48; P=0.002), and this difference persisted when all studies were combined (mean difference, 3.00 points; 95% CI, 0.05 to 5.94, P=0.046).

Figure 5
Forest plots comparing results of meta‐analysis of 9 double‐armed studies, meta‐regression of 19 single‐armed studies, and meta‐regression of all 28 studies reporting Maslach Burnout Inventory scores. The direction of the y‐axis of the personal accomplishment plot has been reversed so that higher burnout in outpatient physicians remains to the right. Error bars represent the 95% confidence interval.

Subgroup analysis by geographic location showed US outpatient physicians had a significantly higher personal accomplishment score than US inpatient physicians (mean difference, 2.38 points; 95% CI, 1.22 to 3.55; P<0.001) in double‐armed studies. This difference did not persist when single‐armed studies were included through meta‐regression (mean difference, 0.55 points, 95% CI, 4.30 to 5.40, P=0.83).

Table 4 demonstrates that methodological quality was generally good from the standpoint of the reporting and bias subsections of the Downs and Black tool. External validity was scored lower for many studies due to the use of convenience samples and lack of information about physicians who declined to participate.

Assessment of Methodologic Quality
Lead Author, Publication Year Reporting External Validity Internal Validity: Bias Internal Validity: Confounding Power
  • NOTE: For survey studies (all studies except Krasner,[77] Lucas,[84] and Quenot[100]), questions regarding interventions were omitted. For uncontrolled studies (all studies except Lucas[84]), questions regarding controls were omitted. The presence of a power calculation was awarded 1 point.

Schweitzer, 1994 [12] 5 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Varga, 1996 [88] 5 of 6 points 1 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Aasland, 1997 [54] 3 of 6 points 2 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Bargellini, 2000 [89] 5 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Grassi, 2000 [58] 6 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
McManus, 2000 [59] 5 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Hoff, 2001 [33] 6 of 6 points 2 of 2 points 2 of 4 points 1 of 1 point 0 of 1 point
Yaman, 2002 [60] 5 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Cathbras, 2004 [61] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Kushnir, 2004 [62] 5 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Goehring, 2005 [63] 6 of 6 points 1 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Trichard, 2005 [90] 3 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Esteva, 2006 [64] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Gandini, 2006 [65] 6 of 6 points 1 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Ozyurt, 2006 [66] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Deighton, 2007 [67] 5 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Dunwoodie, 2007 [68] 5 of 6 points 2 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Srgaard, 2007 [69] 6 of 6 points 0 of 2 points 3 of 4 points 1 of 1 point 1 of 1 point
Sosa Oberlin, 2007 [56] 4 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Voltmer, 2007 [57] 4 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
dm, 2008 [70] 5 of 6 points 2 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Di Iorio, 2008 [71] 6 of 6 points 0 of 2 points 2 of 4 points 0 of 1 point 0 of 1 point
Fuss, 2008 [91] 6 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Lee, 2008 [49] 4 of 6 points 2 of 2 points 4 of 4 points 0 of 1 point 1 of 1 point
Marner, 2008 [92] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Shehabi, 2008 [93] 3 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Truchot, 2008 [72] 5 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Twellaar, 2008 [73] 6 of 6 points 2 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Vela‐Bueno, 2008 [74] 5 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Arigoni, 2009 [17] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Bernhardt, 2009 [75] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Bressi, 2009 [76] 6 of 6 points 0 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Brown, 2009 [94] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Krasner, 2009 [77] 9 of 11 points 0 of 3 points 6 of 7 points 1 of 2 points 1 of 1 point
Lasalvia, 2009 [55] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Lesic, 2009 [78] 5 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Peisah, 2009 [79] 6 of 6 points 2 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Shanafelt, 2009 [80] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Tunc, 2009 [95] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Zantinge, 2009 [81] 5 of 6 points 0 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Cocco, 2010 [96] 4 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Demirci, 2010 [82] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Voltmer, 2010 [83] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Doppia, 2011 [97] 5 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Glasheen, 2011 [98] 5 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Lucas, 2011 [84] 10 of 11 points 2 of 3 points 7 of 7 points 5 of 6 points 1 of 1 point
Maccacaro, 2011 [85] 5 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Putnik, 2011 [86] 6 of 6 points 1 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Thorsen, 2011 [99] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Hinami, 2012 [50] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 1 of 1 point
Quenot, 2012 [100] 8 of 11 points 1 of 3 points 6 of 7 points 1 of 2 points 0 of 1 point
Ruitenburg, 2012 [101] 6 of 6 points 2 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Seibt, 2012 [102] 6 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Shanafelt, 2012 [87] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point

Funnel plots were used to evaluate for publication bias in the meta‐analysis of the 8 double‐armed studies (Figure 6). We found no significant evidence of bias, which was supported by Begg's test P values of 0.90 for emotional exhaustion, >0.99 for depersonalization, and 0.54 for personal accomplishment. A trim‐and‐fill analysis determined that no adjustment was necessary.

Figure 6
Funnel plots for the 8 double‐armed studies that reported Maslach Burnout Inventory scores for emotional exhaustion, depersonalization, and personal accomplishment. Abbreviations: CI, confidence interval.

DISCUSSION

There appears to be no support for the long‐held belief that inpatient physicians are particularly prone to burnout. Among studies for which practice location was stated explicitly or could be obtained from the authors, and who used the MBI, no differences were found among inpatient and outpatient physicians with regard to depersonalization or personal accomplishment. This finding persisted whether double‐armed studies were compared directly, single‐armed studies were incorporated into this analysis, or single‐armed studies were analyzed separately. Outpatient physicians had a higher degree of emotional exhaustion when all studies were considered.

There are several reasons why outpatient physicians may be more prone to emotional exhaustion than their inpatient colleagues. Although it is by no means true that all inpatient physicians work in shifts, the increased availability of shift work may allow some inpatient physicians to better balance their professional and personal lives, a factor of work with which some outpatient physicians have struggled.[47] Inpatient practice may also afford more opportunity for teamwork, a factor that has been shown to correlate with reduced burnout.[48] When surveyed about burnout, outpatient physicians have cited patient volumes, paperwork, medicolegal concerns, and lack of community support as factors.[49] Inpatient physicians are not immune to these forces, but they arguably experience them to different degrees.

The absence of a higher rate of depersonalization among inpatient physicians is particularly reassuring in light of concerns expressed with the advent of US hospital medicinethat some hospitalists would be prone to viewing patients as an impediment to the efficient running of the hospital,[2] the very definition of depersonalization.

Although the difference in the whole sample was not statistically significant, the consistent tendency toward a greater sense of personal accomplishment among outpatient physicians is also noteworthy, particularly because post hoc subgroup analysis of US physicians did show statistical significance in both 2‐armed studies. Without detailed age data for the physicians in each study, we could not separate the possible impact of age on personal accomplishment; hospital medicine is a newer specialty staffed by generally younger physicians, and hospitalists may not have had time to develop a sense of accomplishment. When surveyed about job satisfaction, hospitalists have also reported the feeling that they were treated as glorified residents,[50] a factor that, if shared by other inpatient physicians, must surely affect their sense of personal accomplishment. The lack of longitudinal care for patients and the substantial provision of end‐of‐life care also may diminish the sense of personal accomplishment among inpatient physicians.

Another important finding from this systematic review is the marked heterogeneity of the instruments used to measure physician burnout. Many of the identified studies could not be subjected to meta‐analysis because of their use of differing burnout measures. Drawing more substantial conclusions about burnout and practice location is limited by the fact that, although the majority of studies used the full MBI, the largest study of European hospital doctors used the Copenhagen Burnout Inventory, and the studies thus far of US hospitalists have used single‐item surveys or portions of the MBI. Not reflected in this review is the fact that a large study of US burnout and job satisfaction[51] did not formally address practice location (M. Linzer, personal communication, August 2012). Similarly, a large study of British hospital doctors[52] is not included herein because many of the physicians involved had substantial outpatient duties (C. Taylor, personal communication, July 2012). Varying burnout measures have complicated a previous systematic review of burnout in oncologists.[53] Two studies that directly compared inpatient and outpatient physicians but that were excluded from our statistical analysis because of their modified versions of the MBI,[54, 55] showed higher burnout scores in outpatient physicians. Two other studies that provided direct inpatient versus outpatient comparisons but that used alternative burnout measures[56, 57] showed a greater frequency of burnout in inpatient physicians, but of these, 1 study[56] involved only 3 inpatient physicians.

Several limitations of our study should be considered. Although we endeavored to obtain information from authors (with some success) about specific local practice patterns and eliminated many studies because of incomplete data or mixed practice patterns (eg, general practitioners who take frequent hospital calls, hospital physicians with extensive outpatient duties in a clinic attached to their hospital), it remains likely that many physicians identified as outpatient provided some inpatient care (attending a few weeks per year on a teaching service, for example) and that some physicians identified as inpatient have minimal outpatient duties.

More importantly, the dataset analyzed is heterogeneous. Studies of the incidence of burnout are naturally observational and therefore not randomized. Inclusion of international studies is necessary to answer the research question (because published data on US hospitalists are sparse) but naturally introduces differences in practice settings, local factors, and other factors for which we cannot possibly account fully.

Our meta‐analysis therefore addressed a broad question about burnout among inpatient and outpatient physicians in various diverse settings. Applying it to any 1 population (including US hospitalists) is, by necessity, imprecise.

Post hoc analysis should be viewed with caution. For example, the finding of a statistical difference between US inpatient and outpatient physicians with regard to personal accomplishment score is compelling from the standpoint of hypothesis generation. However, it is worth bearing in mind that this analysis contained only 2 studies, both by the same primary author, and compared 855 outpatient physicians to only 149 hospitalists. This difference was no longer significant when 2 outpatient studies were added through meta‐regression.

Finally, the specific focus of this study on practice location precluded comparison with emergency physicians and anesthesiologists, 2 specialist types that have been the subject of particularly robust burnout literature. As the literature on hospitalist burnout becomes more extensive, comparative studies with these groups and with intensivists might prove instructive.

In summary, analysis of 24 studies comprising data on 5318 outpatient physicians and 1301 inpatient physicians provides no support for the commonly held belief that hospital‐based physicians are particularly prone to burnout. Outpatient physicians reported higher emotional exhaustion. Further studies of the incidence and severity of burnout according to practice location are indicated. We propose that in future studies, to avoid the difficulties with statistical analysis summarized herein, investigators ask about and explicitly report practice location (inpatient vs outpatient vs both) and report mean MBI subset data and standard deviations. Such information about US hospitalists would allow comparison with a robust (if heterogeneous) international literature on burnout.

Acknowledgments

The authors gratefully acknowledge all of the study authors who contributed clarification and guidance for this project, particularly the following authors who provided unpublished data for further analysis: Olaf Aasland, MD; Szilvia dm, PhD; Annalisa Bargellini, PhD; Cinzia Bressi, MD, PhD; Darrell Campbell Jr, MD; Ennio Cocco, MD; Russell Deighton, PhD; Senem Demirci Alanyali, MD; Biagio Di Iorio, MD, PhD; David Dunwoodie, MBBS; Sharon Einav, MD; Madeleine Estryn‐Behar, PhD; Bernardo Gandini, MD; Keiki Hinami, MD; Antonio Lasalvia, MD, PhD; Joseph Lee, MD; Guido Maccacaro, MD; Swati Marner, EdD; Chris McManus, MD, PhD; Carmelle Peisah, MBBS, MD; Katarina Putnik, MSc; Alfredo Rodrguez‐Muoz, PhD; Yahya Shehabi, MD; Evelyn Sosa Oberlin, MD; Jean Karl Soler, MD, MSc; Knut Srgaard, PhD; Cath Taylor; Viva Thorsen, MPH; Mascha Twellaar, MD; Edgar Voltmer, MD; Colin West, MD, PhD; and Deborah Whippen. The authors also thank the following colleagues for their help with translation: Dusanka Anastasijevic (Norwegian); Joyce Cheung‐Flynn, PhD (simplified Chinese); Ales Hlubocky, MD (Czech); Lena Jungheim, RN (Swedish); Erez Kessler (Hebrew); Kanae Mukai, MD (Japanese); Eliane Purchase (French); Aaron Shmookler, MD (Russian); Jan Stepanek, MD (German); Fernando Tondato, MD (Portuguese); Laszlo Vaszar, MD (Hungarian); and Joseph Verheidje, PhD (Dutch). Finally, the authors thank Cynthia Heltne and Diana Rogers for their expert and tireless library assistance, Bonnie Schimek for her help with figures, and Cindy Laureano and Elizabeth Jones for their help with author contact.

Files
References
  1. Siegal EM. Just because you can, doesn't mean that you should: a call for the rational application of hospitalist comanagement. J Hosp Med. 2008;3(5):398402.
  2. Fitzgerald FT. Hospitalists. Hospitalist. 1998;1(4):56.
  3. Dorevitch S, Forst L. The occupational hazards of emergency physicians. Am J Emerg Med. 2000;18(3):300311.
  4. Fields AI, Cuerdon TT, Brasseux CO, et al. Physician burnout in pediatric critical care medicine. Crit Care Med. 1995;23(8):14251429.
  5. Schroeder SA, Schapiro R. The hospitalist: new boon for internal medicine or retreat from primary care? Ann Intern Med. 1999;130(4 pt 2): 382387.
  6. Maillard MF, Iwatsubo Y, Grimon G, et al. Enquete sur les horaires et la charge de travail des medecins dans un establissement de l'Assitance Publique‐Hopitaux de Paris. Arch Mal Prof. 1996;57:438444.
  7. Bohle A, Baumgartel M, Gotz ML, Muller EH, Jocham D. Burn‐out of urologists in the county of Schleswig‐Holstein, Germany: a comparison of hospital and private practice urologists. J Urol. 2001;165(4): 11581161.
  8. Wetterneck TB, Linzer M, Halls JJ, et al. Satisfaction and worklife of academic hospitalist and non‐hospitalist attendings on general medical inpatient rotations. J Gen Internal Med. 2006;21(S4):128.
  9. Saint S, Zemencuk JK, Hayward RA, Golin CE, Konrad TR, Linzer M; SGIM Career Satisfaction Group. What effect does increasing inpatient time have on outpatient‐oriented internist satisfaction? J Gen Intern Med. 2003;18(9):725729.
  10. Lemkau J, Rafferty J, Gordon R. Burnout and career‐choice regret among family practice physicians in early practice. Fam Pract Res J. 1994;14(3):213222.
  11. Graham J, Ramirez AJ, Cull A, Finlay I, Hoy A, Richards MA. Job stress and satisfaction among palliative physicians. Palliat Med. 1996; 10(3):185194.
  12. Schweitzer B. Stress and burnout in junior doctors. S Afr Med J. 1994; 84(6):352354.
  13. Lim RC, Pinto C. Work stress, satisfaction and burnout in New Zealand radiologists: comparison of public hospital and private practice in New Zealand. J Med Imaging Radiat Oncol. 2009;53(2):194199.
  14. Lewiston NJ, Conley J, Blessing‐Moore J. Measurement of hypothetical burnout in cystic fibrosis caregivers. Acta Paediatr Scand. 1981; 70(6):935939.
  15. Keinan G, Melamed S. Personality characteristics and proneness to burnout: a study among internists. Stress Med. 1987;3(4):307315.
  16. Hoff T, Whitcomb WF, Nelson JR. Thriving and surviving in a new medical career: the case of hospitalist physicians. J Health Soc Behav. 2002;43(1):7291.
  17. Arigoni F, Bovier PA, Mermillod B, Waltz P, Sappino AP. Prevalence of burnout among Swiss cancer clinicians, paediatricians and general practitioners: who are most at risk? Support Care Cancer. 2009;17(1): 7581.
  18. Arora V, Fang MC, Kripalani S, Amin AN. Preparing for “diastole”: advanced training opportunities for academic hospitalists. J Hosp Med. 2006;1(6):368377.
  19. Prosser D, Johnson S, Kuipers E, Szmukler G, Bebbington P, Thornicroft G. Mental health, “burnout” and job satisfaction among hospital and community‐based mental health staff. Br J Psychiatry. 1996;169(3):334337.
  20. McPhillips HA, Stanton B, Zuckerman B, Stapleton FB. Role of a pediatric department chair: factors leading to satisfaction and burnout. J Pediatr. 2007;151(4):425430.
  21. Freudenberger HJ. Staff burn‐out. J Soc Iss. 1974;30(1):159165.
  22. Maslach C. Burned‐out. Hum Behav. 1976;5(9):1622.
  23. Keyes LE. Underpaid women, stressed out men, satisfied emergency physicians. Ann Emerg Med. 2008;51(6):729731.
  24. Scheurer D, McKean S, Miller J, Wetterneck T. U.S. physician satisfaction: a systematic review. J Hosp Med. 2009;4(9):560568.
  25. Johnson JT, Wagner RL, Rueger RM, Goepfert H. Professional burnout among head and neck surgeons: results of a survey. Head Neck. 1993;15(6):557560.
  26. Maslach C, Jackson SE. The measurement of experienced burnout. J Occup Behav. 1981;2(2):99113.
  27. Kristensen TS, Borritz M, Villadsen E, Christensen KB. The Copenhagen Burnout Inventory: a new tool for the assessment of burnout. Work Stress. 2005;19(3):192207.
  28. Schaufeli WB, Dierendonck D. Handleiding van de Utrechtse Burnout Schaal (UBOS). Lisse, the Netherlands: Swets Test Services; 2000.
  29. Goodfellow RL. Alberta Physician Burnout [master's thesis]. Alberta, Canada: The University of Lethbridge; 2003.
  30. Schaarschmidt U, Fischer AW. Arbeitsbezogenes Verhaltensund Erlebensmuster AVEM. Frankfurt, Germany: Swets Test Services; 2003.
  31. Lundgren‐Nilsson A, Jonsdottir IH, Pallant J, Ahlborg G. Internal construct validity of the Shirom‐Melamed Burnout Questionnaire (SMBQ). BMC Public Health. 2012;12:1.
  32. Rohland BM, Kruse GR, Rohrer JE. Validation of a single‐item measure of burnout against the Maslach Burnout Inventory among physicians. Stress Health. 2004;20(2):7579.
  33. Hoff TH, Whitcomb WF, Williams K, Nelson JR, Cheesman RA. Characteristics and work experiences of hospitalists in the United States. Arch Intern Med. 2001;161(6):851858.
  34. Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non‐randomised studies of health care interventions. J Epidemiol Community Health. 1998;52(6):377384.
  35. Reeves BC, Deeks JJ, Higgins JPT, Wells GA. Including nonrandomized studies. In: Higgins JPT, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.0.1. The Cochrane Collaboration; 2008. Available at: www.cochrane‐handbook. org. Accessed July 24, 2013.
  36. Kahn HA, Sempos CT. Statistical Methods in Epidemiology. New York, NY: Oxford University Press; 1989.
  37. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta‐analysis. Stat Med. 2002;21(11):15391558.
  38. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta‐analyses. BMJ. 2003;327(7414):557560.
  39. Furukawa TA, Guyatt GH, Griffith LE. Can we individualize the “number needed to treat”? An empirical study of summary effect measures in meta‐analyses. Int J Epidemiol. 2002;31(1):7276.
  40. Allen IE, Olkin I. Applications of estimating treatment effects in metaanalyses with missing data. Technical Report No. 2000‐25, 2000. Available at: http://statistics.stanford.edu/_ckirby/techreports/GEN/2000/2000‐25.pdf. Accessed July 22, 2013.
  41. Sterne JA, Gavaghan D, Egger M. Publication and related bias in meta‐analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol. 2000;53(11):11191129.
  42. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50(4):10881101.
  43. Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta‐analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009; 339:b2700.
  44. Sobreques J, Cebria J, Segura J, Rodriguez C, Garcia M, Juncosa S. Job satisfaction and burnout in general practitioners [in Spanish]. Aten Primaria. 2003;31(4):227233.
  45. Curiel‐Garcia JA, Rodriguez‐Moran M, Guerrero‐Romero F. Burnout syndrome among health staff [in Spanish]. Rev Med Inst Mex Seguro Soc. 2006;44(3):221226.
  46. Einav S, Shalev AY, Ofek H, Freedman S, Matot I, Weiniger CF. Differences in psychological effects in hospital doctors with and without post‐traumatic stress disorder. Br J Psychiatry. 2008;193(2):165166.
  47. Miedema B, Easley J, Fortin P, Hamilton R, Tatemichi S. Crossing boundaries: family physicians' struggles to protect their private lives. Can Fam Physician. 2009;55(3):286287.e5.
  48. Estryn‐Behar M, Doppia MA, Guetarni K, Fry C, Machet G, Pelloux P, et al. Emergency physicians accumulate more stress factors than other physicians: results from the French SESMAT study. Emerg Med J. 2011 May;28(5):397410. Epub 2010 Dec 1.
  49. Lee FJ, Stewart M, Brown JB. Stress, burnout, and strategies for reducing them: what's the situation among Canadian family physicians? Can Fam Physician. 2008;54(2):234235.
  50. Hinami K, Whelan CT, Wolosin RJ, Miller JA, Wetterneck TB. Worklife and satisfaction of hospitalists: toward flourishing careers. J Gen Intern Med. 2012;27(1):2836.
  51. Linzer M, Manwell LB, Williams ES, Bobula JA, Brown RL, Varkey AB, et al; MEMO (Minimizing Error, Maximizing Outcome) Investigators. Working conditions in primary care: physician reactions and care quality. Ann Intern Med. 2009 Jul 7;151(1):2836.
  52. Ramirez AJ, Graham J, Richards MA, Cull A, Gregory WM. Mental health of hospital consultants: the effects of stress and satisfaction at work. Lancet. 1996 Mar 16;347(9003):7248.
  53. Mukherjee S, Beresford B, Glaser A, Sloper P. Burnout, psychiatric morbidity, and work‐related sources of stress in paediatric oncology staff: a review of the literature. Psycho‐Oncology. 2009 Oct;18(10):101928.
  54. Aasland OG, Olff M, Falkum E, Schweder T, Ursin H. Health complaints and job stress in Norwegian physicians: the use of an overlapping questionnaire design. Soc Sci Med. 1997;45(11):16151629.
  55. Lasalvia A, Bonetto C, Bertani M, et al. Influence of perceived organisational factors on job burnout: survey of community mental health staff. Br J Psychiatry. 2009;195(6):537544.
  56. Sosa Oberlin EN. Frecuencia de los sintomas del syndrome de burnout en profesionales medicos. Rev Med Rosario. 2007;73:1220.
  57. Voltmer E, Kieschke U, Spahn C. Work‐related behaviour and experience patterns of physicians compared to other professions. Swiss Med Wkly. 2007;137(31‐32):448453.
  58. Grassi L, Magnani K. Psychiatric morbidity and burnout in the medical profession: an Italian study of general practitioners and hospital physicians. Psychother Psychosom. 2000;69(6):329334.
  59. McManus IC, Gordon D, Winder BC. Duties of a doctor: UK doctors and good medical practice. Qual Health Care. 2000;9(1):1422.
  60. Yaman H, Soler JK. The job related burnout questionnaire: a multinational pilot study. Aust Fam Physician. 2002;31(11):10551056.
  61. Cathébras P, Begon A, Laporte S, Bois C, Truchot D. Burn out among French general practitioners [in French]. Presse Med. 2004;33(22): 15691574.
  62. Kushnir T, Levhar C, Cohen AH. Are burnout levels increasing? The experience of Israeli primary care physicians. Isr Med Assoc J. 2004; 6(8):451455.
  63. Goehring C, Bouvier Gallacchi M, Kunzi B, Bovier P. Psychosocial and professional characteristics of burnout in Swiss primary care practitioners: a cross‐sectional survey. Swiss Med Wkly. 2005;135(7‐8):101108.
  64. Esteva M, Larraz C, Jimenez F. Mental health in family doctors: effects of satisfaction and stress at work [in Spanish]. Rev Clin Esp. 2006;206(2):7783.
  65. Gandini BJ, Paulini SS, Marcos IJ, Jorge S, Luis F. The professional wearing down or syndrome of welfare labor stress (“burnout”) among health professionals in the city of Cordoba [in Spanish]. Rev Fac Cien Med Univ Nac Cordoba. 2006;63(1):1825.
  66. Ozyurt A, Hayran O, Sur H. Predictors of burnout and job satisfaction among Turkish physicians. QJM. 2006;99(3):161169.
  67. Deighton RM, Gurris N, Traue H. Factors affecting burnout and compassion fatigue in psychotherapists treating torture survivors: is the therapist's attitude to working through trauma relevant? J Trauma Stress. 2007;20(1):6375.
  68. Dunwoodie DA, Auret K. Psychological morbidity and burnout in palliative care doctors in Western Australia. Intern Med J. 2007;37(10): 693698.
  69. Sørgaard KW, Ryan P, Hill R, Dawson I; OSCAR Group. Sources of stress and burnout in acute psychiatric care: inpatient vs. community staff. Soc Psychiatry Psychiatr Epidemiol. 2007;42(10):794802.
  70. Ádám S, Gyorffy Z, Susanszky E. Physician burnout in Hungary: a potential role for work‐family conflict. J Health Psychol. 2008;13:847856.
  71. Iorio B, Cillo N, Cucciniello E, Bellizzi V. Burn‐out in the dialysis unit. J Nephrol. 2008;21(suppl 13):S158S162.
  72. Truchot D. Career orientation and burnout in French general practitioners. Psychol Rep. 2008;103(3):875881.
  73. Twellaar M, Winants Y, Houkes I. How healthy are Dutch general practitioners? Self‐reported (mental) health among Dutch general practitioners. Eur J Gen Pract. 2008;14(1):49.
  74. Vela‐Bueno A, Moreno‐Jimenez B, Rodriguez‐Munoz A, et al. Insomnia and sleep quality among primary care physicians with low and high burnout levels. J Psychosom Res. 2008;64(4):435442.
  75. Bernhardt BA, Rushton CH, Carrese J, Pyeritz RE, Kolodner K, Geller G. Distress and burnout among genetic service providers. Genet Med. 2009;11(7):527535.
  76. Bressi C, Porcellana M, Gambini O, et al. Burnout among psychiatrists in Milan: a multicenter survey. Psychiatr Serv. 2009;60(7):985988.
  77. Krasner MS, Epstein RM, Beckman H, et al. Association of an educational program in mindful communication with burnout, empathy, and attitudes among primary care physicians. JAMA. 2009;302(12): 12841293.
  78. Lesic AR, Stefanovic NP, Perunicic I, Milenkovic P, Tosevski DL, Bumbasirevic MZ. Burnout in Belgrade orthopaedic surgeons and general practitioners, a preliminary report. Acta Chir Iugosl. 2009; 56(2):5359.
  79. Peisah C, Latif E, Wilhelm K, Williams B. Secrets to psychological success: why older doctors might have lower psychological distress and burnout than younger doctors. Aging Ment Health. 2009;13(2):300307.
  80. Shanafelt TD, West CP, Sloan JA, et al. Career fit and burnout among academic faculty. Arch Intern Med. 2009;169(10):990995.
  81. Zantinge EM, Verhaak PF, Bakker DH, Meer K, Bensing JM. Does burnout among doctors affect their involvement in patients' mental health problems? A study of videotaped consultations. BMC Fam Pract. 2009;10:60.
  82. Demirci S, Yildirim YK, Ozsaran Z, Uslu R, Yalman D, Aras AB. Evaluation of burnout syndrome in oncology employees. Med Oncol. 2010;27(3):968974.
  83. Voltmer E, Schwappach DL, Frank E, Wirsching M, Spahn C. Workrelated behavior and experience patterns and predictors of mental health in German physicians in medical practice. Fam Med. 2010; 42(6):433439.
  84. Lucas B, Trick W, Evans A, et al. Emotional exhaustion, life stress, and perceived control among medicine ward attending physicians: a randomized trial of 2‐ versus 4‐week ward rotations [abstract]. J Hosp Med. 2011; 6(4 suppl 2):S43S44.
  85. Maccacaro G, Tommaso F, Ferrai P, Bonatti D, Bombana S, Merseburger A. The effort of being male: a survey on gender and burnout [in Italian]. Med Lav. 2011;102(3):286296.
  86. Putnik K, Houkes I. Word related characteristics, work‐home and home‐work interference and burnout among primary healthcare physicians: a gender perspective in a Serbian context. BMC Public Health. 2011;11:716.
  87. Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work‐life balance among US physicians relative to the general US population. Arch Intern Med. 2012;172(18):13771385.
  88. Varga ED, Urdaniz AP, Canti GF. Burnout syndrome in general hospital doctors. Eur J Psychiat. 1996;10:207213.
  89. Bargellini A, Barbieri A, Rovesti S, Vivoli R, Roncaglia R, Borella P. Relation between immune variables and burnout in a sample of physicians. Occup Environ Med. 2000;57(7):453457.
  90. Trichard A, Danel T, Sobaszek A. Epuisement professionnel et consummation de psychotropes chez les medecins hospitaliers. Alcoologie et Addictologie. 2005;27(4):303308.
  91. Fuss I, Nubling M, Hasselhorn HM, Schwappach D, Rieger MA. Working conditions and Work‐Family Conflict in German hospital physicians: psychosocial and organisational predictors and consequences. BMC Public Health. 2008;8:353.
  92. Marner S. The Role of Empathy and Witnessed Aggression in Stress Reactions Among Staff Working in a Psychiatric Hospital [dissertation]. New Brunswick, NJ: Rutgers University; 2008.
  93. Shehabi Y, Dobb G, Jenkins I, Pascoe R, Edwards N, Butt W. Burnout syndrome among Australian intensivists: a survey. Crit Care Resusc. 2008;10(4):312315.
  94. Brown R, Dunn S, Byrnes K, Morris R, Heinrich P, Shaw J. Doctors' stress responses and poor communication performance in simulated bad‐news consultations. Acad Med. 2009;84(11):15951602.
  95. Tunc T, Kutanis RO. Role conflict, role ambiguity, and burnout in nurses and physicians at a university hospital in Turkey. Nurs Health Sci. 2009;11(4):410416.
  96. Cocco E. How much is geriatric caregivers burnout caring‐specific? Questions from a questionnaire survey. Clin Pract Epidemiol Ment Health. 2010;6:6671.
  97. Doppia MA, Estryn‐Behar M, Fry C, Guetarni K, Lieutaud T; comite de pilotage de l'enquete SESMAT. Burnout in French doctors: a comparative study among anaesthesiologists and other specialists in French hospitals (SESMAT study) [in French]. Ann Fr Anesth Reanim. 2011;30(11):782794.
  98. Glasheen JJ, Misky GJ, Reid MB, Harrison RA, Sharpe B, Auerbach A. Career satisfaction and burnout in academic hospital medicine. Arch Intern Med. 2011;171(8):782785.
  99. Thorsen VC, Tharp AL, Meguid T. High rates of burnout among maternal health staff at a referral hospital in Malawi: a cross‐sectional study. BMC Nurs. 2011;10:9.
  100. Quenot JP, Rigaud JP, Prin S, et al. Suffering among careers working in critical care can be reduced by an intensive communication strategy on end‐of‐life practices. Intensive Care Med. 2012;38:5561.
  101. Ruitenburg MM, Frings‐Dresen MH, Sluiter JK. The prevalence of common mental disorders among hospital physicians and their association with self‐reported work ability: a cross‐sectional study. BMC Health Serv Res. 2012;12:292298.
  102. Seibt R, Hubler A, Steputat A, Scheuch K. Effort‐reward‐ratio and burnout risk among female teachers and hospital‐employed female physicians: a comparison between professions [in German]. Arbeitsmed Sozialmed Umweltmed. 2012;47:396406.
Article PDF
Issue
Journal of Hospital Medicine - 8(11)
Publications
Page Number
653-664
Sections
Files
Files
Article PDF
Article PDF

Hospital medicine is a rapidly growing field of US clinical practice.[1] Almost since its advent, concerns have been expressed about the potential for hospitalists to burn out.[2] Hospitalists are not unique in this; similar concerns heralded the arrival of other location‐defined specialties, including emergency medicine[3] and the full‐time intensivist model,[4] a fact that has not gone unnoted in the literature about hospitalists.[5]

The existing international literature on physician burnout provides good reason for this concern. Inpatient‐based physicians tend to work unpredictable schedules, with substantial impact on home life.[6] They tend to be young, and much burnout literature suggests a higher risk among younger, less‐experienced physicians.[7] When surveyed, hospitalists have expressed more concerns about their potential for burnout than their outpatient‐based colleagues.[8]

In fact, data suggesting a correlation between inpatient practice and burnout predate the advent of the US hospitalist movement. Increased hospital time was reported to correlate with higher rates of burnout in internists,[9] family practitioners,[10] palliative physicians,[11] junior doctors,[12] radiologists,[13] and cystic fibrosis caregivers.[14] In 1987, Keinan and Melamed[15] noted, Hospital work by its very nature, as compared to the work of a general practitioner, deals with the more severe and complicated illnesses, coupled with continuous daily contacts with patients and their anxious families. In addition, these physicians may find themselves embroiled in the power struggles and competition so common in their work environment.

There are other features, however, that may protect inpatient physicians from burnout. Hospital practice can facilitate favorable social relations involving colleagues, co‐workers, and patients,[16] a factor that may be protective.[17] A hospitalist schedule also can allow more focused time for continuing medical education, research, and teaching,[18] which have all been associated with reduced risk of burnout in some studies.[17] Studies of psychiatrists[19] and pediatricians[20] have shown a lower rate of burnout among physicians with more inpatient duties. Finally, a practice model involving a seemingly stable cadre of inpatient physicians has existed in Europe for decades,[2] indicating at least a degree of sustainability.

Information suggesting a higher rate of burnout among inpatient physicians could be used to target therapeutic interventions and to adjust schedules, whereas the opposite outcome could refute a pervasive myth. We therefore endeavored to summarize the literature on burnout among inpatient versus outpatient physicians in a systematic fashion, and to include data not only from the US hospitalist experience but also from other countries that have used a similar model for decades. Our primary hypothesis was that inpatient physicians experience more burnout than outpatient physicians.

It is important to distinguish burnout from depression, job dissatisfaction, and occupational stress, all of which have been studied extensively in physicians. Burnout, as introduced by Freudenberger[21] and further characterized by Maslach,[22] is a condition in which emotional exhaustion, depersonalization, and a low sense of personal accomplishment combine to negatively affect work life (as opposed to clinical depression, which affects all aspects of life). Job satisfaction can correlate inversely with burnout, but it is a separate process[23] and the subject of a recent systematic review.[24] The importance of distinguishing burnout from job dissatisfaction is illustrated by a survey of head and neck surgeons, in which 97% of those surveyed indicated satisfaction with their jobs and 34% of the same group answered in the affirmative when asked if they felt burned out.[25]

One obstacle to the meaningful comparison of burnout prevalence across time, geography, and specialty is the myriad ways in which burnout is measured and reported. The oldest and most commonly used instrument to measure burnout is the Maslach Burnout Inventory (MBI), which contains 22 items assessing 3 components of burnout (emotional exhaustion, depersonalization, and low personal accomplishment).[26] Other measures include the Copenhagen Burnout Inventory[27] (19 items with the components personal burnout, work‐related burnout, and client‐related burnout), Utrecht Burnout Inventory[28] (20‐item modification of the MBI), Boudreau Burnout Questionnaire[29] (30 items), Arbeitsbezogenes Verhaltens und Erlebensmuster[30] (66‐item questionnaire assessing professional commitment, resistance to stress, and emotional well‐being), Shirom‐Melamed Burnout Measure[31] (22 items with subscales for physical fatigue, cognitive weariness, tension, and listlessness), and a validated single‐item questionnaire.[32]

METHODS

Electronic searches of MEDLINE, EMBASE, PsycINFO, SCOPUS, and PubMed were undertaken for articles published from January 1, 1974 (the year in which burnout was first described by Freudenberger[21]) to 2012 (last accessed, September 12, 2012) using the Medical Subject Headings (MeSH) terms stress, psychological; burnout, professional; adaptation, psychological; and the keyword burnout. The same sources were searched to create another set for the MeSH terms hospitalists, physician's practice patterns, physicians/px, professional practice location, and the keyword hospitalist#. Where exact subject headings did not exist in databases, comparable subject headings or keywords were used. The 2 sets were then combined using the operator and. Abstracts from the Society of Hospital Medicine annual conferences were hand‐searched, as were reference lists from identified articles. To ensure that pertinent international literature was captured, there was no language restriction in the search.

A 2‐stage screening process was used. The titles and abstracts of all articles identified in the search were independently reviewed by 2 investigators (D.L.R. and K.J.C.) who had no knowledge of each other's results. An article was obtained when either reviewer deemed it worthy of full‐text review.

All full‐text articles were independently reviewed by the same 2 investigators. The inclusion criterion was the measurement of burnout in physicians who are stated to or can be reasonably assumed to spend the substantial majority of their clinical practice exclusively in either the inpatient or the outpatient setting. Studies of emergency department physicians or specialists who invariably spend substantial amounts of time in both settings (eg, surgeons, anesthesiologists) were excluded. Studies limited to trainees or nonphysicians were also excluded. For both stages of review, agreement between the 2 investigators was assessed by calculating the statistic. Disagreements about inclusion were adjudicated by a third investigator (A.I.B.).

Because our goal was to establish and compare the rate of burnout among US hospitalists and other inpatient physicians around the world, we included studies of hospitalists according to the definition in use at the time of the individual study, noting that the formal definition of a hospitalist has changed over the years.[33] Because practice patterns for physicians described as primary care physicians, family doctors, hospital doctors, and others differ substantially from country to country, we otherwise included only the studies where the practice location was stated explicitly or where the authors confirmed that their study participants either are known or can be reasonably assumed to spend more than 75% of their time caring for hospital inpatients, or are known or can be reasonably assumed to spend the vast majority of their time caring for outpatients.

Data were abstracted using a standardized form and included the measure of burnout used in the study, results, practice location of study subjects, and total number of study subjects. When data were not clear (eg, burnout measured but not reported by the authors, practice location of study subjects not clear), authors were contacted by email, or when no current email address could be located or no response was received, by telephone or letter. In instances where burnout was measured repeatedly over time or before and after a specific intervention, only the baseline measurement was recorded. Because all studies were expected to be nonrandomized, methodological quality was assessed using a version of the tool of Downs and Black,[34] adapted where necessary by omitting questions not applicable to the specific study type (eg randomization for survey studies)[35] and giving a maximum of 1 point for the inclusion of a power calculation.

Two a priori analyses were planned: (1) a statistical comparison of articles directly comparing burnout among inpatient and outpatient physicians, and (2) a statistical comparison of articles measuring burnout among inpatient physicians with articles measuring burnout among outpatient physicians by the most frequently reported measuremean subset scores for emotional exhaustion, depersonalization, and personal accomplishment on the MBI.

The primary outcome measures were the differences between mean subset scores for emotional exhaustion, depersonalization, and personal accomplishment on the MBI. All differences are expressed as (outpatient meaninpatient mean). The variance of each outcome was calculated with standard formulas.[36] To calculate the overall estimate, each study was weighted by the reciprocal of its variance. Studies with fewer than 10 subjects were excluded from statistical analysis but retained in the systematic review.

For studies that reported data for both inpatient and outpatient physicians (double‐armed studies), Cochran Q test and the I2 value were used to assess heterogeneity.[37, 38] Substantial heterogeneity was expected because these individual studies were conducted for different populations in different settings with different study designs, and this expectation was confirmed statistically. Therefore, we used a random effects model to estimate the overall effect, providing a conservative approach that accounted for heterogeneity among studies.[39]

To assess the durability of our findings, we performed separate multivariate meta‐regression analyses by including single‐armed studies only and including both single‐armed and double‐armed studies. For these meta‐regressions, means were again weighted by the reciprocal of their variances, and the arms of 2‐armed studies were considered separately. This approach allowed us to generate an estimate of the differences between MBI subset scores from studies that did not include such an estimate when analyzed separately.[40]

We examined the potential for publication bias in double‐armed studies by constructing a funnel plot, in which mean scores were plotted against their standard errors.[41] The trim‐and‐fill method was used to determine whether adjustment for publication bias was necessary. In addition, Begg's rank correlation test[42] was completed to test for statistically significant publication bias.

Stata 10.0 statistical software (StataCorp, College Station, TX) was used for data analyses. A P value of 0.05 or less was deemed statistically significant. The Preferred Reporting Items for Systematic Reviews and Meta‐analysis checklist was used for the design and execution of the systematic review and meta‐analysis.[43]

Subgroup analyses based on location were undertaken a posteriori. All data (double‐armed meta‐analysis, meta‐regression of single‐armed studies, and meta‐regression of single‐ and double‐armed studies) were analyzed by location (United States vs other; United States vs Europe vs other).

RESULTS

The search results are outlined in Figure 1. In total, 1704 articles met the criteria for full‐text review. A review of pertinent reference lists and author contacts led to the addition of 149 articles. Twenty‐nine references could not be located by any means, despite repeated attempts. Therefore, 1824 articles were subjected to full‐text review by the 2 investigators.

Figure 1
Flow chart of study selection.

Initially, 57 articles were found that met criteria for inclusion. Of these, 2 articles reported data in formats that could not be interpreted.[44, 45] When efforts to clarify the data with the authors were unsuccessful, these studies were excluded. A study specifically designed to assess the response of physicians to a recent series of terrorist attacks[46] was excluded a posteriori because of lack of generalizability. Of the other 54 studies, 15 reported burnout data on both outpatient physicians and inpatient physicians, 22 reported data on outpatient physicians only, and 17 reported data on inpatient physicians only. Table 1 summarizes the results of the 37 studies involving outpatient physicians; Table 2 summarizes the 32 studies involving inpatient physicians.

Summaries of Studies of Outpatient‐Based Physicians Meeting Inclusion Criteria
Lead Author, Publication Year Study Population and Location Instrument No. of Participants EE Score (SD)a DP Score (SD) PA Score (SD) Other Results
  • NOTE: Abbreviations: AVEM, Arbeitsbezogenes Verhaltens und Erlebensmuster; DP, depersonalization subset of MBI; EE, emotional exhaustion subset of MBI; MBI, Maslach Burnout Inventory; PA, personal accomplishment subset of MBI; SMBM, Shirom‐Melamad Burnout Measure; SD, standard deviation.

  • High scores of EE and DP and low scores of PA are features of burnout.

  • Data obtained directly from authors 20102012.

  • SDs calculated from published standard errors. Personal accomplishment scale reversed to match other studies.

  • SDs calculated from published CIs.

Schweitzer, 1994[12] Young physicians of various specialties in South Africa Single‐item survey 7 6 (83%) endorsed burnout
Aasland, 1997 [54]b General practitioners in Norway Modified MBI (22 items; scale, 15) 298 2.65 (0.80) 1.90 (0.59) 3.45 (0.40)
Grassi, 2000 [58] General practitioners in Italy MBI 182 18.49 (11.49) 6.11 (5.86) 38.52 (7.60)
McManus, 2000 [59]b General practitioners in United Kingdom Modified MBI (9 items; scale, 06) 800 8.34 (4.39) 3.18 (3.40) 14.16 (2.95)
Yaman, 2002 [60] General practitioners in 8 European nations MBI 98 25.1 (8.50) 7.3 (4.92) 34.5 (7.67)
Cathbras, 2004 [61] General practitioners in France MBI 306 21.85 (12.4) 9.13 (6.7) 38.7 (7.1)
Goehring, 2005 [63] General practitioners, general internists, pediatricians in Switzerland MBI 1755 17.9 (9.8) 6.5 (4.7) 39.6 (6.5)
Esteva, 2006 [64] General practitioners, pediatricians in Spain MBI 261 27.4 (11.8) 10.07 (6.4) 35.9 (7.06)
Gandini, 2006 [65]b Physicians of various specialties in Argentina MBI 67 31.0 (13.8) 10.2 (6.6) 38.4 (6.8)
Ozyurt, 2006 [66] General practitioners in Turkey Modified MBI (22 items; scale, 04) 55 15.23 (5.80) 4.47 (3.31) 23.38 (4.29)
Deighton, 2007 [67]b Psychiatrists in several German‐speaking nations MBI 19 30.68 (9.92) 13.42 (4.23) 37.16 (3.39)
Dunwoodie, 2007 [68]b Palliative care physicians in Australia MBI 21 14.95 (9.14) 3.95 (3.40) 38.90 (2.88)
Srgaard, 2007 [69]b Psychiatrists in 5 European nations MBI 22 19.41 (8.08) 6.68 (4.93) 39.00 (4.40)
Sosa Oberlin, 2007 [56]b Physicians of various specialties in Argentina Author‐designed instrument 33 26 (78.8%) had 4 burnout symptoms, 6.15 symptoms per physician
Voltmer, 2007 [57]b Physicians of various specialties in Germany AVEM 46 11 (23.9%) exhibited burnout (type B) pattern
dm, 2008 [70]b Physicians of various specialties in Hungary MBI 163 17.45 (11.12) 4.86 (4.91) 36.56 (7.03)
Di Iorio, 2008 [71]b Dialysis physicians in Italy Author‐designed instrument 54 Work: 2.6 (1.5), Material: 3.1 (2.1), Climate: 3.0 (1.1), Objectives: 3.4 (1.6), Quality: 2.2 (1.5), Justification: 3.2 (2.0)
Lee, 2008 [49]b Family physicians in Canada MBI 123 26.26 (9.53) 10.20 (5.22) 38.43 (7.34)
Truchot, 2008 [72] General practitioners in France MBI 259 25.4 (11.7) 7.5 (5.5) 36.5 (7.1)
Twellaar, 2008 [73]b General practitioners in the Netherlands Utrecht Burnout Inventory 349 2.06 (1.11) 1.71 (1.05) 5.08 (0.77)
Arigoni, 2009 [17] General practitioners, pediatricians in Switzerland MBI 258 22.8 (12.0) 6.9 (6.1) 39.0 (7.2)
Bernhardt, 2009 [75] Clinical geneticists in United States MBI 72 25.8 (10.01)c 10.9 (4.16)c 34.8 (5.43)c
Bressi, 2009 [76]b Psychiatrists in Italy MBI 53 23.15 (11.99) 7.02 (6.29) 36.41 (7.54)
Krasner, 2009 [77] General practitioners in United States MBI 60 26.8 (10.9)d 8.4 (5.1)d 40.2 (5.3)d
Lasalvia, 2009 [55]b Psychiatrists in Italy Modified MBI (16 items; scale, 06) 38 2.37 (1.27) 1.51 (1.15) 4.46 (0.87)
Peisah, 2009 [79]b Physicians of various specialties in Australia MBI 28 13.92 (9.24) 3.66 (3.95) 39.34 (8.55)
Shanafelt, 2009 [80]b Physicians of various specialties in United States MBI 408 20.5 (11.10) 4.3 (4.74) 40.8 (6.26)
Zantinge, 2009 [81] General practitioners in the Netherlands Utrecht Burnout Inventory 126 1.58 (0.79) 1.32 (0.72) 4.27 (0.77)
Voltmer, 2010 [83]b Psychiatrists in Germany AVEM 526 114 (21.7%) exhibited burnout (type B) pattern
Maccacaro, 2011 [85]b Physicians of various specialties in Italy MBI 42 14.31 (11.98) 3.62 (4.95) 38.24 (6.22)
Lucas, 2011 [84]b Outpatient physicians periodically staffing an academic hospital teaching service in United States MBI (EE only) 30 24.37 (14.95)
Shanafelt, 2012 [87]b General internists in United States MBI 447 25.4 (14.0) 7.5 (6.3) 41.4 (6.0)
Kushnir, 2004 [62] General practitioners and pediatricians in Israel MBI (DP only) and SMBM 309 9.15 (3.95) SMBM mean (SD), 2.73 per item (0.86)
Vela‐Bueno, 2008 [74]b General practitioners in Spain MBI 240 26.91 (11.61) 9.20 (6.35) 35.92 (7.92)
Lesic, 2009 [78]b General practitioners in Serbia MBI 38 24.71 (10.81) 7.47 (5.51) 37.21 (7.44)
Demirci, 2010 [82]b Medical specialists related to oncology practice in Hungary MBI 26 23.31 (11.2) 6.46 (5.7) 37.7 (8.14)
Putnik, 2011 [86]b General practitioners in Hungary MBI 370 22.22 (11.75) 3.66 (4.40) 41.40 (6.85)
Summary of Studies of Inpatient Physicians Meeting Inclusion Criteria
Lead Author, Publication Year Study Population and Location Instrument No. of Participants EE Score (SD)a DP Score (SD) PA Score (SD) Other Results
  • NOTE: Abbreviations: AVEM, Arbeitsbezogenes Verhaltens und Erlebensmuster; DP, depersonalization subset of MBI; EE, emotional exhaustion subset of MBI; MBI, Maslach Burnout Inventory; PA, personal accomplishment subset of MBI; SD, standard deviation.

  • High scores of EE and DP and low scores of PA are features of burnout.

  • SDs not available; study therefore excluded from statistical comparisons.

  • Different survey item than other studies in this table using a single‐item, 5‐point burnout measure.

  • Data obtained directly from authors 20102012.

  • Personal accomplishment scale reversed to match other studies.

Varga, 1996 [88] Hospital doctors in Spain MBI 179 21.61b 7.33b 35.28b
Aasland, 1997 [54] Hospital doctors in Norway Modified MBI (22 items; scale, 15) 582 2.39 (0.80) 1.81 (0.65) 3.51 (0.46)
Bargellini, 2000 [89] Hospital doctors in Italy MBI 51 17.45 (9.87) 7.06 (5.54) 35.33 (7.90)
Grassi, 2000 [58] Hospital doctors in Italy MBI 146 16.17 (9.64) 5.32 (4.76) 38.71 (7.28)
Hoff, 2001 [33] Hospitalists in United States Single‐item surveyc 393 12.9% burned out (>4/5), 24.9% at risk for burnout (34/5), 62.2% at no current risk (mean, 2.86 on 15 scale)
Trichard, 2005 [90] Hospital doctors in France MBI 199 16 (10.7) 6.6 (5.7) 38.5 (6.5)
Gandini, 2006 [65]d Hospital doctors in Argentina MBI 290 25.0 (12.7) 7.9 (6.2) 40.1 (7.0)
Dunwoodie, 2007 [68]d Palliative care doctors in Australia MBI 14 18.29 (14.24) 5.29 (5.89) 38.86 (3.42)
Srgaard, 2007 [69]d Psychiatrists in 5 European nations MBI 18 18.56 (9.32) 5.50 (3.79) 39.08 (5.39)
Sosa Oberlin, 2007 [56]d Hospital doctors in Argentina Author‐designed instrument 3 3 (100%) had 4 burnout symptoms, 8.67 symptoms per physician
Voltmer, 2007 [57]d Hospital doctors in Germany AVEM 271 77 (28.4%) exhibited burnout (type B) pattern
dm, 2008 [70]b Physicians of various specialties in Hungary MBI 194 19.23 (10.79) 4.88 (4.61) 35.26 (8.42)
Di Iorio, 2008 [71]d Dialysis physicians in Italy Author‐designed instrument 62 Work, mean (SD), 3.1 (1.4); Material, mean (SD), 3.3 (1.5); Climate, mean (SD), 2.9 (1.1); Objectives, mean (SD), 2.5 (1.5); Quality, mean (SD), 3.0 (1.1); Justification, mean (SD), 3.1 (2.1)
Fuss, 2008 [91]d Hospital doctors in Germany Copenhagen Burnout Inventory 292 Mean Copenhagen Burnout Inventory, mean (SD), 46.90 (18.45)
Marner, 2008 [92]d Psychiatrists and 1 generalist in United States MBI 9 20.67 (9.75) 7.78 (5.14) 35.33 (6.44)
Shehabi, 2008 [93]d Intensivists in Australia Modified MBI (6 items; scale, 15) 86 2.85 (0.93) 2.64 (0.85) 2.58 (0.83)
Bressi, 2009 [76]d Psychiatrists in Italy MBI 28 17.89 (14.46) 5.32 (7.01) 34.57 (11.27)
Brown, 2009 [94] Hospital doctors in Australia MBI 12 22.25 (8.59) 6.33 (2.71) 39.83 (7.31)
Lasalvia, 2009 [55]d Psychiatrists in Italy Modified MBI (16 items; scale, 06) 21 1.95 (1.04) 1.35 (0.85) 4.46 (1.04)
Peisah, 2009 [79]d Hospital doctors in Australia MBI 62 20.09 (9.91) 6.34 (4.90) 35.06 (7.33)
Shanafelt, 2009 [80]d Hospitalists and intensivists in United States MBI 19 25.2 (11.59) 4.4 (3.79) 38.5 (8.04)
Tunc, 2009 [95] Hospital doctors in Turkey Modified MBI (22 items; scale, 04) 62 1.18 (0.78) 0.81 (0.73) 3.10 (0.59)e
Cocco, 2010 [96]d Hospital geriatricians in Italy MBI 38 16.21 (11.56) 4.53 (4.63) 39.13 (7.09)
Doppia, 2011 [97]d Hospital doctors in France Copenhagen Burnout Inventory 1,684 Mean work‐related burnout score, 2.72 (0.75)
Glasheen, 2011 [98] Hospitalists in United States Single‐item survey 265 Mean, 2.08 on 15 scale 62 (23.4%) burned out
Lucas, 2011 [84]d Academic hospitalists in United States MBI (EE only) 26 19.54 (12.85)
Thorsen, 2011 [99] Hospital doctors in Malawi MBI 2 25.5 (4.95) 8.5 (6.36) 25.0 (5.66)
Hinami, 2012 [50]d Hospital doctors in United States Single‐item survey 793 Mean, 2.24 on 15 scale 261 (27.2%) burned out
Quenot, 2012 [100]d Intensivists in France MBI 4 33.25 (4.57) 13.50 (5.45) 35.25 (4.86)
Ruitenburg, 2012 [101] Hospital doctors in the Netherlands MBI (EE and DP only) 214 13.3 (8.0) 4.5 (4.1)
Seibt, 2012 [102]d Hospital doctors in Germany Modified MBI (16 items; scale, 06, reported per item rather than totals) 2,154 2.2 (1.4) 1.4 (1.2) 5.1 (0.9)
Shanafelt, 2012 [87]d Hospitalists in United States MBI 130 24.7 (12.5) 9.1 (6.9) 39.0 (7.6)

Table 3 summarizes the results of the 15 studies that reported burnout data for both inpatient and outpatient physicians, allowing direct comparisons to be made. Nine studies reported MBI subset totals with standard deviations, 2 used different modifications of the MBI, 2 used different author‐derived measures, 1 used only the emotional exhaustion subscale of the MBI, and 1 used the Arbeitsbezogenes Verhaltens und Erlebensmuster. Therefore, statistical comparison was attempted only for the 9 studies reporting comparable MBI data, comprising burnout data on 1390 outpatient physicians and 899 inpatient physicians.

Summary of Studies Including Both Inpatient‐Based and Outpatient‐Based Physicians Meeting Inclusion Criteria
Lead Author, Publication Year Location Instrument Inpatient‐Based Physicians Outpatient‐Based Physicians
No. Results, Score (SD)a No. Results, Score (SD)a
  • NOTE: Abbreviations: AVEM, Arbeitsbezogenes Verhaltens und Erlebensmuster; DP, depersonalization subset of MBI; EE, emotional exhaustion subset of MBI; MBI, Maslach Burnout Inventory; PA, personal accomplishment subset of MBI; SD, standard deviation.

  • High scores of EE and DP and low scores of PA are features of burnout.

  • Data obtained directly from authors from 20102012.

Aasland, 1997 [54]b Norway Modified MBI (22 items; scale, 15) 582 EE, 2.39 (0.80); DP, 1.81 (0.65); PA, 3.51 (0.46) 298 EE, 2.65 (0.80); DP, 1.90 (0.59); PA, 3.45 (0.40)
Grassi, 2000 [58] Italy MBI 146 EE, 16.17 (9.64); DP, 5.32 (4.76); PA, 38.71 (7.28) 182 EE, 18.49 (11.49); DP, 6.11 (5.86); PA, 38.52 (7.60)
Gandini, 2006 [65]b Argentina MBI 290 EE, 25.0 (12.7);DP, 7.9 (6.2); PA, 40.1 (7.0) 67 EE, 31.0 (13.8); DP, 10.2 (6.6); PA, 38.4 (6.8)
Dunwoodie, 2007 [68]b Australia MBI 14 EE, 18.29 (14.24); DP, 5.29 (5.89); PA, 38.86 (3.42) 21 EE, 14.95 (9.14); DP, 3.95 (3.40); PA, 38.90 (2.88)
Srgaard, 2007 [69]b 5 European nations MBI 18 EE, 18.56 (9.32); DP, 5.50 (3.79); PA, 39.08 (5.39) 22 EE, 19.41 (8.08); DP, 6.68 (4.93); PA, 39.00 (4.40)
Sosa Oberlin, 2007 [56]b Argentina Author‐designed instrument 3 3 (100%) had 4 burnout symptoms, 8.67 symptoms per physician 33 26 (78.8%) had 4 burnout symptoms, 6.15 symptoms per physician
Voltmer, 2007 [57]b Germany AVEM 271 77 (28.4%) exhibited burnout (type B) pattern 46 11 (23.9%) exhibited burnout (type B) pattern
dm, 2008 [70]b Hungary MBI 194 EE, 19.23 (10.79); DP, 4.88 (4.61); PA, 35.26 (8.42) 163 EE, 17.45 (11.12); DP, 4.86 (4.91); PA, 36.56 (7.03)
Di Iorio, 2008 [71]b Italy Author‐designed instrument 62 Work: 3.1 (1.4); material: 3.3 (1.5); climate: 2.9 (1.1); objectives: 2.5 (1.5); quality: 3.0 (1.1); justification: 3.1 (2.1) 54 Work: 2.6 (1.5); material: 3.1 (2.1); climate: 3.0 (1.1); objectives: 3.4 (1.6); quality: 2.2 (1.5); justification: 3.2 (2.0)
Bressi, 2009 [76]b Italy MBI 28 EE, 17.89 (14.46); DP, 5.32 (7.01); PA, 34.57 (11.27) 53 EE, 23.15 (11.99); DP, 7.02 (6.29); PA, 36.41 (7.54)
Lasalvia, 2009[55]b Italy Modified MBI (16 items; scale, 06) 21 EE, 1.95 (1.04); DP, 1.35 (0.85); PA, 4.46 (1.04) 38 EE, 2.37 (1.27); DP, 1.51 (1.15); PA, 4.46 (0.87)
Peisah, 2009 [79]b Australia MBI 62 EE, 20.09 (9.91); DP, 6.34 (4.90); PA, 35.06 (7.33) 28 EE, 13.92 (9.24); DP, 3.66 (3.95); PA, 39.34 (8.55)
Shanafelt, 2009 [80]b United States MBI 19 EE, 25.2 (11.59); DP, 4.4 (3.79); PA, 38.5 (8.04) 408 EE, 20.5 (11.10); DP, 4.3 (4.74); PA, 40.8 (6.26)
Lucas, 2011 [84]b United States MBI (EE only) 26 EE, 19.54 (12.85) 30 EE, 24.37 (14.95)
Shanafelt, 2012 [87]b United States MBI 130 EE, 24.7 (12.5); DP, 9.1 (6.9); PA, 39.0 (7.6) 447 EE, 25.4 (14.0); DP, 7.5 (6.3); PA, 41.4 (6.0)

Figure 2 shows that no significant difference existed between the groups regarding emotional exhaustion (mean difference, 0.11 points on a 54‐point scale; 95% confidence interval [CI], 2.40 to 2.61; P=0.94). In addition, there was no significant difference between the groups regarding depersonalization (Figure 3; mean difference, 0.00 points on a 30‐point scale; 95% CI, 1.03 to 1.02; P=0.99) and personal accomplishment (Figure 4; mean difference, 0.93 points on a 48‐point scale; 95% CI, 0.23 to 2.09; P=0.11).

Figure 2
Forest plot for double‐armed studies reporting Maslach Burnout Inventory scores for emotional exhaustion. The size of the square represents study size, and the bars represent the 95% confidence interval (CI).
Figure 3
Forest plot for double‐armed studies reporting Maslach Burnout Inventory scores for depersonalization. The size of the square represents study size and the bars represent the 95% confidence interval (CI).
Figure 4
Forest plot for double‐armed studies reporting Maslach Burnout Inventory scores for personal accomplishment. The size of the square represents study size and the bars represent the 95% confidence interval (CI). The direction of the y‐axis has been reversed so that greater burnout in outpatient physicians remains to the right.

We used meta‐regression to allow the incorporation of single‐armed MBI studies. Whether single‐armed studies were analyzed separately (15 outpatient studies comprising 3927 physicians, 4 inpatient studies comprising 300 physicians) or analyzed with double‐armed studies (24 outpatient arms comprising 5318 physicians, 13 inpatient arms comprising 1301 physicians), the lack of a significant difference between the groups persisted for the depersonalization and personal accomplishment scales (Figure 5). Emotional exhaustion was significantly higher in outpatient physicians when single‐armed studies were considered separately (mean difference, 6.36 points; 95% CI, 2.24 to 10.48; P=0.002), and this difference persisted when all studies were combined (mean difference, 3.00 points; 95% CI, 0.05 to 5.94, P=0.046).

Figure 5
Forest plots comparing results of meta‐analysis of 9 double‐armed studies, meta‐regression of 19 single‐armed studies, and meta‐regression of all 28 studies reporting Maslach Burnout Inventory scores. The direction of the y‐axis of the personal accomplishment plot has been reversed so that higher burnout in outpatient physicians remains to the right. Error bars represent the 95% confidence interval.

Subgroup analysis by geographic location showed US outpatient physicians had a significantly higher personal accomplishment score than US inpatient physicians (mean difference, 2.38 points; 95% CI, 1.22 to 3.55; P<0.001) in double‐armed studies. This difference did not persist when single‐armed studies were included through meta‐regression (mean difference, 0.55 points, 95% CI, 4.30 to 5.40, P=0.83).

Table 4 demonstrates that methodological quality was generally good from the standpoint of the reporting and bias subsections of the Downs and Black tool. External validity was scored lower for many studies due to the use of convenience samples and lack of information about physicians who declined to participate.

Assessment of Methodologic Quality
Lead Author, Publication Year Reporting External Validity Internal Validity: Bias Internal Validity: Confounding Power
  • NOTE: For survey studies (all studies except Krasner,[77] Lucas,[84] and Quenot[100]), questions regarding interventions were omitted. For uncontrolled studies (all studies except Lucas[84]), questions regarding controls were omitted. The presence of a power calculation was awarded 1 point.

Schweitzer, 1994 [12] 5 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Varga, 1996 [88] 5 of 6 points 1 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Aasland, 1997 [54] 3 of 6 points 2 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Bargellini, 2000 [89] 5 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Grassi, 2000 [58] 6 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
McManus, 2000 [59] 5 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Hoff, 2001 [33] 6 of 6 points 2 of 2 points 2 of 4 points 1 of 1 point 0 of 1 point
Yaman, 2002 [60] 5 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Cathbras, 2004 [61] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Kushnir, 2004 [62] 5 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Goehring, 2005 [63] 6 of 6 points 1 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Trichard, 2005 [90] 3 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Esteva, 2006 [64] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Gandini, 2006 [65] 6 of 6 points 1 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Ozyurt, 2006 [66] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Deighton, 2007 [67] 5 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Dunwoodie, 2007 [68] 5 of 6 points 2 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Srgaard, 2007 [69] 6 of 6 points 0 of 2 points 3 of 4 points 1 of 1 point 1 of 1 point
Sosa Oberlin, 2007 [56] 4 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Voltmer, 2007 [57] 4 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
dm, 2008 [70] 5 of 6 points 2 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Di Iorio, 2008 [71] 6 of 6 points 0 of 2 points 2 of 4 points 0 of 1 point 0 of 1 point
Fuss, 2008 [91] 6 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Lee, 2008 [49] 4 of 6 points 2 of 2 points 4 of 4 points 0 of 1 point 1 of 1 point
Marner, 2008 [92] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Shehabi, 2008 [93] 3 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Truchot, 2008 [72] 5 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Twellaar, 2008 [73] 6 of 6 points 2 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Vela‐Bueno, 2008 [74] 5 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Arigoni, 2009 [17] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Bernhardt, 2009 [75] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Bressi, 2009 [76] 6 of 6 points 0 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Brown, 2009 [94] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Krasner, 2009 [77] 9 of 11 points 0 of 3 points 6 of 7 points 1 of 2 points 1 of 1 point
Lasalvia, 2009 [55] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Lesic, 2009 [78] 5 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Peisah, 2009 [79] 6 of 6 points 2 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Shanafelt, 2009 [80] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Tunc, 2009 [95] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Zantinge, 2009 [81] 5 of 6 points 0 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Cocco, 2010 [96] 4 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Demirci, 2010 [82] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Voltmer, 2010 [83] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Doppia, 2011 [97] 5 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Glasheen, 2011 [98] 5 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Lucas, 2011 [84] 10 of 11 points 2 of 3 points 7 of 7 points 5 of 6 points 1 of 1 point
Maccacaro, 2011 [85] 5 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Putnik, 2011 [86] 6 of 6 points 1 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Thorsen, 2011 [99] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Hinami, 2012 [50] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 1 of 1 point
Quenot, 2012 [100] 8 of 11 points 1 of 3 points 6 of 7 points 1 of 2 points 0 of 1 point
Ruitenburg, 2012 [101] 6 of 6 points 2 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Seibt, 2012 [102] 6 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Shanafelt, 2012 [87] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point

Funnel plots were used to evaluate for publication bias in the meta‐analysis of the 8 double‐armed studies (Figure 6). We found no significant evidence of bias, which was supported by Begg's test P values of 0.90 for emotional exhaustion, >0.99 for depersonalization, and 0.54 for personal accomplishment. A trim‐and‐fill analysis determined that no adjustment was necessary.

Figure 6
Funnel plots for the 8 double‐armed studies that reported Maslach Burnout Inventory scores for emotional exhaustion, depersonalization, and personal accomplishment. Abbreviations: CI, confidence interval.

DISCUSSION

There appears to be no support for the long‐held belief that inpatient physicians are particularly prone to burnout. Among studies for which practice location was stated explicitly or could be obtained from the authors, and who used the MBI, no differences were found among inpatient and outpatient physicians with regard to depersonalization or personal accomplishment. This finding persisted whether double‐armed studies were compared directly, single‐armed studies were incorporated into this analysis, or single‐armed studies were analyzed separately. Outpatient physicians had a higher degree of emotional exhaustion when all studies were considered.

There are several reasons why outpatient physicians may be more prone to emotional exhaustion than their inpatient colleagues. Although it is by no means true that all inpatient physicians work in shifts, the increased availability of shift work may allow some inpatient physicians to better balance their professional and personal lives, a factor of work with which some outpatient physicians have struggled.[47] Inpatient practice may also afford more opportunity for teamwork, a factor that has been shown to correlate with reduced burnout.[48] When surveyed about burnout, outpatient physicians have cited patient volumes, paperwork, medicolegal concerns, and lack of community support as factors.[49] Inpatient physicians are not immune to these forces, but they arguably experience them to different degrees.

The absence of a higher rate of depersonalization among inpatient physicians is particularly reassuring in light of concerns expressed with the advent of US hospital medicinethat some hospitalists would be prone to viewing patients as an impediment to the efficient running of the hospital,[2] the very definition of depersonalization.

Although the difference in the whole sample was not statistically significant, the consistent tendency toward a greater sense of personal accomplishment among outpatient physicians is also noteworthy, particularly because post hoc subgroup analysis of US physicians did show statistical significance in both 2‐armed studies. Without detailed age data for the physicians in each study, we could not separate the possible impact of age on personal accomplishment; hospital medicine is a newer specialty staffed by generally younger physicians, and hospitalists may not have had time to develop a sense of accomplishment. When surveyed about job satisfaction, hospitalists have also reported the feeling that they were treated as glorified residents,[50] a factor that, if shared by other inpatient physicians, must surely affect their sense of personal accomplishment. The lack of longitudinal care for patients and the substantial provision of end‐of‐life care also may diminish the sense of personal accomplishment among inpatient physicians.

Another important finding from this systematic review is the marked heterogeneity of the instruments used to measure physician burnout. Many of the identified studies could not be subjected to meta‐analysis because of their use of differing burnout measures. Drawing more substantial conclusions about burnout and practice location is limited by the fact that, although the majority of studies used the full MBI, the largest study of European hospital doctors used the Copenhagen Burnout Inventory, and the studies thus far of US hospitalists have used single‐item surveys or portions of the MBI. Not reflected in this review is the fact that a large study of US burnout and job satisfaction[51] did not formally address practice location (M. Linzer, personal communication, August 2012). Similarly, a large study of British hospital doctors[52] is not included herein because many of the physicians involved had substantial outpatient duties (C. Taylor, personal communication, July 2012). Varying burnout measures have complicated a previous systematic review of burnout in oncologists.[53] Two studies that directly compared inpatient and outpatient physicians but that were excluded from our statistical analysis because of their modified versions of the MBI,[54, 55] showed higher burnout scores in outpatient physicians. Two other studies that provided direct inpatient versus outpatient comparisons but that used alternative burnout measures[56, 57] showed a greater frequency of burnout in inpatient physicians, but of these, 1 study[56] involved only 3 inpatient physicians.

Several limitations of our study should be considered. Although we endeavored to obtain information from authors (with some success) about specific local practice patterns and eliminated many studies because of incomplete data or mixed practice patterns (eg, general practitioners who take frequent hospital calls, hospital physicians with extensive outpatient duties in a clinic attached to their hospital), it remains likely that many physicians identified as outpatient provided some inpatient care (attending a few weeks per year on a teaching service, for example) and that some physicians identified as inpatient have minimal outpatient duties.

More importantly, the dataset analyzed is heterogeneous. Studies of the incidence of burnout are naturally observational and therefore not randomized. Inclusion of international studies is necessary to answer the research question (because published data on US hospitalists are sparse) but naturally introduces differences in practice settings, local factors, and other factors for which we cannot possibly account fully.

Our meta‐analysis therefore addressed a broad question about burnout among inpatient and outpatient physicians in various diverse settings. Applying it to any 1 population (including US hospitalists) is, by necessity, imprecise.

Post hoc analysis should be viewed with caution. For example, the finding of a statistical difference between US inpatient and outpatient physicians with regard to personal accomplishment score is compelling from the standpoint of hypothesis generation. However, it is worth bearing in mind that this analysis contained only 2 studies, both by the same primary author, and compared 855 outpatient physicians to only 149 hospitalists. This difference was no longer significant when 2 outpatient studies were added through meta‐regression.

Finally, the specific focus of this study on practice location precluded comparison with emergency physicians and anesthesiologists, 2 specialist types that have been the subject of particularly robust burnout literature. As the literature on hospitalist burnout becomes more extensive, comparative studies with these groups and with intensivists might prove instructive.

In summary, analysis of 24 studies comprising data on 5318 outpatient physicians and 1301 inpatient physicians provides no support for the commonly held belief that hospital‐based physicians are particularly prone to burnout. Outpatient physicians reported higher emotional exhaustion. Further studies of the incidence and severity of burnout according to practice location are indicated. We propose that in future studies, to avoid the difficulties with statistical analysis summarized herein, investigators ask about and explicitly report practice location (inpatient vs outpatient vs both) and report mean MBI subset data and standard deviations. Such information about US hospitalists would allow comparison with a robust (if heterogeneous) international literature on burnout.

Acknowledgments

The authors gratefully acknowledge all of the study authors who contributed clarification and guidance for this project, particularly the following authors who provided unpublished data for further analysis: Olaf Aasland, MD; Szilvia dm, PhD; Annalisa Bargellini, PhD; Cinzia Bressi, MD, PhD; Darrell Campbell Jr, MD; Ennio Cocco, MD; Russell Deighton, PhD; Senem Demirci Alanyali, MD; Biagio Di Iorio, MD, PhD; David Dunwoodie, MBBS; Sharon Einav, MD; Madeleine Estryn‐Behar, PhD; Bernardo Gandini, MD; Keiki Hinami, MD; Antonio Lasalvia, MD, PhD; Joseph Lee, MD; Guido Maccacaro, MD; Swati Marner, EdD; Chris McManus, MD, PhD; Carmelle Peisah, MBBS, MD; Katarina Putnik, MSc; Alfredo Rodrguez‐Muoz, PhD; Yahya Shehabi, MD; Evelyn Sosa Oberlin, MD; Jean Karl Soler, MD, MSc; Knut Srgaard, PhD; Cath Taylor; Viva Thorsen, MPH; Mascha Twellaar, MD; Edgar Voltmer, MD; Colin West, MD, PhD; and Deborah Whippen. The authors also thank the following colleagues for their help with translation: Dusanka Anastasijevic (Norwegian); Joyce Cheung‐Flynn, PhD (simplified Chinese); Ales Hlubocky, MD (Czech); Lena Jungheim, RN (Swedish); Erez Kessler (Hebrew); Kanae Mukai, MD (Japanese); Eliane Purchase (French); Aaron Shmookler, MD (Russian); Jan Stepanek, MD (German); Fernando Tondato, MD (Portuguese); Laszlo Vaszar, MD (Hungarian); and Joseph Verheidje, PhD (Dutch). Finally, the authors thank Cynthia Heltne and Diana Rogers for their expert and tireless library assistance, Bonnie Schimek for her help with figures, and Cindy Laureano and Elizabeth Jones for their help with author contact.

Hospital medicine is a rapidly growing field of US clinical practice.[1] Almost since its advent, concerns have been expressed about the potential for hospitalists to burn out.[2] Hospitalists are not unique in this; similar concerns heralded the arrival of other location‐defined specialties, including emergency medicine[3] and the full‐time intensivist model,[4] a fact that has not gone unnoted in the literature about hospitalists.[5]

The existing international literature on physician burnout provides good reason for this concern. Inpatient‐based physicians tend to work unpredictable schedules, with substantial impact on home life.[6] They tend to be young, and much burnout literature suggests a higher risk among younger, less‐experienced physicians.[7] When surveyed, hospitalists have expressed more concerns about their potential for burnout than their outpatient‐based colleagues.[8]

In fact, data suggesting a correlation between inpatient practice and burnout predate the advent of the US hospitalist movement. Increased hospital time was reported to correlate with higher rates of burnout in internists,[9] family practitioners,[10] palliative physicians,[11] junior doctors,[12] radiologists,[13] and cystic fibrosis caregivers.[14] In 1987, Keinan and Melamed[15] noted, Hospital work by its very nature, as compared to the work of a general practitioner, deals with the more severe and complicated illnesses, coupled with continuous daily contacts with patients and their anxious families. In addition, these physicians may find themselves embroiled in the power struggles and competition so common in their work environment.

There are other features, however, that may protect inpatient physicians from burnout. Hospital practice can facilitate favorable social relations involving colleagues, co‐workers, and patients,[16] a factor that may be protective.[17] A hospitalist schedule also can allow more focused time for continuing medical education, research, and teaching,[18] which have all been associated with reduced risk of burnout in some studies.[17] Studies of psychiatrists[19] and pediatricians[20] have shown a lower rate of burnout among physicians with more inpatient duties. Finally, a practice model involving a seemingly stable cadre of inpatient physicians has existed in Europe for decades,[2] indicating at least a degree of sustainability.

Information suggesting a higher rate of burnout among inpatient physicians could be used to target therapeutic interventions and to adjust schedules, whereas the opposite outcome could refute a pervasive myth. We therefore endeavored to summarize the literature on burnout among inpatient versus outpatient physicians in a systematic fashion, and to include data not only from the US hospitalist experience but also from other countries that have used a similar model for decades. Our primary hypothesis was that inpatient physicians experience more burnout than outpatient physicians.

It is important to distinguish burnout from depression, job dissatisfaction, and occupational stress, all of which have been studied extensively in physicians. Burnout, as introduced by Freudenberger[21] and further characterized by Maslach,[22] is a condition in which emotional exhaustion, depersonalization, and a low sense of personal accomplishment combine to negatively affect work life (as opposed to clinical depression, which affects all aspects of life). Job satisfaction can correlate inversely with burnout, but it is a separate process[23] and the subject of a recent systematic review.[24] The importance of distinguishing burnout from job dissatisfaction is illustrated by a survey of head and neck surgeons, in which 97% of those surveyed indicated satisfaction with their jobs and 34% of the same group answered in the affirmative when asked if they felt burned out.[25]

One obstacle to the meaningful comparison of burnout prevalence across time, geography, and specialty is the myriad ways in which burnout is measured and reported. The oldest and most commonly used instrument to measure burnout is the Maslach Burnout Inventory (MBI), which contains 22 items assessing 3 components of burnout (emotional exhaustion, depersonalization, and low personal accomplishment).[26] Other measures include the Copenhagen Burnout Inventory[27] (19 items with the components personal burnout, work‐related burnout, and client‐related burnout), Utrecht Burnout Inventory[28] (20‐item modification of the MBI), Boudreau Burnout Questionnaire[29] (30 items), Arbeitsbezogenes Verhaltens und Erlebensmuster[30] (66‐item questionnaire assessing professional commitment, resistance to stress, and emotional well‐being), Shirom‐Melamed Burnout Measure[31] (22 items with subscales for physical fatigue, cognitive weariness, tension, and listlessness), and a validated single‐item questionnaire.[32]

METHODS

Electronic searches of MEDLINE, EMBASE, PsycINFO, SCOPUS, and PubMed were undertaken for articles published from January 1, 1974 (the year in which burnout was first described by Freudenberger[21]) to 2012 (last accessed, September 12, 2012) using the Medical Subject Headings (MeSH) terms stress, psychological; burnout, professional; adaptation, psychological; and the keyword burnout. The same sources were searched to create another set for the MeSH terms hospitalists, physician's practice patterns, physicians/px, professional practice location, and the keyword hospitalist#. Where exact subject headings did not exist in databases, comparable subject headings or keywords were used. The 2 sets were then combined using the operator and. Abstracts from the Society of Hospital Medicine annual conferences were hand‐searched, as were reference lists from identified articles. To ensure that pertinent international literature was captured, there was no language restriction in the search.

A 2‐stage screening process was used. The titles and abstracts of all articles identified in the search were independently reviewed by 2 investigators (D.L.R. and K.J.C.) who had no knowledge of each other's results. An article was obtained when either reviewer deemed it worthy of full‐text review.

All full‐text articles were independently reviewed by the same 2 investigators. The inclusion criterion was the measurement of burnout in physicians who are stated to or can be reasonably assumed to spend the substantial majority of their clinical practice exclusively in either the inpatient or the outpatient setting. Studies of emergency department physicians or specialists who invariably spend substantial amounts of time in both settings (eg, surgeons, anesthesiologists) were excluded. Studies limited to trainees or nonphysicians were also excluded. For both stages of review, agreement between the 2 investigators was assessed by calculating the statistic. Disagreements about inclusion were adjudicated by a third investigator (A.I.B.).

Because our goal was to establish and compare the rate of burnout among US hospitalists and other inpatient physicians around the world, we included studies of hospitalists according to the definition in use at the time of the individual study, noting that the formal definition of a hospitalist has changed over the years.[33] Because practice patterns for physicians described as primary care physicians, family doctors, hospital doctors, and others differ substantially from country to country, we otherwise included only the studies where the practice location was stated explicitly or where the authors confirmed that their study participants either are known or can be reasonably assumed to spend more than 75% of their time caring for hospital inpatients, or are known or can be reasonably assumed to spend the vast majority of their time caring for outpatients.

Data were abstracted using a standardized form and included the measure of burnout used in the study, results, practice location of study subjects, and total number of study subjects. When data were not clear (eg, burnout measured but not reported by the authors, practice location of study subjects not clear), authors were contacted by email, or when no current email address could be located or no response was received, by telephone or letter. In instances where burnout was measured repeatedly over time or before and after a specific intervention, only the baseline measurement was recorded. Because all studies were expected to be nonrandomized, methodological quality was assessed using a version of the tool of Downs and Black,[34] adapted where necessary by omitting questions not applicable to the specific study type (eg randomization for survey studies)[35] and giving a maximum of 1 point for the inclusion of a power calculation.

Two a priori analyses were planned: (1) a statistical comparison of articles directly comparing burnout among inpatient and outpatient physicians, and (2) a statistical comparison of articles measuring burnout among inpatient physicians with articles measuring burnout among outpatient physicians by the most frequently reported measuremean subset scores for emotional exhaustion, depersonalization, and personal accomplishment on the MBI.

The primary outcome measures were the differences between mean subset scores for emotional exhaustion, depersonalization, and personal accomplishment on the MBI. All differences are expressed as (outpatient meaninpatient mean). The variance of each outcome was calculated with standard formulas.[36] To calculate the overall estimate, each study was weighted by the reciprocal of its variance. Studies with fewer than 10 subjects were excluded from statistical analysis but retained in the systematic review.

For studies that reported data for both inpatient and outpatient physicians (double‐armed studies), Cochran Q test and the I2 value were used to assess heterogeneity.[37, 38] Substantial heterogeneity was expected because these individual studies were conducted for different populations in different settings with different study designs, and this expectation was confirmed statistically. Therefore, we used a random effects model to estimate the overall effect, providing a conservative approach that accounted for heterogeneity among studies.[39]

To assess the durability of our findings, we performed separate multivariate meta‐regression analyses by including single‐armed studies only and including both single‐armed and double‐armed studies. For these meta‐regressions, means were again weighted by the reciprocal of their variances, and the arms of 2‐armed studies were considered separately. This approach allowed us to generate an estimate of the differences between MBI subset scores from studies that did not include such an estimate when analyzed separately.[40]

We examined the potential for publication bias in double‐armed studies by constructing a funnel plot, in which mean scores were plotted against their standard errors.[41] The trim‐and‐fill method was used to determine whether adjustment for publication bias was necessary. In addition, Begg's rank correlation test[42] was completed to test for statistically significant publication bias.

Stata 10.0 statistical software (StataCorp, College Station, TX) was used for data analyses. A P value of 0.05 or less was deemed statistically significant. The Preferred Reporting Items for Systematic Reviews and Meta‐analysis checklist was used for the design and execution of the systematic review and meta‐analysis.[43]

Subgroup analyses based on location were undertaken a posteriori. All data (double‐armed meta‐analysis, meta‐regression of single‐armed studies, and meta‐regression of single‐ and double‐armed studies) were analyzed by location (United States vs other; United States vs Europe vs other).

RESULTS

The search results are outlined in Figure 1. In total, 1704 articles met the criteria for full‐text review. A review of pertinent reference lists and author contacts led to the addition of 149 articles. Twenty‐nine references could not be located by any means, despite repeated attempts. Therefore, 1824 articles were subjected to full‐text review by the 2 investigators.

Figure 1
Flow chart of study selection.

Initially, 57 articles were found that met criteria for inclusion. Of these, 2 articles reported data in formats that could not be interpreted.[44, 45] When efforts to clarify the data with the authors were unsuccessful, these studies were excluded. A study specifically designed to assess the response of physicians to a recent series of terrorist attacks[46] was excluded a posteriori because of lack of generalizability. Of the other 54 studies, 15 reported burnout data on both outpatient physicians and inpatient physicians, 22 reported data on outpatient physicians only, and 17 reported data on inpatient physicians only. Table 1 summarizes the results of the 37 studies involving outpatient physicians; Table 2 summarizes the 32 studies involving inpatient physicians.

Summaries of Studies of Outpatient‐Based Physicians Meeting Inclusion Criteria
Lead Author, Publication Year Study Population and Location Instrument No. of Participants EE Score (SD)a DP Score (SD) PA Score (SD) Other Results
  • NOTE: Abbreviations: AVEM, Arbeitsbezogenes Verhaltens und Erlebensmuster; DP, depersonalization subset of MBI; EE, emotional exhaustion subset of MBI; MBI, Maslach Burnout Inventory; PA, personal accomplishment subset of MBI; SMBM, Shirom‐Melamad Burnout Measure; SD, standard deviation.

  • High scores of EE and DP and low scores of PA are features of burnout.

  • Data obtained directly from authors 20102012.

  • SDs calculated from published standard errors. Personal accomplishment scale reversed to match other studies.

  • SDs calculated from published CIs.

Schweitzer, 1994[12] Young physicians of various specialties in South Africa Single‐item survey 7 6 (83%) endorsed burnout
Aasland, 1997 [54]b General practitioners in Norway Modified MBI (22 items; scale, 15) 298 2.65 (0.80) 1.90 (0.59) 3.45 (0.40)
Grassi, 2000 [58] General practitioners in Italy MBI 182 18.49 (11.49) 6.11 (5.86) 38.52 (7.60)
McManus, 2000 [59]b General practitioners in United Kingdom Modified MBI (9 items; scale, 06) 800 8.34 (4.39) 3.18 (3.40) 14.16 (2.95)
Yaman, 2002 [60] General practitioners in 8 European nations MBI 98 25.1 (8.50) 7.3 (4.92) 34.5 (7.67)
Cathbras, 2004 [61] General practitioners in France MBI 306 21.85 (12.4) 9.13 (6.7) 38.7 (7.1)
Goehring, 2005 [63] General practitioners, general internists, pediatricians in Switzerland MBI 1755 17.9 (9.8) 6.5 (4.7) 39.6 (6.5)
Esteva, 2006 [64] General practitioners, pediatricians in Spain MBI 261 27.4 (11.8) 10.07 (6.4) 35.9 (7.06)
Gandini, 2006 [65]b Physicians of various specialties in Argentina MBI 67 31.0 (13.8) 10.2 (6.6) 38.4 (6.8)
Ozyurt, 2006 [66] General practitioners in Turkey Modified MBI (22 items; scale, 04) 55 15.23 (5.80) 4.47 (3.31) 23.38 (4.29)
Deighton, 2007 [67]b Psychiatrists in several German‐speaking nations MBI 19 30.68 (9.92) 13.42 (4.23) 37.16 (3.39)
Dunwoodie, 2007 [68]b Palliative care physicians in Australia MBI 21 14.95 (9.14) 3.95 (3.40) 38.90 (2.88)
Srgaard, 2007 [69]b Psychiatrists in 5 European nations MBI 22 19.41 (8.08) 6.68 (4.93) 39.00 (4.40)
Sosa Oberlin, 2007 [56]b Physicians of various specialties in Argentina Author‐designed instrument 33 26 (78.8%) had 4 burnout symptoms, 6.15 symptoms per physician
Voltmer, 2007 [57]b Physicians of various specialties in Germany AVEM 46 11 (23.9%) exhibited burnout (type B) pattern
dm, 2008 [70]b Physicians of various specialties in Hungary MBI 163 17.45 (11.12) 4.86 (4.91) 36.56 (7.03)
Di Iorio, 2008 [71]b Dialysis physicians in Italy Author‐designed instrument 54 Work: 2.6 (1.5), Material: 3.1 (2.1), Climate: 3.0 (1.1), Objectives: 3.4 (1.6), Quality: 2.2 (1.5), Justification: 3.2 (2.0)
Lee, 2008 [49]b Family physicians in Canada MBI 123 26.26 (9.53) 10.20 (5.22) 38.43 (7.34)
Truchot, 2008 [72] General practitioners in France MBI 259 25.4 (11.7) 7.5 (5.5) 36.5 (7.1)
Twellaar, 2008 [73]b General practitioners in the Netherlands Utrecht Burnout Inventory 349 2.06 (1.11) 1.71 (1.05) 5.08 (0.77)
Arigoni, 2009 [17] General practitioners, pediatricians in Switzerland MBI 258 22.8 (12.0) 6.9 (6.1) 39.0 (7.2)
Bernhardt, 2009 [75] Clinical geneticists in United States MBI 72 25.8 (10.01)c 10.9 (4.16)c 34.8 (5.43)c
Bressi, 2009 [76]b Psychiatrists in Italy MBI 53 23.15 (11.99) 7.02 (6.29) 36.41 (7.54)
Krasner, 2009 [77] General practitioners in United States MBI 60 26.8 (10.9)d 8.4 (5.1)d 40.2 (5.3)d
Lasalvia, 2009 [55]b Psychiatrists in Italy Modified MBI (16 items; scale, 06) 38 2.37 (1.27) 1.51 (1.15) 4.46 (0.87)
Peisah, 2009 [79]b Physicians of various specialties in Australia MBI 28 13.92 (9.24) 3.66 (3.95) 39.34 (8.55)
Shanafelt, 2009 [80]b Physicians of various specialties in United States MBI 408 20.5 (11.10) 4.3 (4.74) 40.8 (6.26)
Zantinge, 2009 [81] General practitioners in the Netherlands Utrecht Burnout Inventory 126 1.58 (0.79) 1.32 (0.72) 4.27 (0.77)
Voltmer, 2010 [83]b Psychiatrists in Germany AVEM 526 114 (21.7%) exhibited burnout (type B) pattern
Maccacaro, 2011 [85]b Physicians of various specialties in Italy MBI 42 14.31 (11.98) 3.62 (4.95) 38.24 (6.22)
Lucas, 2011 [84]b Outpatient physicians periodically staffing an academic hospital teaching service in United States MBI (EE only) 30 24.37 (14.95)
Shanafelt, 2012 [87]b General internists in United States MBI 447 25.4 (14.0) 7.5 (6.3) 41.4 (6.0)
Kushnir, 2004 [62] General practitioners and pediatricians in Israel MBI (DP only) and SMBM 309 9.15 (3.95) SMBM mean (SD), 2.73 per item (0.86)
Vela‐Bueno, 2008 [74]b General practitioners in Spain MBI 240 26.91 (11.61) 9.20 (6.35) 35.92 (7.92)
Lesic, 2009 [78]b General practitioners in Serbia MBI 38 24.71 (10.81) 7.47 (5.51) 37.21 (7.44)
Demirci, 2010 [82]b Medical specialists related to oncology practice in Hungary MBI 26 23.31 (11.2) 6.46 (5.7) 37.7 (8.14)
Putnik, 2011 [86]b General practitioners in Hungary MBI 370 22.22 (11.75) 3.66 (4.40) 41.40 (6.85)
Summary of Studies of Inpatient Physicians Meeting Inclusion Criteria
Lead Author, Publication Year Study Population and Location Instrument No. of Participants EE Score (SD)a DP Score (SD) PA Score (SD) Other Results
  • NOTE: Abbreviations: AVEM, Arbeitsbezogenes Verhaltens und Erlebensmuster; DP, depersonalization subset of MBI; EE, emotional exhaustion subset of MBI; MBI, Maslach Burnout Inventory; PA, personal accomplishment subset of MBI; SD, standard deviation.

  • High scores of EE and DP and low scores of PA are features of burnout.

  • SDs not available; study therefore excluded from statistical comparisons.

  • Different survey item than other studies in this table using a single‐item, 5‐point burnout measure.

  • Data obtained directly from authors 20102012.

  • Personal accomplishment scale reversed to match other studies.

Varga, 1996 [88] Hospital doctors in Spain MBI 179 21.61b 7.33b 35.28b
Aasland, 1997 [54] Hospital doctors in Norway Modified MBI (22 items; scale, 15) 582 2.39 (0.80) 1.81 (0.65) 3.51 (0.46)
Bargellini, 2000 [89] Hospital doctors in Italy MBI 51 17.45 (9.87) 7.06 (5.54) 35.33 (7.90)
Grassi, 2000 [58] Hospital doctors in Italy MBI 146 16.17 (9.64) 5.32 (4.76) 38.71 (7.28)
Hoff, 2001 [33] Hospitalists in United States Single‐item surveyc 393 12.9% burned out (>4/5), 24.9% at risk for burnout (34/5), 62.2% at no current risk (mean, 2.86 on 15 scale)
Trichard, 2005 [90] Hospital doctors in France MBI 199 16 (10.7) 6.6 (5.7) 38.5 (6.5)
Gandini, 2006 [65]d Hospital doctors in Argentina MBI 290 25.0 (12.7) 7.9 (6.2) 40.1 (7.0)
Dunwoodie, 2007 [68]d Palliative care doctors in Australia MBI 14 18.29 (14.24) 5.29 (5.89) 38.86 (3.42)
Srgaard, 2007 [69]d Psychiatrists in 5 European nations MBI 18 18.56 (9.32) 5.50 (3.79) 39.08 (5.39)
Sosa Oberlin, 2007 [56]d Hospital doctors in Argentina Author‐designed instrument 3 3 (100%) had 4 burnout symptoms, 8.67 symptoms per physician
Voltmer, 2007 [57]d Hospital doctors in Germany AVEM 271 77 (28.4%) exhibited burnout (type B) pattern
dm, 2008 [70]b Physicians of various specialties in Hungary MBI 194 19.23 (10.79) 4.88 (4.61) 35.26 (8.42)
Di Iorio, 2008 [71]d Dialysis physicians in Italy Author‐designed instrument 62 Work, mean (SD), 3.1 (1.4); Material, mean (SD), 3.3 (1.5); Climate, mean (SD), 2.9 (1.1); Objectives, mean (SD), 2.5 (1.5); Quality, mean (SD), 3.0 (1.1); Justification, mean (SD), 3.1 (2.1)
Fuss, 2008 [91]d Hospital doctors in Germany Copenhagen Burnout Inventory 292 Mean Copenhagen Burnout Inventory, mean (SD), 46.90 (18.45)
Marner, 2008 [92]d Psychiatrists and 1 generalist in United States MBI 9 20.67 (9.75) 7.78 (5.14) 35.33 (6.44)
Shehabi, 2008 [93]d Intensivists in Australia Modified MBI (6 items; scale, 15) 86 2.85 (0.93) 2.64 (0.85) 2.58 (0.83)
Bressi, 2009 [76]d Psychiatrists in Italy MBI 28 17.89 (14.46) 5.32 (7.01) 34.57 (11.27)
Brown, 2009 [94] Hospital doctors in Australia MBI 12 22.25 (8.59) 6.33 (2.71) 39.83 (7.31)
Lasalvia, 2009 [55]d Psychiatrists in Italy Modified MBI (16 items; scale, 06) 21 1.95 (1.04) 1.35 (0.85) 4.46 (1.04)
Peisah, 2009 [79]d Hospital doctors in Australia MBI 62 20.09 (9.91) 6.34 (4.90) 35.06 (7.33)
Shanafelt, 2009 [80]d Hospitalists and intensivists in United States MBI 19 25.2 (11.59) 4.4 (3.79) 38.5 (8.04)
Tunc, 2009 [95] Hospital doctors in Turkey Modified MBI (22 items; scale, 04) 62 1.18 (0.78) 0.81 (0.73) 3.10 (0.59)e
Cocco, 2010 [96]d Hospital geriatricians in Italy MBI 38 16.21 (11.56) 4.53 (4.63) 39.13 (7.09)
Doppia, 2011 [97]d Hospital doctors in France Copenhagen Burnout Inventory 1,684 Mean work‐related burnout score, 2.72 (0.75)
Glasheen, 2011 [98] Hospitalists in United States Single‐item survey 265 Mean, 2.08 on 15 scale 62 (23.4%) burned out
Lucas, 2011 [84]d Academic hospitalists in United States MBI (EE only) 26 19.54 (12.85)
Thorsen, 2011 [99] Hospital doctors in Malawi MBI 2 25.5 (4.95) 8.5 (6.36) 25.0 (5.66)
Hinami, 2012 [50]d Hospital doctors in United States Single‐item survey 793 Mean, 2.24 on 15 scale 261 (27.2%) burned out
Quenot, 2012 [100]d Intensivists in France MBI 4 33.25 (4.57) 13.50 (5.45) 35.25 (4.86)
Ruitenburg, 2012 [101] Hospital doctors in the Netherlands MBI (EE and DP only) 214 13.3 (8.0) 4.5 (4.1)
Seibt, 2012 [102]d Hospital doctors in Germany Modified MBI (16 items; scale, 06, reported per item rather than totals) 2,154 2.2 (1.4) 1.4 (1.2) 5.1 (0.9)
Shanafelt, 2012 [87]d Hospitalists in United States MBI 130 24.7 (12.5) 9.1 (6.9) 39.0 (7.6)

Table 3 summarizes the results of the 15 studies that reported burnout data for both inpatient and outpatient physicians, allowing direct comparisons to be made. Nine studies reported MBI subset totals with standard deviations, 2 used different modifications of the MBI, 2 used different author‐derived measures, 1 used only the emotional exhaustion subscale of the MBI, and 1 used the Arbeitsbezogenes Verhaltens und Erlebensmuster. Therefore, statistical comparison was attempted only for the 9 studies reporting comparable MBI data, comprising burnout data on 1390 outpatient physicians and 899 inpatient physicians.

Summary of Studies Including Both Inpatient‐Based and Outpatient‐Based Physicians Meeting Inclusion Criteria
Lead Author, Publication Year Location Instrument Inpatient‐Based Physicians Outpatient‐Based Physicians
No. Results, Score (SD)a No. Results, Score (SD)a
  • NOTE: Abbreviations: AVEM, Arbeitsbezogenes Verhaltens und Erlebensmuster; DP, depersonalization subset of MBI; EE, emotional exhaustion subset of MBI; MBI, Maslach Burnout Inventory; PA, personal accomplishment subset of MBI; SD, standard deviation.

  • High scores of EE and DP and low scores of PA are features of burnout.

  • Data obtained directly from authors from 20102012.

Aasland, 1997 [54]b Norway Modified MBI (22 items; scale, 15) 582 EE, 2.39 (0.80); DP, 1.81 (0.65); PA, 3.51 (0.46) 298 EE, 2.65 (0.80); DP, 1.90 (0.59); PA, 3.45 (0.40)
Grassi, 2000 [58] Italy MBI 146 EE, 16.17 (9.64); DP, 5.32 (4.76); PA, 38.71 (7.28) 182 EE, 18.49 (11.49); DP, 6.11 (5.86); PA, 38.52 (7.60)
Gandini, 2006 [65]b Argentina MBI 290 EE, 25.0 (12.7);DP, 7.9 (6.2); PA, 40.1 (7.0) 67 EE, 31.0 (13.8); DP, 10.2 (6.6); PA, 38.4 (6.8)
Dunwoodie, 2007 [68]b Australia MBI 14 EE, 18.29 (14.24); DP, 5.29 (5.89); PA, 38.86 (3.42) 21 EE, 14.95 (9.14); DP, 3.95 (3.40); PA, 38.90 (2.88)
Srgaard, 2007 [69]b 5 European nations MBI 18 EE, 18.56 (9.32); DP, 5.50 (3.79); PA, 39.08 (5.39) 22 EE, 19.41 (8.08); DP, 6.68 (4.93); PA, 39.00 (4.40)
Sosa Oberlin, 2007 [56]b Argentina Author‐designed instrument 3 3 (100%) had 4 burnout symptoms, 8.67 symptoms per physician 33 26 (78.8%) had 4 burnout symptoms, 6.15 symptoms per physician
Voltmer, 2007 [57]b Germany AVEM 271 77 (28.4%) exhibited burnout (type B) pattern 46 11 (23.9%) exhibited burnout (type B) pattern
dm, 2008 [70]b Hungary MBI 194 EE, 19.23 (10.79); DP, 4.88 (4.61); PA, 35.26 (8.42) 163 EE, 17.45 (11.12); DP, 4.86 (4.91); PA, 36.56 (7.03)
Di Iorio, 2008 [71]b Italy Author‐designed instrument 62 Work: 3.1 (1.4); material: 3.3 (1.5); climate: 2.9 (1.1); objectives: 2.5 (1.5); quality: 3.0 (1.1); justification: 3.1 (2.1) 54 Work: 2.6 (1.5); material: 3.1 (2.1); climate: 3.0 (1.1); objectives: 3.4 (1.6); quality: 2.2 (1.5); justification: 3.2 (2.0)
Bressi, 2009 [76]b Italy MBI 28 EE, 17.89 (14.46); DP, 5.32 (7.01); PA, 34.57 (11.27) 53 EE, 23.15 (11.99); DP, 7.02 (6.29); PA, 36.41 (7.54)
Lasalvia, 2009[55]b Italy Modified MBI (16 items; scale, 06) 21 EE, 1.95 (1.04); DP, 1.35 (0.85); PA, 4.46 (1.04) 38 EE, 2.37 (1.27); DP, 1.51 (1.15); PA, 4.46 (0.87)
Peisah, 2009 [79]b Australia MBI 62 EE, 20.09 (9.91); DP, 6.34 (4.90); PA, 35.06 (7.33) 28 EE, 13.92 (9.24); DP, 3.66 (3.95); PA, 39.34 (8.55)
Shanafelt, 2009 [80]b United States MBI 19 EE, 25.2 (11.59); DP, 4.4 (3.79); PA, 38.5 (8.04) 408 EE, 20.5 (11.10); DP, 4.3 (4.74); PA, 40.8 (6.26)
Lucas, 2011 [84]b United States MBI (EE only) 26 EE, 19.54 (12.85) 30 EE, 24.37 (14.95)
Shanafelt, 2012 [87]b United States MBI 130 EE, 24.7 (12.5); DP, 9.1 (6.9); PA, 39.0 (7.6) 447 EE, 25.4 (14.0); DP, 7.5 (6.3); PA, 41.4 (6.0)

Figure 2 shows that no significant difference existed between the groups regarding emotional exhaustion (mean difference, 0.11 points on a 54‐point scale; 95% confidence interval [CI], 2.40 to 2.61; P=0.94). In addition, there was no significant difference between the groups regarding depersonalization (Figure 3; mean difference, 0.00 points on a 30‐point scale; 95% CI, 1.03 to 1.02; P=0.99) and personal accomplishment (Figure 4; mean difference, 0.93 points on a 48‐point scale; 95% CI, 0.23 to 2.09; P=0.11).

Figure 2
Forest plot for double‐armed studies reporting Maslach Burnout Inventory scores for emotional exhaustion. The size of the square represents study size, and the bars represent the 95% confidence interval (CI).
Figure 3
Forest plot for double‐armed studies reporting Maslach Burnout Inventory scores for depersonalization. The size of the square represents study size and the bars represent the 95% confidence interval (CI).
Figure 4
Forest plot for double‐armed studies reporting Maslach Burnout Inventory scores for personal accomplishment. The size of the square represents study size and the bars represent the 95% confidence interval (CI). The direction of the y‐axis has been reversed so that greater burnout in outpatient physicians remains to the right.

We used meta‐regression to allow the incorporation of single‐armed MBI studies. Whether single‐armed studies were analyzed separately (15 outpatient studies comprising 3927 physicians, 4 inpatient studies comprising 300 physicians) or analyzed with double‐armed studies (24 outpatient arms comprising 5318 physicians, 13 inpatient arms comprising 1301 physicians), the lack of a significant difference between the groups persisted for the depersonalization and personal accomplishment scales (Figure 5). Emotional exhaustion was significantly higher in outpatient physicians when single‐armed studies were considered separately (mean difference, 6.36 points; 95% CI, 2.24 to 10.48; P=0.002), and this difference persisted when all studies were combined (mean difference, 3.00 points; 95% CI, 0.05 to 5.94, P=0.046).

Figure 5
Forest plots comparing results of meta‐analysis of 9 double‐armed studies, meta‐regression of 19 single‐armed studies, and meta‐regression of all 28 studies reporting Maslach Burnout Inventory scores. The direction of the y‐axis of the personal accomplishment plot has been reversed so that higher burnout in outpatient physicians remains to the right. Error bars represent the 95% confidence interval.

Subgroup analysis by geographic location showed US outpatient physicians had a significantly higher personal accomplishment score than US inpatient physicians (mean difference, 2.38 points; 95% CI, 1.22 to 3.55; P<0.001) in double‐armed studies. This difference did not persist when single‐armed studies were included through meta‐regression (mean difference, 0.55 points, 95% CI, 4.30 to 5.40, P=0.83).

Table 4 demonstrates that methodological quality was generally good from the standpoint of the reporting and bias subsections of the Downs and Black tool. External validity was scored lower for many studies due to the use of convenience samples and lack of information about physicians who declined to participate.

Assessment of Methodologic Quality
Lead Author, Publication Year Reporting External Validity Internal Validity: Bias Internal Validity: Confounding Power
  • NOTE: For survey studies (all studies except Krasner,[77] Lucas,[84] and Quenot[100]), questions regarding interventions were omitted. For uncontrolled studies (all studies except Lucas[84]), questions regarding controls were omitted. The presence of a power calculation was awarded 1 point.

Schweitzer, 1994 [12] 5 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Varga, 1996 [88] 5 of 6 points 1 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Aasland, 1997 [54] 3 of 6 points 2 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Bargellini, 2000 [89] 5 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Grassi, 2000 [58] 6 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
McManus, 2000 [59] 5 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Hoff, 2001 [33] 6 of 6 points 2 of 2 points 2 of 4 points 1 of 1 point 0 of 1 point
Yaman, 2002 [60] 5 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Cathbras, 2004 [61] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Kushnir, 2004 [62] 5 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Goehring, 2005 [63] 6 of 6 points 1 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Trichard, 2005 [90] 3 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Esteva, 2006 [64] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Gandini, 2006 [65] 6 of 6 points 1 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Ozyurt, 2006 [66] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Deighton, 2007 [67] 5 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Dunwoodie, 2007 [68] 5 of 6 points 2 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Srgaard, 2007 [69] 6 of 6 points 0 of 2 points 3 of 4 points 1 of 1 point 1 of 1 point
Sosa Oberlin, 2007 [56] 4 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Voltmer, 2007 [57] 4 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
dm, 2008 [70] 5 of 6 points 2 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Di Iorio, 2008 [71] 6 of 6 points 0 of 2 points 2 of 4 points 0 of 1 point 0 of 1 point
Fuss, 2008 [91] 6 of 6 points 0 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Lee, 2008 [49] 4 of 6 points 2 of 2 points 4 of 4 points 0 of 1 point 1 of 1 point
Marner, 2008 [92] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Shehabi, 2008 [93] 3 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Truchot, 2008 [72] 5 of 6 points 1 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Twellaar, 2008 [73] 6 of 6 points 2 of 2 points 3 of 4 points 0 of 1 point 0 of 1 point
Vela‐Bueno, 2008 [74] 5 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Arigoni, 2009 [17] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Bernhardt, 2009 [75] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Bressi, 2009 [76] 6 of 6 points 0 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Brown, 2009 [94] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Krasner, 2009 [77] 9 of 11 points 0 of 3 points 6 of 7 points 1 of 2 points 1 of 1 point
Lasalvia, 2009 [55] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Lesic, 2009 [78] 5 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Peisah, 2009 [79] 6 of 6 points 2 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Shanafelt, 2009 [80] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Tunc, 2009 [95] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Zantinge, 2009 [81] 5 of 6 points 0 of 2 points 3 of 4 points 1 of 1 point 0 of 1 point
Cocco, 2010 [96] 4 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Demirci, 2010 [82] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Voltmer, 2010 [83] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Doppia, 2011 [97] 5 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Glasheen, 2011 [98] 5 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Lucas, 2011 [84] 10 of 11 points 2 of 3 points 7 of 7 points 5 of 6 points 1 of 1 point
Maccacaro, 2011 [85] 5 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Putnik, 2011 [86] 6 of 6 points 1 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Thorsen, 2011 [99] 6 of 6 points 0 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Hinami, 2012 [50] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 1 of 1 point
Quenot, 2012 [100] 8 of 11 points 1 of 3 points 6 of 7 points 1 of 2 points 0 of 1 point
Ruitenburg, 2012 [101] 6 of 6 points 2 of 2 points 4 of 4 points 0 of 1 point 0 of 1 point
Seibt, 2012 [102] 6 of 6 points 0 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point
Shanafelt, 2012 [87] 6 of 6 points 2 of 2 points 4 of 4 points 1 of 1 point 0 of 1 point

Funnel plots were used to evaluate for publication bias in the meta‐analysis of the 8 double‐armed studies (Figure 6). We found no significant evidence of bias, which was supported by Begg's test P values of 0.90 for emotional exhaustion, >0.99 for depersonalization, and 0.54 for personal accomplishment. A trim‐and‐fill analysis determined that no adjustment was necessary.

Figure 6
Funnel plots for the 8 double‐armed studies that reported Maslach Burnout Inventory scores for emotional exhaustion, depersonalization, and personal accomplishment. Abbreviations: CI, confidence interval.

DISCUSSION

There appears to be no support for the long‐held belief that inpatient physicians are particularly prone to burnout. Among studies for which practice location was stated explicitly or could be obtained from the authors, and who used the MBI, no differences were found among inpatient and outpatient physicians with regard to depersonalization or personal accomplishment. This finding persisted whether double‐armed studies were compared directly, single‐armed studies were incorporated into this analysis, or single‐armed studies were analyzed separately. Outpatient physicians had a higher degree of emotional exhaustion when all studies were considered.

There are several reasons why outpatient physicians may be more prone to emotional exhaustion than their inpatient colleagues. Although it is by no means true that all inpatient physicians work in shifts, the increased availability of shift work may allow some inpatient physicians to better balance their professional and personal lives, a factor of work with which some outpatient physicians have struggled.[47] Inpatient practice may also afford more opportunity for teamwork, a factor that has been shown to correlate with reduced burnout.[48] When surveyed about burnout, outpatient physicians have cited patient volumes, paperwork, medicolegal concerns, and lack of community support as factors.[49] Inpatient physicians are not immune to these forces, but they arguably experience them to different degrees.

The absence of a higher rate of depersonalization among inpatient physicians is particularly reassuring in light of concerns expressed with the advent of US hospital medicinethat some hospitalists would be prone to viewing patients as an impediment to the efficient running of the hospital,[2] the very definition of depersonalization.

Although the difference in the whole sample was not statistically significant, the consistent tendency toward a greater sense of personal accomplishment among outpatient physicians is also noteworthy, particularly because post hoc subgroup analysis of US physicians did show statistical significance in both 2‐armed studies. Without detailed age data for the physicians in each study, we could not separate the possible impact of age on personal accomplishment; hospital medicine is a newer specialty staffed by generally younger physicians, and hospitalists may not have had time to develop a sense of accomplishment. When surveyed about job satisfaction, hospitalists have also reported the feeling that they were treated as glorified residents,[50] a factor that, if shared by other inpatient physicians, must surely affect their sense of personal accomplishment. The lack of longitudinal care for patients and the substantial provision of end‐of‐life care also may diminish the sense of personal accomplishment among inpatient physicians.

Another important finding from this systematic review is the marked heterogeneity of the instruments used to measure physician burnout. Many of the identified studies could not be subjected to meta‐analysis because of their use of differing burnout measures. Drawing more substantial conclusions about burnout and practice location is limited by the fact that, although the majority of studies used the full MBI, the largest study of European hospital doctors used the Copenhagen Burnout Inventory, and the studies thus far of US hospitalists have used single‐item surveys or portions of the MBI. Not reflected in this review is the fact that a large study of US burnout and job satisfaction[51] did not formally address practice location (M. Linzer, personal communication, August 2012). Similarly, a large study of British hospital doctors[52] is not included herein because many of the physicians involved had substantial outpatient duties (C. Taylor, personal communication, July 2012). Varying burnout measures have complicated a previous systematic review of burnout in oncologists.[53] Two studies that directly compared inpatient and outpatient physicians but that were excluded from our statistical analysis because of their modified versions of the MBI,[54, 55] showed higher burnout scores in outpatient physicians. Two other studies that provided direct inpatient versus outpatient comparisons but that used alternative burnout measures[56, 57] showed a greater frequency of burnout in inpatient physicians, but of these, 1 study[56] involved only 3 inpatient physicians.

Several limitations of our study should be considered. Although we endeavored to obtain information from authors (with some success) about specific local practice patterns and eliminated many studies because of incomplete data or mixed practice patterns (eg, general practitioners who take frequent hospital calls, hospital physicians with extensive outpatient duties in a clinic attached to their hospital), it remains likely that many physicians identified as outpatient provided some inpatient care (attending a few weeks per year on a teaching service, for example) and that some physicians identified as inpatient have minimal outpatient duties.

More importantly, the dataset analyzed is heterogeneous. Studies of the incidence of burnout are naturally observational and therefore not randomized. Inclusion of international studies is necessary to answer the research question (because published data on US hospitalists are sparse) but naturally introduces differences in practice settings, local factors, and other factors for which we cannot possibly account fully.

Our meta‐analysis therefore addressed a broad question about burnout among inpatient and outpatient physicians in various diverse settings. Applying it to any 1 population (including US hospitalists) is, by necessity, imprecise.

Post hoc analysis should be viewed with caution. For example, the finding of a statistical difference between US inpatient and outpatient physicians with regard to personal accomplishment score is compelling from the standpoint of hypothesis generation. However, it is worth bearing in mind that this analysis contained only 2 studies, both by the same primary author, and compared 855 outpatient physicians to only 149 hospitalists. This difference was no longer significant when 2 outpatient studies were added through meta‐regression.

Finally, the specific focus of this study on practice location precluded comparison with emergency physicians and anesthesiologists, 2 specialist types that have been the subject of particularly robust burnout literature. As the literature on hospitalist burnout becomes more extensive, comparative studies with these groups and with intensivists might prove instructive.

In summary, analysis of 24 studies comprising data on 5318 outpatient physicians and 1301 inpatient physicians provides no support for the commonly held belief that hospital‐based physicians are particularly prone to burnout. Outpatient physicians reported higher emotional exhaustion. Further studies of the incidence and severity of burnout according to practice location are indicated. We propose that in future studies, to avoid the difficulties with statistical analysis summarized herein, investigators ask about and explicitly report practice location (inpatient vs outpatient vs both) and report mean MBI subset data and standard deviations. Such information about US hospitalists would allow comparison with a robust (if heterogeneous) international literature on burnout.

Acknowledgments

The authors gratefully acknowledge all of the study authors who contributed clarification and guidance for this project, particularly the following authors who provided unpublished data for further analysis: Olaf Aasland, MD; Szilvia dm, PhD; Annalisa Bargellini, PhD; Cinzia Bressi, MD, PhD; Darrell Campbell Jr, MD; Ennio Cocco, MD; Russell Deighton, PhD; Senem Demirci Alanyali, MD; Biagio Di Iorio, MD, PhD; David Dunwoodie, MBBS; Sharon Einav, MD; Madeleine Estryn‐Behar, PhD; Bernardo Gandini, MD; Keiki Hinami, MD; Antonio Lasalvia, MD, PhD; Joseph Lee, MD; Guido Maccacaro, MD; Swati Marner, EdD; Chris McManus, MD, PhD; Carmelle Peisah, MBBS, MD; Katarina Putnik, MSc; Alfredo Rodrguez‐Muoz, PhD; Yahya Shehabi, MD; Evelyn Sosa Oberlin, MD; Jean Karl Soler, MD, MSc; Knut Srgaard, PhD; Cath Taylor; Viva Thorsen, MPH; Mascha Twellaar, MD; Edgar Voltmer, MD; Colin West, MD, PhD; and Deborah Whippen. The authors also thank the following colleagues for their help with translation: Dusanka Anastasijevic (Norwegian); Joyce Cheung‐Flynn, PhD (simplified Chinese); Ales Hlubocky, MD (Czech); Lena Jungheim, RN (Swedish); Erez Kessler (Hebrew); Kanae Mukai, MD (Japanese); Eliane Purchase (French); Aaron Shmookler, MD (Russian); Jan Stepanek, MD (German); Fernando Tondato, MD (Portuguese); Laszlo Vaszar, MD (Hungarian); and Joseph Verheidje, PhD (Dutch). Finally, the authors thank Cynthia Heltne and Diana Rogers for their expert and tireless library assistance, Bonnie Schimek for her help with figures, and Cindy Laureano and Elizabeth Jones for their help with author contact.

References
  1. Siegal EM. Just because you can, doesn't mean that you should: a call for the rational application of hospitalist comanagement. J Hosp Med. 2008;3(5):398402.
  2. Fitzgerald FT. Hospitalists. Hospitalist. 1998;1(4):56.
  3. Dorevitch S, Forst L. The occupational hazards of emergency physicians. Am J Emerg Med. 2000;18(3):300311.
  4. Fields AI, Cuerdon TT, Brasseux CO, et al. Physician burnout in pediatric critical care medicine. Crit Care Med. 1995;23(8):14251429.
  5. Schroeder SA, Schapiro R. The hospitalist: new boon for internal medicine or retreat from primary care? Ann Intern Med. 1999;130(4 pt 2): 382387.
  6. Maillard MF, Iwatsubo Y, Grimon G, et al. Enquete sur les horaires et la charge de travail des medecins dans un establissement de l'Assitance Publique‐Hopitaux de Paris. Arch Mal Prof. 1996;57:438444.
  7. Bohle A, Baumgartel M, Gotz ML, Muller EH, Jocham D. Burn‐out of urologists in the county of Schleswig‐Holstein, Germany: a comparison of hospital and private practice urologists. J Urol. 2001;165(4): 11581161.
  8. Wetterneck TB, Linzer M, Halls JJ, et al. Satisfaction and worklife of academic hospitalist and non‐hospitalist attendings on general medical inpatient rotations. J Gen Internal Med. 2006;21(S4):128.
  9. Saint S, Zemencuk JK, Hayward RA, Golin CE, Konrad TR, Linzer M; SGIM Career Satisfaction Group. What effect does increasing inpatient time have on outpatient‐oriented internist satisfaction? J Gen Intern Med. 2003;18(9):725729.
  10. Lemkau J, Rafferty J, Gordon R. Burnout and career‐choice regret among family practice physicians in early practice. Fam Pract Res J. 1994;14(3):213222.
  11. Graham J, Ramirez AJ, Cull A, Finlay I, Hoy A, Richards MA. Job stress and satisfaction among palliative physicians. Palliat Med. 1996; 10(3):185194.
  12. Schweitzer B. Stress and burnout in junior doctors. S Afr Med J. 1994; 84(6):352354.
  13. Lim RC, Pinto C. Work stress, satisfaction and burnout in New Zealand radiologists: comparison of public hospital and private practice in New Zealand. J Med Imaging Radiat Oncol. 2009;53(2):194199.
  14. Lewiston NJ, Conley J, Blessing‐Moore J. Measurement of hypothetical burnout in cystic fibrosis caregivers. Acta Paediatr Scand. 1981; 70(6):935939.
  15. Keinan G, Melamed S. Personality characteristics and proneness to burnout: a study among internists. Stress Med. 1987;3(4):307315.
  16. Hoff T, Whitcomb WF, Nelson JR. Thriving and surviving in a new medical career: the case of hospitalist physicians. J Health Soc Behav. 2002;43(1):7291.
  17. Arigoni F, Bovier PA, Mermillod B, Waltz P, Sappino AP. Prevalence of burnout among Swiss cancer clinicians, paediatricians and general practitioners: who are most at risk? Support Care Cancer. 2009;17(1): 7581.
  18. Arora V, Fang MC, Kripalani S, Amin AN. Preparing for “diastole”: advanced training opportunities for academic hospitalists. J Hosp Med. 2006;1(6):368377.
  19. Prosser D, Johnson S, Kuipers E, Szmukler G, Bebbington P, Thornicroft G. Mental health, “burnout” and job satisfaction among hospital and community‐based mental health staff. Br J Psychiatry. 1996;169(3):334337.
  20. McPhillips HA, Stanton B, Zuckerman B, Stapleton FB. Role of a pediatric department chair: factors leading to satisfaction and burnout. J Pediatr. 2007;151(4):425430.
  21. Freudenberger HJ. Staff burn‐out. J Soc Iss. 1974;30(1):159165.
  22. Maslach C. Burned‐out. Hum Behav. 1976;5(9):1622.
  23. Keyes LE. Underpaid women, stressed out men, satisfied emergency physicians. Ann Emerg Med. 2008;51(6):729731.
  24. Scheurer D, McKean S, Miller J, Wetterneck T. U.S. physician satisfaction: a systematic review. J Hosp Med. 2009;4(9):560568.
  25. Johnson JT, Wagner RL, Rueger RM, Goepfert H. Professional burnout among head and neck surgeons: results of a survey. Head Neck. 1993;15(6):557560.
  26. Maslach C, Jackson SE. The measurement of experienced burnout. J Occup Behav. 1981;2(2):99113.
  27. Kristensen TS, Borritz M, Villadsen E, Christensen KB. The Copenhagen Burnout Inventory: a new tool for the assessment of burnout. Work Stress. 2005;19(3):192207.
  28. Schaufeli WB, Dierendonck D. Handleiding van de Utrechtse Burnout Schaal (UBOS). Lisse, the Netherlands: Swets Test Services; 2000.
  29. Goodfellow RL. Alberta Physician Burnout [master's thesis]. Alberta, Canada: The University of Lethbridge; 2003.
  30. Schaarschmidt U, Fischer AW. Arbeitsbezogenes Verhaltensund Erlebensmuster AVEM. Frankfurt, Germany: Swets Test Services; 2003.
  31. Lundgren‐Nilsson A, Jonsdottir IH, Pallant J, Ahlborg G. Internal construct validity of the Shirom‐Melamed Burnout Questionnaire (SMBQ). BMC Public Health. 2012;12:1.
  32. Rohland BM, Kruse GR, Rohrer JE. Validation of a single‐item measure of burnout against the Maslach Burnout Inventory among physicians. Stress Health. 2004;20(2):7579.
  33. Hoff TH, Whitcomb WF, Williams K, Nelson JR, Cheesman RA. Characteristics and work experiences of hospitalists in the United States. Arch Intern Med. 2001;161(6):851858.
  34. Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non‐randomised studies of health care interventions. J Epidemiol Community Health. 1998;52(6):377384.
  35. Reeves BC, Deeks JJ, Higgins JPT, Wells GA. Including nonrandomized studies. In: Higgins JPT, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.0.1. The Cochrane Collaboration; 2008. Available at: www.cochrane‐handbook. org. Accessed July 24, 2013.
  36. Kahn HA, Sempos CT. Statistical Methods in Epidemiology. New York, NY: Oxford University Press; 1989.
  37. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta‐analysis. Stat Med. 2002;21(11):15391558.
  38. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta‐analyses. BMJ. 2003;327(7414):557560.
  39. Furukawa TA, Guyatt GH, Griffith LE. Can we individualize the “number needed to treat”? An empirical study of summary effect measures in meta‐analyses. Int J Epidemiol. 2002;31(1):7276.
  40. Allen IE, Olkin I. Applications of estimating treatment effects in metaanalyses with missing data. Technical Report No. 2000‐25, 2000. Available at: http://statistics.stanford.edu/_ckirby/techreports/GEN/2000/2000‐25.pdf. Accessed July 22, 2013.
  41. Sterne JA, Gavaghan D, Egger M. Publication and related bias in meta‐analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol. 2000;53(11):11191129.
  42. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50(4):10881101.
  43. Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta‐analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009; 339:b2700.
  44. Sobreques J, Cebria J, Segura J, Rodriguez C, Garcia M, Juncosa S. Job satisfaction and burnout in general practitioners [in Spanish]. Aten Primaria. 2003;31(4):227233.
  45. Curiel‐Garcia JA, Rodriguez‐Moran M, Guerrero‐Romero F. Burnout syndrome among health staff [in Spanish]. Rev Med Inst Mex Seguro Soc. 2006;44(3):221226.
  46. Einav S, Shalev AY, Ofek H, Freedman S, Matot I, Weiniger CF. Differences in psychological effects in hospital doctors with and without post‐traumatic stress disorder. Br J Psychiatry. 2008;193(2):165166.
  47. Miedema B, Easley J, Fortin P, Hamilton R, Tatemichi S. Crossing boundaries: family physicians' struggles to protect their private lives. Can Fam Physician. 2009;55(3):286287.e5.
  48. Estryn‐Behar M, Doppia MA, Guetarni K, Fry C, Machet G, Pelloux P, et al. Emergency physicians accumulate more stress factors than other physicians: results from the French SESMAT study. Emerg Med J. 2011 May;28(5):397410. Epub 2010 Dec 1.
  49. Lee FJ, Stewart M, Brown JB. Stress, burnout, and strategies for reducing them: what's the situation among Canadian family physicians? Can Fam Physician. 2008;54(2):234235.
  50. Hinami K, Whelan CT, Wolosin RJ, Miller JA, Wetterneck TB. Worklife and satisfaction of hospitalists: toward flourishing careers. J Gen Intern Med. 2012;27(1):2836.
  51. Linzer M, Manwell LB, Williams ES, Bobula JA, Brown RL, Varkey AB, et al; MEMO (Minimizing Error, Maximizing Outcome) Investigators. Working conditions in primary care: physician reactions and care quality. Ann Intern Med. 2009 Jul 7;151(1):2836.
  52. Ramirez AJ, Graham J, Richards MA, Cull A, Gregory WM. Mental health of hospital consultants: the effects of stress and satisfaction at work. Lancet. 1996 Mar 16;347(9003):7248.
  53. Mukherjee S, Beresford B, Glaser A, Sloper P. Burnout, psychiatric morbidity, and work‐related sources of stress in paediatric oncology staff: a review of the literature. Psycho‐Oncology. 2009 Oct;18(10):101928.
  54. Aasland OG, Olff M, Falkum E, Schweder T, Ursin H. Health complaints and job stress in Norwegian physicians: the use of an overlapping questionnaire design. Soc Sci Med. 1997;45(11):16151629.
  55. Lasalvia A, Bonetto C, Bertani M, et al. Influence of perceived organisational factors on job burnout: survey of community mental health staff. Br J Psychiatry. 2009;195(6):537544.
  56. Sosa Oberlin EN. Frecuencia de los sintomas del syndrome de burnout en profesionales medicos. Rev Med Rosario. 2007;73:1220.
  57. Voltmer E, Kieschke U, Spahn C. Work‐related behaviour and experience patterns of physicians compared to other professions. Swiss Med Wkly. 2007;137(31‐32):448453.
  58. Grassi L, Magnani K. Psychiatric morbidity and burnout in the medical profession: an Italian study of general practitioners and hospital physicians. Psychother Psychosom. 2000;69(6):329334.
  59. McManus IC, Gordon D, Winder BC. Duties of a doctor: UK doctors and good medical practice. Qual Health Care. 2000;9(1):1422.
  60. Yaman H, Soler JK. The job related burnout questionnaire: a multinational pilot study. Aust Fam Physician. 2002;31(11):10551056.
  61. Cathébras P, Begon A, Laporte S, Bois C, Truchot D. Burn out among French general practitioners [in French]. Presse Med. 2004;33(22): 15691574.
  62. Kushnir T, Levhar C, Cohen AH. Are burnout levels increasing? The experience of Israeli primary care physicians. Isr Med Assoc J. 2004; 6(8):451455.
  63. Goehring C, Bouvier Gallacchi M, Kunzi B, Bovier P. Psychosocial and professional characteristics of burnout in Swiss primary care practitioners: a cross‐sectional survey. Swiss Med Wkly. 2005;135(7‐8):101108.
  64. Esteva M, Larraz C, Jimenez F. Mental health in family doctors: effects of satisfaction and stress at work [in Spanish]. Rev Clin Esp. 2006;206(2):7783.
  65. Gandini BJ, Paulini SS, Marcos IJ, Jorge S, Luis F. The professional wearing down or syndrome of welfare labor stress (“burnout”) among health professionals in the city of Cordoba [in Spanish]. Rev Fac Cien Med Univ Nac Cordoba. 2006;63(1):1825.
  66. Ozyurt A, Hayran O, Sur H. Predictors of burnout and job satisfaction among Turkish physicians. QJM. 2006;99(3):161169.
  67. Deighton RM, Gurris N, Traue H. Factors affecting burnout and compassion fatigue in psychotherapists treating torture survivors: is the therapist's attitude to working through trauma relevant? J Trauma Stress. 2007;20(1):6375.
  68. Dunwoodie DA, Auret K. Psychological morbidity and burnout in palliative care doctors in Western Australia. Intern Med J. 2007;37(10): 693698.
  69. Sørgaard KW, Ryan P, Hill R, Dawson I; OSCAR Group. Sources of stress and burnout in acute psychiatric care: inpatient vs. community staff. Soc Psychiatry Psychiatr Epidemiol. 2007;42(10):794802.
  70. Ádám S, Gyorffy Z, Susanszky E. Physician burnout in Hungary: a potential role for work‐family conflict. J Health Psychol. 2008;13:847856.
  71. Iorio B, Cillo N, Cucciniello E, Bellizzi V. Burn‐out in the dialysis unit. J Nephrol. 2008;21(suppl 13):S158S162.
  72. Truchot D. Career orientation and burnout in French general practitioners. Psychol Rep. 2008;103(3):875881.
  73. Twellaar M, Winants Y, Houkes I. How healthy are Dutch general practitioners? Self‐reported (mental) health among Dutch general practitioners. Eur J Gen Pract. 2008;14(1):49.
  74. Vela‐Bueno A, Moreno‐Jimenez B, Rodriguez‐Munoz A, et al. Insomnia and sleep quality among primary care physicians with low and high burnout levels. J Psychosom Res. 2008;64(4):435442.
  75. Bernhardt BA, Rushton CH, Carrese J, Pyeritz RE, Kolodner K, Geller G. Distress and burnout among genetic service providers. Genet Med. 2009;11(7):527535.
  76. Bressi C, Porcellana M, Gambini O, et al. Burnout among psychiatrists in Milan: a multicenter survey. Psychiatr Serv. 2009;60(7):985988.
  77. Krasner MS, Epstein RM, Beckman H, et al. Association of an educational program in mindful communication with burnout, empathy, and attitudes among primary care physicians. JAMA. 2009;302(12): 12841293.
  78. Lesic AR, Stefanovic NP, Perunicic I, Milenkovic P, Tosevski DL, Bumbasirevic MZ. Burnout in Belgrade orthopaedic surgeons and general practitioners, a preliminary report. Acta Chir Iugosl. 2009; 56(2):5359.
  79. Peisah C, Latif E, Wilhelm K, Williams B. Secrets to psychological success: why older doctors might have lower psychological distress and burnout than younger doctors. Aging Ment Health. 2009;13(2):300307.
  80. Shanafelt TD, West CP, Sloan JA, et al. Career fit and burnout among academic faculty. Arch Intern Med. 2009;169(10):990995.
  81. Zantinge EM, Verhaak PF, Bakker DH, Meer K, Bensing JM. Does burnout among doctors affect their involvement in patients' mental health problems? A study of videotaped consultations. BMC Fam Pract. 2009;10:60.
  82. Demirci S, Yildirim YK, Ozsaran Z, Uslu R, Yalman D, Aras AB. Evaluation of burnout syndrome in oncology employees. Med Oncol. 2010;27(3):968974.
  83. Voltmer E, Schwappach DL, Frank E, Wirsching M, Spahn C. Workrelated behavior and experience patterns and predictors of mental health in German physicians in medical practice. Fam Med. 2010; 42(6):433439.
  84. Lucas B, Trick W, Evans A, et al. Emotional exhaustion, life stress, and perceived control among medicine ward attending physicians: a randomized trial of 2‐ versus 4‐week ward rotations [abstract]. J Hosp Med. 2011; 6(4 suppl 2):S43S44.
  85. Maccacaro G, Tommaso F, Ferrai P, Bonatti D, Bombana S, Merseburger A. The effort of being male: a survey on gender and burnout [in Italian]. Med Lav. 2011;102(3):286296.
  86. Putnik K, Houkes I. Word related characteristics, work‐home and home‐work interference and burnout among primary healthcare physicians: a gender perspective in a Serbian context. BMC Public Health. 2011;11:716.
  87. Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work‐life balance among US physicians relative to the general US population. Arch Intern Med. 2012;172(18):13771385.
  88. Varga ED, Urdaniz AP, Canti GF. Burnout syndrome in general hospital doctors. Eur J Psychiat. 1996;10:207213.
  89. Bargellini A, Barbieri A, Rovesti S, Vivoli R, Roncaglia R, Borella P. Relation between immune variables and burnout in a sample of physicians. Occup Environ Med. 2000;57(7):453457.
  90. Trichard A, Danel T, Sobaszek A. Epuisement professionnel et consummation de psychotropes chez les medecins hospitaliers. Alcoologie et Addictologie. 2005;27(4):303308.
  91. Fuss I, Nubling M, Hasselhorn HM, Schwappach D, Rieger MA. Working conditions and Work‐Family Conflict in German hospital physicians: psychosocial and organisational predictors and consequences. BMC Public Health. 2008;8:353.
  92. Marner S. The Role of Empathy and Witnessed Aggression in Stress Reactions Among Staff Working in a Psychiatric Hospital [dissertation]. New Brunswick, NJ: Rutgers University; 2008.
  93. Shehabi Y, Dobb G, Jenkins I, Pascoe R, Edwards N, Butt W. Burnout syndrome among Australian intensivists: a survey. Crit Care Resusc. 2008;10(4):312315.
  94. Brown R, Dunn S, Byrnes K, Morris R, Heinrich P, Shaw J. Doctors' stress responses and poor communication performance in simulated bad‐news consultations. Acad Med. 2009;84(11):15951602.
  95. Tunc T, Kutanis RO. Role conflict, role ambiguity, and burnout in nurses and physicians at a university hospital in Turkey. Nurs Health Sci. 2009;11(4):410416.
  96. Cocco E. How much is geriatric caregivers burnout caring‐specific? Questions from a questionnaire survey. Clin Pract Epidemiol Ment Health. 2010;6:6671.
  97. Doppia MA, Estryn‐Behar M, Fry C, Guetarni K, Lieutaud T; comite de pilotage de l'enquete SESMAT. Burnout in French doctors: a comparative study among anaesthesiologists and other specialists in French hospitals (SESMAT study) [in French]. Ann Fr Anesth Reanim. 2011;30(11):782794.
  98. Glasheen JJ, Misky GJ, Reid MB, Harrison RA, Sharpe B, Auerbach A. Career satisfaction and burnout in academic hospital medicine. Arch Intern Med. 2011;171(8):782785.
  99. Thorsen VC, Tharp AL, Meguid T. High rates of burnout among maternal health staff at a referral hospital in Malawi: a cross‐sectional study. BMC Nurs. 2011;10:9.
  100. Quenot JP, Rigaud JP, Prin S, et al. Suffering among careers working in critical care can be reduced by an intensive communication strategy on end‐of‐life practices. Intensive Care Med. 2012;38:5561.
  101. Ruitenburg MM, Frings‐Dresen MH, Sluiter JK. The prevalence of common mental disorders among hospital physicians and their association with self‐reported work ability: a cross‐sectional study. BMC Health Serv Res. 2012;12:292298.
  102. Seibt R, Hubler A, Steputat A, Scheuch K. Effort‐reward‐ratio and burnout risk among female teachers and hospital‐employed female physicians: a comparison between professions [in German]. Arbeitsmed Sozialmed Umweltmed. 2012;47:396406.
References
  1. Siegal EM. Just because you can, doesn't mean that you should: a call for the rational application of hospitalist comanagement. J Hosp Med. 2008;3(5):398402.
  2. Fitzgerald FT. Hospitalists. Hospitalist. 1998;1(4):56.
  3. Dorevitch S, Forst L. The occupational hazards of emergency physicians. Am J Emerg Med. 2000;18(3):300311.
  4. Fields AI, Cuerdon TT, Brasseux CO, et al. Physician burnout in pediatric critical care medicine. Crit Care Med. 1995;23(8):14251429.
  5. Schroeder SA, Schapiro R. The hospitalist: new boon for internal medicine or retreat from primary care? Ann Intern Med. 1999;130(4 pt 2): 382387.
  6. Maillard MF, Iwatsubo Y, Grimon G, et al. Enquete sur les horaires et la charge de travail des medecins dans un establissement de l'Assitance Publique‐Hopitaux de Paris. Arch Mal Prof. 1996;57:438444.
  7. Bohle A, Baumgartel M, Gotz ML, Muller EH, Jocham D. Burn‐out of urologists in the county of Schleswig‐Holstein, Germany: a comparison of hospital and private practice urologists. J Urol. 2001;165(4): 11581161.
  8. Wetterneck TB, Linzer M, Halls JJ, et al. Satisfaction and worklife of academic hospitalist and non‐hospitalist attendings on general medical inpatient rotations. J Gen Internal Med. 2006;21(S4):128.
  9. Saint S, Zemencuk JK, Hayward RA, Golin CE, Konrad TR, Linzer M; SGIM Career Satisfaction Group. What effect does increasing inpatient time have on outpatient‐oriented internist satisfaction? J Gen Intern Med. 2003;18(9):725729.
  10. Lemkau J, Rafferty J, Gordon R. Burnout and career‐choice regret among family practice physicians in early practice. Fam Pract Res J. 1994;14(3):213222.
  11. Graham J, Ramirez AJ, Cull A, Finlay I, Hoy A, Richards MA. Job stress and satisfaction among palliative physicians. Palliat Med. 1996; 10(3):185194.
  12. Schweitzer B. Stress and burnout in junior doctors. S Afr Med J. 1994; 84(6):352354.
  13. Lim RC, Pinto C. Work stress, satisfaction and burnout in New Zealand radiologists: comparison of public hospital and private practice in New Zealand. J Med Imaging Radiat Oncol. 2009;53(2):194199.
  14. Lewiston NJ, Conley J, Blessing‐Moore J. Measurement of hypothetical burnout in cystic fibrosis caregivers. Acta Paediatr Scand. 1981; 70(6):935939.
  15. Keinan G, Melamed S. Personality characteristics and proneness to burnout: a study among internists. Stress Med. 1987;3(4):307315.
  16. Hoff T, Whitcomb WF, Nelson JR. Thriving and surviving in a new medical career: the case of hospitalist physicians. J Health Soc Behav. 2002;43(1):7291.
  17. Arigoni F, Bovier PA, Mermillod B, Waltz P, Sappino AP. Prevalence of burnout among Swiss cancer clinicians, paediatricians and general practitioners: who are most at risk? Support Care Cancer. 2009;17(1): 7581.
  18. Arora V, Fang MC, Kripalani S, Amin AN. Preparing for “diastole”: advanced training opportunities for academic hospitalists. J Hosp Med. 2006;1(6):368377.
  19. Prosser D, Johnson S, Kuipers E, Szmukler G, Bebbington P, Thornicroft G. Mental health, “burnout” and job satisfaction among hospital and community‐based mental health staff. Br J Psychiatry. 1996;169(3):334337.
  20. McPhillips HA, Stanton B, Zuckerman B, Stapleton FB. Role of a pediatric department chair: factors leading to satisfaction and burnout. J Pediatr. 2007;151(4):425430.
  21. Freudenberger HJ. Staff burn‐out. J Soc Iss. 1974;30(1):159165.
  22. Maslach C. Burned‐out. Hum Behav. 1976;5(9):1622.
  23. Keyes LE. Underpaid women, stressed out men, satisfied emergency physicians. Ann Emerg Med. 2008;51(6):729731.
  24. Scheurer D, McKean S, Miller J, Wetterneck T. U.S. physician satisfaction: a systematic review. J Hosp Med. 2009;4(9):560568.
  25. Johnson JT, Wagner RL, Rueger RM, Goepfert H. Professional burnout among head and neck surgeons: results of a survey. Head Neck. 1993;15(6):557560.
  26. Maslach C, Jackson SE. The measurement of experienced burnout. J Occup Behav. 1981;2(2):99113.
  27. Kristensen TS, Borritz M, Villadsen E, Christensen KB. The Copenhagen Burnout Inventory: a new tool for the assessment of burnout. Work Stress. 2005;19(3):192207.
  28. Schaufeli WB, Dierendonck D. Handleiding van de Utrechtse Burnout Schaal (UBOS). Lisse, the Netherlands: Swets Test Services; 2000.
  29. Goodfellow RL. Alberta Physician Burnout [master's thesis]. Alberta, Canada: The University of Lethbridge; 2003.
  30. Schaarschmidt U, Fischer AW. Arbeitsbezogenes Verhaltensund Erlebensmuster AVEM. Frankfurt, Germany: Swets Test Services; 2003.
  31. Lundgren‐Nilsson A, Jonsdottir IH, Pallant J, Ahlborg G. Internal construct validity of the Shirom‐Melamed Burnout Questionnaire (SMBQ). BMC Public Health. 2012;12:1.
  32. Rohland BM, Kruse GR, Rohrer JE. Validation of a single‐item measure of burnout against the Maslach Burnout Inventory among physicians. Stress Health. 2004;20(2):7579.
  33. Hoff TH, Whitcomb WF, Williams K, Nelson JR, Cheesman RA. Characteristics and work experiences of hospitalists in the United States. Arch Intern Med. 2001;161(6):851858.
  34. Downs SH, Black N. The feasibility of creating a checklist for the assessment of the methodological quality both of randomised and non‐randomised studies of health care interventions. J Epidemiol Community Health. 1998;52(6):377384.
  35. Reeves BC, Deeks JJ, Higgins JPT, Wells GA. Including nonrandomized studies. In: Higgins JPT, Green S, eds. Cochrane Handbook for Systematic Reviews of Interventions. Version 5.0.1. The Cochrane Collaboration; 2008. Available at: www.cochrane‐handbook. org. Accessed July 24, 2013.
  36. Kahn HA, Sempos CT. Statistical Methods in Epidemiology. New York, NY: Oxford University Press; 1989.
  37. Higgins JP, Thompson SG. Quantifying heterogeneity in a meta‐analysis. Stat Med. 2002;21(11):15391558.
  38. Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta‐analyses. BMJ. 2003;327(7414):557560.
  39. Furukawa TA, Guyatt GH, Griffith LE. Can we individualize the “number needed to treat”? An empirical study of summary effect measures in meta‐analyses. Int J Epidemiol. 2002;31(1):7276.
  40. Allen IE, Olkin I. Applications of estimating treatment effects in metaanalyses with missing data. Technical Report No. 2000‐25, 2000. Available at: http://statistics.stanford.edu/_ckirby/techreports/GEN/2000/2000‐25.pdf. Accessed July 22, 2013.
  41. Sterne JA, Gavaghan D, Egger M. Publication and related bias in meta‐analysis: power of statistical tests and prevalence in the literature. J Clin Epidemiol. 2000;53(11):11191129.
  42. Begg CB, Mazumdar M. Operating characteristics of a rank correlation test for publication bias. Biometrics. 1994;50(4):10881101.
  43. Liberati A, Altman DG, Tetzlaff J, et al. The PRISMA statement for reporting systematic reviews and meta‐analyses of studies that evaluate healthcare interventions: explanation and elaboration. BMJ. 2009; 339:b2700.
  44. Sobreques J, Cebria J, Segura J, Rodriguez C, Garcia M, Juncosa S. Job satisfaction and burnout in general practitioners [in Spanish]. Aten Primaria. 2003;31(4):227233.
  45. Curiel‐Garcia JA, Rodriguez‐Moran M, Guerrero‐Romero F. Burnout syndrome among health staff [in Spanish]. Rev Med Inst Mex Seguro Soc. 2006;44(3):221226.
  46. Einav S, Shalev AY, Ofek H, Freedman S, Matot I, Weiniger CF. Differences in psychological effects in hospital doctors with and without post‐traumatic stress disorder. Br J Psychiatry. 2008;193(2):165166.
  47. Miedema B, Easley J, Fortin P, Hamilton R, Tatemichi S. Crossing boundaries: family physicians' struggles to protect their private lives. Can Fam Physician. 2009;55(3):286287.e5.
  48. Estryn‐Behar M, Doppia MA, Guetarni K, Fry C, Machet G, Pelloux P, et al. Emergency physicians accumulate more stress factors than other physicians: results from the French SESMAT study. Emerg Med J. 2011 May;28(5):397410. Epub 2010 Dec 1.
  49. Lee FJ, Stewart M, Brown JB. Stress, burnout, and strategies for reducing them: what's the situation among Canadian family physicians? Can Fam Physician. 2008;54(2):234235.
  50. Hinami K, Whelan CT, Wolosin RJ, Miller JA, Wetterneck TB. Worklife and satisfaction of hospitalists: toward flourishing careers. J Gen Intern Med. 2012;27(1):2836.
  51. Linzer M, Manwell LB, Williams ES, Bobula JA, Brown RL, Varkey AB, et al; MEMO (Minimizing Error, Maximizing Outcome) Investigators. Working conditions in primary care: physician reactions and care quality. Ann Intern Med. 2009 Jul 7;151(1):2836.
  52. Ramirez AJ, Graham J, Richards MA, Cull A, Gregory WM. Mental health of hospital consultants: the effects of stress and satisfaction at work. Lancet. 1996 Mar 16;347(9003):7248.
  53. Mukherjee S, Beresford B, Glaser A, Sloper P. Burnout, psychiatric morbidity, and work‐related sources of stress in paediatric oncology staff: a review of the literature. Psycho‐Oncology. 2009 Oct;18(10):101928.
  54. Aasland OG, Olff M, Falkum E, Schweder T, Ursin H. Health complaints and job stress in Norwegian physicians: the use of an overlapping questionnaire design. Soc Sci Med. 1997;45(11):16151629.
  55. Lasalvia A, Bonetto C, Bertani M, et al. Influence of perceived organisational factors on job burnout: survey of community mental health staff. Br J Psychiatry. 2009;195(6):537544.
  56. Sosa Oberlin EN. Frecuencia de los sintomas del syndrome de burnout en profesionales medicos. Rev Med Rosario. 2007;73:1220.
  57. Voltmer E, Kieschke U, Spahn C. Work‐related behaviour and experience patterns of physicians compared to other professions. Swiss Med Wkly. 2007;137(31‐32):448453.
  58. Grassi L, Magnani K. Psychiatric morbidity and burnout in the medical profession: an Italian study of general practitioners and hospital physicians. Psychother Psychosom. 2000;69(6):329334.
  59. McManus IC, Gordon D, Winder BC. Duties of a doctor: UK doctors and good medical practice. Qual Health Care. 2000;9(1):1422.
  60. Yaman H, Soler JK. The job related burnout questionnaire: a multinational pilot study. Aust Fam Physician. 2002;31(11):10551056.
  61. Cathébras P, Begon A, Laporte S, Bois C, Truchot D. Burn out among French general practitioners [in French]. Presse Med. 2004;33(22): 15691574.
  62. Kushnir T, Levhar C, Cohen AH. Are burnout levels increasing? The experience of Israeli primary care physicians. Isr Med Assoc J. 2004; 6(8):451455.
  63. Goehring C, Bouvier Gallacchi M, Kunzi B, Bovier P. Psychosocial and professional characteristics of burnout in Swiss primary care practitioners: a cross‐sectional survey. Swiss Med Wkly. 2005;135(7‐8):101108.
  64. Esteva M, Larraz C, Jimenez F. Mental health in family doctors: effects of satisfaction and stress at work [in Spanish]. Rev Clin Esp. 2006;206(2):7783.
  65. Gandini BJ, Paulini SS, Marcos IJ, Jorge S, Luis F. The professional wearing down or syndrome of welfare labor stress (“burnout”) among health professionals in the city of Cordoba [in Spanish]. Rev Fac Cien Med Univ Nac Cordoba. 2006;63(1):1825.
  66. Ozyurt A, Hayran O, Sur H. Predictors of burnout and job satisfaction among Turkish physicians. QJM. 2006;99(3):161169.
  67. Deighton RM, Gurris N, Traue H. Factors affecting burnout and compassion fatigue in psychotherapists treating torture survivors: is the therapist's attitude to working through trauma relevant? J Trauma Stress. 2007;20(1):6375.
  68. Dunwoodie DA, Auret K. Psychological morbidity and burnout in palliative care doctors in Western Australia. Intern Med J. 2007;37(10): 693698.
  69. Sørgaard KW, Ryan P, Hill R, Dawson I; OSCAR Group. Sources of stress and burnout in acute psychiatric care: inpatient vs. community staff. Soc Psychiatry Psychiatr Epidemiol. 2007;42(10):794802.
  70. Ádám S, Gyorffy Z, Susanszky E. Physician burnout in Hungary: a potential role for work‐family conflict. J Health Psychol. 2008;13:847856.
  71. Iorio B, Cillo N, Cucciniello E, Bellizzi V. Burn‐out in the dialysis unit. J Nephrol. 2008;21(suppl 13):S158S162.
  72. Truchot D. Career orientation and burnout in French general practitioners. Psychol Rep. 2008;103(3):875881.
  73. Twellaar M, Winants Y, Houkes I. How healthy are Dutch general practitioners? Self‐reported (mental) health among Dutch general practitioners. Eur J Gen Pract. 2008;14(1):49.
  74. Vela‐Bueno A, Moreno‐Jimenez B, Rodriguez‐Munoz A, et al. Insomnia and sleep quality among primary care physicians with low and high burnout levels. J Psychosom Res. 2008;64(4):435442.
  75. Bernhardt BA, Rushton CH, Carrese J, Pyeritz RE, Kolodner K, Geller G. Distress and burnout among genetic service providers. Genet Med. 2009;11(7):527535.
  76. Bressi C, Porcellana M, Gambini O, et al. Burnout among psychiatrists in Milan: a multicenter survey. Psychiatr Serv. 2009;60(7):985988.
  77. Krasner MS, Epstein RM, Beckman H, et al. Association of an educational program in mindful communication with burnout, empathy, and attitudes among primary care physicians. JAMA. 2009;302(12): 12841293.
  78. Lesic AR, Stefanovic NP, Perunicic I, Milenkovic P, Tosevski DL, Bumbasirevic MZ. Burnout in Belgrade orthopaedic surgeons and general practitioners, a preliminary report. Acta Chir Iugosl. 2009; 56(2):5359.
  79. Peisah C, Latif E, Wilhelm K, Williams B. Secrets to psychological success: why older doctors might have lower psychological distress and burnout than younger doctors. Aging Ment Health. 2009;13(2):300307.
  80. Shanafelt TD, West CP, Sloan JA, et al. Career fit and burnout among academic faculty. Arch Intern Med. 2009;169(10):990995.
  81. Zantinge EM, Verhaak PF, Bakker DH, Meer K, Bensing JM. Does burnout among doctors affect their involvement in patients' mental health problems? A study of videotaped consultations. BMC Fam Pract. 2009;10:60.
  82. Demirci S, Yildirim YK, Ozsaran Z, Uslu R, Yalman D, Aras AB. Evaluation of burnout syndrome in oncology employees. Med Oncol. 2010;27(3):968974.
  83. Voltmer E, Schwappach DL, Frank E, Wirsching M, Spahn C. Workrelated behavior and experience patterns and predictors of mental health in German physicians in medical practice. Fam Med. 2010; 42(6):433439.
  84. Lucas B, Trick W, Evans A, et al. Emotional exhaustion, life stress, and perceived control among medicine ward attending physicians: a randomized trial of 2‐ versus 4‐week ward rotations [abstract]. J Hosp Med. 2011; 6(4 suppl 2):S43S44.
  85. Maccacaro G, Tommaso F, Ferrai P, Bonatti D, Bombana S, Merseburger A. The effort of being male: a survey on gender and burnout [in Italian]. Med Lav. 2011;102(3):286296.
  86. Putnik K, Houkes I. Word related characteristics, work‐home and home‐work interference and burnout among primary healthcare physicians: a gender perspective in a Serbian context. BMC Public Health. 2011;11:716.
  87. Shanafelt TD, Boone S, Tan L, et al. Burnout and satisfaction with work‐life balance among US physicians relative to the general US population. Arch Intern Med. 2012;172(18):13771385.
  88. Varga ED, Urdaniz AP, Canti GF. Burnout syndrome in general hospital doctors. Eur J Psychiat. 1996;10:207213.
  89. Bargellini A, Barbieri A, Rovesti S, Vivoli R, Roncaglia R, Borella P. Relation between immune variables and burnout in a sample of physicians. Occup Environ Med. 2000;57(7):453457.
  90. Trichard A, Danel T, Sobaszek A. Epuisement professionnel et consummation de psychotropes chez les medecins hospitaliers. Alcoologie et Addictologie. 2005;27(4):303308.
  91. Fuss I, Nubling M, Hasselhorn HM, Schwappach D, Rieger MA. Working conditions and Work‐Family Conflict in German hospital physicians: psychosocial and organisational predictors and consequences. BMC Public Health. 2008;8:353.
  92. Marner S. The Role of Empathy and Witnessed Aggression in Stress Reactions Among Staff Working in a Psychiatric Hospital [dissertation]. New Brunswick, NJ: Rutgers University; 2008.
  93. Shehabi Y, Dobb G, Jenkins I, Pascoe R, Edwards N, Butt W. Burnout syndrome among Australian intensivists: a survey. Crit Care Resusc. 2008;10(4):312315.
  94. Brown R, Dunn S, Byrnes K, Morris R, Heinrich P, Shaw J. Doctors' stress responses and poor communication performance in simulated bad‐news consultations. Acad Med. 2009;84(11):15951602.
  95. Tunc T, Kutanis RO. Role conflict, role ambiguity, and burnout in nurses and physicians at a university hospital in Turkey. Nurs Health Sci. 2009;11(4):410416.
  96. Cocco E. How much is geriatric caregivers burnout caring‐specific? Questions from a questionnaire survey. Clin Pract Epidemiol Ment Health. 2010;6:6671.
  97. Doppia MA, Estryn‐Behar M, Fry C, Guetarni K, Lieutaud T; comite de pilotage de l'enquete SESMAT. Burnout in French doctors: a comparative study among anaesthesiologists and other specialists in French hospitals (SESMAT study) [in French]. Ann Fr Anesth Reanim. 2011;30(11):782794.
  98. Glasheen JJ, Misky GJ, Reid MB, Harrison RA, Sharpe B, Auerbach A. Career satisfaction and burnout in academic hospital medicine. Arch Intern Med. 2011;171(8):782785.
  99. Thorsen VC, Tharp AL, Meguid T. High rates of burnout among maternal health staff at a referral hospital in Malawi: a cross‐sectional study. BMC Nurs. 2011;10:9.
  100. Quenot JP, Rigaud JP, Prin S, et al. Suffering among careers working in critical care can be reduced by an intensive communication strategy on end‐of‐life practices. Intensive Care Med. 2012;38:5561.
  101. Ruitenburg MM, Frings‐Dresen MH, Sluiter JK. The prevalence of common mental disorders among hospital physicians and their association with self‐reported work ability: a cross‐sectional study. BMC Health Serv Res. 2012;12:292298.
  102. Seibt R, Hubler A, Steputat A, Scheuch K. Effort‐reward‐ratio and burnout risk among female teachers and hospital‐employed female physicians: a comparison between professions [in German]. Arbeitsmed Sozialmed Umweltmed. 2012;47:396406.
Issue
Journal of Hospital Medicine - 8(11)
Issue
Journal of Hospital Medicine - 8(11)
Page Number
653-664
Page Number
653-664
Publications
Publications
Article Type
Display Headline
Burnout in inpatient‐based versus outpatient‐based physicians: A systematic review and meta‐analysis
Display Headline
Burnout in inpatient‐based versus outpatient‐based physicians: A systematic review and meta‐analysis
Sections
Article Source
© 2013 Society of Hospital Medicine
Disallow All Ads
Correspondence Location
Address for correspondence and reprint requests: Daniel L. Roberts, MD, Division of Hospital Internal Medicine, Mayo Clinic Hospital, 5777 E. Mayo Blvd, Phoenix, AZ 85054; Telephone: (480) 342‐1387; FAX: (480) 342‐1388; E‐mail: [email protected]
Content Gating
Gated (full article locked unless allowed per User)
Gating Strategy
First Peek Free
Article PDF Media
Media Files