User login
Mortality and Readmission Correlations
The Centers for Medicare & Medicaid Services (CMS) publicly reports hospital‐specific, 30‐day risk‐standardized mortality and readmission rates for Medicare fee‐for‐service patients admitted with acute myocardial infarction (AMI), heart failure (HF), and pneumonia.1 These measures are intended to reflect hospital performance on quality of care provided to patients during and after hospitalization.2, 3
Quality‐of‐care measures for a given disease are often assumed to reflect the quality of care for that particular condition. However, studies have found limited association between condition‐specific process measures and either mortality or readmission rates for those conditions.46 Mortality and readmission rates may instead reflect broader hospital‐wide or specialty‐wide structure, culture, and practice. For example, studies have previously found that hospitals differ in mortality or readmission rates according to organizational structure,7 financial structure,8 culture,9, 10 information technology,11 patient volume,1214 academic status,12 and other institution‐wide factors.12 There is now a strong policy push towards developing hospital‐wide (all‐condition) measures, beginning with readmission.15
It is not clear how much of the quality of care for a given condition is attributable to hospital‐wide influences that affect all conditions rather than disease‐specific factors. If readmission or mortality performance for a particular condition reflects, in large part, broader institutional characteristics, then improvement efforts might better be focused on hospital‐wide activities, such as team training or implementing electronic medical records. On the other hand, if the disease‐specific measures reflect quality strictly for those conditions, then improvement efforts would be better focused on disease‐specific care, such as early identification of the relevant patient population or standardizing disease‐specific care. As hospitals work to improve performance across an increasingly wide variety of conditions, it is becoming more important for hospitals to prioritize and focus their activities effectively and efficiently.
One means of determining the relative contribution of hospital versus disease factors is to explore whether outcome rates are consistent among different conditions cared for in the same hospital. If mortality (or readmission) rates across different conditions are highly correlated, it would suggest that hospital‐wide factors may play a substantive role in outcomes. Some studies have found that mortality for a particular surgical condition is a useful proxy for mortality for other surgical conditions,16, 17 while other studies have found little correlation among mortality rates for various medical conditions.18, 19 It is also possible that correlation varies according to hospital characteristics; for example, smaller or nonteaching hospitals might be more homogenous in their care than larger, less homogeneous institutions. No studies have been performed using publicly reported estimates of risk‐standardized mortality or readmission rates. In this study we use the publicly reported measures of 30‐day mortality and 30‐day readmission for AMI, HF, and pneumonia to examine whether, and to what degree, mortality rates track together within US hospitals, and separately, to what degree readmission rates track together within US hospitals.
METHODS
Data Sources
CMS calculates risk‐standardized mortality and readmission rates, and patient volume, for all acute care nonfederal hospitals with one or more eligible case of AMI, HF, and pneumonia annually based on fee‐for‐service (FFS) Medicare claims. CMS publicly releases the rates for the large subset of hospitals that participate in public reporting and have 25 or more cases for the conditions over the 3‐year period between July 2006 and June 2009. We estimated the rates for all hospitals included in the measure calculations, including those with fewer than 25 cases, using the CMS methodology and data obtained from CMS. The distribution of these rates has been previously reported.20, 21 In addition, we used the 2008 American Hospital Association (AHA) Survey to obtain data about hospital characteristics, including number of beds, hospital ownership (government, not‐for‐profit, for‐profit), teaching status (member of Council of Teaching Hospitals, other teaching hospital, nonteaching), presence of specialized cardiac capabilities (coronary artery bypass graft surgery, cardiac catheterization lab without cardiac surgery, neither), US Census Bureau core‐based statistical area (division [subarea of area with urban center >2.5 million people], metropolitan [urban center of at least 50,000 people], micropolitan [urban center of between 10,000 and 50,000 people], and rural [<10,000 people]), and safety net status22 (yes/no). Safety net status was defined as either public hospitals or private hospitals with a Medicaid caseload greater than one standard deviation above their respective state's mean private hospital Medicaid caseload using the 2007 AHA Annual Survey data.
Study Sample
This study includes 2 hospital cohorts, 1 for mortality and 1 for readmission. Hospitals were eligible for the mortality cohort if the dataset included risk‐standardized mortality rates for all 3 conditions (AMI, HF, and pneumonia). Hospitals were eligible for the readmission cohort if the dataset included risk‐standardized readmission rates for all 3 of these conditions.
Risk‐Standardized Measures
The measures include all FFS Medicare patients who are 65 years old, have been enrolled in FFS Medicare for the 12 months before the index hospitalization, are admitted with 1 of the 3 qualifying diagnoses, and do not leave the hospital against medical advice. The mortality measures include all deaths within 30 days of admission, and all deaths are attributable to the initial admitting hospital, even if the patient is then transferred to another acute care facility. Therefore, for a given hospital, transfers into the hospital are excluded from its rate, but transfers out are included. The readmission measures include all readmissions within 30 days of discharge, and all readmissions are attributable to the final discharging hospital, even if the patient was originally admitted to a different acute care facility. Therefore, for a given hospital, transfers in are included in its rate, but transfers out are excluded. For mortality measures, only 1 hospitalization for a patient in a specific year is randomly selected if the patient has multiple hospitalizations in the year. For readmission measures, admissions in which the patient died prior to discharge, and admissions within 30 days of an index admission, are not counted as index admissions.
Outcomes for all measures are all‐cause; however, for the AMI readmission measure, planned admissions for cardiac procedures are not counted as readmissions. Patients in observation status or in non‐acute care facilities are not counted as readmissions. Detailed specifications for the outcomes measures are available at the National Quality Measures Clearinghouse.23
The derivation and validation of the risk‐standardized outcome measures have been previously reported.20, 21, 2327 The measures are derived from hierarchical logistic regression models that include age, sex, clinical covariates, and a hospital‐specific random effect. The rates are calculated as the ratio of the number of predicted outcomes (obtained from a model applying the hospital‐specific effect) to the number of expected outcomes (obtained from a model applying the average effect among hospitals), multiplied by the unadjusted overall 30‐day rate.
Statistical Analysis
We examined patterns and distributions of hospital volume, risk‐standardized mortality rates, and risk‐standardized readmission rates among included hospitals. To measure the degree of association among hospitals' risk‐standardized mortality rates for AMI, HF, and pneumonia, we calculated Pearson correlation coefficients, resulting in 3 correlations for the 3 pairs of conditions (AMI and HF, AMI and pneumonia, HF and pneumonia), and tested whether they were significantly different from 0. We also conducted a factor analysis using the principal component method with a minimum eigenvalue of 1 to retain factors to determine whether there was a single common factor underlying mortality performance for the 3 conditions.28 Finally, we divided hospitals into quartiles of performance for each outcome based on the point estimate of risk‐standardized rate, and compared quartile of performance between condition pairs for each outcome. For each condition pair, we assessed the percent of hospitals in the same quartile of performance in both conditions, the percent of hospitals in either the top quartile of performance or the bottom quartile of performance for both, and the percent of hospitals in the top quartile for one and the bottom quartile for the other. We calculated the weighted kappa for agreement on quartile of performance between condition pairs for each outcome and the Spearman correlation for quartiles of performance. Then, we examined Pearson correlation coefficients in different subgroups of hospitals, including by size, ownership, teaching status, cardiac procedure capability, statistical area, and safety net status. In order to determine whether these correlations differed by hospital characteristics, we tested if the Pearson correlation coefficients were different between any 2 subgroups using the method proposed by Fisher.29 We repeated all of these analyses separately for the risk‐standardized readmission rates.
To determine whether correlations between mortality rates were significantly different than correlations between readmission rates for any given condition pair, we used the method recommended by Raghunathan et al.30 For these analyses, we included only hospitals reporting both mortality and readmission rates for the condition pairs. We used the same methods to determine whether correlations between mortality rates were significantly different than correlations between readmission rates for any given condition pair among subgroups of hospital characteristics.
All analyses and graphing were performed using the SAS statistical package version 9.2 (SAS Institute, Cary, NC). We considered a P‐value < 0.05 to be statistically significant, and all statistical tests were 2‐tailed.
RESULTS
The mortality cohort included 4559 hospitals, and the readmission cohort included 4468 hospitals. The majority of hospitals was small, nonteaching, and did not have advanced cardiac capabilities such as cardiac surgery or cardiac catheterization (Table 1).
Description | Mortality Measures | Readmission Measures |
---|---|---|
Hospital N = 4559 | Hospital N = 4468 | |
N (%)* | N (%)* | |
| ||
No. of beds | ||
>600 | 157 (3.4) | 156 (3.5) |
300600 | 628 (13.8) | 626 (14.0) |
<300 | 3588 (78.7) | 3505 (78.5) |
Unknown | 186 (4.08) | 181 (4.1) |
Mean (SD) | 173.24 (189.52) | 175.23 (190.00) |
Ownership | ||
Not‐for‐profit | 2650 (58.1) | 2619 (58.6) |
For‐profit | 672 (14.7) | 663 (14.8) |
Government | 1051 (23.1) | 1005 (22.5) |
Unknown | 186 (4.1) | 181 (4.1) |
Teaching status | ||
COTH | 277 (6.1) | 276 (6.2) |
Teaching | 505 (11.1) | 503 (11.3) |
Nonteaching | 3591 (78.8) | 3508 (78.5) |
Unknown | 186 (4.1) | 181 (4.1) |
Cardiac facility type | ||
CABG | 1471 (32.3) | 1467 (32.8) |
Cath lab | 578 (12.7) | 578 (12.9) |
Neither | 2324 (51.0) | 2242 (50.2) |
Unknown | 186 (4.1) | 181 (4.1) |
Core‐based statistical area | ||
Division | 621 (13.6) | 618 (13.8) |
Metro | 1850 (40.6) | 1835 (41.1) |
Micro | 801 (17.6) | 788 (17.6) |
Rural | 1101 (24.2) | 1046 (23.4) |
Unknown | 186 (4.1) | 181 (4.1) |
Safety net status | ||
No | 2995 (65.7) | 2967 (66.4) |
Yes | 1377 (30.2) | 1319 (29.5) |
Unknown | 187 (4.1) | 182 (4.1) |
For mortality measures, the smallest median number of cases per hospital was for AMI (48; interquartile range [IQR], 13,171), and the greatest number was for pneumonia (178; IQR, 87, 336). The same pattern held for readmission measures (AMI median 33; IQR; 9, 150; pneumonia median 191; IQR, 95, 352.5). With respect to mortality measures, AMI had the highest rate and HF the lowest rate; however, for readmission measures, HF had the highest rate and pneumonia the lowest rate (Table 2).
Description | Mortality Measures (N = 4559) | Readmission Measures (N = 4468) | ||||
---|---|---|---|---|---|---|
AMI | HF | PN | AMI | HF | PN | |
| ||||||
Total discharges | 558,653 | 1,094,960 | 1,114,706 | 546,514 | 1,314,394 | 1,152,708 |
Hospital volume | ||||||
Mean (SD) | 122.54 (172.52) | 240.18 (271.35) | 244.51 (220.74) | 122.32 (201.78) | 294.18 (333.2) | 257.99 (228.5) |
Median (IQR) | 48 (13, 171) | 142 (56, 337) | 178 (87, 336) | 33 (9, 150) | 172.5 (68, 407) | 191 (95, 352.5) |
Range min, max | 1, 1379 | 1, 2814 | 1, 2241 | 1, 1611 | 1, 3410 | 2, 2359 |
30‐Day risk‐standardized rate* | ||||||
Mean (SD) | 15.7 (1.8) | 10.9 (1.6) | 11.5 (1.9) | 19.9 (1.5) | 24.8 (2.1) | 18.5 (1.7) |
Median (IQR) | 15.7 (14.5, 16.8) | 10.8 (9.9, 11.9) | 11.3 (10.2, 12.6) | 19.9 (18.9, 20.8) | 24.7 (23.4, 26.1) | 18.4 (17.3, 19.5) |
Range min, max | 10.3, 24.6 | 6.6, 18.2 | 6.7, 20.9 | 15.2, 26.3 | 17.3, 32.4 | 13.6, 26.7 |
Every mortality measure was significantly correlated with every other mortality measure (range of correlation coefficients, 0.270.41, P < 0.0001 for all 3 correlations). For example, the correlation between risk‐standardized mortality rates (RSMR) for HF and pneumonia was 0.41. Similarly, every readmission measure was significantly correlated with every other readmission measure (range of correlation coefficients, 0.320.47; P < 0.0001 for all 3 correlations). Overall, the lowest correlation was between risk‐standardized mortality rates for AMI and pneumonia (r = 0.27), and the highest correlation was between risk‐standardized readmission rates (RSRR) for HF and pneumonia (r = 0.47) (Table 3).
Description | Mortality Measures | Readmission Measures | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
N | AMI and HF | AMI and PN | HF and PN | AMI and HF | AMI and PN | HF and PN | ||||||||
r | P | r | P | r | P | N | r | P | r | P | r | P | ||
| ||||||||||||||
All | 4559 | 0.30 | 0.27 | 0.41 | 4468 | 0.38 | 0.32 | 0.47 | ||||||
Hospitals with 25 patients | 2872 | 0.33 | 0.30 | 0.44 | 2467 | 0.44 | 0.38 | 0.51 | ||||||
No. of beds | 0.15 | 0.005 | 0.0009 | <0.0001 | <0.0001 | <0.0001 | ||||||||
>600 | 157 | 0.38 | 0.43 | 0.51 | 156 | 0.67 | 0.50 | 0.66 | ||||||
300600 | 628 | 0.29 | 0.30 | 0.49 | 626 | 0.54 | 0.45 | 0.58 | ||||||
<300 | 3588 | 0.27 | 0.23 | 0.37 | 3505 | 0.30 | 0.26 | 0.44 | ||||||
Ownership | 0.021 | 0.05 | 0.39 | 0.0004 | 0.0004 | 0.003 | ||||||||
Not‐for‐profit | 2650 | 0.32 | 0.28 | 0.42 | 2619 | 0.43 | 0.36 | 0.50 | ||||||
For‐profit | 672 | 0.30 | 0.23 | 0.40 | 663 | 0.29 | 0.22 | 0.40 | ||||||
Government | 1051 | 0.24 | 0.22 | 0.39 | 1005 | 0.32 | 0.29 | 0.45 | ||||||
Teaching status | 0.11 | 0.08 | 0.0012 | <0.0001 | 0.0002 | 0.0003 | ||||||||
COTH | 277 | 0.31 | 0.34 | 0.54 | 276 | 0.54 | 0.47 | 0.59 | ||||||
Teaching | 505 | 0.22 | 0.28 | 0.43 | 503 | 0.52 | 0.42 | 0.56 | ||||||
Nonteaching | 3591 | 0.29 | 0.24 | 0.39 | 3508 | 0.32 | 0.26 | 0.44 | ||||||
Cardiac facility type | 0.022 | 0.006 | <0.0001 | <0.0001 | 0.0006 | 0.004 | ||||||||
CABG | 1471 | 0.33 | 0.29 | 0.47 | 1467 | 0.48 | 0.37 | 0.52 | ||||||
Cath lab | 578 | 0.25 | 0.26 | 0.36 | 578 | 0.32 | 0.37 | 0.47 | ||||||
Neither | 2324 | 0.26 | 0.21 | 0.36 | 2242 | 0.28 | 0.27 | 0.44 | ||||||
Core‐based statistical area | 0.0001 | <0.0001 | 0.002 | <0.0001 | <0.0001 | <0.0001 | ||||||||
Division | 621 | 0.38 | 0.34 | 0.41 | 618 | 0.46 | 0.40 | 0.56 | ||||||
Metro | 1850 | 0.26 | 0.26 | 0.42 | 1835 | 0.38 | 0.30 | 0.40 | ||||||
Micro | 801 | 0.23 | 0.22 | 0.34 | 788 | 0.32 | 0.30 | 0.47 | ||||||
Rural | 1101 | 0.21 | 0.13 | 0.32 | 1046 | 0.22 | 0.21 | 0.44 | ||||||
Safety net status | 0.001 | 0.027 | 0.68 | 0.029 | 0.037 | 0.28 | ||||||||
No | 2995 | 0.33 | 0.28 | 0.41 | 2967 | 0.40 | 0.33 | 0.48 | ||||||
Yes | 1377 | 0.23 | 0.21 | 0.40 | 1319 | 0.34 | 0.30 | 0.45 |
Both the factor analysis for the mortality measures and the factor analysis for the readmission measures yielded only one factor with an eigenvalue >1. In each factor analysis, this single common factor kept more than half of the data based on the cumulative eigenvalue (55% for mortality measures and 60% for readmission measures). For the mortality measures, the pattern of RSMR for myocardial infarction (MI), heart failure (HF), and pneumonia (PN) in the factor was high (0.68 for MI, 0.78 for HF, and 0.76 for PN); the same was true of the RSRR in the readmission measures (0.72 for MI, 0.81 for HF, and 0.78 for PN).
For all condition pairs and both outcomes, a third or more of hospitals were in the same quartile of performance for both conditions of the pair (Table 4). Hospitals were more likely to be in the same quartile of performance if they were in the top or bottom quartile than if they were in the middle. Less than 10% of hospitals were in the top quartile for one condition in the mortality or readmission pair and in the bottom quartile for the other condition in the pair. Kappa scores for same quartile of performance between pairs of outcomes ranged from 0.16 to 0.27, and were highest for HF and pneumonia for both mortality and readmission rates.
Condition Pair | Same Quartile (Any) (%) | Same Quartile (Q1 or Q4) (%) | Q1 in One and Q4 in Another (%) | Weighted Kappa | Spearman Correlation |
---|---|---|---|---|---|
| |||||
Mortality | |||||
MI and HF | 34.8 | 20.2 | 7.9 | 0.19 | 0.25 |
MI and PN | 32.7 | 18.8 | 8.2 | 0.16 | 0.22 |
HF and PN | 35.9 | 21.8 | 5.0 | 0.26 | 0.36 |
Readmission | |||||
MI and HF | 36.6 | 21.0 | 7.5 | 0.22 | 0.28 |
MI and PN | 34.0 | 19.6 | 8.1 | 0.19 | 0.24 |
HF and PN | 37.1 | 22.6 | 5.4 | 0.27 | 0.37 |
In subgroup analyses, the highest mortality correlation was between HF and pneumonia in hospitals with more than 600 beds (r = 0.51, P = 0.0009), and the highest readmission correlation was between AMI and HF in hospitals with more than 600 beds (r = 0.67, P < 0.0001). Across both measures and all 3 condition pairs, correlations between conditions increased with increasing hospital bed size, presence of cardiac surgery capability, and increasing population of the hospital's Census Bureau statistical area. Furthermore, for most measures and condition pairs, correlations between conditions were highest in not‐for‐profit hospitals, hospitals belonging to the Council of Teaching Hospitals, and non‐safety net hospitals (Table 3).
For all condition pairs, the correlation between readmission rates was significantly higher than the correlation between mortality rates (P < 0.01). In subgroup analyses, readmission correlations were also significantly higher than mortality correlations for all pairs of conditions among moderate‐sized hospitals, among nonprofit hospitals, among teaching hospitals that did not belong to the Council of Teaching Hospitals, and among non‐safety net hospitals (Table 5).
Description | AMI and HF | AMI and PN | HF and PN | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
N | MC | RC | P | N | MC | RC | P | N | MC | RC | P | |
| ||||||||||||
All | 4457 | 0.31 | 0.38 | <0.0001 | 4459 | 0.27 | 0.32 | 0.007 | 4731 | 0.41 | 0.46 | 0.0004 |
Hospitals with 25 patients | 2472 | 0.33 | 0.44 | <0.001 | 2463 | 0.31 | 0.38 | 0.01 | 4104 | 0.42 | 0.47 | 0.001 |
No. of beds | ||||||||||||
>600 | 156 | 0.38 | 0.67 | 0.0002 | 156 | 0.43 | 0.50 | 0.48 | 160 | 0.51 | 0.66 | 0.042 |
300600 | 626 | 0.29 | 0.54 | <0.0001 | 626 | 0.31 | 0.45 | 0.003 | 630 | 0.49 | 0.58 | 0.033 |
<300 | 3494 | 0.28 | 0.30 | 0.21 | 3496 | 0.23 | 0.26 | 0.17 | 3733 | 0.37 | 0.43 | 0.003 |
Ownership | ||||||||||||
Not‐for‐profit | 2614 | 0.32 | 0.43 | <0.0001 | 2617 | 0.28 | 0.36 | 0.003 | 2697 | 0.42 | 0.50 | 0.0003 |
For‐profit | 662 | 0.30 | 0.29 | 0.90 | 661 | 0.23 | 0.22 | 0.75 | 699 | 0.40 | 0.40 | 0.99 |
Government | 1000 | 0.25 | 0.32 | 0.09 | 1000 | 0.22 | 0.29 | 0.09 | 1127 | 0.39 | 0.43 | 0.21 |
Teaching status | ||||||||||||
COTH | 276 | 0.31 | 0.54 | 0.001 | 277 | 0.35 | 0.46 | 0.10 | 278 | 0.54 | 0.59 | 0.41 |
Teaching | 504 | 0.22 | 0.52 | <0.0001 | 504 | 0.28 | 0.42 | 0.012 | 508 | 0.43 | 0.56 | 0.005 |
Nonteaching | 3496 | 0.29 | 0.32 | 0.18 | 3497 | 0.24 | 0.26 | 0.46 | 3737 | 0.39 | 0.43 | 0.016 |
Cardiac facility type | ||||||||||||
CABG | 1465 | 0.33 | 0.48 | <0.0001 | 1467 | 0.30 | 0.37 | 0.018 | 1483 | 0.47 | 0.51 | 0.103 |
Cath lab | 577 | 0.25 | 0.32 | 0.18 | 577 | 0.26 | 0.37 | 0.046 | 579 | 0.36 | 0.47 | 0.022 |
Neither | 2234 | 0.26 | 0.28 | 0.48 | 2234 | 0.21 | 0.27 | 0.037 | 2461 | 0.36 | 0.44 | 0.002 |
Core‐based statistical area | ||||||||||||
Division | 618 | 0.38 | 0.46 | 0.09 | 620 | 0.34 | 0.40 | 0.18 | 630 | 0.41 | 0.56 | 0.001 |
Metro | 1833 | 0.26 | 0.38 | <0.0001 | 1832 | 0.26 | 0.30 | 0.21 | 1896 | 0.42 | 0.40 | 0.63 |
Micro | 787 | 0.24 | 0.32 | 0.08 | 787 | 0.22 | 0.30 | 0.11 | 820 | 0.34 | 0.46 | 0.003 |
Rural | 1038 | 0.21 | 0.22 | 0.83 | 1039 | 0.13 | 0.21 | 0.056 | 1177 | 0.32 | 0.43 | 0.002 |
Safety net status | ||||||||||||
No | 2961 | 0.33 | 0.40 | 0.001 | 2963 | 0.28 | 0.33 | 0.036 | 3062 | 0.41 | 0.48 | 0.001 |
Yes | 1314 | 0.23 | 0.34 | 0.003 | 1314 | 0.22 | 0.30 | 0.015 | 1460 | 0.40 | 0.45 | 0.14 |
DISCUSSION
In this study, we found that risk‐standardized mortality rates for 3 common medical conditions were moderately correlated within institutions, as were risk‐standardized readmission rates. Readmission rates were more strongly correlated than mortality rates, and all rates tracked closest together in large, urban, and/or teaching hospitals. Very few hospitals were in the top quartile of performance for one condition and in the bottom quartile for a different condition.
Our findings are consistent with the hypothesis that 30‐day risk‐standardized mortality and 30‐day risk‐standardized readmission rates, in part, capture broad aspects of hospital quality that transcend condition‐specific activities. In this study, readmission rates tracked better together than mortality rates for every pair of conditions, suggesting that there may be a greater contribution of hospital‐wide environment, structure, and processes to readmission rates than to mortality rates. This difference is plausible because services specific to readmission, such as discharge planning, care coordination, medication reconciliation, and discharge communication with patients and outpatient clinicians, are typically hospital‐wide processes.
Our study differs from earlier studies of medical conditions in that the correlations we found were higher.18, 19 There are several possible explanations for this difference. First, during the intervening 1525 years since those studies were performed, care for these conditions has evolved substantially, such that there are now more standardized protocols available for all 3 of these diseases. Hospitals that are sufficiently organized or acculturated to systematically implement care protocols may have the infrastructure or culture to do so for all conditions, increasing correlation of performance among conditions. In addition, there are now more technologies and systems available that span care for multiple conditions, such as electronic medical records and quality committees, than were available in previous generations. Second, one of these studies utilized less robust risk‐adjustment,18 and neither used the same methodology of risk standardization. Nonetheless, it is interesting to note that Rosenthal and colleagues identified the same increase in correlation with higher volumes than we did.19 Studies investigating mortality correlations among surgical procedures, on the other hand, have generally found higher correlations than we found in these medical conditions.16, 17
Accountable care organizations will be assessed using an all‐condition readmission measure,31 several states track all‐condition readmission rates,3234 and several countries measure all‐condition mortality.35 An all‐condition measure for quality assessment first requires that there be a hospital‐wide quality signal above and beyond disease‐specific care. This study suggests that a moderate signal exists for readmission and, to a slightly lesser extent, for mortality, across 3 common conditions. There are other considerations, however, in developing all‐condition measures. There must be adequate risk adjustment for the wide variety of conditions that are included, and there must be a means of accounting for the variation in types of conditions and procedures cared for by different hospitals. Our study does not address these challenges, which have been described to be substantial for mortality measures.35
We were surprised by the finding that risk‐standardized rates correlated more strongly within larger institutions than smaller ones, because one might assume that care within smaller hospitals might be more homogenous. It may be easier, however, to detect a quality signal in hospitals with higher volumes of patients for all 3 conditions, because estimates for these hospitals are more precise. Consequently, we have greater confidence in results for larger volumes, and suspect a similar quality signal may be present but more difficult to detect statistically in smaller hospitals. Overall correlations were higher when we restricted the sample to hospitals with at least 25 cases, as is used for public reporting. It is also possible that the finding is real given that large‐volume hospitals have been demonstrated to provide better care for these conditions and are more likely to adopt systems of care that affect multiple conditions, such as electronic medical records.14, 36
The kappa scores comparing quartile of national performance for pairs of conditions were only in the fair range. There are several possible explanations for this fact: 1) outcomes for these 3 conditions are not measuring the same constructs; 2) they are all measuring the same construct, but they are unreliable in doing so; and/or 3) hospitals have similar latent quality for all 3 conditions, but the national quality of performance differs by condition, yielding variable relative performance per hospital for each condition. Based solely on our findings, we cannot distinguish which, if any, of these explanations may be true.31
Our study has several limitations. First, all 3 conditions currently publicly reported by CMS are medical diagnoses, although AMI patients may be cared for in distinct cardiology units and often undergo procedures; therefore, we cannot determine the degree to which correlations reflect hospital‐wide quality versus medicine‐wide quality. An institution may have a weak medicine department but a strong surgical department or vice versa. Second, it is possible that the correlations among conditions for readmission and among conditions for mortality are attributable to patient characteristics that are not adequately adjusted for in the risk‐adjustment model, such as socioeconomic factors, or to hospital characteristics not related to quality, such as coding practices or inter‐hospital transfer rates. For this to be true, these unmeasured characteristics would have to be consistent across different conditions within each hospital and have a consistent influence on outcomes. Third, it is possible that public reporting may have prompted disease‐specific focus on these conditions. We do not have data from non‐publicly reported conditions to test this hypothesis. Fourth, there are many small‐volume hospitals in this study; their estimates for readmission and mortality are less reliable than for large‐volume hospitals, potentially limiting our ability to detect correlations in this group of hospitals.
This study lends credence to the hypothesis that 30‐day risk‐standardized mortality and readmission rates for individual conditions may reflect aspects of hospital‐wide quality or at least medicine‐wide quality, although the correlations are not large enough to conclude that hospital‐wide factors play a dominant role, and there are other possible explanations for the correlations. Further work is warranted to better understand the causes of the correlations, and to better specify the nature of hospital factors that contribute to correlations among outcomes.
Acknowledgements
Disclosures: Dr Horwitz is supported by the National Institute on Aging (K08 AG038336) and by the American Federation of Aging Research through the Paul B. Beeson Career Development Award Program. Dr Horwitz is also a Pepper Scholar with support from the Claude D. Pepper Older Americans Independence Center at Yale University School of Medicine (P30 AG021342 NIH/NIA). Dr Krumholz is supported by grant U01 HL105270‐01 (Center for Cardiovascular Outcomes Research at Yale University) from the National Heart, Lung, and Blood Institute. Dr Krumholz chairs a cardiac scientific advisory board for UnitedHealth. Authors Drye, Krumholz, and Wang receive support from the Centers for Medicare & Medicaid Services (CMS) to develop and maintain performance measures that are used for public reporting. The analyses upon which this publication is based were performed under Contract Number HHSM‐500‐2008‐0025I Task Order T0001, entitled Measure & Instrument Development and Support (MIDS)Development and Re‐evaluation of the CMS Hospital Outcomes and Efficiency Measures, funded by the Centers for Medicare & Medicaid Services, an agency of the US Department of Health and Human Services. The Centers for Medicare & Medicaid Services reviewed and approved the use of its data for this work, and approved submission of the manuscript. The content of this publication does not necessarily reflect the views or policies of the Department of Health and Human Services, nor does mention of trade names, commercial products, or organizations imply endorsement by the US Government. The authors assume full responsibility for the accuracy and completeness of the ideas presented.
- US Department of Health and Human Services. Hospital Compare.2011. Available at: http://www.hospitalcompare.hhs.gov. Accessed March 5, 2011.
- Early readmissions to the department of medicine as a screening tool for monitoring quality of care problems.Medicine (Baltimore).2008;87(5):294–300. , , .
- Hospital inpatient mortality. Is it a predictor of quality?N Engl J Med.1987;317(26):1674–1680. , , , , .
- Relationship between Medicare's hospital compare performance measures and mortality rates.JAMA.2006;296(22):2694–2702. , .
- Public reporting of discharge planning and rates of readmissions.N Engl J Med.2009;361(27):2637–2645. , , .
- Process of care performance measures and long‐term outcomes in patients hospitalized with heart failure.Med Care.2010;48(3):210–216. , , , et al.
- Variations in inpatient mortality among hospitals in different system types, 1995 to 2000.Med Care.2009;47(4):466–473. , , , , , .
- A systematic review and meta‐analysis of studies comparing mortality rates of private for‐profit and private not‐for‐profit hospitals.Can Med Assoc J.2002;166(11):1399–1406. , , , et al.
- What distinguishes top‐performing hospitals in acute myocardial infarction mortality rates? A qualitative study.Ann Intern Med.2011;154(6):384–390. , , , et al.
- Perceptions of hospital safety climate and incidence of readmission.Health Serv Res.2011;46(2):596–616. , , .
- Decrease in hospital‐wide mortality rate after implementation of a commercially sold computerized physician order entry system.Pediatrics.2010;126(1):14–21. , , , et al.
- The condition of the literature on differences in hospital mortality.Med Care.1989;27(4):315–336. , , .
- Threshold volumes associated with higher survival in health care: a systematic review.Med Care.2003;41(10):1129–1141. , , .
- Hospital volume and 30‐day mortality for three common medical conditions.N Engl J Med.2010;362(12):1110–1118. , , , et al.
- Patient Protection and Affordable Care Act Pub. L. No. 111–148, 124 Stat, §3025.2010. Available at: http://www.gpo.gov/fdsys/pkg/PLAW‐111publ148/content‐detail.html. Accessed on July 26, year="2012"2012.
- Are mortality rates for different operations related? Implications for measuring the quality of noncardiac surgery.Med Care.2006;44(8):774–778. , , .
- Do hospitals with low mortality rates in coronary artery bypass also perform well in valve replacement?Ann Thorac Surg.2003;76(4):1131–1137. , , , .
- Differences among hospitals in Medicare patient mortality.Health Serv Res.1989;24(1):1–31. , , , , .
- Variations in standardized hospital mortality rates for six common medical diagnoses: implications for profiling hospital quality.Med Care.1998;36(7):955–964. , , , .
- Development, validation, and results of a measure of 30‐day readmission following hospitalization for pneumonia.J Hosp Med.2011;6(3):142–150. , , , et al.
- An administrative claims measure suitable for profiling hospital performance on the basis of 30‐day all‐cause readmission rates among patients with heart failure.Circ Cardiovasc Qual Outcomes.2008;1:29–37. , , , et al.
- Quality of care for acute myocardial infarction at urban safety‐net hospitals.Health Aff (Millwood).2007;26(1):238–248. , , , et al.
- National Quality Measures Clearinghouse.2011. Available at: http://www.qualitymeasures.ahrq.gov/. Accessed February 21,year="2011"2011.
- An administrative claims model suitable for profiling hospital performance based on 30‐day mortality rates among patients with an acute myocardial infarction.Circulation.2006;113(13):1683–1692. , , , et al.
- An administrative claims model suitable for profiling hospital performance based on 30‐day mortality rates among patients with heart failure.Circulation.2006;113(13):1693–1701. , , , et al.
- An administrative claims model for profiling hospital 30‐day mortality rates for pneumonia patients.PLoS One.2011;6(4):e17401. , , , et al.
- An administrative claims measure suitable for profiling hospital performance based on 30‐day all‐cause readmission rates among patients with acute myocardial infarction.Circ Cardiovasc Qual Outcomes.2011;4(2):243–252. , , , et al.
- The application of electronic computers to factor analysis.Educ Psychol Meas.1960;20:141–151. .
- On the ‘probable error’ of a coefficient of correlation deduced from a small sample.Metron.1921;1:3–32. .
- Comparing correlated but nonoverlapping correlations.Psychol Methods.1996;1(2):178–183. , , .
- Centers for Medicare and Medicaid Services.Medicare Shared Savings Program: Accountable Care Organizations, Final Rule.Fed Reg.2011;76:67802–67990.
- Massachusetts Healthcare Quality and Cost Council. Potentially Preventable Readmissions.2011. Available at: http://www.mass.gov/hqcc/the‐hcqcc‐council/data‐submission‐information/potentially‐preventable‐readmissions‐ppr.html. Accessed February 29, 2012.
- Texas Medicaid. Potentially Preventable Readmission (PPR).2012. Available at: http://www.tmhp.com/Pages/Medicaid/Hospital_PPR.aspx. Accessed February 29, 2012.
- New York State. Potentially Preventable Readmissions.2011. Available at: http://www.health.ny.gov/regulations/recently_adopted/docs/2011–02‐23_potentially_preventable_readmissions.pdf. Accessed February 29, 2012.
- Variability in the measurement of hospital‐wide mortality rates.N Engl J Med.2010;363(26):2530–2539. , , , , .
- Use of electronic health records in U.S. hospitals.N Engl J Med.2009;360(16):1628–1638. , , , et al.
The Centers for Medicare & Medicaid Services (CMS) publicly reports hospital‐specific, 30‐day risk‐standardized mortality and readmission rates for Medicare fee‐for‐service patients admitted with acute myocardial infarction (AMI), heart failure (HF), and pneumonia.1 These measures are intended to reflect hospital performance on quality of care provided to patients during and after hospitalization.2, 3
Quality‐of‐care measures for a given disease are often assumed to reflect the quality of care for that particular condition. However, studies have found limited association between condition‐specific process measures and either mortality or readmission rates for those conditions.46 Mortality and readmission rates may instead reflect broader hospital‐wide or specialty‐wide structure, culture, and practice. For example, studies have previously found that hospitals differ in mortality or readmission rates according to organizational structure,7 financial structure,8 culture,9, 10 information technology,11 patient volume,1214 academic status,12 and other institution‐wide factors.12 There is now a strong policy push towards developing hospital‐wide (all‐condition) measures, beginning with readmission.15
It is not clear how much of the quality of care for a given condition is attributable to hospital‐wide influences that affect all conditions rather than disease‐specific factors. If readmission or mortality performance for a particular condition reflects, in large part, broader institutional characteristics, then improvement efforts might better be focused on hospital‐wide activities, such as team training or implementing electronic medical records. On the other hand, if the disease‐specific measures reflect quality strictly for those conditions, then improvement efforts would be better focused on disease‐specific care, such as early identification of the relevant patient population or standardizing disease‐specific care. As hospitals work to improve performance across an increasingly wide variety of conditions, it is becoming more important for hospitals to prioritize and focus their activities effectively and efficiently.
One means of determining the relative contribution of hospital versus disease factors is to explore whether outcome rates are consistent among different conditions cared for in the same hospital. If mortality (or readmission) rates across different conditions are highly correlated, it would suggest that hospital‐wide factors may play a substantive role in outcomes. Some studies have found that mortality for a particular surgical condition is a useful proxy for mortality for other surgical conditions,16, 17 while other studies have found little correlation among mortality rates for various medical conditions.18, 19 It is also possible that correlation varies according to hospital characteristics; for example, smaller or nonteaching hospitals might be more homogenous in their care than larger, less homogeneous institutions. No studies have been performed using publicly reported estimates of risk‐standardized mortality or readmission rates. In this study we use the publicly reported measures of 30‐day mortality and 30‐day readmission for AMI, HF, and pneumonia to examine whether, and to what degree, mortality rates track together within US hospitals, and separately, to what degree readmission rates track together within US hospitals.
METHODS
Data Sources
CMS calculates risk‐standardized mortality and readmission rates, and patient volume, for all acute care nonfederal hospitals with one or more eligible case of AMI, HF, and pneumonia annually based on fee‐for‐service (FFS) Medicare claims. CMS publicly releases the rates for the large subset of hospitals that participate in public reporting and have 25 or more cases for the conditions over the 3‐year period between July 2006 and June 2009. We estimated the rates for all hospitals included in the measure calculations, including those with fewer than 25 cases, using the CMS methodology and data obtained from CMS. The distribution of these rates has been previously reported.20, 21 In addition, we used the 2008 American Hospital Association (AHA) Survey to obtain data about hospital characteristics, including number of beds, hospital ownership (government, not‐for‐profit, for‐profit), teaching status (member of Council of Teaching Hospitals, other teaching hospital, nonteaching), presence of specialized cardiac capabilities (coronary artery bypass graft surgery, cardiac catheterization lab without cardiac surgery, neither), US Census Bureau core‐based statistical area (division [subarea of area with urban center >2.5 million people], metropolitan [urban center of at least 50,000 people], micropolitan [urban center of between 10,000 and 50,000 people], and rural [<10,000 people]), and safety net status22 (yes/no). Safety net status was defined as either public hospitals or private hospitals with a Medicaid caseload greater than one standard deviation above their respective state's mean private hospital Medicaid caseload using the 2007 AHA Annual Survey data.
Study Sample
This study includes 2 hospital cohorts, 1 for mortality and 1 for readmission. Hospitals were eligible for the mortality cohort if the dataset included risk‐standardized mortality rates for all 3 conditions (AMI, HF, and pneumonia). Hospitals were eligible for the readmission cohort if the dataset included risk‐standardized readmission rates for all 3 of these conditions.
Risk‐Standardized Measures
The measures include all FFS Medicare patients who are 65 years old, have been enrolled in FFS Medicare for the 12 months before the index hospitalization, are admitted with 1 of the 3 qualifying diagnoses, and do not leave the hospital against medical advice. The mortality measures include all deaths within 30 days of admission, and all deaths are attributable to the initial admitting hospital, even if the patient is then transferred to another acute care facility. Therefore, for a given hospital, transfers into the hospital are excluded from its rate, but transfers out are included. The readmission measures include all readmissions within 30 days of discharge, and all readmissions are attributable to the final discharging hospital, even if the patient was originally admitted to a different acute care facility. Therefore, for a given hospital, transfers in are included in its rate, but transfers out are excluded. For mortality measures, only 1 hospitalization for a patient in a specific year is randomly selected if the patient has multiple hospitalizations in the year. For readmission measures, admissions in which the patient died prior to discharge, and admissions within 30 days of an index admission, are not counted as index admissions.
Outcomes for all measures are all‐cause; however, for the AMI readmission measure, planned admissions for cardiac procedures are not counted as readmissions. Patients in observation status or in non‐acute care facilities are not counted as readmissions. Detailed specifications for the outcomes measures are available at the National Quality Measures Clearinghouse.23
The derivation and validation of the risk‐standardized outcome measures have been previously reported.20, 21, 2327 The measures are derived from hierarchical logistic regression models that include age, sex, clinical covariates, and a hospital‐specific random effect. The rates are calculated as the ratio of the number of predicted outcomes (obtained from a model applying the hospital‐specific effect) to the number of expected outcomes (obtained from a model applying the average effect among hospitals), multiplied by the unadjusted overall 30‐day rate.
Statistical Analysis
We examined patterns and distributions of hospital volume, risk‐standardized mortality rates, and risk‐standardized readmission rates among included hospitals. To measure the degree of association among hospitals' risk‐standardized mortality rates for AMI, HF, and pneumonia, we calculated Pearson correlation coefficients, resulting in 3 correlations for the 3 pairs of conditions (AMI and HF, AMI and pneumonia, HF and pneumonia), and tested whether they were significantly different from 0. We also conducted a factor analysis using the principal component method with a minimum eigenvalue of 1 to retain factors to determine whether there was a single common factor underlying mortality performance for the 3 conditions.28 Finally, we divided hospitals into quartiles of performance for each outcome based on the point estimate of risk‐standardized rate, and compared quartile of performance between condition pairs for each outcome. For each condition pair, we assessed the percent of hospitals in the same quartile of performance in both conditions, the percent of hospitals in either the top quartile of performance or the bottom quartile of performance for both, and the percent of hospitals in the top quartile for one and the bottom quartile for the other. We calculated the weighted kappa for agreement on quartile of performance between condition pairs for each outcome and the Spearman correlation for quartiles of performance. Then, we examined Pearson correlation coefficients in different subgroups of hospitals, including by size, ownership, teaching status, cardiac procedure capability, statistical area, and safety net status. In order to determine whether these correlations differed by hospital characteristics, we tested if the Pearson correlation coefficients were different between any 2 subgroups using the method proposed by Fisher.29 We repeated all of these analyses separately for the risk‐standardized readmission rates.
To determine whether correlations between mortality rates were significantly different than correlations between readmission rates for any given condition pair, we used the method recommended by Raghunathan et al.30 For these analyses, we included only hospitals reporting both mortality and readmission rates for the condition pairs. We used the same methods to determine whether correlations between mortality rates were significantly different than correlations between readmission rates for any given condition pair among subgroups of hospital characteristics.
All analyses and graphing were performed using the SAS statistical package version 9.2 (SAS Institute, Cary, NC). We considered a P‐value < 0.05 to be statistically significant, and all statistical tests were 2‐tailed.
RESULTS
The mortality cohort included 4559 hospitals, and the readmission cohort included 4468 hospitals. The majority of hospitals was small, nonteaching, and did not have advanced cardiac capabilities such as cardiac surgery or cardiac catheterization (Table 1).
Description | Mortality Measures | Readmission Measures |
---|---|---|
Hospital N = 4559 | Hospital N = 4468 | |
N (%)* | N (%)* | |
| ||
No. of beds | ||
>600 | 157 (3.4) | 156 (3.5) |
300600 | 628 (13.8) | 626 (14.0) |
<300 | 3588 (78.7) | 3505 (78.5) |
Unknown | 186 (4.08) | 181 (4.1) |
Mean (SD) | 173.24 (189.52) | 175.23 (190.00) |
Ownership | ||
Not‐for‐profit | 2650 (58.1) | 2619 (58.6) |
For‐profit | 672 (14.7) | 663 (14.8) |
Government | 1051 (23.1) | 1005 (22.5) |
Unknown | 186 (4.1) | 181 (4.1) |
Teaching status | ||
COTH | 277 (6.1) | 276 (6.2) |
Teaching | 505 (11.1) | 503 (11.3) |
Nonteaching | 3591 (78.8) | 3508 (78.5) |
Unknown | 186 (4.1) | 181 (4.1) |
Cardiac facility type | ||
CABG | 1471 (32.3) | 1467 (32.8) |
Cath lab | 578 (12.7) | 578 (12.9) |
Neither | 2324 (51.0) | 2242 (50.2) |
Unknown | 186 (4.1) | 181 (4.1) |
Core‐based statistical area | ||
Division | 621 (13.6) | 618 (13.8) |
Metro | 1850 (40.6) | 1835 (41.1) |
Micro | 801 (17.6) | 788 (17.6) |
Rural | 1101 (24.2) | 1046 (23.4) |
Unknown | 186 (4.1) | 181 (4.1) |
Safety net status | ||
No | 2995 (65.7) | 2967 (66.4) |
Yes | 1377 (30.2) | 1319 (29.5) |
Unknown | 187 (4.1) | 182 (4.1) |
For mortality measures, the smallest median number of cases per hospital was for AMI (48; interquartile range [IQR], 13,171), and the greatest number was for pneumonia (178; IQR, 87, 336). The same pattern held for readmission measures (AMI median 33; IQR; 9, 150; pneumonia median 191; IQR, 95, 352.5). With respect to mortality measures, AMI had the highest rate and HF the lowest rate; however, for readmission measures, HF had the highest rate and pneumonia the lowest rate (Table 2).
Description | Mortality Measures (N = 4559) | Readmission Measures (N = 4468) | ||||
---|---|---|---|---|---|---|
AMI | HF | PN | AMI | HF | PN | |
| ||||||
Total discharges | 558,653 | 1,094,960 | 1,114,706 | 546,514 | 1,314,394 | 1,152,708 |
Hospital volume | ||||||
Mean (SD) | 122.54 (172.52) | 240.18 (271.35) | 244.51 (220.74) | 122.32 (201.78) | 294.18 (333.2) | 257.99 (228.5) |
Median (IQR) | 48 (13, 171) | 142 (56, 337) | 178 (87, 336) | 33 (9, 150) | 172.5 (68, 407) | 191 (95, 352.5) |
Range min, max | 1, 1379 | 1, 2814 | 1, 2241 | 1, 1611 | 1, 3410 | 2, 2359 |
30‐Day risk‐standardized rate* | ||||||
Mean (SD) | 15.7 (1.8) | 10.9 (1.6) | 11.5 (1.9) | 19.9 (1.5) | 24.8 (2.1) | 18.5 (1.7) |
Median (IQR) | 15.7 (14.5, 16.8) | 10.8 (9.9, 11.9) | 11.3 (10.2, 12.6) | 19.9 (18.9, 20.8) | 24.7 (23.4, 26.1) | 18.4 (17.3, 19.5) |
Range min, max | 10.3, 24.6 | 6.6, 18.2 | 6.7, 20.9 | 15.2, 26.3 | 17.3, 32.4 | 13.6, 26.7 |
Every mortality measure was significantly correlated with every other mortality measure (range of correlation coefficients, 0.270.41, P < 0.0001 for all 3 correlations). For example, the correlation between risk‐standardized mortality rates (RSMR) for HF and pneumonia was 0.41. Similarly, every readmission measure was significantly correlated with every other readmission measure (range of correlation coefficients, 0.320.47; P < 0.0001 for all 3 correlations). Overall, the lowest correlation was between risk‐standardized mortality rates for AMI and pneumonia (r = 0.27), and the highest correlation was between risk‐standardized readmission rates (RSRR) for HF and pneumonia (r = 0.47) (Table 3).
Description | Mortality Measures | Readmission Measures | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
N | AMI and HF | AMI and PN | HF and PN | AMI and HF | AMI and PN | HF and PN | ||||||||
r | P | r | P | r | P | N | r | P | r | P | r | P | ||
| ||||||||||||||
All | 4559 | 0.30 | 0.27 | 0.41 | 4468 | 0.38 | 0.32 | 0.47 | ||||||
Hospitals with 25 patients | 2872 | 0.33 | 0.30 | 0.44 | 2467 | 0.44 | 0.38 | 0.51 | ||||||
No. of beds | 0.15 | 0.005 | 0.0009 | <0.0001 | <0.0001 | <0.0001 | ||||||||
>600 | 157 | 0.38 | 0.43 | 0.51 | 156 | 0.67 | 0.50 | 0.66 | ||||||
300600 | 628 | 0.29 | 0.30 | 0.49 | 626 | 0.54 | 0.45 | 0.58 | ||||||
<300 | 3588 | 0.27 | 0.23 | 0.37 | 3505 | 0.30 | 0.26 | 0.44 | ||||||
Ownership | 0.021 | 0.05 | 0.39 | 0.0004 | 0.0004 | 0.003 | ||||||||
Not‐for‐profit | 2650 | 0.32 | 0.28 | 0.42 | 2619 | 0.43 | 0.36 | 0.50 | ||||||
For‐profit | 672 | 0.30 | 0.23 | 0.40 | 663 | 0.29 | 0.22 | 0.40 | ||||||
Government | 1051 | 0.24 | 0.22 | 0.39 | 1005 | 0.32 | 0.29 | 0.45 | ||||||
Teaching status | 0.11 | 0.08 | 0.0012 | <0.0001 | 0.0002 | 0.0003 | ||||||||
COTH | 277 | 0.31 | 0.34 | 0.54 | 276 | 0.54 | 0.47 | 0.59 | ||||||
Teaching | 505 | 0.22 | 0.28 | 0.43 | 503 | 0.52 | 0.42 | 0.56 | ||||||
Nonteaching | 3591 | 0.29 | 0.24 | 0.39 | 3508 | 0.32 | 0.26 | 0.44 | ||||||
Cardiac facility type | 0.022 | 0.006 | <0.0001 | <0.0001 | 0.0006 | 0.004 | ||||||||
CABG | 1471 | 0.33 | 0.29 | 0.47 | 1467 | 0.48 | 0.37 | 0.52 | ||||||
Cath lab | 578 | 0.25 | 0.26 | 0.36 | 578 | 0.32 | 0.37 | 0.47 | ||||||
Neither | 2324 | 0.26 | 0.21 | 0.36 | 2242 | 0.28 | 0.27 | 0.44 | ||||||
Core‐based statistical area | 0.0001 | <0.0001 | 0.002 | <0.0001 | <0.0001 | <0.0001 | ||||||||
Division | 621 | 0.38 | 0.34 | 0.41 | 618 | 0.46 | 0.40 | 0.56 | ||||||
Metro | 1850 | 0.26 | 0.26 | 0.42 | 1835 | 0.38 | 0.30 | 0.40 | ||||||
Micro | 801 | 0.23 | 0.22 | 0.34 | 788 | 0.32 | 0.30 | 0.47 | ||||||
Rural | 1101 | 0.21 | 0.13 | 0.32 | 1046 | 0.22 | 0.21 | 0.44 | ||||||
Safety net status | 0.001 | 0.027 | 0.68 | 0.029 | 0.037 | 0.28 | ||||||||
No | 2995 | 0.33 | 0.28 | 0.41 | 2967 | 0.40 | 0.33 | 0.48 | ||||||
Yes | 1377 | 0.23 | 0.21 | 0.40 | 1319 | 0.34 | 0.30 | 0.45 |
Both the factor analysis for the mortality measures and the factor analysis for the readmission measures yielded only one factor with an eigenvalue >1. In each factor analysis, this single common factor kept more than half of the data based on the cumulative eigenvalue (55% for mortality measures and 60% for readmission measures). For the mortality measures, the pattern of RSMR for myocardial infarction (MI), heart failure (HF), and pneumonia (PN) in the factor was high (0.68 for MI, 0.78 for HF, and 0.76 for PN); the same was true of the RSRR in the readmission measures (0.72 for MI, 0.81 for HF, and 0.78 for PN).
For all condition pairs and both outcomes, a third or more of hospitals were in the same quartile of performance for both conditions of the pair (Table 4). Hospitals were more likely to be in the same quartile of performance if they were in the top or bottom quartile than if they were in the middle. Less than 10% of hospitals were in the top quartile for one condition in the mortality or readmission pair and in the bottom quartile for the other condition in the pair. Kappa scores for same quartile of performance between pairs of outcomes ranged from 0.16 to 0.27, and were highest for HF and pneumonia for both mortality and readmission rates.
Condition Pair | Same Quartile (Any) (%) | Same Quartile (Q1 or Q4) (%) | Q1 in One and Q4 in Another (%) | Weighted Kappa | Spearman Correlation |
---|---|---|---|---|---|
| |||||
Mortality | |||||
MI and HF | 34.8 | 20.2 | 7.9 | 0.19 | 0.25 |
MI and PN | 32.7 | 18.8 | 8.2 | 0.16 | 0.22 |
HF and PN | 35.9 | 21.8 | 5.0 | 0.26 | 0.36 |
Readmission | |||||
MI and HF | 36.6 | 21.0 | 7.5 | 0.22 | 0.28 |
MI and PN | 34.0 | 19.6 | 8.1 | 0.19 | 0.24 |
HF and PN | 37.1 | 22.6 | 5.4 | 0.27 | 0.37 |
In subgroup analyses, the highest mortality correlation was between HF and pneumonia in hospitals with more than 600 beds (r = 0.51, P = 0.0009), and the highest readmission correlation was between AMI and HF in hospitals with more than 600 beds (r = 0.67, P < 0.0001). Across both measures and all 3 condition pairs, correlations between conditions increased with increasing hospital bed size, presence of cardiac surgery capability, and increasing population of the hospital's Census Bureau statistical area. Furthermore, for most measures and condition pairs, correlations between conditions were highest in not‐for‐profit hospitals, hospitals belonging to the Council of Teaching Hospitals, and non‐safety net hospitals (Table 3).
For all condition pairs, the correlation between readmission rates was significantly higher than the correlation between mortality rates (P < 0.01). In subgroup analyses, readmission correlations were also significantly higher than mortality correlations for all pairs of conditions among moderate‐sized hospitals, among nonprofit hospitals, among teaching hospitals that did not belong to the Council of Teaching Hospitals, and among non‐safety net hospitals (Table 5).
Description | AMI and HF | AMI and PN | HF and PN | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
N | MC | RC | P | N | MC | RC | P | N | MC | RC | P | |
| ||||||||||||
All | 4457 | 0.31 | 0.38 | <0.0001 | 4459 | 0.27 | 0.32 | 0.007 | 4731 | 0.41 | 0.46 | 0.0004 |
Hospitals with 25 patients | 2472 | 0.33 | 0.44 | <0.001 | 2463 | 0.31 | 0.38 | 0.01 | 4104 | 0.42 | 0.47 | 0.001 |
No. of beds | ||||||||||||
>600 | 156 | 0.38 | 0.67 | 0.0002 | 156 | 0.43 | 0.50 | 0.48 | 160 | 0.51 | 0.66 | 0.042 |
300600 | 626 | 0.29 | 0.54 | <0.0001 | 626 | 0.31 | 0.45 | 0.003 | 630 | 0.49 | 0.58 | 0.033 |
<300 | 3494 | 0.28 | 0.30 | 0.21 | 3496 | 0.23 | 0.26 | 0.17 | 3733 | 0.37 | 0.43 | 0.003 |
Ownership | ||||||||||||
Not‐for‐profit | 2614 | 0.32 | 0.43 | <0.0001 | 2617 | 0.28 | 0.36 | 0.003 | 2697 | 0.42 | 0.50 | 0.0003 |
For‐profit | 662 | 0.30 | 0.29 | 0.90 | 661 | 0.23 | 0.22 | 0.75 | 699 | 0.40 | 0.40 | 0.99 |
Government | 1000 | 0.25 | 0.32 | 0.09 | 1000 | 0.22 | 0.29 | 0.09 | 1127 | 0.39 | 0.43 | 0.21 |
Teaching status | ||||||||||||
COTH | 276 | 0.31 | 0.54 | 0.001 | 277 | 0.35 | 0.46 | 0.10 | 278 | 0.54 | 0.59 | 0.41 |
Teaching | 504 | 0.22 | 0.52 | <0.0001 | 504 | 0.28 | 0.42 | 0.012 | 508 | 0.43 | 0.56 | 0.005 |
Nonteaching | 3496 | 0.29 | 0.32 | 0.18 | 3497 | 0.24 | 0.26 | 0.46 | 3737 | 0.39 | 0.43 | 0.016 |
Cardiac facility type | ||||||||||||
CABG | 1465 | 0.33 | 0.48 | <0.0001 | 1467 | 0.30 | 0.37 | 0.018 | 1483 | 0.47 | 0.51 | 0.103 |
Cath lab | 577 | 0.25 | 0.32 | 0.18 | 577 | 0.26 | 0.37 | 0.046 | 579 | 0.36 | 0.47 | 0.022 |
Neither | 2234 | 0.26 | 0.28 | 0.48 | 2234 | 0.21 | 0.27 | 0.037 | 2461 | 0.36 | 0.44 | 0.002 |
Core‐based statistical area | ||||||||||||
Division | 618 | 0.38 | 0.46 | 0.09 | 620 | 0.34 | 0.40 | 0.18 | 630 | 0.41 | 0.56 | 0.001 |
Metro | 1833 | 0.26 | 0.38 | <0.0001 | 1832 | 0.26 | 0.30 | 0.21 | 1896 | 0.42 | 0.40 | 0.63 |
Micro | 787 | 0.24 | 0.32 | 0.08 | 787 | 0.22 | 0.30 | 0.11 | 820 | 0.34 | 0.46 | 0.003 |
Rural | 1038 | 0.21 | 0.22 | 0.83 | 1039 | 0.13 | 0.21 | 0.056 | 1177 | 0.32 | 0.43 | 0.002 |
Safety net status | ||||||||||||
No | 2961 | 0.33 | 0.40 | 0.001 | 2963 | 0.28 | 0.33 | 0.036 | 3062 | 0.41 | 0.48 | 0.001 |
Yes | 1314 | 0.23 | 0.34 | 0.003 | 1314 | 0.22 | 0.30 | 0.015 | 1460 | 0.40 | 0.45 | 0.14 |
DISCUSSION
In this study, we found that risk‐standardized mortality rates for 3 common medical conditions were moderately correlated within institutions, as were risk‐standardized readmission rates. Readmission rates were more strongly correlated than mortality rates, and all rates tracked closest together in large, urban, and/or teaching hospitals. Very few hospitals were in the top quartile of performance for one condition and in the bottom quartile for a different condition.
Our findings are consistent with the hypothesis that 30‐day risk‐standardized mortality and 30‐day risk‐standardized readmission rates, in part, capture broad aspects of hospital quality that transcend condition‐specific activities. In this study, readmission rates tracked better together than mortality rates for every pair of conditions, suggesting that there may be a greater contribution of hospital‐wide environment, structure, and processes to readmission rates than to mortality rates. This difference is plausible because services specific to readmission, such as discharge planning, care coordination, medication reconciliation, and discharge communication with patients and outpatient clinicians, are typically hospital‐wide processes.
Our study differs from earlier studies of medical conditions in that the correlations we found were higher.18, 19 There are several possible explanations for this difference. First, during the intervening 1525 years since those studies were performed, care for these conditions has evolved substantially, such that there are now more standardized protocols available for all 3 of these diseases. Hospitals that are sufficiently organized or acculturated to systematically implement care protocols may have the infrastructure or culture to do so for all conditions, increasing correlation of performance among conditions. In addition, there are now more technologies and systems available that span care for multiple conditions, such as electronic medical records and quality committees, than were available in previous generations. Second, one of these studies utilized less robust risk‐adjustment,18 and neither used the same methodology of risk standardization. Nonetheless, it is interesting to note that Rosenthal and colleagues identified the same increase in correlation with higher volumes than we did.19 Studies investigating mortality correlations among surgical procedures, on the other hand, have generally found higher correlations than we found in these medical conditions.16, 17
Accountable care organizations will be assessed using an all‐condition readmission measure,31 several states track all‐condition readmission rates,3234 and several countries measure all‐condition mortality.35 An all‐condition measure for quality assessment first requires that there be a hospital‐wide quality signal above and beyond disease‐specific care. This study suggests that a moderate signal exists for readmission and, to a slightly lesser extent, for mortality, across 3 common conditions. There are other considerations, however, in developing all‐condition measures. There must be adequate risk adjustment for the wide variety of conditions that are included, and there must be a means of accounting for the variation in types of conditions and procedures cared for by different hospitals. Our study does not address these challenges, which have been described to be substantial for mortality measures.35
We were surprised by the finding that risk‐standardized rates correlated more strongly within larger institutions than smaller ones, because one might assume that care within smaller hospitals might be more homogenous. It may be easier, however, to detect a quality signal in hospitals with higher volumes of patients for all 3 conditions, because estimates for these hospitals are more precise. Consequently, we have greater confidence in results for larger volumes, and suspect a similar quality signal may be present but more difficult to detect statistically in smaller hospitals. Overall correlations were higher when we restricted the sample to hospitals with at least 25 cases, as is used for public reporting. It is also possible that the finding is real given that large‐volume hospitals have been demonstrated to provide better care for these conditions and are more likely to adopt systems of care that affect multiple conditions, such as electronic medical records.14, 36
The kappa scores comparing quartile of national performance for pairs of conditions were only in the fair range. There are several possible explanations for this fact: 1) outcomes for these 3 conditions are not measuring the same constructs; 2) they are all measuring the same construct, but they are unreliable in doing so; and/or 3) hospitals have similar latent quality for all 3 conditions, but the national quality of performance differs by condition, yielding variable relative performance per hospital for each condition. Based solely on our findings, we cannot distinguish which, if any, of these explanations may be true.31
Our study has several limitations. First, all 3 conditions currently publicly reported by CMS are medical diagnoses, although AMI patients may be cared for in distinct cardiology units and often undergo procedures; therefore, we cannot determine the degree to which correlations reflect hospital‐wide quality versus medicine‐wide quality. An institution may have a weak medicine department but a strong surgical department or vice versa. Second, it is possible that the correlations among conditions for readmission and among conditions for mortality are attributable to patient characteristics that are not adequately adjusted for in the risk‐adjustment model, such as socioeconomic factors, or to hospital characteristics not related to quality, such as coding practices or inter‐hospital transfer rates. For this to be true, these unmeasured characteristics would have to be consistent across different conditions within each hospital and have a consistent influence on outcomes. Third, it is possible that public reporting may have prompted disease‐specific focus on these conditions. We do not have data from non‐publicly reported conditions to test this hypothesis. Fourth, there are many small‐volume hospitals in this study; their estimates for readmission and mortality are less reliable than for large‐volume hospitals, potentially limiting our ability to detect correlations in this group of hospitals.
This study lends credence to the hypothesis that 30‐day risk‐standardized mortality and readmission rates for individual conditions may reflect aspects of hospital‐wide quality or at least medicine‐wide quality, although the correlations are not large enough to conclude that hospital‐wide factors play a dominant role, and there are other possible explanations for the correlations. Further work is warranted to better understand the causes of the correlations, and to better specify the nature of hospital factors that contribute to correlations among outcomes.
Acknowledgements
Disclosures: Dr Horwitz is supported by the National Institute on Aging (K08 AG038336) and by the American Federation of Aging Research through the Paul B. Beeson Career Development Award Program. Dr Horwitz is also a Pepper Scholar with support from the Claude D. Pepper Older Americans Independence Center at Yale University School of Medicine (P30 AG021342 NIH/NIA). Dr Krumholz is supported by grant U01 HL105270‐01 (Center for Cardiovascular Outcomes Research at Yale University) from the National Heart, Lung, and Blood Institute. Dr Krumholz chairs a cardiac scientific advisory board for UnitedHealth. Authors Drye, Krumholz, and Wang receive support from the Centers for Medicare & Medicaid Services (CMS) to develop and maintain performance measures that are used for public reporting. The analyses upon which this publication is based were performed under Contract Number HHSM‐500‐2008‐0025I Task Order T0001, entitled Measure & Instrument Development and Support (MIDS)Development and Re‐evaluation of the CMS Hospital Outcomes and Efficiency Measures, funded by the Centers for Medicare & Medicaid Services, an agency of the US Department of Health and Human Services. The Centers for Medicare & Medicaid Services reviewed and approved the use of its data for this work, and approved submission of the manuscript. The content of this publication does not necessarily reflect the views or policies of the Department of Health and Human Services, nor does mention of trade names, commercial products, or organizations imply endorsement by the US Government. The authors assume full responsibility for the accuracy and completeness of the ideas presented.
The Centers for Medicare & Medicaid Services (CMS) publicly reports hospital‐specific, 30‐day risk‐standardized mortality and readmission rates for Medicare fee‐for‐service patients admitted with acute myocardial infarction (AMI), heart failure (HF), and pneumonia.1 These measures are intended to reflect hospital performance on quality of care provided to patients during and after hospitalization.2, 3
Quality‐of‐care measures for a given disease are often assumed to reflect the quality of care for that particular condition. However, studies have found limited association between condition‐specific process measures and either mortality or readmission rates for those conditions.46 Mortality and readmission rates may instead reflect broader hospital‐wide or specialty‐wide structure, culture, and practice. For example, studies have previously found that hospitals differ in mortality or readmission rates according to organizational structure,7 financial structure,8 culture,9, 10 information technology,11 patient volume,1214 academic status,12 and other institution‐wide factors.12 There is now a strong policy push towards developing hospital‐wide (all‐condition) measures, beginning with readmission.15
It is not clear how much of the quality of care for a given condition is attributable to hospital‐wide influences that affect all conditions rather than disease‐specific factors. If readmission or mortality performance for a particular condition reflects, in large part, broader institutional characteristics, then improvement efforts might better be focused on hospital‐wide activities, such as team training or implementing electronic medical records. On the other hand, if the disease‐specific measures reflect quality strictly for those conditions, then improvement efforts would be better focused on disease‐specific care, such as early identification of the relevant patient population or standardizing disease‐specific care. As hospitals work to improve performance across an increasingly wide variety of conditions, it is becoming more important for hospitals to prioritize and focus their activities effectively and efficiently.
One means of determining the relative contribution of hospital versus disease factors is to explore whether outcome rates are consistent among different conditions cared for in the same hospital. If mortality (or readmission) rates across different conditions are highly correlated, it would suggest that hospital‐wide factors may play a substantive role in outcomes. Some studies have found that mortality for a particular surgical condition is a useful proxy for mortality for other surgical conditions,16, 17 while other studies have found little correlation among mortality rates for various medical conditions.18, 19 It is also possible that correlation varies according to hospital characteristics; for example, smaller or nonteaching hospitals might be more homogenous in their care than larger, less homogeneous institutions. No studies have been performed using publicly reported estimates of risk‐standardized mortality or readmission rates. In this study we use the publicly reported measures of 30‐day mortality and 30‐day readmission for AMI, HF, and pneumonia to examine whether, and to what degree, mortality rates track together within US hospitals, and separately, to what degree readmission rates track together within US hospitals.
METHODS
Data Sources
CMS calculates risk‐standardized mortality and readmission rates, and patient volume, for all acute care nonfederal hospitals with one or more eligible case of AMI, HF, and pneumonia annually based on fee‐for‐service (FFS) Medicare claims. CMS publicly releases the rates for the large subset of hospitals that participate in public reporting and have 25 or more cases for the conditions over the 3‐year period between July 2006 and June 2009. We estimated the rates for all hospitals included in the measure calculations, including those with fewer than 25 cases, using the CMS methodology and data obtained from CMS. The distribution of these rates has been previously reported.20, 21 In addition, we used the 2008 American Hospital Association (AHA) Survey to obtain data about hospital characteristics, including number of beds, hospital ownership (government, not‐for‐profit, for‐profit), teaching status (member of Council of Teaching Hospitals, other teaching hospital, nonteaching), presence of specialized cardiac capabilities (coronary artery bypass graft surgery, cardiac catheterization lab without cardiac surgery, neither), US Census Bureau core‐based statistical area (division [subarea of area with urban center >2.5 million people], metropolitan [urban center of at least 50,000 people], micropolitan [urban center of between 10,000 and 50,000 people], and rural [<10,000 people]), and safety net status22 (yes/no). Safety net status was defined as either public hospitals or private hospitals with a Medicaid caseload greater than one standard deviation above their respective state's mean private hospital Medicaid caseload using the 2007 AHA Annual Survey data.
Study Sample
This study includes 2 hospital cohorts, 1 for mortality and 1 for readmission. Hospitals were eligible for the mortality cohort if the dataset included risk‐standardized mortality rates for all 3 conditions (AMI, HF, and pneumonia). Hospitals were eligible for the readmission cohort if the dataset included risk‐standardized readmission rates for all 3 of these conditions.
Risk‐Standardized Measures
The measures include all FFS Medicare patients who are 65 years old, have been enrolled in FFS Medicare for the 12 months before the index hospitalization, are admitted with 1 of the 3 qualifying diagnoses, and do not leave the hospital against medical advice. The mortality measures include all deaths within 30 days of admission, and all deaths are attributable to the initial admitting hospital, even if the patient is then transferred to another acute care facility. Therefore, for a given hospital, transfers into the hospital are excluded from its rate, but transfers out are included. The readmission measures include all readmissions within 30 days of discharge, and all readmissions are attributable to the final discharging hospital, even if the patient was originally admitted to a different acute care facility. Therefore, for a given hospital, transfers in are included in its rate, but transfers out are excluded. For mortality measures, only 1 hospitalization for a patient in a specific year is randomly selected if the patient has multiple hospitalizations in the year. For readmission measures, admissions in which the patient died prior to discharge, and admissions within 30 days of an index admission, are not counted as index admissions.
Outcomes for all measures are all‐cause; however, for the AMI readmission measure, planned admissions for cardiac procedures are not counted as readmissions. Patients in observation status or in non‐acute care facilities are not counted as readmissions. Detailed specifications for the outcomes measures are available at the National Quality Measures Clearinghouse.23
The derivation and validation of the risk‐standardized outcome measures have been previously reported.20, 21, 2327 The measures are derived from hierarchical logistic regression models that include age, sex, clinical covariates, and a hospital‐specific random effect. The rates are calculated as the ratio of the number of predicted outcomes (obtained from a model applying the hospital‐specific effect) to the number of expected outcomes (obtained from a model applying the average effect among hospitals), multiplied by the unadjusted overall 30‐day rate.
Statistical Analysis
We examined patterns and distributions of hospital volume, risk‐standardized mortality rates, and risk‐standardized readmission rates among included hospitals. To measure the degree of association among hospitals' risk‐standardized mortality rates for AMI, HF, and pneumonia, we calculated Pearson correlation coefficients, resulting in 3 correlations for the 3 pairs of conditions (AMI and HF, AMI and pneumonia, HF and pneumonia), and tested whether they were significantly different from 0. We also conducted a factor analysis using the principal component method with a minimum eigenvalue of 1 to retain factors to determine whether there was a single common factor underlying mortality performance for the 3 conditions.28 Finally, we divided hospitals into quartiles of performance for each outcome based on the point estimate of risk‐standardized rate, and compared quartile of performance between condition pairs for each outcome. For each condition pair, we assessed the percent of hospitals in the same quartile of performance in both conditions, the percent of hospitals in either the top quartile of performance or the bottom quartile of performance for both, and the percent of hospitals in the top quartile for one and the bottom quartile for the other. We calculated the weighted kappa for agreement on quartile of performance between condition pairs for each outcome and the Spearman correlation for quartiles of performance. Then, we examined Pearson correlation coefficients in different subgroups of hospitals, including by size, ownership, teaching status, cardiac procedure capability, statistical area, and safety net status. In order to determine whether these correlations differed by hospital characteristics, we tested if the Pearson correlation coefficients were different between any 2 subgroups using the method proposed by Fisher.29 We repeated all of these analyses separately for the risk‐standardized readmission rates.
To determine whether correlations between mortality rates were significantly different than correlations between readmission rates for any given condition pair, we used the method recommended by Raghunathan et al.30 For these analyses, we included only hospitals reporting both mortality and readmission rates for the condition pairs. We used the same methods to determine whether correlations between mortality rates were significantly different than correlations between readmission rates for any given condition pair among subgroups of hospital characteristics.
All analyses and graphing were performed using the SAS statistical package version 9.2 (SAS Institute, Cary, NC). We considered a P‐value < 0.05 to be statistically significant, and all statistical tests were 2‐tailed.
RESULTS
The mortality cohort included 4559 hospitals, and the readmission cohort included 4468 hospitals. The majority of hospitals was small, nonteaching, and did not have advanced cardiac capabilities such as cardiac surgery or cardiac catheterization (Table 1).
Description | Mortality Measures | Readmission Measures |
---|---|---|
Hospital N = 4559 | Hospital N = 4468 | |
N (%)* | N (%)* | |
| ||
No. of beds | ||
>600 | 157 (3.4) | 156 (3.5) |
300600 | 628 (13.8) | 626 (14.0) |
<300 | 3588 (78.7) | 3505 (78.5) |
Unknown | 186 (4.08) | 181 (4.1) |
Mean (SD) | 173.24 (189.52) | 175.23 (190.00) |
Ownership | ||
Not‐for‐profit | 2650 (58.1) | 2619 (58.6) |
For‐profit | 672 (14.7) | 663 (14.8) |
Government | 1051 (23.1) | 1005 (22.5) |
Unknown | 186 (4.1) | 181 (4.1) |
Teaching status | ||
COTH | 277 (6.1) | 276 (6.2) |
Teaching | 505 (11.1) | 503 (11.3) |
Nonteaching | 3591 (78.8) | 3508 (78.5) |
Unknown | 186 (4.1) | 181 (4.1) |
Cardiac facility type | ||
CABG | 1471 (32.3) | 1467 (32.8) |
Cath lab | 578 (12.7) | 578 (12.9) |
Neither | 2324 (51.0) | 2242 (50.2) |
Unknown | 186 (4.1) | 181 (4.1) |
Core‐based statistical area | ||
Division | 621 (13.6) | 618 (13.8) |
Metro | 1850 (40.6) | 1835 (41.1) |
Micro | 801 (17.6) | 788 (17.6) |
Rural | 1101 (24.2) | 1046 (23.4) |
Unknown | 186 (4.1) | 181 (4.1) |
Safety net status | ||
No | 2995 (65.7) | 2967 (66.4) |
Yes | 1377 (30.2) | 1319 (29.5) |
Unknown | 187 (4.1) | 182 (4.1) |
For mortality measures, the smallest median number of cases per hospital was for AMI (48; interquartile range [IQR], 13,171), and the greatest number was for pneumonia (178; IQR, 87, 336). The same pattern held for readmission measures (AMI median 33; IQR; 9, 150; pneumonia median 191; IQR, 95, 352.5). With respect to mortality measures, AMI had the highest rate and HF the lowest rate; however, for readmission measures, HF had the highest rate and pneumonia the lowest rate (Table 2).
Description | Mortality Measures (N = 4559) | Readmission Measures (N = 4468) | ||||
---|---|---|---|---|---|---|
AMI | HF | PN | AMI | HF | PN | |
| ||||||
Total discharges | 558,653 | 1,094,960 | 1,114,706 | 546,514 | 1,314,394 | 1,152,708 |
Hospital volume | ||||||
Mean (SD) | 122.54 (172.52) | 240.18 (271.35) | 244.51 (220.74) | 122.32 (201.78) | 294.18 (333.2) | 257.99 (228.5) |
Median (IQR) | 48 (13, 171) | 142 (56, 337) | 178 (87, 336) | 33 (9, 150) | 172.5 (68, 407) | 191 (95, 352.5) |
Range min, max | 1, 1379 | 1, 2814 | 1, 2241 | 1, 1611 | 1, 3410 | 2, 2359 |
30‐Day risk‐standardized rate* | ||||||
Mean (SD) | 15.7 (1.8) | 10.9 (1.6) | 11.5 (1.9) | 19.9 (1.5) | 24.8 (2.1) | 18.5 (1.7) |
Median (IQR) | 15.7 (14.5, 16.8) | 10.8 (9.9, 11.9) | 11.3 (10.2, 12.6) | 19.9 (18.9, 20.8) | 24.7 (23.4, 26.1) | 18.4 (17.3, 19.5) |
Range min, max | 10.3, 24.6 | 6.6, 18.2 | 6.7, 20.9 | 15.2, 26.3 | 17.3, 32.4 | 13.6, 26.7 |
Every mortality measure was significantly correlated with every other mortality measure (range of correlation coefficients, 0.270.41, P < 0.0001 for all 3 correlations). For example, the correlation between risk‐standardized mortality rates (RSMR) for HF and pneumonia was 0.41. Similarly, every readmission measure was significantly correlated with every other readmission measure (range of correlation coefficients, 0.320.47; P < 0.0001 for all 3 correlations). Overall, the lowest correlation was between risk‐standardized mortality rates for AMI and pneumonia (r = 0.27), and the highest correlation was between risk‐standardized readmission rates (RSRR) for HF and pneumonia (r = 0.47) (Table 3).
Description | Mortality Measures | Readmission Measures | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
N | AMI and HF | AMI and PN | HF and PN | AMI and HF | AMI and PN | HF and PN | ||||||||
r | P | r | P | r | P | N | r | P | r | P | r | P | ||
| ||||||||||||||
All | 4559 | 0.30 | 0.27 | 0.41 | 4468 | 0.38 | 0.32 | 0.47 | ||||||
Hospitals with 25 patients | 2872 | 0.33 | 0.30 | 0.44 | 2467 | 0.44 | 0.38 | 0.51 | ||||||
No. of beds | 0.15 | 0.005 | 0.0009 | <0.0001 | <0.0001 | <0.0001 | ||||||||
>600 | 157 | 0.38 | 0.43 | 0.51 | 156 | 0.67 | 0.50 | 0.66 | ||||||
300600 | 628 | 0.29 | 0.30 | 0.49 | 626 | 0.54 | 0.45 | 0.58 | ||||||
<300 | 3588 | 0.27 | 0.23 | 0.37 | 3505 | 0.30 | 0.26 | 0.44 | ||||||
Ownership | 0.021 | 0.05 | 0.39 | 0.0004 | 0.0004 | 0.003 | ||||||||
Not‐for‐profit | 2650 | 0.32 | 0.28 | 0.42 | 2619 | 0.43 | 0.36 | 0.50 | ||||||
For‐profit | 672 | 0.30 | 0.23 | 0.40 | 663 | 0.29 | 0.22 | 0.40 | ||||||
Government | 1051 | 0.24 | 0.22 | 0.39 | 1005 | 0.32 | 0.29 | 0.45 | ||||||
Teaching status | 0.11 | 0.08 | 0.0012 | <0.0001 | 0.0002 | 0.0003 | ||||||||
COTH | 277 | 0.31 | 0.34 | 0.54 | 276 | 0.54 | 0.47 | 0.59 | ||||||
Teaching | 505 | 0.22 | 0.28 | 0.43 | 503 | 0.52 | 0.42 | 0.56 | ||||||
Nonteaching | 3591 | 0.29 | 0.24 | 0.39 | 3508 | 0.32 | 0.26 | 0.44 | ||||||
Cardiac facility type | 0.022 | 0.006 | <0.0001 | <0.0001 | 0.0006 | 0.004 | ||||||||
CABG | 1471 | 0.33 | 0.29 | 0.47 | 1467 | 0.48 | 0.37 | 0.52 | ||||||
Cath lab | 578 | 0.25 | 0.26 | 0.36 | 578 | 0.32 | 0.37 | 0.47 | ||||||
Neither | 2324 | 0.26 | 0.21 | 0.36 | 2242 | 0.28 | 0.27 | 0.44 | ||||||
Core‐based statistical area | 0.0001 | <0.0001 | 0.002 | <0.0001 | <0.0001 | <0.0001 | ||||||||
Division | 621 | 0.38 | 0.34 | 0.41 | 618 | 0.46 | 0.40 | 0.56 | ||||||
Metro | 1850 | 0.26 | 0.26 | 0.42 | 1835 | 0.38 | 0.30 | 0.40 | ||||||
Micro | 801 | 0.23 | 0.22 | 0.34 | 788 | 0.32 | 0.30 | 0.47 | ||||||
Rural | 1101 | 0.21 | 0.13 | 0.32 | 1046 | 0.22 | 0.21 | 0.44 | ||||||
Safety net status | 0.001 | 0.027 | 0.68 | 0.029 | 0.037 | 0.28 | ||||||||
No | 2995 | 0.33 | 0.28 | 0.41 | 2967 | 0.40 | 0.33 | 0.48 | ||||||
Yes | 1377 | 0.23 | 0.21 | 0.40 | 1319 | 0.34 | 0.30 | 0.45 |
Both the factor analysis for the mortality measures and the factor analysis for the readmission measures yielded only one factor with an eigenvalue >1. In each factor analysis, this single common factor kept more than half of the data based on the cumulative eigenvalue (55% for mortality measures and 60% for readmission measures). For the mortality measures, the pattern of RSMR for myocardial infarction (MI), heart failure (HF), and pneumonia (PN) in the factor was high (0.68 for MI, 0.78 for HF, and 0.76 for PN); the same was true of the RSRR in the readmission measures (0.72 for MI, 0.81 for HF, and 0.78 for PN).
For all condition pairs and both outcomes, a third or more of hospitals were in the same quartile of performance for both conditions of the pair (Table 4). Hospitals were more likely to be in the same quartile of performance if they were in the top or bottom quartile than if they were in the middle. Less than 10% of hospitals were in the top quartile for one condition in the mortality or readmission pair and in the bottom quartile for the other condition in the pair. Kappa scores for same quartile of performance between pairs of outcomes ranged from 0.16 to 0.27, and were highest for HF and pneumonia for both mortality and readmission rates.
Condition Pair | Same Quartile (Any) (%) | Same Quartile (Q1 or Q4) (%) | Q1 in One and Q4 in Another (%) | Weighted Kappa | Spearman Correlation |
---|---|---|---|---|---|
| |||||
Mortality | |||||
MI and HF | 34.8 | 20.2 | 7.9 | 0.19 | 0.25 |
MI and PN | 32.7 | 18.8 | 8.2 | 0.16 | 0.22 |
HF and PN | 35.9 | 21.8 | 5.0 | 0.26 | 0.36 |
Readmission | |||||
MI and HF | 36.6 | 21.0 | 7.5 | 0.22 | 0.28 |
MI and PN | 34.0 | 19.6 | 8.1 | 0.19 | 0.24 |
HF and PN | 37.1 | 22.6 | 5.4 | 0.27 | 0.37 |
In subgroup analyses, the highest mortality correlation was between HF and pneumonia in hospitals with more than 600 beds (r = 0.51, P = 0.0009), and the highest readmission correlation was between AMI and HF in hospitals with more than 600 beds (r = 0.67, P < 0.0001). Across both measures and all 3 condition pairs, correlations between conditions increased with increasing hospital bed size, presence of cardiac surgery capability, and increasing population of the hospital's Census Bureau statistical area. Furthermore, for most measures and condition pairs, correlations between conditions were highest in not‐for‐profit hospitals, hospitals belonging to the Council of Teaching Hospitals, and non‐safety net hospitals (Table 3).
For all condition pairs, the correlation between readmission rates was significantly higher than the correlation between mortality rates (P < 0.01). In subgroup analyses, readmission correlations were also significantly higher than mortality correlations for all pairs of conditions among moderate‐sized hospitals, among nonprofit hospitals, among teaching hospitals that did not belong to the Council of Teaching Hospitals, and among non‐safety net hospitals (Table 5).
Description | AMI and HF | AMI and PN | HF and PN | |||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
N | MC | RC | P | N | MC | RC | P | N | MC | RC | P | |
| ||||||||||||
All | 4457 | 0.31 | 0.38 | <0.0001 | 4459 | 0.27 | 0.32 | 0.007 | 4731 | 0.41 | 0.46 | 0.0004 |
Hospitals with 25 patients | 2472 | 0.33 | 0.44 | <0.001 | 2463 | 0.31 | 0.38 | 0.01 | 4104 | 0.42 | 0.47 | 0.001 |
No. of beds | ||||||||||||
>600 | 156 | 0.38 | 0.67 | 0.0002 | 156 | 0.43 | 0.50 | 0.48 | 160 | 0.51 | 0.66 | 0.042 |
300600 | 626 | 0.29 | 0.54 | <0.0001 | 626 | 0.31 | 0.45 | 0.003 | 630 | 0.49 | 0.58 | 0.033 |
<300 | 3494 | 0.28 | 0.30 | 0.21 | 3496 | 0.23 | 0.26 | 0.17 | 3733 | 0.37 | 0.43 | 0.003 |
Ownership | ||||||||||||
Not‐for‐profit | 2614 | 0.32 | 0.43 | <0.0001 | 2617 | 0.28 | 0.36 | 0.003 | 2697 | 0.42 | 0.50 | 0.0003 |
For‐profit | 662 | 0.30 | 0.29 | 0.90 | 661 | 0.23 | 0.22 | 0.75 | 699 | 0.40 | 0.40 | 0.99 |
Government | 1000 | 0.25 | 0.32 | 0.09 | 1000 | 0.22 | 0.29 | 0.09 | 1127 | 0.39 | 0.43 | 0.21 |
Teaching status | ||||||||||||
COTH | 276 | 0.31 | 0.54 | 0.001 | 277 | 0.35 | 0.46 | 0.10 | 278 | 0.54 | 0.59 | 0.41 |
Teaching | 504 | 0.22 | 0.52 | <0.0001 | 504 | 0.28 | 0.42 | 0.012 | 508 | 0.43 | 0.56 | 0.005 |
Nonteaching | 3496 | 0.29 | 0.32 | 0.18 | 3497 | 0.24 | 0.26 | 0.46 | 3737 | 0.39 | 0.43 | 0.016 |
Cardiac facility type | ||||||||||||
CABG | 1465 | 0.33 | 0.48 | <0.0001 | 1467 | 0.30 | 0.37 | 0.018 | 1483 | 0.47 | 0.51 | 0.103 |
Cath lab | 577 | 0.25 | 0.32 | 0.18 | 577 | 0.26 | 0.37 | 0.046 | 579 | 0.36 | 0.47 | 0.022 |
Neither | 2234 | 0.26 | 0.28 | 0.48 | 2234 | 0.21 | 0.27 | 0.037 | 2461 | 0.36 | 0.44 | 0.002 |
Core‐based statistical area | ||||||||||||
Division | 618 | 0.38 | 0.46 | 0.09 | 620 | 0.34 | 0.40 | 0.18 | 630 | 0.41 | 0.56 | 0.001 |
Metro | 1833 | 0.26 | 0.38 | <0.0001 | 1832 | 0.26 | 0.30 | 0.21 | 1896 | 0.42 | 0.40 | 0.63 |
Micro | 787 | 0.24 | 0.32 | 0.08 | 787 | 0.22 | 0.30 | 0.11 | 820 | 0.34 | 0.46 | 0.003 |
Rural | 1038 | 0.21 | 0.22 | 0.83 | 1039 | 0.13 | 0.21 | 0.056 | 1177 | 0.32 | 0.43 | 0.002 |
Safety net status | ||||||||||||
No | 2961 | 0.33 | 0.40 | 0.001 | 2963 | 0.28 | 0.33 | 0.036 | 3062 | 0.41 | 0.48 | 0.001 |
Yes | 1314 | 0.23 | 0.34 | 0.003 | 1314 | 0.22 | 0.30 | 0.015 | 1460 | 0.40 | 0.45 | 0.14 |
DISCUSSION
In this study, we found that risk‐standardized mortality rates for 3 common medical conditions were moderately correlated within institutions, as were risk‐standardized readmission rates. Readmission rates were more strongly correlated than mortality rates, and all rates tracked closest together in large, urban, and/or teaching hospitals. Very few hospitals were in the top quartile of performance for one condition and in the bottom quartile for a different condition.
Our findings are consistent with the hypothesis that 30‐day risk‐standardized mortality and 30‐day risk‐standardized readmission rates, in part, capture broad aspects of hospital quality that transcend condition‐specific activities. In this study, readmission rates tracked better together than mortality rates for every pair of conditions, suggesting that there may be a greater contribution of hospital‐wide environment, structure, and processes to readmission rates than to mortality rates. This difference is plausible because services specific to readmission, such as discharge planning, care coordination, medication reconciliation, and discharge communication with patients and outpatient clinicians, are typically hospital‐wide processes.
Our study differs from earlier studies of medical conditions in that the correlations we found were higher.18, 19 There are several possible explanations for this difference. First, during the intervening 1525 years since those studies were performed, care for these conditions has evolved substantially, such that there are now more standardized protocols available for all 3 of these diseases. Hospitals that are sufficiently organized or acculturated to systematically implement care protocols may have the infrastructure or culture to do so for all conditions, increasing correlation of performance among conditions. In addition, there are now more technologies and systems available that span care for multiple conditions, such as electronic medical records and quality committees, than were available in previous generations. Second, one of these studies utilized less robust risk‐adjustment,18 and neither used the same methodology of risk standardization. Nonetheless, it is interesting to note that Rosenthal and colleagues identified the same increase in correlation with higher volumes than we did.19 Studies investigating mortality correlations among surgical procedures, on the other hand, have generally found higher correlations than we found in these medical conditions.16, 17
Accountable care organizations will be assessed using an all‐condition readmission measure,31 several states track all‐condition readmission rates,3234 and several countries measure all‐condition mortality.35 An all‐condition measure for quality assessment first requires that there be a hospital‐wide quality signal above and beyond disease‐specific care. This study suggests that a moderate signal exists for readmission and, to a slightly lesser extent, for mortality, across 3 common conditions. There are other considerations, however, in developing all‐condition measures. There must be adequate risk adjustment for the wide variety of conditions that are included, and there must be a means of accounting for the variation in types of conditions and procedures cared for by different hospitals. Our study does not address these challenges, which have been described to be substantial for mortality measures.35
We were surprised by the finding that risk‐standardized rates correlated more strongly within larger institutions than smaller ones, because one might assume that care within smaller hospitals might be more homogenous. It may be easier, however, to detect a quality signal in hospitals with higher volumes of patients for all 3 conditions, because estimates for these hospitals are more precise. Consequently, we have greater confidence in results for larger volumes, and suspect a similar quality signal may be present but more difficult to detect statistically in smaller hospitals. Overall correlations were higher when we restricted the sample to hospitals with at least 25 cases, as is used for public reporting. It is also possible that the finding is real given that large‐volume hospitals have been demonstrated to provide better care for these conditions and are more likely to adopt systems of care that affect multiple conditions, such as electronic medical records.14, 36
The kappa scores comparing quartile of national performance for pairs of conditions were only in the fair range. There are several possible explanations for this fact: 1) outcomes for these 3 conditions are not measuring the same constructs; 2) they are all measuring the same construct, but they are unreliable in doing so; and/or 3) hospitals have similar latent quality for all 3 conditions, but the national quality of performance differs by condition, yielding variable relative performance per hospital for each condition. Based solely on our findings, we cannot distinguish which, if any, of these explanations may be true.31
Our study has several limitations. First, all 3 conditions currently publicly reported by CMS are medical diagnoses, although AMI patients may be cared for in distinct cardiology units and often undergo procedures; therefore, we cannot determine the degree to which correlations reflect hospital‐wide quality versus medicine‐wide quality. An institution may have a weak medicine department but a strong surgical department or vice versa. Second, it is possible that the correlations among conditions for readmission and among conditions for mortality are attributable to patient characteristics that are not adequately adjusted for in the risk‐adjustment model, such as socioeconomic factors, or to hospital characteristics not related to quality, such as coding practices or inter‐hospital transfer rates. For this to be true, these unmeasured characteristics would have to be consistent across different conditions within each hospital and have a consistent influence on outcomes. Third, it is possible that public reporting may have prompted disease‐specific focus on these conditions. We do not have data from non‐publicly reported conditions to test this hypothesis. Fourth, there are many small‐volume hospitals in this study; their estimates for readmission and mortality are less reliable than for large‐volume hospitals, potentially limiting our ability to detect correlations in this group of hospitals.
This study lends credence to the hypothesis that 30‐day risk‐standardized mortality and readmission rates for individual conditions may reflect aspects of hospital‐wide quality or at least medicine‐wide quality, although the correlations are not large enough to conclude that hospital‐wide factors play a dominant role, and there are other possible explanations for the correlations. Further work is warranted to better understand the causes of the correlations, and to better specify the nature of hospital factors that contribute to correlations among outcomes.
Acknowledgements
Disclosures: Dr Horwitz is supported by the National Institute on Aging (K08 AG038336) and by the American Federation of Aging Research through the Paul B. Beeson Career Development Award Program. Dr Horwitz is also a Pepper Scholar with support from the Claude D. Pepper Older Americans Independence Center at Yale University School of Medicine (P30 AG021342 NIH/NIA). Dr Krumholz is supported by grant U01 HL105270‐01 (Center for Cardiovascular Outcomes Research at Yale University) from the National Heart, Lung, and Blood Institute. Dr Krumholz chairs a cardiac scientific advisory board for UnitedHealth. Authors Drye, Krumholz, and Wang receive support from the Centers for Medicare & Medicaid Services (CMS) to develop and maintain performance measures that are used for public reporting. The analyses upon which this publication is based were performed under Contract Number HHSM‐500‐2008‐0025I Task Order T0001, entitled Measure & Instrument Development and Support (MIDS)Development and Re‐evaluation of the CMS Hospital Outcomes and Efficiency Measures, funded by the Centers for Medicare & Medicaid Services, an agency of the US Department of Health and Human Services. The Centers for Medicare & Medicaid Services reviewed and approved the use of its data for this work, and approved submission of the manuscript. The content of this publication does not necessarily reflect the views or policies of the Department of Health and Human Services, nor does mention of trade names, commercial products, or organizations imply endorsement by the US Government. The authors assume full responsibility for the accuracy and completeness of the ideas presented.
- US Department of Health and Human Services. Hospital Compare.2011. Available at: http://www.hospitalcompare.hhs.gov. Accessed March 5, 2011.
- Early readmissions to the department of medicine as a screening tool for monitoring quality of care problems.Medicine (Baltimore).2008;87(5):294–300. , , .
- Hospital inpatient mortality. Is it a predictor of quality?N Engl J Med.1987;317(26):1674–1680. , , , , .
- Relationship between Medicare's hospital compare performance measures and mortality rates.JAMA.2006;296(22):2694–2702. , .
- Public reporting of discharge planning and rates of readmissions.N Engl J Med.2009;361(27):2637–2645. , , .
- Process of care performance measures and long‐term outcomes in patients hospitalized with heart failure.Med Care.2010;48(3):210–216. , , , et al.
- Variations in inpatient mortality among hospitals in different system types, 1995 to 2000.Med Care.2009;47(4):466–473. , , , , , .
- A systematic review and meta‐analysis of studies comparing mortality rates of private for‐profit and private not‐for‐profit hospitals.Can Med Assoc J.2002;166(11):1399–1406. , , , et al.
- What distinguishes top‐performing hospitals in acute myocardial infarction mortality rates? A qualitative study.Ann Intern Med.2011;154(6):384–390. , , , et al.
- Perceptions of hospital safety climate and incidence of readmission.Health Serv Res.2011;46(2):596–616. , , .
- Decrease in hospital‐wide mortality rate after implementation of a commercially sold computerized physician order entry system.Pediatrics.2010;126(1):14–21. , , , et al.
- The condition of the literature on differences in hospital mortality.Med Care.1989;27(4):315–336. , , .
- Threshold volumes associated with higher survival in health care: a systematic review.Med Care.2003;41(10):1129–1141. , , .
- Hospital volume and 30‐day mortality for three common medical conditions.N Engl J Med.2010;362(12):1110–1118. , , , et al.
- Patient Protection and Affordable Care Act Pub. L. No. 111–148, 124 Stat, §3025.2010. Available at: http://www.gpo.gov/fdsys/pkg/PLAW‐111publ148/content‐detail.html. Accessed on July 26, year="2012"2012.
- Are mortality rates for different operations related? Implications for measuring the quality of noncardiac surgery.Med Care.2006;44(8):774–778. , , .
- Do hospitals with low mortality rates in coronary artery bypass also perform well in valve replacement?Ann Thorac Surg.2003;76(4):1131–1137. , , , .
- Differences among hospitals in Medicare patient mortality.Health Serv Res.1989;24(1):1–31. , , , , .
- Variations in standardized hospital mortality rates for six common medical diagnoses: implications for profiling hospital quality.Med Care.1998;36(7):955–964. , , , .
- Development, validation, and results of a measure of 30‐day readmission following hospitalization for pneumonia.J Hosp Med.2011;6(3):142–150. , , , et al.
- An administrative claims measure suitable for profiling hospital performance on the basis of 30‐day all‐cause readmission rates among patients with heart failure.Circ Cardiovasc Qual Outcomes.2008;1:29–37. , , , et al.
- Quality of care for acute myocardial infarction at urban safety‐net hospitals.Health Aff (Millwood).2007;26(1):238–248. , , , et al.
- National Quality Measures Clearinghouse.2011. Available at: http://www.qualitymeasures.ahrq.gov/. Accessed February 21,year="2011"2011.
- An administrative claims model suitable for profiling hospital performance based on 30‐day mortality rates among patients with an acute myocardial infarction.Circulation.2006;113(13):1683–1692. , , , et al.
- An administrative claims model suitable for profiling hospital performance based on 30‐day mortality rates among patients with heart failure.Circulation.2006;113(13):1693–1701. , , , et al.
- An administrative claims model for profiling hospital 30‐day mortality rates for pneumonia patients.PLoS One.2011;6(4):e17401. , , , et al.
- An administrative claims measure suitable for profiling hospital performance based on 30‐day all‐cause readmission rates among patients with acute myocardial infarction.Circ Cardiovasc Qual Outcomes.2011;4(2):243–252. , , , et al.
- The application of electronic computers to factor analysis.Educ Psychol Meas.1960;20:141–151. .
- On the ‘probable error’ of a coefficient of correlation deduced from a small sample.Metron.1921;1:3–32. .
- Comparing correlated but nonoverlapping correlations.Psychol Methods.1996;1(2):178–183. , , .
- Centers for Medicare and Medicaid Services.Medicare Shared Savings Program: Accountable Care Organizations, Final Rule.Fed Reg.2011;76:67802–67990.
- Massachusetts Healthcare Quality and Cost Council. Potentially Preventable Readmissions.2011. Available at: http://www.mass.gov/hqcc/the‐hcqcc‐council/data‐submission‐information/potentially‐preventable‐readmissions‐ppr.html. Accessed February 29, 2012.
- Texas Medicaid. Potentially Preventable Readmission (PPR).2012. Available at: http://www.tmhp.com/Pages/Medicaid/Hospital_PPR.aspx. Accessed February 29, 2012.
- New York State. Potentially Preventable Readmissions.2011. Available at: http://www.health.ny.gov/regulations/recently_adopted/docs/2011–02‐23_potentially_preventable_readmissions.pdf. Accessed February 29, 2012.
- Variability in the measurement of hospital‐wide mortality rates.N Engl J Med.2010;363(26):2530–2539. , , , , .
- Use of electronic health records in U.S. hospitals.N Engl J Med.2009;360(16):1628–1638. , , , et al.
- US Department of Health and Human Services. Hospital Compare.2011. Available at: http://www.hospitalcompare.hhs.gov. Accessed March 5, 2011.
- Early readmissions to the department of medicine as a screening tool for monitoring quality of care problems.Medicine (Baltimore).2008;87(5):294–300. , , .
- Hospital inpatient mortality. Is it a predictor of quality?N Engl J Med.1987;317(26):1674–1680. , , , , .
- Relationship between Medicare's hospital compare performance measures and mortality rates.JAMA.2006;296(22):2694–2702. , .
- Public reporting of discharge planning and rates of readmissions.N Engl J Med.2009;361(27):2637–2645. , , .
- Process of care performance measures and long‐term outcomes in patients hospitalized with heart failure.Med Care.2010;48(3):210–216. , , , et al.
- Variations in inpatient mortality among hospitals in different system types, 1995 to 2000.Med Care.2009;47(4):466–473. , , , , , .
- A systematic review and meta‐analysis of studies comparing mortality rates of private for‐profit and private not‐for‐profit hospitals.Can Med Assoc J.2002;166(11):1399–1406. , , , et al.
- What distinguishes top‐performing hospitals in acute myocardial infarction mortality rates? A qualitative study.Ann Intern Med.2011;154(6):384–390. , , , et al.
- Perceptions of hospital safety climate and incidence of readmission.Health Serv Res.2011;46(2):596–616. , , .
- Decrease in hospital‐wide mortality rate after implementation of a commercially sold computerized physician order entry system.Pediatrics.2010;126(1):14–21. , , , et al.
- The condition of the literature on differences in hospital mortality.Med Care.1989;27(4):315–336. , , .
- Threshold volumes associated with higher survival in health care: a systematic review.Med Care.2003;41(10):1129–1141. , , .
- Hospital volume and 30‐day mortality for three common medical conditions.N Engl J Med.2010;362(12):1110–1118. , , , et al.
- Patient Protection and Affordable Care Act Pub. L. No. 111–148, 124 Stat, §3025.2010. Available at: http://www.gpo.gov/fdsys/pkg/PLAW‐111publ148/content‐detail.html. Accessed on July 26, year="2012"2012.
- Are mortality rates for different operations related? Implications for measuring the quality of noncardiac surgery.Med Care.2006;44(8):774–778. , , .
- Do hospitals with low mortality rates in coronary artery bypass also perform well in valve replacement?Ann Thorac Surg.2003;76(4):1131–1137. , , , .
- Differences among hospitals in Medicare patient mortality.Health Serv Res.1989;24(1):1–31. , , , , .
- Variations in standardized hospital mortality rates for six common medical diagnoses: implications for profiling hospital quality.Med Care.1998;36(7):955–964. , , , .
- Development, validation, and results of a measure of 30‐day readmission following hospitalization for pneumonia.J Hosp Med.2011;6(3):142–150. , , , et al.
- An administrative claims measure suitable for profiling hospital performance on the basis of 30‐day all‐cause readmission rates among patients with heart failure.Circ Cardiovasc Qual Outcomes.2008;1:29–37. , , , et al.
- Quality of care for acute myocardial infarction at urban safety‐net hospitals.Health Aff (Millwood).2007;26(1):238–248. , , , et al.
- National Quality Measures Clearinghouse.2011. Available at: http://www.qualitymeasures.ahrq.gov/. Accessed February 21,year="2011"2011.
- An administrative claims model suitable for profiling hospital performance based on 30‐day mortality rates among patients with an acute myocardial infarction.Circulation.2006;113(13):1683–1692. , , , et al.
- An administrative claims model suitable for profiling hospital performance based on 30‐day mortality rates among patients with heart failure.Circulation.2006;113(13):1693–1701. , , , et al.
- An administrative claims model for profiling hospital 30‐day mortality rates for pneumonia patients.PLoS One.2011;6(4):e17401. , , , et al.
- An administrative claims measure suitable for profiling hospital performance based on 30‐day all‐cause readmission rates among patients with acute myocardial infarction.Circ Cardiovasc Qual Outcomes.2011;4(2):243–252. , , , et al.
- The application of electronic computers to factor analysis.Educ Psychol Meas.1960;20:141–151. .
- On the ‘probable error’ of a coefficient of correlation deduced from a small sample.Metron.1921;1:3–32. .
- Comparing correlated but nonoverlapping correlations.Psychol Methods.1996;1(2):178–183. , , .
- Centers for Medicare and Medicaid Services.Medicare Shared Savings Program: Accountable Care Organizations, Final Rule.Fed Reg.2011;76:67802–67990.
- Massachusetts Healthcare Quality and Cost Council. Potentially Preventable Readmissions.2011. Available at: http://www.mass.gov/hqcc/the‐hcqcc‐council/data‐submission‐information/potentially‐preventable‐readmissions‐ppr.html. Accessed February 29, 2012.
- Texas Medicaid. Potentially Preventable Readmission (PPR).2012. Available at: http://www.tmhp.com/Pages/Medicaid/Hospital_PPR.aspx. Accessed February 29, 2012.
- New York State. Potentially Preventable Readmissions.2011. Available at: http://www.health.ny.gov/regulations/recently_adopted/docs/2011–02‐23_potentially_preventable_readmissions.pdf. Accessed February 29, 2012.
- Variability in the measurement of hospital‐wide mortality rates.N Engl J Med.2010;363(26):2530–2539. , , , , .
- Use of electronic health records in U.S. hospitals.N Engl J Med.2009;360(16):1628–1638. , , , et al.
Copyright © 2012 Society of Hospital Medicine
“Out of Sight, Out of Mind”
Hospital readmission is a common, costly, and often preventable occurrence in the United States. Among Medicare beneficiaries, 1 out of 5 patients is readmitted within 30 days, and the cost of unplanned readmissions exceeded $17 billion in 2007.1 As a result, the Centers for Medicare and Medicaid Services (CMS) and others have called for focused efforts to reduce hospital readmission rates.24 The quality of hospital discharge care is a key determinant of readmission rates,57 and many recent interventions to reduce readmission have focused on improving various aspects of the discharge process.810 Although these approaches have shown promise, the role of physicians in improving the quality of discharge care has not been extensively studied. Existing studies have focused on communication barriers between physicians in the hospital and outpatient settings,1113 but these have not examined the hospital discharge process itself and the experience of physicians in that process. Physician perspectives on this process are critical to inform strategies to leverage their roles in improving the performance of discharge teams.
Accordingly, we sought to understand physician experiences with the hospital discharge process, focusing on factors that physicians perceived to limit the quality of the discharge process at teaching hospitals. Teaching hospitals provided an ideal setting for this study given their high readmission rates,14 despite efforts to improve discharge quality of care through multidisciplinary team approaches. We focused on housestaff physicians because of their in‐depth involvement in the discharge process at teaching hospitals, which collectively provide 20% of all hospital care in the US.15 Housestaff perspectives on quality‐limiting factors of the discharge process may help identify targets for interventions to improve the quality of inpatient discharge care and to ultimately reduce hospital readmissions.
METHODS
Study Design and Sample
We conducted a qualitative study of internal medicine housestaff at 2 residency programs, with 7 different hospital settings, to ensure breadth of experience and perspectives (Table 1). Both programs train a large number of housestaff, and both are affiliated with prestigious medical schools and major universities. Qualitative methods are ideally suited to examine physician perspectives on discharge care because the inherent complexity of discharge processes, and importance of communication and multidisciplinary teamwork, are difficult to quantify.16, 17 We focused on housestaff because they are responsible for coordinating discharge care at teaching hospitals and have direct experience with the phenomenon of interest.18 We created a discussion guide (see Supporting Information, Out of Sight, Out of Mind Interview Guide in the online version of this article) informed by clinical experience and recent qualitative studies of housestaff, to guide conversation during the interviews.1921
Hospital | Residency Program | Ownership | Setting | Teaching Intensity |
---|---|---|---|---|
A | A | Private, nonprofit | Urban | High |
B | B | Private, nonprofit | Semi‐urban | High |
C | A | Private, nonprofit specialty (oncology) | Urban | High |
D | B | Private, nonprofit community hospital | Rural | Low |
E | A | Public (Veterans Affairs) | Urban | High |
F | B | Public (Veterans Affairs) | Semi‐urban | High |
G | A | Public (county hospital) | Urban | High |
We obtained a list of current housestaff from directors at both residency programs and invited participation from all housestaff with an inpatient rotation in the preceding 6 months, using purposeful sampling to ensure adequate representation by postgraduate year (PGY) and gender. Given that interns are more involved in executing the details of discharge care, we purposefully over‐sampled for PGY‐1 rather than sampling each PGY equally. As an incentive, participants were entered into a lottery for one of three $100 gift cards at each site. All participants gave informed consent, and all research procedures were approved by the Institutional Review Boards of record for both residency programs.
Data Collection
We conducted in‐depth interviews until no new concepts were elicited with successive interviews; this theoretical saturation22, 23 occurred after 29 interviews. To ensure rigor in our approach, we adhered to a focused scope of inquiry, developed a cohesive theoretical sample, and held regular team meetings to assess the adequacy and comprehensiveness of all analytic results.24 All interviews were digitally recorded and transcribed by a professional transcription service, and all transcripts were reviewed for accuracy. A brief demographic survey was administered after each interview (Table 2).
Characteristic | Total N = 29 |
---|---|
| |
Age | Mean: 29.6 yr |
Range: 2634 yr | |
Gender | |
Female | 19 (66%) |
Male | 10 (34%) |
Residency program | |
A | 12 (41%) |
B | 17 (59%) |
Year in training | |
PGY‐1 | 17 (59%) |
PGY‐2 | 7 (24%) |
PGY‐3 | 5 (17%) |
Data Analysis
We employed the constant comparative method of qualitative data analysis.16, 18 Codes were developed iteratively and refined to identify conceptual segments of the data. The team reviewed the code structure throughout the analytic process, and revised the scope and content of codes as needed. The final code structure contained 22 codes, which we subsequently integrated into the 5 recurrent themes. Two members of the research team (S.R.G., D.S.) coded all of the transcripts; other team members (L.I.H., L.C., and E.H.B.) double‐ and triple‐coded portions of the data. All data were entered into a single database (Atlas.ti version 5.2) to ensure consistent application of codes across all transcripts. Disagreements in coding were resolved through negotiated consensus. Additional strategies to enhance the reliability of our findings included creation of an audit trail documenting the data coding and analysis processes, and seeking participant review and confirmation of the findings.24, 25 We shared summary findings with all participants via e‐mail, and sought participant confirmation through in‐person conversations with several individuals and responses to findings via e‐mail.
RESULTS
Based on interview transcripts from 29 internal medicine housestaff physicians (Table 3), we identified 5 recurrent and unifying themes describing factors perceived to limit the quality of inpatient discharge care: (1) competing priorities in the discharge process; (2) inadequate coordination within multidisciplinary discharge teams; (3) lack of standardization in discharge procedures; (4) poor patient and family communication; and (5) lack of postdischarge feedback and clinical responsibility.
Theme: Competing priorities of timeliness and thoroughness |
Supporting codes |
Professional or hospital norms about discharge |
Time pressures including early discharge rules |
Balancing multiple priorities or responsibilities |
Duty hours and off hours including weekends and cross‐cover |
Theme: Lack of coordination within multidisciplinary discharge team members |
Supporting codes |
Teamwork including individual roles, communication and coordination between team members |
Clinical complexity or specific complexities of the healthcare system |
Specific difficulties arranging for follow‐up care |
Theme: Uncertainty about provider roles and patient readiness for discharge |
Supporting codes |
Uncertainty about provider roles or discharge timing |
Readmissions and bounce‐backs |
Clinical complexity or specific complexities of the healthcare system |
Theme: Lack of standardization in discharge procedures |
Supporting codes |
Teamwork |
Readmissions and bounce‐backs |
Patient safety including the concept of safe discharge and mistakes or errors |
Clinical complexity or specific complexities of the healthcare system |
Checklists or other specific procedures/aids or clever systems to improve quality |
Discharge documentation |
Theme: Poor patient communication and postdischarge continuity of care |
Supporting codes |
Lack of continuity of care after discharge |
Specific difficulties arranging for follow‐up care |
Information technology including electronic medical records |
Patient communication, education, or understanding |
Discharge documentation |
Competing Priorities in the Discharge Process
Housestaff uniformly asserted the importance of consistently performing high‐quality discharge; however, they identified several competing priorities that turned their attention elsewhere. Housestaff noted that the pressure to discharge early in the day was palpable, even if this compromised the thoroughness of the discharge process. Illustrating this theme, one participant said:
One thing that I found very frustrating here is the goal for 11:00 AM discharge . It's more important to get the patient out than it is to be thorough in the discharge is how it feels a lot of the time. [PGY‐1, Program B, Interview #3]
In addition to competing institutional priorities, housestaff also articulated tensions between their roles as learners and providers. Although educational duties, such as noon conference, contributed to general time constraints, they highlighted other patient care responsibilities as the primary competing priority to a high‐quality discharge:
The worst part in discharging is that it takes a lot of time and you're often limited by having to admit new patients . I don't think people realize how much time it takes often a lot longer than doing an admission. [PGY‐1, Program A, Interview #27]
Participants also described competing priorities in the context of transfers of care or sign‐out from the post‐call team to the on‐call team. Because discharges frequently occurred around the same time as these sign‐outs, housestaff described conflicting institutional priorities that created ambiguity about post‐call discharge responsibilities:
When you're post‐call, the hospital administration wants you to be out by 12:00, but then they're also saying do all the [discharge] stuff. So, which one do you want me to do? They kind of endorse both and that's confusing. [PGY‐1, Program B, Interview #7]
Although housestaff articulated patient safety as an essential goal of discharge care, the net effect of these competing individual and institutional priorities was an inconsistent focus on the discharge process and an unspoken or hidden message that discharge care was not of top‐level importance.
Inadequate Coordination Within Multidisciplinary Discharge Teams
Housestaff described difficulties in coordination and communication with multidisciplinary staff involved with the discharge process beyond the physician team. They felt their engagement with other team members was constrained by professional hierarchy and insufficient contact among team members, both of which directly affected hospital efficiency and patient safety:
On the hospital floor, it still feels like a hierarchy and it's very difficult to fit communication with nurses into our daily rounds . If we worked together more as a team, we could discharge patients faster and safer. [PGY‐3, Program B, Interview #1]
Housestaff also noted that discharge team experiences were diverse. Some discharge teams were described as cohesive, while others were described as fragmented and characterized by last‐minute problem solving and lack of cooperation among team members:
A low‐quality discharge is a rushed discharge for whatever reason, you don't really know that you're discharging the patient until that day. Those are the ones that are really hard. You're pushing social work to get things set up. They're pushing back at you. [PGY‐2, Program B, Interview #6]
Housestaff concerns about inadequate discharge planning were exacerbated by role confusion and uncertainty about which components of discharge care were to be performed by other team members. Even when housestaff articulated clear ownership for a particular task such as documenting plans in a discharge summary, they were uncertain how these documents would be used by other team members to communicate these plans to patients:
Half the time, I'm not sure if the patient gets the discharge summary, because I enter it but I don't actually know what the nurse does with it. I know she goes over their meds with them and gives them appointments, but if she actually gives them the discharge summary, I have no idea. [PGY‐1, Program A, Interview #18]
Thus, although housestaff described multidisciplinary teamwork as important, they often did not know how to lead or function effectively within the team, leading to conflict, misunderstanding, delays, and inefficiency. Moreover, uncertainty about roles for team members often led to wide variation in discharge practices observed at their institutions.
Lack of Standards for Discharge Procedures
Housestaff described an overall lack of standardization for the discharge process; a high degree of variation in practices was apparent at several levels. Housestaff noted differences in approaches to arranging follow‐up care depending on the hospital where they were rotating:
At this hospital, making follow‐up appointments is intermittent because there are some rotations that have someone help you with that, and others that don't. That is something that I feel should be standardized everywhere. [PGY‐1, Program B, Interview #7]
Housestaff also noted differences in approaches to discharge planning across different services within a single hospital, including examples of units that stood out for their ability to consistently provide high‐quality discharge care:
Coordinating with social work is very team‐dependent. On the Chest service and Virology services, we've got very good social workers who focus on those conditions so they know the issues in and out, and it just flows much more smoothly. [PGY‐3, Program A, Interview #20]
Lastly, variation was also noted in individual physician practices, especially with respect to attending physician involvement with the discharge team and teaching or supervision of housestaff discharge care:
The role of the attending totally varies. This month, I don't even think my attending looked at the prescriptions. She just stamped, stamped, signed whatever. But last month my attending was very involved; she double‐checked every prescription. [PGY‐1, Program A, Interview #21]
Overall, lack of standardization limited efforts to coordinate discharge procedures and set the stage for poor communication practices between discharge team members and patients and their families.
Poor Patient and Family Communication
Housestaff described practices for communicating with patients and families, at the time of discharge, as problematic. Although housestaff articulated this communication as critically important, they also recognized that time allocated to achieving this goal was not always commensurate:
I think, in a perfect world, I would have time to sit down with every single patient and say take these meds in the morning, these in the evening, and these are the reasons you're taking all of them, but I don't think that you have time to do all of that and I find that frustrating. [PGY‐2, Program A, Interview #27]
In addition to direct patient communication, housestaff identified problems with information in printed discharge materials. Although problems could stem from inadequate details in documentation given to patients, information overload was also a concern:
The discharge packet is like a book. I think there's too much extraneous information in it, and it's overwhelming to be discharged with this book of information. [PGY‐1, Program A, Interview #18]
Further, housestaff described the execution of discharge communication as perfunctory and lacking in attention to signs of adequate patient understanding:
Often, all patients get is a handshake and a stack of paperwork. Many of them don't know why they were in the hospital and what was done. [PGY‐2, Program B, Interview #2]
Overall, housestaff described patient understanding as a goal for the entire discharge team, but lacked individual accountability for patient and family communication. Housestaff also indicated that responsibilities to assess patient readiness to navigate the transition from hospital to post‐hospital care were not clearly defined.
Lack of Postdischarge Feedback and Clinical Responsibility
Housestaff described that the norms and culture of being on service focused on the hospital portion of care, and underemphasized post‐hospitalization care. With the extensive workload on inpatient services, housestaff commonly expressed their lack of involvement with a patient's care after discharge:
So often when you're on service once the patient is out of sight, they're out of mind. Once they leave our service, we are not the doctor anymore. That's the mentality. [PGY‐2, Program A, Interview #19]
Additionally, housestaff indicated that they rarely received feedback concerning postdischarge patient outcomes, and that the only mechanism for learning about outcomes of discharge care was patient readmission:
There's a lot of uncertainty at the time of discharge which is frustrating. I hope that I sent them out on the right doses, the right medication, to the right sorts of facilities with the right follow‐up providers, but I never know. The only way I'll find out if it's wrong is they come back to the hospital. [PGY‐1, Program B, Interview #4]
Housestaff also conceded that they could not follow patients postdischarge, given the demands of high turnover on inpatient rotations, and needed to limit their obligations to discharged patients to focus on newly admitted patients:
It's hard to keep track because sometimes we're discharging 10 patients a day, admitting 10 patients a day . So, once they leave, you did a good job and they're okay. [PGY‐3, Program A, Interview #26]
Furthermore, for patients readmitted to the hospital, housestaff described an approach to workup and management that focused on events during the prior admission, rather than events in the postdischarge period:
So if I'm admitting someone who's just been discharged, I think, Is this a new problem? Did we do this to the person? and if it's the same problem, Well, what did we do about it last time? Did we do anything? [PGY‐2, Program B, Interview #13]
Thus, although readmissions were described as problematic and undesirable, housestaff described a limited ability to follow up with patients or learn about the impact of the discharge practices on subsequent patient outcomes. More specifically, housestaff portrayed a limited ability to address the root causes for poor outcomes, such as readmission.
DISCUSSION
Housestaff physicians experienced 5 quality‐limiting factors that collectively created and reinforced a practice environment in which patients and patient outcomes after discharge remain largely out of sight, out of mind. In this environment, discharge was often viewed as a summative event that signaled the conclusion of care in one setting rather than a transition in care from one setting to another. Paradoxically, this environment was apparent despite the values and goals participants described for providing high‐quality discharge care, working within multidisciplinary discharge teams, and reducing readmissions.
The degree to which housestaff were focused on the hospital portion of patients' care, and viewed postdischarge care as beyond their scope or responsibility, was striking. The tight boundary they drew between hospital and post‐hospital care reflected the demanding workload in the hospital, the lack of data feedback about patients post‐hospitalization, and professional norms and expectations about housestaff responsibilities. Downstream effects of this tight boundary may result in confusion for patients and family about who to contact in case of postdischarge complications, and may ultimately catalyze higher emergency department use and readmissions.26 Efforts to redefine inpatient physician responsibilities, as providing patient care until management has been successfully transferred to a community‐based provider, may be necessary to ensure adequate postdischarge continuity of care.27
We also found that housestaff physicians reported marked variation in discharge practices across different hospitals and training settings, across different teams within hospitals, and across individual attending physicians. Although guidelines for discharge care currently endorsed by the National Quality Forum28 and others4, 27, 29 provide excellent templates, our findings suggest that the implementation of these standards at the hospital and physician level is limited. Furthermore, while existing single‐site interventions to standardize various discharge practices provide a foundational evidence base for high‐quality discharge care,2932 our study adds insight into the individual and institutional barriers that prevent diffusion of these practices to other hospitals.
Finally, the lack of coordination within discharge teams, described by housestaff physicians in our study, also suggests a need for improved leadership in the hospital overall and at the level of the discharge team. Studies of high‐performing hospitals have shown that top‐level institutional support is a necessary substrate for the creation and maintenance of high‐performance teamwork.33 At the level of the discharge team, creating a culture of high‐quality discharge care will require greater focus on defining team‐member roles and responsibilities. At the individual level, changes in physician training to provide discharge care are critical, especially since practice patterns learned in residency may predict quality of care over physicians' careers.34 Recent examples of curricular innovations for discharge care are encouraging,35 but more research on how physicians learn about discharge care and related systems‐based practice, learning, and improvement is needed to enable changes on a national scale.
Our findings should be interpreted in light of several limitations. First, we recruited housestaff from 1 specialty at 2 large training programs; experiences of housestaff in other specialties and other training programs may differ. Second, we cannot quantify the frequency of specific discharge procedures or outcomes described by our participants, as this was beyond the scope of our qualitative approach. Nevertheless, our aim was to explore the range of quality‐limiting factors, rather than their prevalence, and this in‐depth analysis has extended previous work by identifying factors that may influence the quality of discharge care. Third, social desirability bias36 could have led participants to exaggerate or minimize aspects of quality‐limiting factors identified in this study. To minimize this potential bias, we included specific prompts for both negative and positive aspects of providing discharge care in our interview guide. Finally, our analytic decisions to over‐sample for interns, and to not include physicians who have completed training (eg, hospitalists), may introduce bias towards inexperience; however, our objective was to study the culture of discharge care at teaching hospitals, and our sample reflects the distribution of labor for tasks of discharge care at such institutions. Future research should address important questions raised by this study about the role of attending physicians in discharge care at teaching and non‐teaching hospitals.
Improving the quality of discharge care is an important step to improving overall outcomes of hospitalization, including reduced adverse events and unnecessary admissions. Our study suggests important quality‐limiting factors embedded in the norms for discharge care at teaching hospitals. These factors are unlikely to change without interventions at multiple levels of hospitals, discharge teams, and individual providers. Targeted interventions to change these practices will be necessary to achieve higher overall quality of care for hospitalized patients at teaching hospitals.
- Rehospitalizations among patients in the Medicare fee‐for‐service program.N Engl J Med.2009;360:1418–1428. , , .
- Hospital readmission as an accountability measure.JAMA.2011;305(5):504–505. , .
- Hospital to Home (H2H) Initiative. Available at: http://www.h2hquality.org/. Accessed May 15,2011.
- Better Outcomes for Older adults through Safe Transitions (Project BOOST). Available at: http://www.hospitalmedicine.org/boost. Accessed May 18,2011.
- The association between the quality of inpatient care and early readmission.Ann Intern Med.1995;122(6):415–421. , , , , .
- The association between the quality of inpatient care and early readmission: a meta‐analysis of the evidence.Med Care.1997;35(10):1044–1059. , , , , .
- Hospital readmissions as a measure of quality of health care: advantages and limitations.Arch Intern Med.2000;160(8):1074–1081. , .
- The hospital discharge: a review of a high risk care transition with highlights of a reengineered discharge process.J Patient Saf.2007;3:97–106. , , .
- Transitional care of older adults hospitalized with heart failure: a randomized, controlled trial.J Am Geriatr Soc.2004;52(5):675–684. , , , et al.
- Comprehensive discharge planning with postdischarge support for older patients with congestive heart failure: a meta‐analysis.JAMA.2004;291:1358–1367. , , , , , .
- Improving the quality of discharge communication with an educational intervention.Pediatrics.2010;126(4):734–739. , , , , , .
- Improving transitions of care at hospital discharge—implications for pediatric hospitalists and primary care providers.J Healthc Qual.2010;32(5):51–60. , , , et al.
- Deficits in communication and information transfer between hospital‐based and primary care physicians: implications for patient safety and continuity of care.JAMA.2007;297:831–841. , , , et al.
- The impact of resident duty hour reform on hospital readmission rates among Medicare beneficiaries.J Gen Intern Med.2011;26(4):405–411. , , , et al.
- American Association of Medical Colleges. What Roles Do Teaching Hospitals Fullfill? Available at: http://www.aamc.org/about/teachhosp_facts1.pdf. Accessed December 15,2009.
- Qualitative data analysis for health services research: developing taxonomy, themes, and theory.Health Serv Res.2007;42(4):1758–1772. , , .
- Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research.BMJ.1995;311(6996):42–45. , .
- Qualitative Research and Evaluation Methods.Thousand Oaks, CA:Sage Publications;2002. .
- Consequences of inadequate sign‐out for patient care.Arch Intern Med.2008;168(16):1755–1760. , , , , .
- What are covering doctors told about their patients? Analysis of sign‐out among internal medicine house staff.Qual Saf Health Care.2009;18:248–255. , , , et al.
- Getting by: underuse of interpreters by resident physicians.J Gen Intern Med.2008;24(2):256–262. . , , , , .
- The significance of saturation.Qual Health Res.1995;5(2):147–149. .
- The Discovery of Grounded Theory: Strategies for Qualitative Research.Chicago, IL:Aldine;1967. , .
- Doing Qualitative Research (Research Methods for Primary Care).Thousand Oaks, CA: Sage;1999:33–46. , , eds.
- Qualitative Data Analysis.2nd ed.Thousand Oaks, CA: Sage;1994. , .
- Reduction of 30‐day post‐discharge hospital readmission or ED visit rates in high‐risk elderly medical patients through delivery of a targeted care bundle.J Hosp Med.2009;4:211–218. , , , et al.
- Transitions of Care Consensus Policy Statement American College of Physicians–Society of General Internal Medicine–Society of Hospital Medicine–American Geriatrics Society–American College of Emergency Physicians–Society of Academic Emergency Medicine.J Gen Intern Med.2009;24(8):971–976. , , , et al.
- Reengineering hospital discharge: a protocol to improve patient safety, reduce costs, and boost patient satisfaction.Am J Med Qual.2009;24(4):344–346. .
- Assessing the quality of preparation for post‐hospital care from the patient's perspective: the care transitions measure.Med Care.2005;43(3):246–255. , , .
- Hospital discharge documentation and risk of rehospitalisation.BMJ Qual Saf.2011;20(9):773–778. , , , et al.
- Effect of standardized electronic discharge instructions on post‐discharge hospital utilization.J Gen Intern Med.2011;26(7):718–723. , , , , .
- Patient safety concerns arising from test results that return after hospital discharge.Ann Intern Med.2005;143(2):121–128. , , , et al.
- What distinguishes top‐performing hospitals in acute myocardial infarction mortality rates? A qualitative study.Ann Intern Med.2011;154(6):384–390. , , , et al.
- Evaluating obstetrical residency programs using patient outcomes.JAMA.2009;302(12):1277–1283. , , , , .
- Creating a better discharge summary: improvement in quality and timeliness using an electronic discharge summary.J Hosp Med.2009;4:219–225. , , , et al.
- Thinking About Answers: The Application of Cognitive Processes to Survey Methodology.San Francisco, CA:Jossey‐Bass;1996. , , .
Hospital readmission is a common, costly, and often preventable occurrence in the United States. Among Medicare beneficiaries, 1 out of 5 patients is readmitted within 30 days, and the cost of unplanned readmissions exceeded $17 billion in 2007.1 As a result, the Centers for Medicare and Medicaid Services (CMS) and others have called for focused efforts to reduce hospital readmission rates.24 The quality of hospital discharge care is a key determinant of readmission rates,57 and many recent interventions to reduce readmission have focused on improving various aspects of the discharge process.810 Although these approaches have shown promise, the role of physicians in improving the quality of discharge care has not been extensively studied. Existing studies have focused on communication barriers between physicians in the hospital and outpatient settings,1113 but these have not examined the hospital discharge process itself and the experience of physicians in that process. Physician perspectives on this process are critical to inform strategies to leverage their roles in improving the performance of discharge teams.
Accordingly, we sought to understand physician experiences with the hospital discharge process, focusing on factors that physicians perceived to limit the quality of the discharge process at teaching hospitals. Teaching hospitals provided an ideal setting for this study given their high readmission rates,14 despite efforts to improve discharge quality of care through multidisciplinary team approaches. We focused on housestaff physicians because of their in‐depth involvement in the discharge process at teaching hospitals, which collectively provide 20% of all hospital care in the US.15 Housestaff perspectives on quality‐limiting factors of the discharge process may help identify targets for interventions to improve the quality of inpatient discharge care and to ultimately reduce hospital readmissions.
METHODS
Study Design and Sample
We conducted a qualitative study of internal medicine housestaff at 2 residency programs, with 7 different hospital settings, to ensure breadth of experience and perspectives (Table 1). Both programs train a large number of housestaff, and both are affiliated with prestigious medical schools and major universities. Qualitative methods are ideally suited to examine physician perspectives on discharge care because the inherent complexity of discharge processes, and importance of communication and multidisciplinary teamwork, are difficult to quantify.16, 17 We focused on housestaff because they are responsible for coordinating discharge care at teaching hospitals and have direct experience with the phenomenon of interest.18 We created a discussion guide (see Supporting Information, Out of Sight, Out of Mind Interview Guide in the online version of this article) informed by clinical experience and recent qualitative studies of housestaff, to guide conversation during the interviews.1921
Hospital | Residency Program | Ownership | Setting | Teaching Intensity |
---|---|---|---|---|
A | A | Private, nonprofit | Urban | High |
B | B | Private, nonprofit | Semi‐urban | High |
C | A | Private, nonprofit specialty (oncology) | Urban | High |
D | B | Private, nonprofit community hospital | Rural | Low |
E | A | Public (Veterans Affairs) | Urban | High |
F | B | Public (Veterans Affairs) | Semi‐urban | High |
G | A | Public (county hospital) | Urban | High |
We obtained a list of current housestaff from directors at both residency programs and invited participation from all housestaff with an inpatient rotation in the preceding 6 months, using purposeful sampling to ensure adequate representation by postgraduate year (PGY) and gender. Given that interns are more involved in executing the details of discharge care, we purposefully over‐sampled for PGY‐1 rather than sampling each PGY equally. As an incentive, participants were entered into a lottery for one of three $100 gift cards at each site. All participants gave informed consent, and all research procedures were approved by the Institutional Review Boards of record for both residency programs.
Data Collection
We conducted in‐depth interviews until no new concepts were elicited with successive interviews; this theoretical saturation22, 23 occurred after 29 interviews. To ensure rigor in our approach, we adhered to a focused scope of inquiry, developed a cohesive theoretical sample, and held regular team meetings to assess the adequacy and comprehensiveness of all analytic results.24 All interviews were digitally recorded and transcribed by a professional transcription service, and all transcripts were reviewed for accuracy. A brief demographic survey was administered after each interview (Table 2).
Characteristic | Total N = 29 |
---|---|
| |
Age | Mean: 29.6 yr |
Range: 2634 yr | |
Gender | |
Female | 19 (66%) |
Male | 10 (34%) |
Residency program | |
A | 12 (41%) |
B | 17 (59%) |
Year in training | |
PGY‐1 | 17 (59%) |
PGY‐2 | 7 (24%) |
PGY‐3 | 5 (17%) |
Data Analysis
We employed the constant comparative method of qualitative data analysis.16, 18 Codes were developed iteratively and refined to identify conceptual segments of the data. The team reviewed the code structure throughout the analytic process, and revised the scope and content of codes as needed. The final code structure contained 22 codes, which we subsequently integrated into the 5 recurrent themes. Two members of the research team (S.R.G., D.S.) coded all of the transcripts; other team members (L.I.H., L.C., and E.H.B.) double‐ and triple‐coded portions of the data. All data were entered into a single database (Atlas.ti version 5.2) to ensure consistent application of codes across all transcripts. Disagreements in coding were resolved through negotiated consensus. Additional strategies to enhance the reliability of our findings included creation of an audit trail documenting the data coding and analysis processes, and seeking participant review and confirmation of the findings.24, 25 We shared summary findings with all participants via e‐mail, and sought participant confirmation through in‐person conversations with several individuals and responses to findings via e‐mail.
RESULTS
Based on interview transcripts from 29 internal medicine housestaff physicians (Table 3), we identified 5 recurrent and unifying themes describing factors perceived to limit the quality of inpatient discharge care: (1) competing priorities in the discharge process; (2) inadequate coordination within multidisciplinary discharge teams; (3) lack of standardization in discharge procedures; (4) poor patient and family communication; and (5) lack of postdischarge feedback and clinical responsibility.
Theme: Competing priorities of timeliness and thoroughness |
Supporting codes |
Professional or hospital norms about discharge |
Time pressures including early discharge rules |
Balancing multiple priorities or responsibilities |
Duty hours and off hours including weekends and cross‐cover |
Theme: Lack of coordination within multidisciplinary discharge team members |
Supporting codes |
Teamwork including individual roles, communication and coordination between team members |
Clinical complexity or specific complexities of the healthcare system |
Specific difficulties arranging for follow‐up care |
Theme: Uncertainty about provider roles and patient readiness for discharge |
Supporting codes |
Uncertainty about provider roles or discharge timing |
Readmissions and bounce‐backs |
Clinical complexity or specific complexities of the healthcare system |
Theme: Lack of standardization in discharge procedures |
Supporting codes |
Teamwork |
Readmissions and bounce‐backs |
Patient safety including the concept of safe discharge and mistakes or errors |
Clinical complexity or specific complexities of the healthcare system |
Checklists or other specific procedures/aids or clever systems to improve quality |
Discharge documentation |
Theme: Poor patient communication and postdischarge continuity of care |
Supporting codes |
Lack of continuity of care after discharge |
Specific difficulties arranging for follow‐up care |
Information technology including electronic medical records |
Patient communication, education, or understanding |
Discharge documentation |
Competing Priorities in the Discharge Process
Housestaff uniformly asserted the importance of consistently performing high‐quality discharge; however, they identified several competing priorities that turned their attention elsewhere. Housestaff noted that the pressure to discharge early in the day was palpable, even if this compromised the thoroughness of the discharge process. Illustrating this theme, one participant said:
One thing that I found very frustrating here is the goal for 11:00 AM discharge . It's more important to get the patient out than it is to be thorough in the discharge is how it feels a lot of the time. [PGY‐1, Program B, Interview #3]
In addition to competing institutional priorities, housestaff also articulated tensions between their roles as learners and providers. Although educational duties, such as noon conference, contributed to general time constraints, they highlighted other patient care responsibilities as the primary competing priority to a high‐quality discharge:
The worst part in discharging is that it takes a lot of time and you're often limited by having to admit new patients . I don't think people realize how much time it takes often a lot longer than doing an admission. [PGY‐1, Program A, Interview #27]
Participants also described competing priorities in the context of transfers of care or sign‐out from the post‐call team to the on‐call team. Because discharges frequently occurred around the same time as these sign‐outs, housestaff described conflicting institutional priorities that created ambiguity about post‐call discharge responsibilities:
When you're post‐call, the hospital administration wants you to be out by 12:00, but then they're also saying do all the [discharge] stuff. So, which one do you want me to do? They kind of endorse both and that's confusing. [PGY‐1, Program B, Interview #7]
Although housestaff articulated patient safety as an essential goal of discharge care, the net effect of these competing individual and institutional priorities was an inconsistent focus on the discharge process and an unspoken or hidden message that discharge care was not of top‐level importance.
Inadequate Coordination Within Multidisciplinary Discharge Teams
Housestaff described difficulties in coordination and communication with multidisciplinary staff involved with the discharge process beyond the physician team. They felt their engagement with other team members was constrained by professional hierarchy and insufficient contact among team members, both of which directly affected hospital efficiency and patient safety:
On the hospital floor, it still feels like a hierarchy and it's very difficult to fit communication with nurses into our daily rounds . If we worked together more as a team, we could discharge patients faster and safer. [PGY‐3, Program B, Interview #1]
Housestaff also noted that discharge team experiences were diverse. Some discharge teams were described as cohesive, while others were described as fragmented and characterized by last‐minute problem solving and lack of cooperation among team members:
A low‐quality discharge is a rushed discharge for whatever reason, you don't really know that you're discharging the patient until that day. Those are the ones that are really hard. You're pushing social work to get things set up. They're pushing back at you. [PGY‐2, Program B, Interview #6]
Housestaff concerns about inadequate discharge planning were exacerbated by role confusion and uncertainty about which components of discharge care were to be performed by other team members. Even when housestaff articulated clear ownership for a particular task such as documenting plans in a discharge summary, they were uncertain how these documents would be used by other team members to communicate these plans to patients:
Half the time, I'm not sure if the patient gets the discharge summary, because I enter it but I don't actually know what the nurse does with it. I know she goes over their meds with them and gives them appointments, but if she actually gives them the discharge summary, I have no idea. [PGY‐1, Program A, Interview #18]
Thus, although housestaff described multidisciplinary teamwork as important, they often did not know how to lead or function effectively within the team, leading to conflict, misunderstanding, delays, and inefficiency. Moreover, uncertainty about roles for team members often led to wide variation in discharge practices observed at their institutions.
Lack of Standards for Discharge Procedures
Housestaff described an overall lack of standardization for the discharge process; a high degree of variation in practices was apparent at several levels. Housestaff noted differences in approaches to arranging follow‐up care depending on the hospital where they were rotating:
At this hospital, making follow‐up appointments is intermittent because there are some rotations that have someone help you with that, and others that don't. That is something that I feel should be standardized everywhere. [PGY‐1, Program B, Interview #7]
Housestaff also noted differences in approaches to discharge planning across different services within a single hospital, including examples of units that stood out for their ability to consistently provide high‐quality discharge care:
Coordinating with social work is very team‐dependent. On the Chest service and Virology services, we've got very good social workers who focus on those conditions so they know the issues in and out, and it just flows much more smoothly. [PGY‐3, Program A, Interview #20]
Lastly, variation was also noted in individual physician practices, especially with respect to attending physician involvement with the discharge team and teaching or supervision of housestaff discharge care:
The role of the attending totally varies. This month, I don't even think my attending looked at the prescriptions. She just stamped, stamped, signed whatever. But last month my attending was very involved; she double‐checked every prescription. [PGY‐1, Program A, Interview #21]
Overall, lack of standardization limited efforts to coordinate discharge procedures and set the stage for poor communication practices between discharge team members and patients and their families.
Poor Patient and Family Communication
Housestaff described practices for communicating with patients and families, at the time of discharge, as problematic. Although housestaff articulated this communication as critically important, they also recognized that time allocated to achieving this goal was not always commensurate:
I think, in a perfect world, I would have time to sit down with every single patient and say take these meds in the morning, these in the evening, and these are the reasons you're taking all of them, but I don't think that you have time to do all of that and I find that frustrating. [PGY‐2, Program A, Interview #27]
In addition to direct patient communication, housestaff identified problems with information in printed discharge materials. Although problems could stem from inadequate details in documentation given to patients, information overload was also a concern:
The discharge packet is like a book. I think there's too much extraneous information in it, and it's overwhelming to be discharged with this book of information. [PGY‐1, Program A, Interview #18]
Further, housestaff described the execution of discharge communication as perfunctory and lacking in attention to signs of adequate patient understanding:
Often, all patients get is a handshake and a stack of paperwork. Many of them don't know why they were in the hospital and what was done. [PGY‐2, Program B, Interview #2]
Overall, housestaff described patient understanding as a goal for the entire discharge team, but lacked individual accountability for patient and family communication. Housestaff also indicated that responsibilities to assess patient readiness to navigate the transition from hospital to post‐hospital care were not clearly defined.
Lack of Postdischarge Feedback and Clinical Responsibility
Housestaff described that the norms and culture of being on service focused on the hospital portion of care, and underemphasized post‐hospitalization care. With the extensive workload on inpatient services, housestaff commonly expressed their lack of involvement with a patient's care after discharge:
So often when you're on service once the patient is out of sight, they're out of mind. Once they leave our service, we are not the doctor anymore. That's the mentality. [PGY‐2, Program A, Interview #19]
Additionally, housestaff indicated that they rarely received feedback concerning postdischarge patient outcomes, and that the only mechanism for learning about outcomes of discharge care was patient readmission:
There's a lot of uncertainty at the time of discharge which is frustrating. I hope that I sent them out on the right doses, the right medication, to the right sorts of facilities with the right follow‐up providers, but I never know. The only way I'll find out if it's wrong is they come back to the hospital. [PGY‐1, Program B, Interview #4]
Housestaff also conceded that they could not follow patients postdischarge, given the demands of high turnover on inpatient rotations, and needed to limit their obligations to discharged patients to focus on newly admitted patients:
It's hard to keep track because sometimes we're discharging 10 patients a day, admitting 10 patients a day . So, once they leave, you did a good job and they're okay. [PGY‐3, Program A, Interview #26]
Furthermore, for patients readmitted to the hospital, housestaff described an approach to workup and management that focused on events during the prior admission, rather than events in the postdischarge period:
So if I'm admitting someone who's just been discharged, I think, Is this a new problem? Did we do this to the person? and if it's the same problem, Well, what did we do about it last time? Did we do anything? [PGY‐2, Program B, Interview #13]
Thus, although readmissions were described as problematic and undesirable, housestaff described a limited ability to follow up with patients or learn about the impact of the discharge practices on subsequent patient outcomes. More specifically, housestaff portrayed a limited ability to address the root causes for poor outcomes, such as readmission.
DISCUSSION
Housestaff physicians experienced 5 quality‐limiting factors that collectively created and reinforced a practice environment in which patients and patient outcomes after discharge remain largely out of sight, out of mind. In this environment, discharge was often viewed as a summative event that signaled the conclusion of care in one setting rather than a transition in care from one setting to another. Paradoxically, this environment was apparent despite the values and goals participants described for providing high‐quality discharge care, working within multidisciplinary discharge teams, and reducing readmissions.
The degree to which housestaff were focused on the hospital portion of patients' care, and viewed postdischarge care as beyond their scope or responsibility, was striking. The tight boundary they drew between hospital and post‐hospital care reflected the demanding workload in the hospital, the lack of data feedback about patients post‐hospitalization, and professional norms and expectations about housestaff responsibilities. Downstream effects of this tight boundary may result in confusion for patients and family about who to contact in case of postdischarge complications, and may ultimately catalyze higher emergency department use and readmissions.26 Efforts to redefine inpatient physician responsibilities, as providing patient care until management has been successfully transferred to a community‐based provider, may be necessary to ensure adequate postdischarge continuity of care.27
We also found that housestaff physicians reported marked variation in discharge practices across different hospitals and training settings, across different teams within hospitals, and across individual attending physicians. Although guidelines for discharge care currently endorsed by the National Quality Forum28 and others4, 27, 29 provide excellent templates, our findings suggest that the implementation of these standards at the hospital and physician level is limited. Furthermore, while existing single‐site interventions to standardize various discharge practices provide a foundational evidence base for high‐quality discharge care,2932 our study adds insight into the individual and institutional barriers that prevent diffusion of these practices to other hospitals.
Finally, the lack of coordination within discharge teams, described by housestaff physicians in our study, also suggests a need for improved leadership in the hospital overall and at the level of the discharge team. Studies of high‐performing hospitals have shown that top‐level institutional support is a necessary substrate for the creation and maintenance of high‐performance teamwork.33 At the level of the discharge team, creating a culture of high‐quality discharge care will require greater focus on defining team‐member roles and responsibilities. At the individual level, changes in physician training to provide discharge care are critical, especially since practice patterns learned in residency may predict quality of care over physicians' careers.34 Recent examples of curricular innovations for discharge care are encouraging,35 but more research on how physicians learn about discharge care and related systems‐based practice, learning, and improvement is needed to enable changes on a national scale.
Our findings should be interpreted in light of several limitations. First, we recruited housestaff from 1 specialty at 2 large training programs; experiences of housestaff in other specialties and other training programs may differ. Second, we cannot quantify the frequency of specific discharge procedures or outcomes described by our participants, as this was beyond the scope of our qualitative approach. Nevertheless, our aim was to explore the range of quality‐limiting factors, rather than their prevalence, and this in‐depth analysis has extended previous work by identifying factors that may influence the quality of discharge care. Third, social desirability bias36 could have led participants to exaggerate or minimize aspects of quality‐limiting factors identified in this study. To minimize this potential bias, we included specific prompts for both negative and positive aspects of providing discharge care in our interview guide. Finally, our analytic decisions to over‐sample for interns, and to not include physicians who have completed training (eg, hospitalists), may introduce bias towards inexperience; however, our objective was to study the culture of discharge care at teaching hospitals, and our sample reflects the distribution of labor for tasks of discharge care at such institutions. Future research should address important questions raised by this study about the role of attending physicians in discharge care at teaching and non‐teaching hospitals.
Improving the quality of discharge care is an important step to improving overall outcomes of hospitalization, including reduced adverse events and unnecessary admissions. Our study suggests important quality‐limiting factors embedded in the norms for discharge care at teaching hospitals. These factors are unlikely to change without interventions at multiple levels of hospitals, discharge teams, and individual providers. Targeted interventions to change these practices will be necessary to achieve higher overall quality of care for hospitalized patients at teaching hospitals.
Hospital readmission is a common, costly, and often preventable occurrence in the United States. Among Medicare beneficiaries, 1 out of 5 patients is readmitted within 30 days, and the cost of unplanned readmissions exceeded $17 billion in 2007.1 As a result, the Centers for Medicare and Medicaid Services (CMS) and others have called for focused efforts to reduce hospital readmission rates.24 The quality of hospital discharge care is a key determinant of readmission rates,57 and many recent interventions to reduce readmission have focused on improving various aspects of the discharge process.810 Although these approaches have shown promise, the role of physicians in improving the quality of discharge care has not been extensively studied. Existing studies have focused on communication barriers between physicians in the hospital and outpatient settings,1113 but these have not examined the hospital discharge process itself and the experience of physicians in that process. Physician perspectives on this process are critical to inform strategies to leverage their roles in improving the performance of discharge teams.
Accordingly, we sought to understand physician experiences with the hospital discharge process, focusing on factors that physicians perceived to limit the quality of the discharge process at teaching hospitals. Teaching hospitals provided an ideal setting for this study given their high readmission rates,14 despite efforts to improve discharge quality of care through multidisciplinary team approaches. We focused on housestaff physicians because of their in‐depth involvement in the discharge process at teaching hospitals, which collectively provide 20% of all hospital care in the US.15 Housestaff perspectives on quality‐limiting factors of the discharge process may help identify targets for interventions to improve the quality of inpatient discharge care and to ultimately reduce hospital readmissions.
METHODS
Study Design and Sample
We conducted a qualitative study of internal medicine housestaff at 2 residency programs, with 7 different hospital settings, to ensure breadth of experience and perspectives (Table 1). Both programs train a large number of housestaff, and both are affiliated with prestigious medical schools and major universities. Qualitative methods are ideally suited to examine physician perspectives on discharge care because the inherent complexity of discharge processes, and importance of communication and multidisciplinary teamwork, are difficult to quantify.16, 17 We focused on housestaff because they are responsible for coordinating discharge care at teaching hospitals and have direct experience with the phenomenon of interest.18 We created a discussion guide (see Supporting Information, Out of Sight, Out of Mind Interview Guide in the online version of this article) informed by clinical experience and recent qualitative studies of housestaff, to guide conversation during the interviews.1921
Hospital | Residency Program | Ownership | Setting | Teaching Intensity |
---|---|---|---|---|
A | A | Private, nonprofit | Urban | High |
B | B | Private, nonprofit | Semi‐urban | High |
C | A | Private, nonprofit specialty (oncology) | Urban | High |
D | B | Private, nonprofit community hospital | Rural | Low |
E | A | Public (Veterans Affairs) | Urban | High |
F | B | Public (Veterans Affairs) | Semi‐urban | High |
G | A | Public (county hospital) | Urban | High |
We obtained a list of current housestaff from directors at both residency programs and invited participation from all housestaff with an inpatient rotation in the preceding 6 months, using purposeful sampling to ensure adequate representation by postgraduate year (PGY) and gender. Given that interns are more involved in executing the details of discharge care, we purposefully over‐sampled for PGY‐1 rather than sampling each PGY equally. As an incentive, participants were entered into a lottery for one of three $100 gift cards at each site. All participants gave informed consent, and all research procedures were approved by the Institutional Review Boards of record for both residency programs.
Data Collection
We conducted in‐depth interviews until no new concepts were elicited with successive interviews; this theoretical saturation22, 23 occurred after 29 interviews. To ensure rigor in our approach, we adhered to a focused scope of inquiry, developed a cohesive theoretical sample, and held regular team meetings to assess the adequacy and comprehensiveness of all analytic results.24 All interviews were digitally recorded and transcribed by a professional transcription service, and all transcripts were reviewed for accuracy. A brief demographic survey was administered after each interview (Table 2).
Characteristic | Total N = 29 |
---|---|
| |
Age | Mean: 29.6 yr |
Range: 2634 yr | |
Gender | |
Female | 19 (66%) |
Male | 10 (34%) |
Residency program | |
A | 12 (41%) |
B | 17 (59%) |
Year in training | |
PGY‐1 | 17 (59%) |
PGY‐2 | 7 (24%) |
PGY‐3 | 5 (17%) |
Data Analysis
We employed the constant comparative method of qualitative data analysis.16, 18 Codes were developed iteratively and refined to identify conceptual segments of the data. The team reviewed the code structure throughout the analytic process, and revised the scope and content of codes as needed. The final code structure contained 22 codes, which we subsequently integrated into the 5 recurrent themes. Two members of the research team (S.R.G., D.S.) coded all of the transcripts; other team members (L.I.H., L.C., and E.H.B.) double‐ and triple‐coded portions of the data. All data were entered into a single database (Atlas.ti version 5.2) to ensure consistent application of codes across all transcripts. Disagreements in coding were resolved through negotiated consensus. Additional strategies to enhance the reliability of our findings included creation of an audit trail documenting the data coding and analysis processes, and seeking participant review and confirmation of the findings.24, 25 We shared summary findings with all participants via e‐mail, and sought participant confirmation through in‐person conversations with several individuals and responses to findings via e‐mail.
RESULTS
Based on interview transcripts from 29 internal medicine housestaff physicians (Table 3), we identified 5 recurrent and unifying themes describing factors perceived to limit the quality of inpatient discharge care: (1) competing priorities in the discharge process; (2) inadequate coordination within multidisciplinary discharge teams; (3) lack of standardization in discharge procedures; (4) poor patient and family communication; and (5) lack of postdischarge feedback and clinical responsibility.
Theme: Competing priorities of timeliness and thoroughness |
Supporting codes |
Professional or hospital norms about discharge |
Time pressures including early discharge rules |
Balancing multiple priorities or responsibilities |
Duty hours and off hours including weekends and cross‐cover |
Theme: Lack of coordination within multidisciplinary discharge team members |
Supporting codes |
Teamwork including individual roles, communication and coordination between team members |
Clinical complexity or specific complexities of the healthcare system |
Specific difficulties arranging for follow‐up care |
Theme: Uncertainty about provider roles and patient readiness for discharge |
Supporting codes |
Uncertainty about provider roles or discharge timing |
Readmissions and bounce‐backs |
Clinical complexity or specific complexities of the healthcare system |
Theme: Lack of standardization in discharge procedures |
Supporting codes |
Teamwork |
Readmissions and bounce‐backs |
Patient safety including the concept of safe discharge and mistakes or errors |
Clinical complexity or specific complexities of the healthcare system |
Checklists or other specific procedures/aids or clever systems to improve quality |
Discharge documentation |
Theme: Poor patient communication and postdischarge continuity of care |
Supporting codes |
Lack of continuity of care after discharge |
Specific difficulties arranging for follow‐up care |
Information technology including electronic medical records |
Patient communication, education, or understanding |
Discharge documentation |
Competing Priorities in the Discharge Process
Housestaff uniformly asserted the importance of consistently performing high‐quality discharge; however, they identified several competing priorities that turned their attention elsewhere. Housestaff noted that the pressure to discharge early in the day was palpable, even if this compromised the thoroughness of the discharge process. Illustrating this theme, one participant said:
One thing that I found very frustrating here is the goal for 11:00 AM discharge . It's more important to get the patient out than it is to be thorough in the discharge is how it feels a lot of the time. [PGY‐1, Program B, Interview #3]
In addition to competing institutional priorities, housestaff also articulated tensions between their roles as learners and providers. Although educational duties, such as noon conference, contributed to general time constraints, they highlighted other patient care responsibilities as the primary competing priority to a high‐quality discharge:
The worst part in discharging is that it takes a lot of time and you're often limited by having to admit new patients . I don't think people realize how much time it takes often a lot longer than doing an admission. [PGY‐1, Program A, Interview #27]
Participants also described competing priorities in the context of transfers of care or sign‐out from the post‐call team to the on‐call team. Because discharges frequently occurred around the same time as these sign‐outs, housestaff described conflicting institutional priorities that created ambiguity about post‐call discharge responsibilities:
When you're post‐call, the hospital administration wants you to be out by 12:00, but then they're also saying do all the [discharge] stuff. So, which one do you want me to do? They kind of endorse both and that's confusing. [PGY‐1, Program B, Interview #7]
Although housestaff articulated patient safety as an essential goal of discharge care, the net effect of these competing individual and institutional priorities was an inconsistent focus on the discharge process and an unspoken or hidden message that discharge care was not of top‐level importance.
Inadequate Coordination Within Multidisciplinary Discharge Teams
Housestaff described difficulties in coordination and communication with multidisciplinary staff involved with the discharge process beyond the physician team. They felt their engagement with other team members was constrained by professional hierarchy and insufficient contact among team members, both of which directly affected hospital efficiency and patient safety:
On the hospital floor, it still feels like a hierarchy and it's very difficult to fit communication with nurses into our daily rounds . If we worked together more as a team, we could discharge patients faster and safer. [PGY‐3, Program B, Interview #1]
Housestaff also noted that discharge team experiences were diverse. Some discharge teams were described as cohesive, while others were described as fragmented and characterized by last‐minute problem solving and lack of cooperation among team members:
A low‐quality discharge is a rushed discharge for whatever reason, you don't really know that you're discharging the patient until that day. Those are the ones that are really hard. You're pushing social work to get things set up. They're pushing back at you. [PGY‐2, Program B, Interview #6]
Housestaff concerns about inadequate discharge planning were exacerbated by role confusion and uncertainty about which components of discharge care were to be performed by other team members. Even when housestaff articulated clear ownership for a particular task such as documenting plans in a discharge summary, they were uncertain how these documents would be used by other team members to communicate these plans to patients:
Half the time, I'm not sure if the patient gets the discharge summary, because I enter it but I don't actually know what the nurse does with it. I know she goes over their meds with them and gives them appointments, but if she actually gives them the discharge summary, I have no idea. [PGY‐1, Program A, Interview #18]
Thus, although housestaff described multidisciplinary teamwork as important, they often did not know how to lead or function effectively within the team, leading to conflict, misunderstanding, delays, and inefficiency. Moreover, uncertainty about roles for team members often led to wide variation in discharge practices observed at their institutions.
Lack of Standards for Discharge Procedures
Housestaff described an overall lack of standardization for the discharge process; a high degree of variation in practices was apparent at several levels. Housestaff noted differences in approaches to arranging follow‐up care depending on the hospital where they were rotating:
At this hospital, making follow‐up appointments is intermittent because there are some rotations that have someone help you with that, and others that don't. That is something that I feel should be standardized everywhere. [PGY‐1, Program B, Interview #7]
Housestaff also noted differences in approaches to discharge planning across different services within a single hospital, including examples of units that stood out for their ability to consistently provide high‐quality discharge care:
Coordinating with social work is very team‐dependent. On the Chest service and Virology services, we've got very good social workers who focus on those conditions so they know the issues in and out, and it just flows much more smoothly. [PGY‐3, Program A, Interview #20]
Lastly, variation was also noted in individual physician practices, especially with respect to attending physician involvement with the discharge team and teaching or supervision of housestaff discharge care:
The role of the attending totally varies. This month, I don't even think my attending looked at the prescriptions. She just stamped, stamped, signed whatever. But last month my attending was very involved; she double‐checked every prescription. [PGY‐1, Program A, Interview #21]
Overall, lack of standardization limited efforts to coordinate discharge procedures and set the stage for poor communication practices between discharge team members and patients and their families.
Poor Patient and Family Communication
Housestaff described practices for communicating with patients and families, at the time of discharge, as problematic. Although housestaff articulated this communication as critically important, they also recognized that time allocated to achieving this goal was not always commensurate:
I think, in a perfect world, I would have time to sit down with every single patient and say take these meds in the morning, these in the evening, and these are the reasons you're taking all of them, but I don't think that you have time to do all of that and I find that frustrating. [PGY‐2, Program A, Interview #27]
In addition to direct patient communication, housestaff identified problems with information in printed discharge materials. Although problems could stem from inadequate details in documentation given to patients, information overload was also a concern:
The discharge packet is like a book. I think there's too much extraneous information in it, and it's overwhelming to be discharged with this book of information. [PGY‐1, Program A, Interview #18]
Further, housestaff described the execution of discharge communication as perfunctory and lacking in attention to signs of adequate patient understanding:
Often, all patients get is a handshake and a stack of paperwork. Many of them don't know why they were in the hospital and what was done. [PGY‐2, Program B, Interview #2]
Overall, housestaff described patient understanding as a goal for the entire discharge team, but lacked individual accountability for patient and family communication. Housestaff also indicated that responsibilities to assess patient readiness to navigate the transition from hospital to post‐hospital care were not clearly defined.
Lack of Postdischarge Feedback and Clinical Responsibility
Housestaff described that the norms and culture of being on service focused on the hospital portion of care, and underemphasized post‐hospitalization care. With the extensive workload on inpatient services, housestaff commonly expressed their lack of involvement with a patient's care after discharge:
So often when you're on service once the patient is out of sight, they're out of mind. Once they leave our service, we are not the doctor anymore. That's the mentality. [PGY‐2, Program A, Interview #19]
Additionally, housestaff indicated that they rarely received feedback concerning postdischarge patient outcomes, and that the only mechanism for learning about outcomes of discharge care was patient readmission:
There's a lot of uncertainty at the time of discharge which is frustrating. I hope that I sent them out on the right doses, the right medication, to the right sorts of facilities with the right follow‐up providers, but I never know. The only way I'll find out if it's wrong is they come back to the hospital. [PGY‐1, Program B, Interview #4]
Housestaff also conceded that they could not follow patients postdischarge, given the demands of high turnover on inpatient rotations, and needed to limit their obligations to discharged patients to focus on newly admitted patients:
It's hard to keep track because sometimes we're discharging 10 patients a day, admitting 10 patients a day . So, once they leave, you did a good job and they're okay. [PGY‐3, Program A, Interview #26]
Furthermore, for patients readmitted to the hospital, housestaff described an approach to workup and management that focused on events during the prior admission, rather than events in the postdischarge period:
So if I'm admitting someone who's just been discharged, I think, Is this a new problem? Did we do this to the person? and if it's the same problem, Well, what did we do about it last time? Did we do anything? [PGY‐2, Program B, Interview #13]
Thus, although readmissions were described as problematic and undesirable, housestaff described a limited ability to follow up with patients or learn about the impact of the discharge practices on subsequent patient outcomes. More specifically, housestaff portrayed a limited ability to address the root causes for poor outcomes, such as readmission.
DISCUSSION
Housestaff physicians experienced 5 quality‐limiting factors that collectively created and reinforced a practice environment in which patients and patient outcomes after discharge remain largely out of sight, out of mind. In this environment, discharge was often viewed as a summative event that signaled the conclusion of care in one setting rather than a transition in care from one setting to another. Paradoxically, this environment was apparent despite the values and goals participants described for providing high‐quality discharge care, working within multidisciplinary discharge teams, and reducing readmissions.
The degree to which housestaff were focused on the hospital portion of patients' care, and viewed postdischarge care as beyond their scope or responsibility, was striking. The tight boundary they drew between hospital and post‐hospital care reflected the demanding workload in the hospital, the lack of data feedback about patients post‐hospitalization, and professional norms and expectations about housestaff responsibilities. Downstream effects of this tight boundary may result in confusion for patients and family about who to contact in case of postdischarge complications, and may ultimately catalyze higher emergency department use and readmissions.26 Efforts to redefine inpatient physician responsibilities, as providing patient care until management has been successfully transferred to a community‐based provider, may be necessary to ensure adequate postdischarge continuity of care.27
We also found that housestaff physicians reported marked variation in discharge practices across different hospitals and training settings, across different teams within hospitals, and across individual attending physicians. Although guidelines for discharge care currently endorsed by the National Quality Forum28 and others4, 27, 29 provide excellent templates, our findings suggest that the implementation of these standards at the hospital and physician level is limited. Furthermore, while existing single‐site interventions to standardize various discharge practices provide a foundational evidence base for high‐quality discharge care,2932 our study adds insight into the individual and institutional barriers that prevent diffusion of these practices to other hospitals.
Finally, the lack of coordination within discharge teams, described by housestaff physicians in our study, also suggests a need for improved leadership in the hospital overall and at the level of the discharge team. Studies of high‐performing hospitals have shown that top‐level institutional support is a necessary substrate for the creation and maintenance of high‐performance teamwork.33 At the level of the discharge team, creating a culture of high‐quality discharge care will require greater focus on defining team‐member roles and responsibilities. At the individual level, changes in physician training to provide discharge care are critical, especially since practice patterns learned in residency may predict quality of care over physicians' careers.34 Recent examples of curricular innovations for discharge care are encouraging,35 but more research on how physicians learn about discharge care and related systems‐based practice, learning, and improvement is needed to enable changes on a national scale.
Our findings should be interpreted in light of several limitations. First, we recruited housestaff from 1 specialty at 2 large training programs; experiences of housestaff in other specialties and other training programs may differ. Second, we cannot quantify the frequency of specific discharge procedures or outcomes described by our participants, as this was beyond the scope of our qualitative approach. Nevertheless, our aim was to explore the range of quality‐limiting factors, rather than their prevalence, and this in‐depth analysis has extended previous work by identifying factors that may influence the quality of discharge care. Third, social desirability bias36 could have led participants to exaggerate or minimize aspects of quality‐limiting factors identified in this study. To minimize this potential bias, we included specific prompts for both negative and positive aspects of providing discharge care in our interview guide. Finally, our analytic decisions to over‐sample for interns, and to not include physicians who have completed training (eg, hospitalists), may introduce bias towards inexperience; however, our objective was to study the culture of discharge care at teaching hospitals, and our sample reflects the distribution of labor for tasks of discharge care at such institutions. Future research should address important questions raised by this study about the role of attending physicians in discharge care at teaching and non‐teaching hospitals.
Improving the quality of discharge care is an important step to improving overall outcomes of hospitalization, including reduced adverse events and unnecessary admissions. Our study suggests important quality‐limiting factors embedded in the norms for discharge care at teaching hospitals. These factors are unlikely to change without interventions at multiple levels of hospitals, discharge teams, and individual providers. Targeted interventions to change these practices will be necessary to achieve higher overall quality of care for hospitalized patients at teaching hospitals.
- Rehospitalizations among patients in the Medicare fee‐for‐service program.N Engl J Med.2009;360:1418–1428. , , .
- Hospital readmission as an accountability measure.JAMA.2011;305(5):504–505. , .
- Hospital to Home (H2H) Initiative. Available at: http://www.h2hquality.org/. Accessed May 15,2011.
- Better Outcomes for Older adults through Safe Transitions (Project BOOST). Available at: http://www.hospitalmedicine.org/boost. Accessed May 18,2011.
- The association between the quality of inpatient care and early readmission.Ann Intern Med.1995;122(6):415–421. , , , , .
- The association between the quality of inpatient care and early readmission: a meta‐analysis of the evidence.Med Care.1997;35(10):1044–1059. , , , , .
- Hospital readmissions as a measure of quality of health care: advantages and limitations.Arch Intern Med.2000;160(8):1074–1081. , .
- The hospital discharge: a review of a high risk care transition with highlights of a reengineered discharge process.J Patient Saf.2007;3:97–106. , , .
- Transitional care of older adults hospitalized with heart failure: a randomized, controlled trial.J Am Geriatr Soc.2004;52(5):675–684. , , , et al.
- Comprehensive discharge planning with postdischarge support for older patients with congestive heart failure: a meta‐analysis.JAMA.2004;291:1358–1367. , , , , , .
- Improving the quality of discharge communication with an educational intervention.Pediatrics.2010;126(4):734–739. , , , , , .
- Improving transitions of care at hospital discharge—implications for pediatric hospitalists and primary care providers.J Healthc Qual.2010;32(5):51–60. , , , et al.
- Deficits in communication and information transfer between hospital‐based and primary care physicians: implications for patient safety and continuity of care.JAMA.2007;297:831–841. , , , et al.
- The impact of resident duty hour reform on hospital readmission rates among Medicare beneficiaries.J Gen Intern Med.2011;26(4):405–411. , , , et al.
- American Association of Medical Colleges. What Roles Do Teaching Hospitals Fullfill? Available at: http://www.aamc.org/about/teachhosp_facts1.pdf. Accessed December 15,2009.
- Qualitative data analysis for health services research: developing taxonomy, themes, and theory.Health Serv Res.2007;42(4):1758–1772. , , .
- Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research.BMJ.1995;311(6996):42–45. , .
- Qualitative Research and Evaluation Methods.Thousand Oaks, CA:Sage Publications;2002. .
- Consequences of inadequate sign‐out for patient care.Arch Intern Med.2008;168(16):1755–1760. , , , , .
- What are covering doctors told about their patients? Analysis of sign‐out among internal medicine house staff.Qual Saf Health Care.2009;18:248–255. , , , et al.
- Getting by: underuse of interpreters by resident physicians.J Gen Intern Med.2008;24(2):256–262. . , , , , .
- The significance of saturation.Qual Health Res.1995;5(2):147–149. .
- The Discovery of Grounded Theory: Strategies for Qualitative Research.Chicago, IL:Aldine;1967. , .
- Doing Qualitative Research (Research Methods for Primary Care).Thousand Oaks, CA: Sage;1999:33–46. , , eds.
- Qualitative Data Analysis.2nd ed.Thousand Oaks, CA: Sage;1994. , .
- Reduction of 30‐day post‐discharge hospital readmission or ED visit rates in high‐risk elderly medical patients through delivery of a targeted care bundle.J Hosp Med.2009;4:211–218. , , , et al.
- Transitions of Care Consensus Policy Statement American College of Physicians–Society of General Internal Medicine–Society of Hospital Medicine–American Geriatrics Society–American College of Emergency Physicians–Society of Academic Emergency Medicine.J Gen Intern Med.2009;24(8):971–976. , , , et al.
- Reengineering hospital discharge: a protocol to improve patient safety, reduce costs, and boost patient satisfaction.Am J Med Qual.2009;24(4):344–346. .
- Assessing the quality of preparation for post‐hospital care from the patient's perspective: the care transitions measure.Med Care.2005;43(3):246–255. , , .
- Hospital discharge documentation and risk of rehospitalisation.BMJ Qual Saf.2011;20(9):773–778. , , , et al.
- Effect of standardized electronic discharge instructions on post‐discharge hospital utilization.J Gen Intern Med.2011;26(7):718–723. , , , , .
- Patient safety concerns arising from test results that return after hospital discharge.Ann Intern Med.2005;143(2):121–128. , , , et al.
- What distinguishes top‐performing hospitals in acute myocardial infarction mortality rates? A qualitative study.Ann Intern Med.2011;154(6):384–390. , , , et al.
- Evaluating obstetrical residency programs using patient outcomes.JAMA.2009;302(12):1277–1283. , , , , .
- Creating a better discharge summary: improvement in quality and timeliness using an electronic discharge summary.J Hosp Med.2009;4:219–225. , , , et al.
- Thinking About Answers: The Application of Cognitive Processes to Survey Methodology.San Francisco, CA:Jossey‐Bass;1996. , , .
- Rehospitalizations among patients in the Medicare fee‐for‐service program.N Engl J Med.2009;360:1418–1428. , , .
- Hospital readmission as an accountability measure.JAMA.2011;305(5):504–505. , .
- Hospital to Home (H2H) Initiative. Available at: http://www.h2hquality.org/. Accessed May 15,2011.
- Better Outcomes for Older adults through Safe Transitions (Project BOOST). Available at: http://www.hospitalmedicine.org/boost. Accessed May 18,2011.
- The association between the quality of inpatient care and early readmission.Ann Intern Med.1995;122(6):415–421. , , , , .
- The association between the quality of inpatient care and early readmission: a meta‐analysis of the evidence.Med Care.1997;35(10):1044–1059. , , , , .
- Hospital readmissions as a measure of quality of health care: advantages and limitations.Arch Intern Med.2000;160(8):1074–1081. , .
- The hospital discharge: a review of a high risk care transition with highlights of a reengineered discharge process.J Patient Saf.2007;3:97–106. , , .
- Transitional care of older adults hospitalized with heart failure: a randomized, controlled trial.J Am Geriatr Soc.2004;52(5):675–684. , , , et al.
- Comprehensive discharge planning with postdischarge support for older patients with congestive heart failure: a meta‐analysis.JAMA.2004;291:1358–1367. , , , , , .
- Improving the quality of discharge communication with an educational intervention.Pediatrics.2010;126(4):734–739. , , , , , .
- Improving transitions of care at hospital discharge—implications for pediatric hospitalists and primary care providers.J Healthc Qual.2010;32(5):51–60. , , , et al.
- Deficits in communication and information transfer between hospital‐based and primary care physicians: implications for patient safety and continuity of care.JAMA.2007;297:831–841. , , , et al.
- The impact of resident duty hour reform on hospital readmission rates among Medicare beneficiaries.J Gen Intern Med.2011;26(4):405–411. , , , et al.
- American Association of Medical Colleges. What Roles Do Teaching Hospitals Fullfill? Available at: http://www.aamc.org/about/teachhosp_facts1.pdf. Accessed December 15,2009.
- Qualitative data analysis for health services research: developing taxonomy, themes, and theory.Health Serv Res.2007;42(4):1758–1772. , , .
- Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research.BMJ.1995;311(6996):42–45. , .
- Qualitative Research and Evaluation Methods.Thousand Oaks, CA:Sage Publications;2002. .
- Consequences of inadequate sign‐out for patient care.Arch Intern Med.2008;168(16):1755–1760. , , , , .
- What are covering doctors told about their patients? Analysis of sign‐out among internal medicine house staff.Qual Saf Health Care.2009;18:248–255. , , , et al.
- Getting by: underuse of interpreters by resident physicians.J Gen Intern Med.2008;24(2):256–262. . , , , , .
- The significance of saturation.Qual Health Res.1995;5(2):147–149. .
- The Discovery of Grounded Theory: Strategies for Qualitative Research.Chicago, IL:Aldine;1967. , .
- Doing Qualitative Research (Research Methods for Primary Care).Thousand Oaks, CA: Sage;1999:33–46. , , eds.
- Qualitative Data Analysis.2nd ed.Thousand Oaks, CA: Sage;1994. , .
- Reduction of 30‐day post‐discharge hospital readmission or ED visit rates in high‐risk elderly medical patients through delivery of a targeted care bundle.J Hosp Med.2009;4:211–218. , , , et al.
- Transitions of Care Consensus Policy Statement American College of Physicians–Society of General Internal Medicine–Society of Hospital Medicine–American Geriatrics Society–American College of Emergency Physicians–Society of Academic Emergency Medicine.J Gen Intern Med.2009;24(8):971–976. , , , et al.
- Reengineering hospital discharge: a protocol to improve patient safety, reduce costs, and boost patient satisfaction.Am J Med Qual.2009;24(4):344–346. .
- Assessing the quality of preparation for post‐hospital care from the patient's perspective: the care transitions measure.Med Care.2005;43(3):246–255. , , .
- Hospital discharge documentation and risk of rehospitalisation.BMJ Qual Saf.2011;20(9):773–778. , , , et al.
- Effect of standardized electronic discharge instructions on post‐discharge hospital utilization.J Gen Intern Med.2011;26(7):718–723. , , , , .
- Patient safety concerns arising from test results that return after hospital discharge.Ann Intern Med.2005;143(2):121–128. , , , et al.
- What distinguishes top‐performing hospitals in acute myocardial infarction mortality rates? A qualitative study.Ann Intern Med.2011;154(6):384–390. , , , et al.
- Evaluating obstetrical residency programs using patient outcomes.JAMA.2009;302(12):1277–1283. , , , , .
- Creating a better discharge summary: improvement in quality and timeliness using an electronic discharge summary.J Hosp Med.2009;4:219–225. , , , et al.
- Thinking About Answers: The Application of Cognitive Processes to Survey Methodology.San Francisco, CA:Jossey‐Bass;1996. , , .
Copyright © 2012 Society of Hospital Medicine
Patient Dissatisfaction
The United States spends more money per capita on healthcare than any other industrialized nation,1 yet patients are the least satisfied with their care.2 Patient satisfaction is associated in both cross‐sectional3 and longitudinal studies4 with improved physical and mental health outcomes. Conversely, dissatisfaction with care hampers future medical interactions, prevents sharing of information, and impairs the building of trust.5 The increasing recognition that a patient's experience of care affects patient outcomes has furthered efforts to evaluate satisfaction with care.6, 7
However, patient satisfaction is challenging to define and understand. Even the definition of satisfaction is ambiguous, for to satisfy can mean both to make happy and the lesser, to be adequate. To dissatisfy is to displease or disappoint, but dissatisfaction is not the opposite of satisfaction: qualitative studies give little if any indication that patients evaluate satisfaction on a continuum ranging from dissatisfied at one end to very satisfied at the other.8 Instead, it appears that satisfaction and dissatisfaction are different constructs, such that patients may simultaneously be both satisfied and dissatisfied.9, 10 Patients often express overall satisfaction with a service or encounter while also reporting specific criticisms about its shortcomings.11, 12 Alternatively, consumers may be generally satisfied unless something unpleasant or improper happens.13 Thus, dissatisfaction and satisfaction may require different methods of measurement.
The most common model for measuring patient satisfaction is a quantitative survey of patients' experiences in specific predetermined domains. Of 54 hospital satisfaction surveys in common use, only 11 included patient input in their development,14 casting doubt on the relevance of these attributes to patients' priorities of care. Since it is well recognized that patient expectations influence satisfaction,8, 13, 15 it is important to identify patient expectations and priorities up front. However, these have not been clearly established. Furthermore, focusing purely on satisfaction with particular domains of care may miss the separate but illuminating construct of patient dissatisfaction.
In this study we therefore aim to understand patient dissatisfaction with hospitalization more fully as a means of elucidating implicit expectations for hospital care. Using qualitative techniques, we analyzed a large volume of patient responses to a single open‐ended study question to identify determinants and patterns of patient dissatisfaction.
Methods
Study Design
We conducted a qualitative analysis of telephone survey data obtained from adults recently discharged after an acute care hospitalization. Survey participants were asked five questions, including: If there was one thing we could have done to improve your experience in the hospital, what would it have been? Answers to this open‐ended question were included in this study.
Setting and Participants
The hospital is a 944‐bed, urban academic medical center. Patients or patient representatives were routinely surveyed in a telephone interview conducted by trained hospital staff 1‐5 days after hospital discharge. Calls were attempted to 90% of adult discharged patients, and approximately 50% of them were reached. For this study, we included patients who were age 18 or older, spoke English, and were discharged to home from a medical, surgical, gynecology‐oncology, neurology, neurosurgery, or intensive care unit. Of those patients, we randomly selected 10% of those surveyed between July 1, 2007 and June 30, 2008 for inclusion.
Primary Data Analysis
Qualitative data analysis was used to classify patient suggestions. The study team included internal medicine physicians (J.P.M., L.I.H.), a medical student (A.V.L.), and a recent college graduate (C.P.B.). Codes were generated using a mixed inductive and deductive approach by reading and rereading the primary data.16 A set of 100 interview responses were first read individually by three investigators (J.P.M., A.V.L., C.P.B.), after which investigators met to discuss themes and ideas. A preliminary list of coding categories was then generated. Each investigator then assigned these coding categories to additional survey responses in sets of 100. Subsequent meetings were held to refine codes using the constant comparative method.16 Disagreements were resolved by negotiated consensus. The full study group met periodically to review the code structure for logic and breadth. Once thematic saturation was achieved, the entire dataset was recoded by two investigators using the final coding structure. The final coding structure contained 42 unique codes organized into six broader themes. We used descriptive statistics to characterize the coding category results. The score for intercoder reliability was 0.91.
This study was approved by the Yale Human Investigation Committee, which granted a waiver of informed consent.
Results
A total of 976 surveys was randomly selected from 9,764 postdischarge phone interviews completed between July 1, 2007 and June 30, 2008. A total of 56.3% of patients was female. Nearly half the patients were discharged from medical units (Table 1). Of the 976 patients, 439 (45.0%) gave at least one suggestion for improvement, yielding a total of 579 suggestions. Patients also offered numerous positive comments about their care, but these comments were not included in the analysis.
No. | % of Total Surveyed | |
---|---|---|
Total surveys | 976 | |
Male | 427 | 43.7 |
Female | 549 | 56.3 |
Discharge Unit | ||
Medical | 434 | 44.5 |
Surgical | 303 | 31.0 |
Gynecology/Oncology | 103 | 10.6 |
ICU/CCU/Step‐down | 71 | 7.3 |
Neurology/Neurosurgery | 65 | 6.6 |
No suggestions for improvement | 537 | 55.0 |
At least one suggestion for improvement | 439 | 45.0 |
Through qualitative analysis, we assigned suggestions for improvement to six major categories of dissatisfaction: 1) ineptitude, 2) disrespect, 3) prolonged waits, 4) ineffective communication, 5) lack of environmental control, and 6) substandard amenities. We considered the inverse of these problems to represent six implicit expectations of good hospital care: 1) safety, 2) treatment with respect and dignity, 3) prompt and efficient care, 4) successful exchange of information, 5) environmental autonomy and control, and 6) high‐quality amenities (Table 2). The number of patient suggestions related to each domain is detailed in Table 3.
Domain of Dissatisfaction | Implicit Expectations | Example |
---|---|---|
Ineptitude | Safety | The only thing was that when I was getting ready to get discharged, one of Dr. H*'s associates came in and said, We have to readmit you for a further procedure. I said, Well, that's strange because Dr. H* put in a stent yesterday, and I'm supposed to leave today. Well, he checked, and he had the wrong guy. I'm glad I said something or else they probably would have hauled me off. |
Disrespect | Treatment with respect and dignity | Transport was rude due to me being a heavy person. They were saying they didn't want to move me and snickering. |
Prolonged waits | Prompt and efficient care | I called for someone because I had to use the bathroom really bad, but I had those things stuck to my legs and needed help walking to the bathroom but no one came. Well, I had to go so bad that I had a panic attack. Then all these people came rushing in to help. I felt so embarrassed. |
Ineffective communication | Successful exchange of information | There were a few days that [were] a little confusing to me. I didn't know if I was going to have surgery or go home. The communication wasn't that great. |
Lack of environmental control | Environmental autonomy and control | I was put in a room with a man who had many issues. He was loud and yelling all night. It was a very disturbing experience. |
Substandard amenities | High‐quality amenities | In that ICU they should put a TV on the ceiling for when you're lying flat on your back looking at the ceiling tiles for 4 days. |
Domain of Dissatisfaction | No. (N = 579 suggestionsa) | % of Total Surveyed | % Within Domain |
---|---|---|---|
| |||
Perceived ineptitude | 75 | 7.7 | 100 |
Adverse events | 18 | 1.8 | 24.0 |
Cleanliness | 36 | 3.7 | 48.0 |
Perceived lack of knowledge/skill | 12 | 1.2 | 16.0 |
Rushed out | 9 | 0.9 | 12.0 |
Disrespect | 59 | 6.0 | 100 |
Unprofessional staff behavior | 55 | 5.6 | 93.2 |
Lack of privacy/confidentiality | 4 | 0.4 | 6.8 |
Prolonged waits | 154 | 15.8 | 100 |
Response to call bell | |||
Bathing/toileting/distress | 24 | 2.5 | 15.6 |
General | 41 | 4.2 | 26.6 |
Wait for physician | 12 | 1.2 | 7.8 |
Wait for admission bed | 29 | 3.0 | 18.8 |
Wait for transport | 16 | 1.6 | 10.4 |
Wait for food | 7 | 0.7 | 4.6 |
Wait for medication | 11 | 1.1 | 7.1 |
Wait for diagnostic test/procedures | 6 | 0.6 | 3.9 |
Wait for discharge | 8 | 0.8 | 5.2 |
Ineffective communication | 72 | 7.4 | 100 |
Communication with patients | 33 | 3.4 | 45.8 |
Communication with family | 3 | 0.3 | 4.2 |
Translation | 2 | 0.2 | 2.8 |
Communication between providers | 13 | 1.3 | 18.1 |
Coordination of care (inpatient) | 11 | 1.1 | 15.3 |
Medication reconciliation | 5 | 0.5 | 6.9 |
Continuity inpatient to outpatient | 5 | 0.5 | 6.9 |
Lack of environmental control | 152 | 15.6 | 100 |
Physical environment | |||
Roommates | 38 | 3.9 | 25.0 |
Noise | 24 | 2.5 | 15.8 |
Temperature | 12 | 1.2 | 7.9 |
Smell | 1 | 0.1 | 0.7 |
Interruption by staff | 15 | 1.5 | 9.9 |
Lighting | 2 | 0.2 | 1.3 |
Chaos/hectic | 4 | 0.4 | 2.6 |
Shorter Stay | 8 | 0.8 | 5.3 |
General | 3 | 0.3 | 2.0 |
Facilities | |||
Pain control | 10 | 1.0 | 6.6 |
Painful procedures | 17 | 1.7 | 11.2 |
Facilities | |||
Bathrooms | 7 | 0.7 | 4.6 |
Maintenance response | 5 | 0.5 | 3.3 |
Traffic/parking | 6 | 0.6 | 3.9 |
Substandard amenities | 67 | 6.9 | 100 |
Food quality | 26 | 2.7 | 38.8 |
Food variety | 5 | 0.5 | 7.5 |
Food service | 16 | 1.6 | 23.9 |
TV | 8 | 0.8 | 11.9 |
Beds | 8 | 0.8 | 11.9 |
Gowns | 4 | 0.4 | 6.0 |
Ineptitude
A total of 7.7% of interviewed patients reported experiencing a situation that made them feel unsafe. Dissatisfaction with safety included adverse events or near misses, uncleanliness, and a perceived lack of knowledge or skill. The implicit expectation that emerged from this domain was that the hospital would be safe, and that medical staff would be knowledgeable and skillful.
Adverse events or near misses were experienced in several areas, including diet, medication administration, patient identification, and equipment. Patients were particularly troubled when they or a family member caught the error:
There was one male nurse in training, C*, who was about to give my mother an injection. I asked what he was doing because she was about to go into surgery. He said he thought she was going home. He looked at the chart again and it turns out he was holding her roommate's chart. I don't know what would have happened if I wasn't there.
Dissatisfaction with the cleanliness of the hospital environment was also frequently expressed as a safety concern:
The rooms are dirtyThe floors are dirty. They don't sweep unless you ask them to. It took three different people to come and clean the bathroom right. I have to come back for surgery and I'm scared to death with all that bacteria and uncleanliness.
In this category, patients also described care by not too knowledgeable trainees or other staff as a safety hazard.
Disrespect
A total of 6.0% of surveyed patients suggested improvements that reflected disrespectful treatment, including poor work ethic, lack of warmth, rudeness, and a lack of attention to privacy and confidentiality. This type of dissatisfaction suggested an implicit expectation for treatment with respect and dignity that was clearly distinct from the expectation of technical quality:
[Hospital name] has always been like [this] since I started going there in 1982. They're very good technically but their bedside manner kind of sucks. You survive but you don't walk away with a warm fuzzy feeling.
Underprivileged patients were particularly sensitive to the need for respect:
I feel like the doctor that saw me that last night there was trying to get me out of there as fast as possible, saying not in so many words that it was because I don't have any insurance. I just feel like they treated me like an animal.
Violations of privacy and confidentiality were not only perceived as disrespectful, but also as a direct impediment to high‐quality care:
In the ER, I didn't like that I had no privacy especially talking with the doctor because I was in the hallway. I didn't have any privacy therefore I wasn't completely truthful with the doctor because everyone could hear.
Prolonged Waits
A total of 15.8% of patients noted dissatisfaction with wait times in the hospital. Waits for admission, transport, or discharge were frequently cited as anxiety‐provoking or frustrating:
The ER wait is too long. I was there from 8:00 AM to 2:00 AM the next day. I was there the whole day and night. When someone is in pain, they just want to be taken care of, not waiting around.
Waits related to receiving patient care, for example the inability to access nurses or physicians, more often caused feelings of fear and abandonment:
Every patient is different, I understand, but when you're there at night it can be a little scary. I was not only scared but in pain. The nurse tried to get a hold of the doctor that was on call, but the doctor took hours to respond. That was very scary.
It was also distressing to patients to watch roommates experience a delay in help for urgent needs:
The lady next to me was an elderly woman with a brace on her neck, and she couldn't speak very well. She had diarrhea at night and she would ask for a bedpan. The nurses would take forever bringing it to her. I just think when there are elderly people they should be more attentive to them because they tend to not be as vocal, you know?
Together, these comments represented an implicit expectation for prompt and efficient care.
Ineffective Communication
Communication during hospitalization was a source of dissatisfaction in 7.4% of surveyed patients. Communication failures occurred in several areas. Most common was the ineffective transfer of medical information to patients:
For days I thought I was having surgery on Friday. So all that day I ate and drank nothing and got prepped for surgery. Finally later that night I was told I was going to have it on Saturday. Saturday comes and still nothing. I never saw a surgeon or talked to anyone. Then later after that I was told I'm not having the surgery. That was the most frustrating thing.
Patients were also dissatisfied with their ability to communicate with their doctors:
I was sent home on a Friday and was sent right back on Friday night because my blood count was low and I ended up needing a blood transfusion. I tried to tell them this but they didn't listen. They need to listen to the patients.
Failed communication between care providers in the hospital was a third inadequacy noted by patients:
The only problem I had was all the different doctors coming in and out. There's so many that it confuses the patient, and a lot of them would contradict each other. One doctor said I could go home and another doctor said, No, you need to stay.
Finally, patients were dissatisfied when there was ineffective communication between inpatient and outpatient providers.
They said the VNA [Visiting Nurse Association] is supposed to come. The nurse hasn't come to see me and she hasn't called. My daughter and I have been waiting.
Thus, patients had an implicit expectation for effective communication between all parties in the hospital and were dissatisfied when any type of communication was inadequate.
Lack of Environmental Control
A total of 15.4% of surveyed patients reported dissatisfaction with the inability to control the physical environment. The inability to control noise levels, roommate behavior, temperature, smells, pain, lighting, staff interruptions, food service, smoking, and even humidity were all anxiety‐producing for different patients. The feeling of being imposed upon by an uncomfortable physical environment also extended to hospital facilities such as inaccessible bathrooms, traffic, and parking. Dissatisfaction with rooming arrangements was common:
I was in a triple room and one of my roommates had at least six visitors in the room at a time every day including two infant twins. Someone really should have said something about that. It became very disturbing, and I even left a day early because of that.
An expectation for quiet, especially during the night, was also repeatedly expressed:
The night shift could have been more considerate of people trying to rest. There was a lot of noise and bangs. I know people have to laugh and have fun but it could have been a little more quiet.
Related was the inability to control interruptions by staff members:
It's hard enough to get sleep, but then those blood suckers come in the middle of the night.
This category of dissatisfaction reflected an implicit expectation for autonomy and control over the environment so that it was conducive to rest and healing.
Substandard Amenities
A total of 6.9% of surveyed patients suggested improvements to amenities such as food, bedding, gowns, and television. Moving beyond the expectation of having peaceful surroundings, these comments reflected an expectation of a well‐appointed hospital environment with high‐quality amenities. A typical example was this comment about the food and service:
You never get what you order from the kitchen. Your tray either has something missing from it or it's the wrong tray or not the right diet. It's very frustrating and hard to get the orders the way you want.
Discussion
We analyzed 439 patient suggestions for improving hospital care and found that dissatisfaction resulted from six categories of negative experiences: 1) ineptitude, 2) disrespect, 3) prolonged wait times, 4) ineffective communication, 5) lack of environmental control, and 6) substandard amenities. These domains represented a corresponding set of implicit patient expectations for: 1) safety, 2) treatment with respect and dignity, 3) prompt and efficient care, 4) successful exchange of information, 5) environmental autonomy and control, and 6) high‐quality amenities. Each of these categories suggests avenues by which both the assessment and provision of hospital care can be made more patient‐centered.
The most widely used patient satisfaction survey in use in the United States today is the Hospital Consumer Assessment of Healthcare Providers & Systems (HCAHPS), which includes eight domains: communication with doctors, communication with nurses, responsiveness of hospital staff, pain management, communication about medicines, discharge information, cleanliness of the hospital environment, and quietness of the hospital environment.17 The dissatisfaction domains found in this study closely overlap the HCAHPS satisfaction domains, but with a few key differences.
First, dissatisfaction with ineptitude in our study encompassed concerns over adverse events and near misses, in addition to the cleanliness of the environment. Other research has shown that dissatisfaction with hospitalization can be predicted by the number of reported problems18 and the perception of receiving incorrect treatment.19 While elaborate methods have been devised to assess and compare the hospital quality and safety, patient satisfaction surveys including the HCAHPS survey often fail to ask patients directly about their perceptions of safety. In fact, this study and others20, 21 show that patients are able to recognize adverse events during hospitalization. Patient report may be a useful adjunct to other methods of adverse event case finding and outcomes reporting.
Second, while HCAHPS and others identify warmth, courtesy, concern, and respect as dimensions of patient‐centered care,14, 17, 22, 23 the ability of quantitative satisfaction surveys to capture the experience of disrespectful treatment may be limited, especially during hospitalization. Most respondents who commented on feeling disrespected identified only a single encounter, which can be masked by otherwise satisfying interactions with numerous care providers. Directly asking patients whether any experience during hospitalization caused them to feel disrespected, and allowing room for explanation, might more efficiently identify problem areas. This is particularly important because even one episode of disrespectful treatment, particularly when perceived to be racially motivated, increases the likelihood of not following a doctor's advice or putting off care.24
Third, HCAHPS emphasizes two aspects of communication: that between patients and doctors, and that between patients and nurses. Our patients confirmed that these are important, but they also noted a third dimension of communication contributing to dissatisfaction: provider‐provider communication. Communication and coordination failures among providers are key contributors to adverse events or near misses,2528 but their influence on patient satisfaction has not been widely assessed. Furthermore, patient input is rarely utilized to identify poor interprovider communication. Our study suggests that, just as patients can identify adverse events, they are also able to recognize poor provider‐provider communication.
Patients' reports of dissatisfying events also highlight areas in which small changes in hospital practice might greatly improve the patient experience. For instance, concerns over environment, food, sleep, hygiene, and pain appeared to be representative of a broader dissatisfaction with loss of autonomy and control. Hospitalized patients are often obliged to room with strangers, are subject to noise and interruptions, and cede control of their medication management at a time when they are feeling particularly vulnerable. The importance of this lack of autonomy to patients suggests a variety of small interventions that could improve satisfaction, such as individual control of noise and temperature, a visible commitment to a quiet hospital environment, and minimized interruptions and sleep disturbance.2932 Single‐occupancy hospital rooms have been associated with lower rates of nosocomial infection, medication errors, and patient stress, as well as increased privacy, rest, visitor involvement, and doctor‐patient communication.33, 34 The most sophisticated intervention, acuity‐adaptable private hospital rooms, allows hospitals to maintain patients in the same private hospital room during an entire admission, regardless of changes to level of acuity.35
In‐depth analysis of suggestions for improvement, as gathered by telephone surveys of recently discharged patients, was a particularly well‐suited approach to identifying explicit expectations for care that were violated by dissatisfying incidents. When allowed to express dissatisfaction in terms of suggestions for improvement, patients talked freely about specific dissatisfying experiences. Using telephone interviews allowed a large volume of patient responses to be included, unlike smaller focus groups. Our study was oral and did not rely on the literacy level of patients. Additionally, the open‐ended nature of questioning avoided some of the usual pitfalls of satisfaction surveys. We did not rely on predetermined satisfaction categories or presume the inherent value of particular attributes of care. Nonetheless, our study does have important limitations.
Patient perceptions were not compared with chart data or clinician report. Caregivers were allowed to participate in lieu of patients, which may have reduced identification of some dissatisfying events. Likewise, patients discharged to nursing homes or who were not English or Spanish speaking were excluded and may have had different dissatisfying experiences. Interviews were brief and dissatisfying events were not explored in detail. Although nearly half of respondents reported dissatisfying events, some patients may have been reluctant to criticize their care directly to a hospital representative. Finally, patients generally confined their comments to one or two dissatisfying events, even though there may have been others. We therefore cannot draw any conclusions about the relative frequency of dissatisfying events by domain.
Conclusions
All hospitalized patients bring expectations for their hospital experience. While specific expectations vary between patients, expectations for: 1) safety, 2) treatment with respect and dignity, 3) prompt and efficient care, 4) successful exchange of information, 5) environmental autonomy and control, and 6) high‐quality amenities were found in this study to encompass core expectations for hospitalization. It may be useful to ensure that postdischarge surveys explicitly address these expectations. Efforts to address and manage these core expectations of hospital care may help to reduce patient dissatisfaction with hospitalization and improve the delivery and quality of hospital care.
- Multinational Comparisons of Health Systems Data, 2006.Washington, DC:The Commonwealth Fund;2007. , .
- Toward higher‐performance health systems: Adults' health care experiences in seven countries, 2007.Health Aff.2007;26:w717–734. , , , , , .
- Patient satisfaction and its relationship with clinical quality and inpatient mortality in acute myocardial infarction.Circ Cardiovasc Qual Outcomes.2010;3:188–195. , , , et al.
- A longitudinal analysis of patient satisfaction and subsequent quality of life in Hong Kong Chinese breast and nasopharyngeal cancer patients.Med Care.2009;47:875–881. , .
- Understanding dissatisfied users: developing a framework for comprehending criticisms of health care work.J Adv Nurs.1999;30:723–731. .
- Patient satisfaction: a review of issues and concepts.Soc Sci Med.1997;45:1829–1843. , .
- Institute of Medicine.Crossing the Quality Chasm: A New Health System for the 21st Century.Washington, DC:National Academy Press;2001.
- Patient satisfaction: a valid concept?Soc Sci Med.1994;38:509–516. .
- Exploring the meaning of ‘dissatisfaction’ with health care: the importance of ‘personal identity threat’.Sociol Health Illn.1999;21:95–123. .
- Pathways, pyramids and icebergs? Mapping the links between dissatisfaction and complaints.Sociol Health Illn.1998;20:825–847. , .
- Convergence and divergence: assessing criteria of consumer satisfaction across general practice, dental and hospital care settings.Soc Sci Med.1991;33:707–716. , .
- National survey of hospital patients [see comment].BMJ.1994;309:1542–1546. , , , , , .
- The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature.Health Technol Assess.2002;6:1–244. , , , et al.
- Review of the literature on survey instruments used to collect data on hospital patients' perceptions of care.Health Serv Res.2005;40:1996–2017. , , , .
- Satisfying solutions? A review of some unresolved issues in the measurement of patient satisfaction.J Adv Nurs.1995;22:316–322. , , .
- The Discovery of Grounded Theory: Strategies for Qualitative Research.Chicago, IL:Aldine;1967. , .
- Hospital Consumer Assessment of Healthcare Providers 25:25–36.
- Patient experiences in relation to respondent and health service delivery characteristics: a survey of 26,938 patients attending 62 hospitals throughout Norway.Scand J Public Health.2007;35:70–77. , , , .
- What can hospitalized patients tell us about adverse events? Learning from patient‐reported incidents.J Gen Intern Med.2005;20:830–836. , , , et al.
- A hospitalization from hell: a patient's perspective on quality.Ann Intern Med.2003;138:33–39. .
- Through the Patient's Eyes: Understanding and Promoting Patient‐Centered Care.San Francisco, CA:Jossey‐Bass;1993. , , , .
- What do consumers want to know about the quality of care in hospitals?Health Serv Res.2005;40:2018–2036. , , , , .
- R‐e‐s‐p‐e‐c‐t: patient reports of disrespect in the health care setting and its impact on care.J Fam Pract.2004;53:721–730. , .
- Perceived information needs and communication difficulties of inpatient physicians and nurses.J Am Med Inform Assoc.2002;9(6 suppl 1):S64–S69. , , , , .
- The human factor: the critical importance of effective teamwork and communication in providing safe care.Qual Saf Health Care.2004;13:i85–i90. , , .
- Consequences of inadequate sign‐out for patient care.Arch Intern Med.2008;168:1755–1760. , , , , .
- Dropping the baton: a qualitative analysis of failures during the transition from emergency department to inpatient care.Ann Emerg Med.2009;53:701–710 e704. , , , , , .
- Interactive relationships between hospital patients' noise‐induced stress and other stress with sleep.Heart Lung.2001;30:237–243. , .
- The influence of subjective reactions to noise on health effects of the noise.Environ Int.1996;22:93–104. .
- A novel PACU design for noise reduction.J Perianesth Nurs.2008;23:226–229. .
- The Planetree Model Hospital Project: an example of the patient as partner. (Pacific Presbyterian Medical Center, San Francisco).Hosp Health Serv Admin.1990;35:591–601. , , , .
- Physician‐patient communication in single‐bedded versus four‐bedded hospital rooms.Patient Educ Couns.2008;73:215–219. , , .
- Advantages and disadvantages of single‐versus multiple‐occupancy rooms in acute care environments: a review and analysis of the literature.Environ Behav.2005;37:760–786. , , .
- Impacting patient outcomes through design: acuity adaptable care/universal room design.Crit Care Nurs Q.2006;29:326–341. , .
The United States spends more money per capita on healthcare than any other industrialized nation,1 yet patients are the least satisfied with their care.2 Patient satisfaction is associated in both cross‐sectional3 and longitudinal studies4 with improved physical and mental health outcomes. Conversely, dissatisfaction with care hampers future medical interactions, prevents sharing of information, and impairs the building of trust.5 The increasing recognition that a patient's experience of care affects patient outcomes has furthered efforts to evaluate satisfaction with care.6, 7
However, patient satisfaction is challenging to define and understand. Even the definition of satisfaction is ambiguous, for to satisfy can mean both to make happy and the lesser, to be adequate. To dissatisfy is to displease or disappoint, but dissatisfaction is not the opposite of satisfaction: qualitative studies give little if any indication that patients evaluate satisfaction on a continuum ranging from dissatisfied at one end to very satisfied at the other.8 Instead, it appears that satisfaction and dissatisfaction are different constructs, such that patients may simultaneously be both satisfied and dissatisfied.9, 10 Patients often express overall satisfaction with a service or encounter while also reporting specific criticisms about its shortcomings.11, 12 Alternatively, consumers may be generally satisfied unless something unpleasant or improper happens.13 Thus, dissatisfaction and satisfaction may require different methods of measurement.
The most common model for measuring patient satisfaction is a quantitative survey of patients' experiences in specific predetermined domains. Of 54 hospital satisfaction surveys in common use, only 11 included patient input in their development,14 casting doubt on the relevance of these attributes to patients' priorities of care. Since it is well recognized that patient expectations influence satisfaction,8, 13, 15 it is important to identify patient expectations and priorities up front. However, these have not been clearly established. Furthermore, focusing purely on satisfaction with particular domains of care may miss the separate but illuminating construct of patient dissatisfaction.
In this study we therefore aim to understand patient dissatisfaction with hospitalization more fully as a means of elucidating implicit expectations for hospital care. Using qualitative techniques, we analyzed a large volume of patient responses to a single open‐ended study question to identify determinants and patterns of patient dissatisfaction.
Methods
Study Design
We conducted a qualitative analysis of telephone survey data obtained from adults recently discharged after an acute care hospitalization. Survey participants were asked five questions, including: If there was one thing we could have done to improve your experience in the hospital, what would it have been? Answers to this open‐ended question were included in this study.
Setting and Participants
The hospital is a 944‐bed, urban academic medical center. Patients or patient representatives were routinely surveyed in a telephone interview conducted by trained hospital staff 1‐5 days after hospital discharge. Calls were attempted to 90% of adult discharged patients, and approximately 50% of them were reached. For this study, we included patients who were age 18 or older, spoke English, and were discharged to home from a medical, surgical, gynecology‐oncology, neurology, neurosurgery, or intensive care unit. Of those patients, we randomly selected 10% of those surveyed between July 1, 2007 and June 30, 2008 for inclusion.
Primary Data Analysis
Qualitative data analysis was used to classify patient suggestions. The study team included internal medicine physicians (J.P.M., L.I.H.), a medical student (A.V.L.), and a recent college graduate (C.P.B.). Codes were generated using a mixed inductive and deductive approach by reading and rereading the primary data.16 A set of 100 interview responses were first read individually by three investigators (J.P.M., A.V.L., C.P.B.), after which investigators met to discuss themes and ideas. A preliminary list of coding categories was then generated. Each investigator then assigned these coding categories to additional survey responses in sets of 100. Subsequent meetings were held to refine codes using the constant comparative method.16 Disagreements were resolved by negotiated consensus. The full study group met periodically to review the code structure for logic and breadth. Once thematic saturation was achieved, the entire dataset was recoded by two investigators using the final coding structure. The final coding structure contained 42 unique codes organized into six broader themes. We used descriptive statistics to characterize the coding category results. The score for intercoder reliability was 0.91.
This study was approved by the Yale Human Investigation Committee, which granted a waiver of informed consent.
Results
A total of 976 surveys was randomly selected from 9,764 postdischarge phone interviews completed between July 1, 2007 and June 30, 2008. A total of 56.3% of patients was female. Nearly half the patients were discharged from medical units (Table 1). Of the 976 patients, 439 (45.0%) gave at least one suggestion for improvement, yielding a total of 579 suggestions. Patients also offered numerous positive comments about their care, but these comments were not included in the analysis.
No. | % of Total Surveyed | |
---|---|---|
Total surveys | 976 | |
Male | 427 | 43.7 |
Female | 549 | 56.3 |
Discharge Unit | ||
Medical | 434 | 44.5 |
Surgical | 303 | 31.0 |
Gynecology/Oncology | 103 | 10.6 |
ICU/CCU/Step‐down | 71 | 7.3 |
Neurology/Neurosurgery | 65 | 6.6 |
No suggestions for improvement | 537 | 55.0 |
At least one suggestion for improvement | 439 | 45.0 |
Through qualitative analysis, we assigned suggestions for improvement to six major categories of dissatisfaction: 1) ineptitude, 2) disrespect, 3) prolonged waits, 4) ineffective communication, 5) lack of environmental control, and 6) substandard amenities. We considered the inverse of these problems to represent six implicit expectations of good hospital care: 1) safety, 2) treatment with respect and dignity, 3) prompt and efficient care, 4) successful exchange of information, 5) environmental autonomy and control, and 6) high‐quality amenities (Table 2). The number of patient suggestions related to each domain is detailed in Table 3.
Domain of Dissatisfaction | Implicit Expectations | Example |
---|---|---|
Ineptitude | Safety | The only thing was that when I was getting ready to get discharged, one of Dr. H*'s associates came in and said, We have to readmit you for a further procedure. I said, Well, that's strange because Dr. H* put in a stent yesterday, and I'm supposed to leave today. Well, he checked, and he had the wrong guy. I'm glad I said something or else they probably would have hauled me off. |
Disrespect | Treatment with respect and dignity | Transport was rude due to me being a heavy person. They were saying they didn't want to move me and snickering. |
Prolonged waits | Prompt and efficient care | I called for someone because I had to use the bathroom really bad, but I had those things stuck to my legs and needed help walking to the bathroom but no one came. Well, I had to go so bad that I had a panic attack. Then all these people came rushing in to help. I felt so embarrassed. |
Ineffective communication | Successful exchange of information | There were a few days that [were] a little confusing to me. I didn't know if I was going to have surgery or go home. The communication wasn't that great. |
Lack of environmental control | Environmental autonomy and control | I was put in a room with a man who had many issues. He was loud and yelling all night. It was a very disturbing experience. |
Substandard amenities | High‐quality amenities | In that ICU they should put a TV on the ceiling for when you're lying flat on your back looking at the ceiling tiles for 4 days. |
Domain of Dissatisfaction | No. (N = 579 suggestionsa) | % of Total Surveyed | % Within Domain |
---|---|---|---|
| |||
Perceived ineptitude | 75 | 7.7 | 100 |
Adverse events | 18 | 1.8 | 24.0 |
Cleanliness | 36 | 3.7 | 48.0 |
Perceived lack of knowledge/skill | 12 | 1.2 | 16.0 |
Rushed out | 9 | 0.9 | 12.0 |
Disrespect | 59 | 6.0 | 100 |
Unprofessional staff behavior | 55 | 5.6 | 93.2 |
Lack of privacy/confidentiality | 4 | 0.4 | 6.8 |
Prolonged waits | 154 | 15.8 | 100 |
Response to call bell | |||
Bathing/toileting/distress | 24 | 2.5 | 15.6 |
General | 41 | 4.2 | 26.6 |
Wait for physician | 12 | 1.2 | 7.8 |
Wait for admission bed | 29 | 3.0 | 18.8 |
Wait for transport | 16 | 1.6 | 10.4 |
Wait for food | 7 | 0.7 | 4.6 |
Wait for medication | 11 | 1.1 | 7.1 |
Wait for diagnostic test/procedures | 6 | 0.6 | 3.9 |
Wait for discharge | 8 | 0.8 | 5.2 |
Ineffective communication | 72 | 7.4 | 100 |
Communication with patients | 33 | 3.4 | 45.8 |
Communication with family | 3 | 0.3 | 4.2 |
Translation | 2 | 0.2 | 2.8 |
Communication between providers | 13 | 1.3 | 18.1 |
Coordination of care (inpatient) | 11 | 1.1 | 15.3 |
Medication reconciliation | 5 | 0.5 | 6.9 |
Continuity inpatient to outpatient | 5 | 0.5 | 6.9 |
Lack of environmental control | 152 | 15.6 | 100 |
Physical environment | |||
Roommates | 38 | 3.9 | 25.0 |
Noise | 24 | 2.5 | 15.8 |
Temperature | 12 | 1.2 | 7.9 |
Smell | 1 | 0.1 | 0.7 |
Interruption by staff | 15 | 1.5 | 9.9 |
Lighting | 2 | 0.2 | 1.3 |
Chaos/hectic | 4 | 0.4 | 2.6 |
Shorter Stay | 8 | 0.8 | 5.3 |
General | 3 | 0.3 | 2.0 |
Facilities | |||
Pain control | 10 | 1.0 | 6.6 |
Painful procedures | 17 | 1.7 | 11.2 |
Facilities | |||
Bathrooms | 7 | 0.7 | 4.6 |
Maintenance response | 5 | 0.5 | 3.3 |
Traffic/parking | 6 | 0.6 | 3.9 |
Substandard amenities | 67 | 6.9 | 100 |
Food quality | 26 | 2.7 | 38.8 |
Food variety | 5 | 0.5 | 7.5 |
Food service | 16 | 1.6 | 23.9 |
TV | 8 | 0.8 | 11.9 |
Beds | 8 | 0.8 | 11.9 |
Gowns | 4 | 0.4 | 6.0 |
Ineptitude
A total of 7.7% of interviewed patients reported experiencing a situation that made them feel unsafe. Dissatisfaction with safety included adverse events or near misses, uncleanliness, and a perceived lack of knowledge or skill. The implicit expectation that emerged from this domain was that the hospital would be safe, and that medical staff would be knowledgeable and skillful.
Adverse events or near misses were experienced in several areas, including diet, medication administration, patient identification, and equipment. Patients were particularly troubled when they or a family member caught the error:
There was one male nurse in training, C*, who was about to give my mother an injection. I asked what he was doing because she was about to go into surgery. He said he thought she was going home. He looked at the chart again and it turns out he was holding her roommate's chart. I don't know what would have happened if I wasn't there.
Dissatisfaction with the cleanliness of the hospital environment was also frequently expressed as a safety concern:
The rooms are dirtyThe floors are dirty. They don't sweep unless you ask them to. It took three different people to come and clean the bathroom right. I have to come back for surgery and I'm scared to death with all that bacteria and uncleanliness.
In this category, patients also described care by not too knowledgeable trainees or other staff as a safety hazard.
Disrespect
A total of 6.0% of surveyed patients suggested improvements that reflected disrespectful treatment, including poor work ethic, lack of warmth, rudeness, and a lack of attention to privacy and confidentiality. This type of dissatisfaction suggested an implicit expectation for treatment with respect and dignity that was clearly distinct from the expectation of technical quality:
[Hospital name] has always been like [this] since I started going there in 1982. They're very good technically but their bedside manner kind of sucks. You survive but you don't walk away with a warm fuzzy feeling.
Underprivileged patients were particularly sensitive to the need for respect:
I feel like the doctor that saw me that last night there was trying to get me out of there as fast as possible, saying not in so many words that it was because I don't have any insurance. I just feel like they treated me like an animal.
Violations of privacy and confidentiality were not only perceived as disrespectful, but also as a direct impediment to high‐quality care:
In the ER, I didn't like that I had no privacy especially talking with the doctor because I was in the hallway. I didn't have any privacy therefore I wasn't completely truthful with the doctor because everyone could hear.
Prolonged Waits
A total of 15.8% of patients noted dissatisfaction with wait times in the hospital. Waits for admission, transport, or discharge were frequently cited as anxiety‐provoking or frustrating:
The ER wait is too long. I was there from 8:00 AM to 2:00 AM the next day. I was there the whole day and night. When someone is in pain, they just want to be taken care of, not waiting around.
Waits related to receiving patient care, for example the inability to access nurses or physicians, more often caused feelings of fear and abandonment:
Every patient is different, I understand, but when you're there at night it can be a little scary. I was not only scared but in pain. The nurse tried to get a hold of the doctor that was on call, but the doctor took hours to respond. That was very scary.
It was also distressing to patients to watch roommates experience a delay in help for urgent needs:
The lady next to me was an elderly woman with a brace on her neck, and she couldn't speak very well. She had diarrhea at night and she would ask for a bedpan. The nurses would take forever bringing it to her. I just think when there are elderly people they should be more attentive to them because they tend to not be as vocal, you know?
Together, these comments represented an implicit expectation for prompt and efficient care.
Ineffective Communication
Communication during hospitalization was a source of dissatisfaction in 7.4% of surveyed patients. Communication failures occurred in several areas. Most common was the ineffective transfer of medical information to patients:
For days I thought I was having surgery on Friday. So all that day I ate and drank nothing and got prepped for surgery. Finally later that night I was told I was going to have it on Saturday. Saturday comes and still nothing. I never saw a surgeon or talked to anyone. Then later after that I was told I'm not having the surgery. That was the most frustrating thing.
Patients were also dissatisfied with their ability to communicate with their doctors:
I was sent home on a Friday and was sent right back on Friday night because my blood count was low and I ended up needing a blood transfusion. I tried to tell them this but they didn't listen. They need to listen to the patients.
Failed communication between care providers in the hospital was a third inadequacy noted by patients:
The only problem I had was all the different doctors coming in and out. There's so many that it confuses the patient, and a lot of them would contradict each other. One doctor said I could go home and another doctor said, No, you need to stay.
Finally, patients were dissatisfied when there was ineffective communication between inpatient and outpatient providers.
They said the VNA [Visiting Nurse Association] is supposed to come. The nurse hasn't come to see me and she hasn't called. My daughter and I have been waiting.
Thus, patients had an implicit expectation for effective communication between all parties in the hospital and were dissatisfied when any type of communication was inadequate.
Lack of Environmental Control
A total of 15.4% of surveyed patients reported dissatisfaction with the inability to control the physical environment. The inability to control noise levels, roommate behavior, temperature, smells, pain, lighting, staff interruptions, food service, smoking, and even humidity were all anxiety‐producing for different patients. The feeling of being imposed upon by an uncomfortable physical environment also extended to hospital facilities such as inaccessible bathrooms, traffic, and parking. Dissatisfaction with rooming arrangements was common:
I was in a triple room and one of my roommates had at least six visitors in the room at a time every day including two infant twins. Someone really should have said something about that. It became very disturbing, and I even left a day early because of that.
An expectation for quiet, especially during the night, was also repeatedly expressed:
The night shift could have been more considerate of people trying to rest. There was a lot of noise and bangs. I know people have to laugh and have fun but it could have been a little more quiet.
Related was the inability to control interruptions by staff members:
It's hard enough to get sleep, but then those blood suckers come in the middle of the night.
This category of dissatisfaction reflected an implicit expectation for autonomy and control over the environment so that it was conducive to rest and healing.
Substandard Amenities
A total of 6.9% of surveyed patients suggested improvements to amenities such as food, bedding, gowns, and television. Moving beyond the expectation of having peaceful surroundings, these comments reflected an expectation of a well‐appointed hospital environment with high‐quality amenities. A typical example was this comment about the food and service:
You never get what you order from the kitchen. Your tray either has something missing from it or it's the wrong tray or not the right diet. It's very frustrating and hard to get the orders the way you want.
Discussion
We analyzed 439 patient suggestions for improving hospital care and found that dissatisfaction resulted from six categories of negative experiences: 1) ineptitude, 2) disrespect, 3) prolonged wait times, 4) ineffective communication, 5) lack of environmental control, and 6) substandard amenities. These domains represented a corresponding set of implicit patient expectations for: 1) safety, 2) treatment with respect and dignity, 3) prompt and efficient care, 4) successful exchange of information, 5) environmental autonomy and control, and 6) high‐quality amenities. Each of these categories suggests avenues by which both the assessment and provision of hospital care can be made more patient‐centered.
The most widely used patient satisfaction survey in use in the United States today is the Hospital Consumer Assessment of Healthcare Providers & Systems (HCAHPS), which includes eight domains: communication with doctors, communication with nurses, responsiveness of hospital staff, pain management, communication about medicines, discharge information, cleanliness of the hospital environment, and quietness of the hospital environment.17 The dissatisfaction domains found in this study closely overlap the HCAHPS satisfaction domains, but with a few key differences.
First, dissatisfaction with ineptitude in our study encompassed concerns over adverse events and near misses, in addition to the cleanliness of the environment. Other research has shown that dissatisfaction with hospitalization can be predicted by the number of reported problems18 and the perception of receiving incorrect treatment.19 While elaborate methods have been devised to assess and compare the hospital quality and safety, patient satisfaction surveys including the HCAHPS survey often fail to ask patients directly about their perceptions of safety. In fact, this study and others20, 21 show that patients are able to recognize adverse events during hospitalization. Patient report may be a useful adjunct to other methods of adverse event case finding and outcomes reporting.
Second, while HCAHPS and others identify warmth, courtesy, concern, and respect as dimensions of patient‐centered care,14, 17, 22, 23 the ability of quantitative satisfaction surveys to capture the experience of disrespectful treatment may be limited, especially during hospitalization. Most respondents who commented on feeling disrespected identified only a single encounter, which can be masked by otherwise satisfying interactions with numerous care providers. Directly asking patients whether any experience during hospitalization caused them to feel disrespected, and allowing room for explanation, might more efficiently identify problem areas. This is particularly important because even one episode of disrespectful treatment, particularly when perceived to be racially motivated, increases the likelihood of not following a doctor's advice or putting off care.24
Third, HCAHPS emphasizes two aspects of communication: that between patients and doctors, and that between patients and nurses. Our patients confirmed that these are important, but they also noted a third dimension of communication contributing to dissatisfaction: provider‐provider communication. Communication and coordination failures among providers are key contributors to adverse events or near misses,2528 but their influence on patient satisfaction has not been widely assessed. Furthermore, patient input is rarely utilized to identify poor interprovider communication. Our study suggests that, just as patients can identify adverse events, they are also able to recognize poor provider‐provider communication.
Patients' reports of dissatisfying events also highlight areas in which small changes in hospital practice might greatly improve the patient experience. For instance, concerns over environment, food, sleep, hygiene, and pain appeared to be representative of a broader dissatisfaction with loss of autonomy and control. Hospitalized patients are often obliged to room with strangers, are subject to noise and interruptions, and cede control of their medication management at a time when they are feeling particularly vulnerable. The importance of this lack of autonomy to patients suggests a variety of small interventions that could improve satisfaction, such as individual control of noise and temperature, a visible commitment to a quiet hospital environment, and minimized interruptions and sleep disturbance.2932 Single‐occupancy hospital rooms have been associated with lower rates of nosocomial infection, medication errors, and patient stress, as well as increased privacy, rest, visitor involvement, and doctor‐patient communication.33, 34 The most sophisticated intervention, acuity‐adaptable private hospital rooms, allows hospitals to maintain patients in the same private hospital room during an entire admission, regardless of changes to level of acuity.35
In‐depth analysis of suggestions for improvement, as gathered by telephone surveys of recently discharged patients, was a particularly well‐suited approach to identifying explicit expectations for care that were violated by dissatisfying incidents. When allowed to express dissatisfaction in terms of suggestions for improvement, patients talked freely about specific dissatisfying experiences. Using telephone interviews allowed a large volume of patient responses to be included, unlike smaller focus groups. Our study was oral and did not rely on the literacy level of patients. Additionally, the open‐ended nature of questioning avoided some of the usual pitfalls of satisfaction surveys. We did not rely on predetermined satisfaction categories or presume the inherent value of particular attributes of care. Nonetheless, our study does have important limitations.
Patient perceptions were not compared with chart data or clinician report. Caregivers were allowed to participate in lieu of patients, which may have reduced identification of some dissatisfying events. Likewise, patients discharged to nursing homes or who were not English or Spanish speaking were excluded and may have had different dissatisfying experiences. Interviews were brief and dissatisfying events were not explored in detail. Although nearly half of respondents reported dissatisfying events, some patients may have been reluctant to criticize their care directly to a hospital representative. Finally, patients generally confined their comments to one or two dissatisfying events, even though there may have been others. We therefore cannot draw any conclusions about the relative frequency of dissatisfying events by domain.
Conclusions
All hospitalized patients bring expectations for their hospital experience. While specific expectations vary between patients, expectations for: 1) safety, 2) treatment with respect and dignity, 3) prompt and efficient care, 4) successful exchange of information, 5) environmental autonomy and control, and 6) high‐quality amenities were found in this study to encompass core expectations for hospitalization. It may be useful to ensure that postdischarge surveys explicitly address these expectations. Efforts to address and manage these core expectations of hospital care may help to reduce patient dissatisfaction with hospitalization and improve the delivery and quality of hospital care.
The United States spends more money per capita on healthcare than any other industrialized nation,1 yet patients are the least satisfied with their care.2 Patient satisfaction is associated in both cross‐sectional3 and longitudinal studies4 with improved physical and mental health outcomes. Conversely, dissatisfaction with care hampers future medical interactions, prevents sharing of information, and impairs the building of trust.5 The increasing recognition that a patient's experience of care affects patient outcomes has furthered efforts to evaluate satisfaction with care.6, 7
However, patient satisfaction is challenging to define and understand. Even the definition of satisfaction is ambiguous, for to satisfy can mean both to make happy and the lesser, to be adequate. To dissatisfy is to displease or disappoint, but dissatisfaction is not the opposite of satisfaction: qualitative studies give little if any indication that patients evaluate satisfaction on a continuum ranging from dissatisfied at one end to very satisfied at the other.8 Instead, it appears that satisfaction and dissatisfaction are different constructs, such that patients may simultaneously be both satisfied and dissatisfied.9, 10 Patients often express overall satisfaction with a service or encounter while also reporting specific criticisms about its shortcomings.11, 12 Alternatively, consumers may be generally satisfied unless something unpleasant or improper happens.13 Thus, dissatisfaction and satisfaction may require different methods of measurement.
The most common model for measuring patient satisfaction is a quantitative survey of patients' experiences in specific predetermined domains. Of 54 hospital satisfaction surveys in common use, only 11 included patient input in their development,14 casting doubt on the relevance of these attributes to patients' priorities of care. Since it is well recognized that patient expectations influence satisfaction,8, 13, 15 it is important to identify patient expectations and priorities up front. However, these have not been clearly established. Furthermore, focusing purely on satisfaction with particular domains of care may miss the separate but illuminating construct of patient dissatisfaction.
In this study we therefore aim to understand patient dissatisfaction with hospitalization more fully as a means of elucidating implicit expectations for hospital care. Using qualitative techniques, we analyzed a large volume of patient responses to a single open‐ended study question to identify determinants and patterns of patient dissatisfaction.
Methods
Study Design
We conducted a qualitative analysis of telephone survey data obtained from adults recently discharged after an acute care hospitalization. Survey participants were asked five questions, including: If there was one thing we could have done to improve your experience in the hospital, what would it have been? Answers to this open‐ended question were included in this study.
Setting and Participants
The hospital is a 944‐bed, urban academic medical center. Patients or patient representatives were routinely surveyed in a telephone interview conducted by trained hospital staff 1‐5 days after hospital discharge. Calls were attempted to 90% of adult discharged patients, and approximately 50% of them were reached. For this study, we included patients who were age 18 or older, spoke English, and were discharged to home from a medical, surgical, gynecology‐oncology, neurology, neurosurgery, or intensive care unit. Of those patients, we randomly selected 10% of those surveyed between July 1, 2007 and June 30, 2008 for inclusion.
Primary Data Analysis
Qualitative data analysis was used to classify patient suggestions. The study team included internal medicine physicians (J.P.M., L.I.H.), a medical student (A.V.L.), and a recent college graduate (C.P.B.). Codes were generated using a mixed inductive and deductive approach by reading and rereading the primary data.16 A set of 100 interview responses were first read individually by three investigators (J.P.M., A.V.L., C.P.B.), after which investigators met to discuss themes and ideas. A preliminary list of coding categories was then generated. Each investigator then assigned these coding categories to additional survey responses in sets of 100. Subsequent meetings were held to refine codes using the constant comparative method.16 Disagreements were resolved by negotiated consensus. The full study group met periodically to review the code structure for logic and breadth. Once thematic saturation was achieved, the entire dataset was recoded by two investigators using the final coding structure. The final coding structure contained 42 unique codes organized into six broader themes. We used descriptive statistics to characterize the coding category results. The score for intercoder reliability was 0.91.
This study was approved by the Yale Human Investigation Committee, which granted a waiver of informed consent.
Results
A total of 976 surveys was randomly selected from 9,764 postdischarge phone interviews completed between July 1, 2007 and June 30, 2008. A total of 56.3% of patients was female. Nearly half the patients were discharged from medical units (Table 1). Of the 976 patients, 439 (45.0%) gave at least one suggestion for improvement, yielding a total of 579 suggestions. Patients also offered numerous positive comments about their care, but these comments were not included in the analysis.
No. | % of Total Surveyed | |
---|---|---|
Total surveys | 976 | |
Male | 427 | 43.7 |
Female | 549 | 56.3 |
Discharge Unit | ||
Medical | 434 | 44.5 |
Surgical | 303 | 31.0 |
Gynecology/Oncology | 103 | 10.6 |
ICU/CCU/Step‐down | 71 | 7.3 |
Neurology/Neurosurgery | 65 | 6.6 |
No suggestions for improvement | 537 | 55.0 |
At least one suggestion for improvement | 439 | 45.0 |
Through qualitative analysis, we assigned suggestions for improvement to six major categories of dissatisfaction: 1) ineptitude, 2) disrespect, 3) prolonged waits, 4) ineffective communication, 5) lack of environmental control, and 6) substandard amenities. We considered the inverse of these problems to represent six implicit expectations of good hospital care: 1) safety, 2) treatment with respect and dignity, 3) prompt and efficient care, 4) successful exchange of information, 5) environmental autonomy and control, and 6) high‐quality amenities (Table 2). The number of patient suggestions related to each domain is detailed in Table 3.
Domain of Dissatisfaction | Implicit Expectations | Example |
---|---|---|
Ineptitude | Safety | The only thing was that when I was getting ready to get discharged, one of Dr. H*'s associates came in and said, We have to readmit you for a further procedure. I said, Well, that's strange because Dr. H* put in a stent yesterday, and I'm supposed to leave today. Well, he checked, and he had the wrong guy. I'm glad I said something or else they probably would have hauled me off. |
Disrespect | Treatment with respect and dignity | Transport was rude due to me being a heavy person. They were saying they didn't want to move me and snickering. |
Prolonged waits | Prompt and efficient care | I called for someone because I had to use the bathroom really bad, but I had those things stuck to my legs and needed help walking to the bathroom but no one came. Well, I had to go so bad that I had a panic attack. Then all these people came rushing in to help. I felt so embarrassed. |
Ineffective communication | Successful exchange of information | There were a few days that [were] a little confusing to me. I didn't know if I was going to have surgery or go home. The communication wasn't that great. |
Lack of environmental control | Environmental autonomy and control | I was put in a room with a man who had many issues. He was loud and yelling all night. It was a very disturbing experience. |
Substandard amenities | High‐quality amenities | In that ICU they should put a TV on the ceiling for when you're lying flat on your back looking at the ceiling tiles for 4 days. |
Domain of Dissatisfaction | No. (N = 579 suggestionsa) | % of Total Surveyed | % Within Domain |
---|---|---|---|
| |||
Perceived ineptitude | 75 | 7.7 | 100 |
Adverse events | 18 | 1.8 | 24.0 |
Cleanliness | 36 | 3.7 | 48.0 |
Perceived lack of knowledge/skill | 12 | 1.2 | 16.0 |
Rushed out | 9 | 0.9 | 12.0 |
Disrespect | 59 | 6.0 | 100 |
Unprofessional staff behavior | 55 | 5.6 | 93.2 |
Lack of privacy/confidentiality | 4 | 0.4 | 6.8 |
Prolonged waits | 154 | 15.8 | 100 |
Response to call bell | |||
Bathing/toileting/distress | 24 | 2.5 | 15.6 |
General | 41 | 4.2 | 26.6 |
Wait for physician | 12 | 1.2 | 7.8 |
Wait for admission bed | 29 | 3.0 | 18.8 |
Wait for transport | 16 | 1.6 | 10.4 |
Wait for food | 7 | 0.7 | 4.6 |
Wait for medication | 11 | 1.1 | 7.1 |
Wait for diagnostic test/procedures | 6 | 0.6 | 3.9 |
Wait for discharge | 8 | 0.8 | 5.2 |
Ineffective communication | 72 | 7.4 | 100 |
Communication with patients | 33 | 3.4 | 45.8 |
Communication with family | 3 | 0.3 | 4.2 |
Translation | 2 | 0.2 | 2.8 |
Communication between providers | 13 | 1.3 | 18.1 |
Coordination of care (inpatient) | 11 | 1.1 | 15.3 |
Medication reconciliation | 5 | 0.5 | 6.9 |
Continuity inpatient to outpatient | 5 | 0.5 | 6.9 |
Lack of environmental control | 152 | 15.6 | 100 |
Physical environment | |||
Roommates | 38 | 3.9 | 25.0 |
Noise | 24 | 2.5 | 15.8 |
Temperature | 12 | 1.2 | 7.9 |
Smell | 1 | 0.1 | 0.7 |
Interruption by staff | 15 | 1.5 | 9.9 |
Lighting | 2 | 0.2 | 1.3 |
Chaos/hectic | 4 | 0.4 | 2.6 |
Shorter Stay | 8 | 0.8 | 5.3 |
General | 3 | 0.3 | 2.0 |
Facilities | |||
Pain control | 10 | 1.0 | 6.6 |
Painful procedures | 17 | 1.7 | 11.2 |
Facilities | |||
Bathrooms | 7 | 0.7 | 4.6 |
Maintenance response | 5 | 0.5 | 3.3 |
Traffic/parking | 6 | 0.6 | 3.9 |
Substandard amenities | 67 | 6.9 | 100 |
Food quality | 26 | 2.7 | 38.8 |
Food variety | 5 | 0.5 | 7.5 |
Food service | 16 | 1.6 | 23.9 |
TV | 8 | 0.8 | 11.9 |
Beds | 8 | 0.8 | 11.9 |
Gowns | 4 | 0.4 | 6.0 |
Ineptitude
A total of 7.7% of interviewed patients reported experiencing a situation that made them feel unsafe. Dissatisfaction with safety included adverse events or near misses, uncleanliness, and a perceived lack of knowledge or skill. The implicit expectation that emerged from this domain was that the hospital would be safe, and that medical staff would be knowledgeable and skillful.
Adverse events or near misses were experienced in several areas, including diet, medication administration, patient identification, and equipment. Patients were particularly troubled when they or a family member caught the error:
There was one male nurse in training, C*, who was about to give my mother an injection. I asked what he was doing because she was about to go into surgery. He said he thought she was going home. He looked at the chart again and it turns out he was holding her roommate's chart. I don't know what would have happened if I wasn't there.
Dissatisfaction with the cleanliness of the hospital environment was also frequently expressed as a safety concern:
The rooms are dirtyThe floors are dirty. They don't sweep unless you ask them to. It took three different people to come and clean the bathroom right. I have to come back for surgery and I'm scared to death with all that bacteria and uncleanliness.
In this category, patients also described care by not too knowledgeable trainees or other staff as a safety hazard.
Disrespect
A total of 6.0% of surveyed patients suggested improvements that reflected disrespectful treatment, including poor work ethic, lack of warmth, rudeness, and a lack of attention to privacy and confidentiality. This type of dissatisfaction suggested an implicit expectation for treatment with respect and dignity that was clearly distinct from the expectation of technical quality:
[Hospital name] has always been like [this] since I started going there in 1982. They're very good technically but their bedside manner kind of sucks. You survive but you don't walk away with a warm fuzzy feeling.
Underprivileged patients were particularly sensitive to the need for respect:
I feel like the doctor that saw me that last night there was trying to get me out of there as fast as possible, saying not in so many words that it was because I don't have any insurance. I just feel like they treated me like an animal.
Violations of privacy and confidentiality were not only perceived as disrespectful, but also as a direct impediment to high‐quality care:
In the ER, I didn't like that I had no privacy especially talking with the doctor because I was in the hallway. I didn't have any privacy therefore I wasn't completely truthful with the doctor because everyone could hear.
Prolonged Waits
A total of 15.8% of patients noted dissatisfaction with wait times in the hospital. Waits for admission, transport, or discharge were frequently cited as anxiety‐provoking or frustrating:
The ER wait is too long. I was there from 8:00 AM to 2:00 AM the next day. I was there the whole day and night. When someone is in pain, they just want to be taken care of, not waiting around.
Waits related to receiving patient care, for example the inability to access nurses or physicians, more often caused feelings of fear and abandonment:
Every patient is different, I understand, but when you're there at night it can be a little scary. I was not only scared but in pain. The nurse tried to get a hold of the doctor that was on call, but the doctor took hours to respond. That was very scary.
It was also distressing to patients to watch roommates experience a delay in help for urgent needs:
The lady next to me was an elderly woman with a brace on her neck, and she couldn't speak very well. She had diarrhea at night and she would ask for a bedpan. The nurses would take forever bringing it to her. I just think when there are elderly people they should be more attentive to them because they tend to not be as vocal, you know?
Together, these comments represented an implicit expectation for prompt and efficient care.
Ineffective Communication
Communication during hospitalization was a source of dissatisfaction in 7.4% of surveyed patients. Communication failures occurred in several areas. Most common was the ineffective transfer of medical information to patients:
For days I thought I was having surgery on Friday. So all that day I ate and drank nothing and got prepped for surgery. Finally later that night I was told I was going to have it on Saturday. Saturday comes and still nothing. I never saw a surgeon or talked to anyone. Then later after that I was told I'm not having the surgery. That was the most frustrating thing.
Patients were also dissatisfied with their ability to communicate with their doctors:
I was sent home on a Friday and was sent right back on Friday night because my blood count was low and I ended up needing a blood transfusion. I tried to tell them this but they didn't listen. They need to listen to the patients.
Failed communication between care providers in the hospital was a third inadequacy noted by patients:
The only problem I had was all the different doctors coming in and out. There's so many that it confuses the patient, and a lot of them would contradict each other. One doctor said I could go home and another doctor said, No, you need to stay.
Finally, patients were dissatisfied when there was ineffective communication between inpatient and outpatient providers.
They said the VNA [Visiting Nurse Association] is supposed to come. The nurse hasn't come to see me and she hasn't called. My daughter and I have been waiting.
Thus, patients had an implicit expectation for effective communication between all parties in the hospital and were dissatisfied when any type of communication was inadequate.
Lack of Environmental Control
A total of 15.4% of surveyed patients reported dissatisfaction with the inability to control the physical environment. The inability to control noise levels, roommate behavior, temperature, smells, pain, lighting, staff interruptions, food service, smoking, and even humidity were all anxiety‐producing for different patients. The feeling of being imposed upon by an uncomfortable physical environment also extended to hospital facilities such as inaccessible bathrooms, traffic, and parking. Dissatisfaction with rooming arrangements was common:
I was in a triple room and one of my roommates had at least six visitors in the room at a time every day including two infant twins. Someone really should have said something about that. It became very disturbing, and I even left a day early because of that.
An expectation for quiet, especially during the night, was also repeatedly expressed:
The night shift could have been more considerate of people trying to rest. There was a lot of noise and bangs. I know people have to laugh and have fun but it could have been a little more quiet.
Related was the inability to control interruptions by staff members:
It's hard enough to get sleep, but then those blood suckers come in the middle of the night.
This category of dissatisfaction reflected an implicit expectation for autonomy and control over the environment so that it was conducive to rest and healing.
Substandard Amenities
A total of 6.9% of surveyed patients suggested improvements to amenities such as food, bedding, gowns, and television. Moving beyond the expectation of having peaceful surroundings, these comments reflected an expectation of a well‐appointed hospital environment with high‐quality amenities. A typical example was this comment about the food and service:
You never get what you order from the kitchen. Your tray either has something missing from it or it's the wrong tray or not the right diet. It's very frustrating and hard to get the orders the way you want.
Discussion
We analyzed 439 patient suggestions for improving hospital care and found that dissatisfaction resulted from six categories of negative experiences: 1) ineptitude, 2) disrespect, 3) prolonged wait times, 4) ineffective communication, 5) lack of environmental control, and 6) substandard amenities. These domains represented a corresponding set of implicit patient expectations for: 1) safety, 2) treatment with respect and dignity, 3) prompt and efficient care, 4) successful exchange of information, 5) environmental autonomy and control, and 6) high‐quality amenities. Each of these categories suggests avenues by which both the assessment and provision of hospital care can be made more patient‐centered.
The most widely used patient satisfaction survey in use in the United States today is the Hospital Consumer Assessment of Healthcare Providers & Systems (HCAHPS), which includes eight domains: communication with doctors, communication with nurses, responsiveness of hospital staff, pain management, communication about medicines, discharge information, cleanliness of the hospital environment, and quietness of the hospital environment.17 The dissatisfaction domains found in this study closely overlap the HCAHPS satisfaction domains, but with a few key differences.
First, dissatisfaction with ineptitude in our study encompassed concerns over adverse events and near misses, in addition to the cleanliness of the environment. Other research has shown that dissatisfaction with hospitalization can be predicted by the number of reported problems18 and the perception of receiving incorrect treatment.19 While elaborate methods have been devised to assess and compare the hospital quality and safety, patient satisfaction surveys including the HCAHPS survey often fail to ask patients directly about their perceptions of safety. In fact, this study and others20, 21 show that patients are able to recognize adverse events during hospitalization. Patient report may be a useful adjunct to other methods of adverse event case finding and outcomes reporting.
Second, while HCAHPS and others identify warmth, courtesy, concern, and respect as dimensions of patient‐centered care,14, 17, 22, 23 the ability of quantitative satisfaction surveys to capture the experience of disrespectful treatment may be limited, especially during hospitalization. Most respondents who commented on feeling disrespected identified only a single encounter, which can be masked by otherwise satisfying interactions with numerous care providers. Directly asking patients whether any experience during hospitalization caused them to feel disrespected, and allowing room for explanation, might more efficiently identify problem areas. This is particularly important because even one episode of disrespectful treatment, particularly when perceived to be racially motivated, increases the likelihood of not following a doctor's advice or putting off care.24
Third, HCAHPS emphasizes two aspects of communication: that between patients and doctors, and that between patients and nurses. Our patients confirmed that these are important, but they also noted a third dimension of communication contributing to dissatisfaction: provider‐provider communication. Communication and coordination failures among providers are key contributors to adverse events or near misses,2528 but their influence on patient satisfaction has not been widely assessed. Furthermore, patient input is rarely utilized to identify poor interprovider communication. Our study suggests that, just as patients can identify adverse events, they are also able to recognize poor provider‐provider communication.
Patients' reports of dissatisfying events also highlight areas in which small changes in hospital practice might greatly improve the patient experience. For instance, concerns over environment, food, sleep, hygiene, and pain appeared to be representative of a broader dissatisfaction with loss of autonomy and control. Hospitalized patients are often obliged to room with strangers, are subject to noise and interruptions, and cede control of their medication management at a time when they are feeling particularly vulnerable. The importance of this lack of autonomy to patients suggests a variety of small interventions that could improve satisfaction, such as individual control of noise and temperature, a visible commitment to a quiet hospital environment, and minimized interruptions and sleep disturbance.2932 Single‐occupancy hospital rooms have been associated with lower rates of nosocomial infection, medication errors, and patient stress, as well as increased privacy, rest, visitor involvement, and doctor‐patient communication.33, 34 The most sophisticated intervention, acuity‐adaptable private hospital rooms, allows hospitals to maintain patients in the same private hospital room during an entire admission, regardless of changes to level of acuity.35
In‐depth analysis of suggestions for improvement, as gathered by telephone surveys of recently discharged patients, was a particularly well‐suited approach to identifying explicit expectations for care that were violated by dissatisfying incidents. When allowed to express dissatisfaction in terms of suggestions for improvement, patients talked freely about specific dissatisfying experiences. Using telephone interviews allowed a large volume of patient responses to be included, unlike smaller focus groups. Our study was oral and did not rely on the literacy level of patients. Additionally, the open‐ended nature of questioning avoided some of the usual pitfalls of satisfaction surveys. We did not rely on predetermined satisfaction categories or presume the inherent value of particular attributes of care. Nonetheless, our study does have important limitations.
Patient perceptions were not compared with chart data or clinician report. Caregivers were allowed to participate in lieu of patients, which may have reduced identification of some dissatisfying events. Likewise, patients discharged to nursing homes or who were not English or Spanish speaking were excluded and may have had different dissatisfying experiences. Interviews were brief and dissatisfying events were not explored in detail. Although nearly half of respondents reported dissatisfying events, some patients may have been reluctant to criticize their care directly to a hospital representative. Finally, patients generally confined their comments to one or two dissatisfying events, even though there may have been others. We therefore cannot draw any conclusions about the relative frequency of dissatisfying events by domain.
Conclusions
All hospitalized patients bring expectations for their hospital experience. While specific expectations vary between patients, expectations for: 1) safety, 2) treatment with respect and dignity, 3) prompt and efficient care, 4) successful exchange of information, 5) environmental autonomy and control, and 6) high‐quality amenities were found in this study to encompass core expectations for hospitalization. It may be useful to ensure that postdischarge surveys explicitly address these expectations. Efforts to address and manage these core expectations of hospital care may help to reduce patient dissatisfaction with hospitalization and improve the delivery and quality of hospital care.
- Multinational Comparisons of Health Systems Data, 2006.Washington, DC:The Commonwealth Fund;2007. , .
- Toward higher‐performance health systems: Adults' health care experiences in seven countries, 2007.Health Aff.2007;26:w717–734. , , , , , .
- Patient satisfaction and its relationship with clinical quality and inpatient mortality in acute myocardial infarction.Circ Cardiovasc Qual Outcomes.2010;3:188–195. , , , et al.
- A longitudinal analysis of patient satisfaction and subsequent quality of life in Hong Kong Chinese breast and nasopharyngeal cancer patients.Med Care.2009;47:875–881. , .
- Understanding dissatisfied users: developing a framework for comprehending criticisms of health care work.J Adv Nurs.1999;30:723–731. .
- Patient satisfaction: a review of issues and concepts.Soc Sci Med.1997;45:1829–1843. , .
- Institute of Medicine.Crossing the Quality Chasm: A New Health System for the 21st Century.Washington, DC:National Academy Press;2001.
- Patient satisfaction: a valid concept?Soc Sci Med.1994;38:509–516. .
- Exploring the meaning of ‘dissatisfaction’ with health care: the importance of ‘personal identity threat’.Sociol Health Illn.1999;21:95–123. .
- Pathways, pyramids and icebergs? Mapping the links between dissatisfaction and complaints.Sociol Health Illn.1998;20:825–847. , .
- Convergence and divergence: assessing criteria of consumer satisfaction across general practice, dental and hospital care settings.Soc Sci Med.1991;33:707–716. , .
- National survey of hospital patients [see comment].BMJ.1994;309:1542–1546. , , , , , .
- The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature.Health Technol Assess.2002;6:1–244. , , , et al.
- Review of the literature on survey instruments used to collect data on hospital patients' perceptions of care.Health Serv Res.2005;40:1996–2017. , , , .
- Satisfying solutions? A review of some unresolved issues in the measurement of patient satisfaction.J Adv Nurs.1995;22:316–322. , , .
- The Discovery of Grounded Theory: Strategies for Qualitative Research.Chicago, IL:Aldine;1967. , .
- Hospital Consumer Assessment of Healthcare Providers 25:25–36.
- Patient experiences in relation to respondent and health service delivery characteristics: a survey of 26,938 patients attending 62 hospitals throughout Norway.Scand J Public Health.2007;35:70–77. , , , .
- What can hospitalized patients tell us about adverse events? Learning from patient‐reported incidents.J Gen Intern Med.2005;20:830–836. , , , et al.
- A hospitalization from hell: a patient's perspective on quality.Ann Intern Med.2003;138:33–39. .
- Through the Patient's Eyes: Understanding and Promoting Patient‐Centered Care.San Francisco, CA:Jossey‐Bass;1993. , , , .
- What do consumers want to know about the quality of care in hospitals?Health Serv Res.2005;40:2018–2036. , , , , .
- R‐e‐s‐p‐e‐c‐t: patient reports of disrespect in the health care setting and its impact on care.J Fam Pract.2004;53:721–730. , .
- Perceived information needs and communication difficulties of inpatient physicians and nurses.J Am Med Inform Assoc.2002;9(6 suppl 1):S64–S69. , , , , .
- The human factor: the critical importance of effective teamwork and communication in providing safe care.Qual Saf Health Care.2004;13:i85–i90. , , .
- Consequences of inadequate sign‐out for patient care.Arch Intern Med.2008;168:1755–1760. , , , , .
- Dropping the baton: a qualitative analysis of failures during the transition from emergency department to inpatient care.Ann Emerg Med.2009;53:701–710 e704. , , , , , .
- Interactive relationships between hospital patients' noise‐induced stress and other stress with sleep.Heart Lung.2001;30:237–243. , .
- The influence of subjective reactions to noise on health effects of the noise.Environ Int.1996;22:93–104. .
- A novel PACU design for noise reduction.J Perianesth Nurs.2008;23:226–229. .
- The Planetree Model Hospital Project: an example of the patient as partner. (Pacific Presbyterian Medical Center, San Francisco).Hosp Health Serv Admin.1990;35:591–601. , , , .
- Physician‐patient communication in single‐bedded versus four‐bedded hospital rooms.Patient Educ Couns.2008;73:215–219. , , .
- Advantages and disadvantages of single‐versus multiple‐occupancy rooms in acute care environments: a review and analysis of the literature.Environ Behav.2005;37:760–786. , , .
- Impacting patient outcomes through design: acuity adaptable care/universal room design.Crit Care Nurs Q.2006;29:326–341. , .
- Multinational Comparisons of Health Systems Data, 2006.Washington, DC:The Commonwealth Fund;2007. , .
- Toward higher‐performance health systems: Adults' health care experiences in seven countries, 2007.Health Aff.2007;26:w717–734. , , , , , .
- Patient satisfaction and its relationship with clinical quality and inpatient mortality in acute myocardial infarction.Circ Cardiovasc Qual Outcomes.2010;3:188–195. , , , et al.
- A longitudinal analysis of patient satisfaction and subsequent quality of life in Hong Kong Chinese breast and nasopharyngeal cancer patients.Med Care.2009;47:875–881. , .
- Understanding dissatisfied users: developing a framework for comprehending criticisms of health care work.J Adv Nurs.1999;30:723–731. .
- Patient satisfaction: a review of issues and concepts.Soc Sci Med.1997;45:1829–1843. , .
- Institute of Medicine.Crossing the Quality Chasm: A New Health System for the 21st Century.Washington, DC:National Academy Press;2001.
- Patient satisfaction: a valid concept?Soc Sci Med.1994;38:509–516. .
- Exploring the meaning of ‘dissatisfaction’ with health care: the importance of ‘personal identity threat’.Sociol Health Illn.1999;21:95–123. .
- Pathways, pyramids and icebergs? Mapping the links between dissatisfaction and complaints.Sociol Health Illn.1998;20:825–847. , .
- Convergence and divergence: assessing criteria of consumer satisfaction across general practice, dental and hospital care settings.Soc Sci Med.1991;33:707–716. , .
- National survey of hospital patients [see comment].BMJ.1994;309:1542–1546. , , , , , .
- The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature.Health Technol Assess.2002;6:1–244. , , , et al.
- Review of the literature on survey instruments used to collect data on hospital patients' perceptions of care.Health Serv Res.2005;40:1996–2017. , , , .
- Satisfying solutions? A review of some unresolved issues in the measurement of patient satisfaction.J Adv Nurs.1995;22:316–322. , , .
- The Discovery of Grounded Theory: Strategies for Qualitative Research.Chicago, IL:Aldine;1967. , .
- Hospital Consumer Assessment of Healthcare Providers 25:25–36.
- Patient experiences in relation to respondent and health service delivery characteristics: a survey of 26,938 patients attending 62 hospitals throughout Norway.Scand J Public Health.2007;35:70–77. , , , .
- What can hospitalized patients tell us about adverse events? Learning from patient‐reported incidents.J Gen Intern Med.2005;20:830–836. , , , et al.
- A hospitalization from hell: a patient's perspective on quality.Ann Intern Med.2003;138:33–39. .
- Through the Patient's Eyes: Understanding and Promoting Patient‐Centered Care.San Francisco, CA:Jossey‐Bass;1993. , , , .
- What do consumers want to know about the quality of care in hospitals?Health Serv Res.2005;40:2018–2036. , , , , .
- R‐e‐s‐p‐e‐c‐t: patient reports of disrespect in the health care setting and its impact on care.J Fam Pract.2004;53:721–730. , .
- Perceived information needs and communication difficulties of inpatient physicians and nurses.J Am Med Inform Assoc.2002;9(6 suppl 1):S64–S69. , , , , .
- The human factor: the critical importance of effective teamwork and communication in providing safe care.Qual Saf Health Care.2004;13:i85–i90. , , .
- Consequences of inadequate sign‐out for patient care.Arch Intern Med.2008;168:1755–1760. , , , , .
- Dropping the baton: a qualitative analysis of failures during the transition from emergency department to inpatient care.Ann Emerg Med.2009;53:701–710 e704. , , , , , .
- Interactive relationships between hospital patients' noise‐induced stress and other stress with sleep.Heart Lung.2001;30:237–243. , .
- The influence of subjective reactions to noise on health effects of the noise.Environ Int.1996;22:93–104. .
- A novel PACU design for noise reduction.J Perianesth Nurs.2008;23:226–229. .
- The Planetree Model Hospital Project: an example of the patient as partner. (Pacific Presbyterian Medical Center, San Francisco).Hosp Health Serv Admin.1990;35:591–601. , , , .
- Physician‐patient communication in single‐bedded versus four‐bedded hospital rooms.Patient Educ Couns.2008;73:215–219. , , .
- Advantages and disadvantages of single‐versus multiple‐occupancy rooms in acute care environments: a review and analysis of the literature.Environ Behav.2005;37:760–786. , , .
- Impacting patient outcomes through design: acuity adaptable care/universal room design.Crit Care Nurs Q.2006;29:326–341. , .
Copyright © 2010 Society of Hospital Medicine