User login
Impact of patient-centered discharge tools: A systematic review
Patient-centered care, defined by the Institute of Medicine as “health care that establishes a partnership among practitioners, patients, and their families to ensure that decisions respect patients’ wants, needs and preferences and that patients have the education and support they need to make decisions and participate in their own care,” has been recognized as an important factor in improving care transitions after discharge from the hospital.1 Previous efforts to improve the discharge process for hospitalized patients and reduce avoidable readmissions have focused on improving systems surrounding the patient, such as by increasing the availability of outpatient follow-up or standardizing communication between the inpatient and outpatient care teams.1,2 In fact, successful programs such as Project BOOST and the Care Transitions Interventions™ provide healthcare institutions with a “bundle” of evidence-based transitional care guidelines for discharge: they provide postdischarge transition coaches, assistance with medication self-management, timely follow-up tips, and improved patient records in order to improve postdischarge outcomes.3,4 Successful interventions, however, may not provide more services, but also engage the patient in their own care.5,6 The impact of engaging the patient in his or her own care by providing patient-friendly discharge instructions alone, however, is unknown.
A patient-centered discharge may use tools that were designed with patients, or may involve engaging patients in an interactive process of reviewing discharge instructions and empowering them to manage aspects of their own care after leaving the hospital. This endeavour may lead to more effective use of discharge instructions and reduce the need for additional or more intensive (and costly) interventions. For example, a patient-centered discharge tool could include an educational intervention that uses the “teach-back” method, in which patients are asked to restate in their own words what they thought they heard, or in which staff use additional media or a visual design tool meant to enhance comprehension of discharge instructions.6,7 Visual aids and the use of larger fonts are particularly useful design elements for improving comprehension among non-English speakers and patients with low health literacy, who tend to have poorer recall of instructions.8-10 What may constitute essential design elements to include in a discharge instruction tool, however, is not clear.
Moreover, whether the use of discharge tools with a specific focus on patient engagement may improve postdischarge outcomes is not known. Particularly, the ability of patient-centered discharge tools to improve outcomes beyond comprehension such as self-management, adherence to discharge instructions, a reduction in unplanned visits, and a reduction in mortality has not been studied systematically. The objective of this systematic review was to review the literature on discharge instruction tools with a focus on patient engagement and their impact among hospitalized patients.
METHODS
The Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) Statement was followed as a guideline for reporting throughout this review.11
Data Sources
A literature search was undertaken using the following databases from January 1994 or their inception date to May 2014: Medline, Embase, SIGLE, HTA, Bioethics, ASSIA, Psych Lit, CINAHL, Cochrane Library, EconLit, ERIC, and BioMed Central. We also searched relevant design-focused journals such as Design Issues, Journal of Design Research, Information Design Journal, Innovation, Design Studies, and International Journal of Design, as well as reference lists from studies obtained by electronic searching. The following key words and combination of key words were used with the assistance of a medical librarian: patient discharge, patient-centered discharge, patient-centered design, design thinking, user based design, patient education, discharge summary, education. Additional search terms were added when identified from relevant articles (Appendix).
Inclusion Criteria
We included all English-language studies with patients admitted to the hospital irrespective of age, sex, or medical condition, which included a control group or time period and which measured patient outcomes within 3 months of discharge. The 3-month period after discharge is often cited as a time when outcomes could reasonably be associated with an intervention at discharge.2
Exclusion Criteria
Studies that did not have clear implementation of a patient-centered tool, a control group, or those whose tool was used in the emergency department or as an outpatient were excluded. Studies that included postdischarge tools such as home visits or telephone calls were excluded unless independent effects of the predischarge interventions were measured. Studies with outcomes reported after 3 months were excluded unless outcomes before 3 months were also clearly noted.
All searches were entered into Endnote and duplicates were removed. A 2-stage inclusion process was used. Titles and abstracts of articles were first screened for meeting inclusion and exclusion criteria by 1 reviewer. A second reviewer independently checked a 10% random sample of all the abstracts that met the initial screening criteria. If the agreement to exclude studies was less than 95%, criteria were reviewed before checking the rest of the 90% sample. In the second stage, 2 independent reviewers examined paper copies of the full articles selected in the first stage. Disagreement between reviewers was resolved by discussion or a third reviewer if no agreement could be reached.
Data Analysis and Synthesis
The following information was extracted from the full reference: type of study, population studied, control group or time period, tool used, and outcomes measured. Based on the National Health Care Quality report’s priorities and goals on patient and/or family engagement during transitions of care, educational tools were further described based on method of teaching, involvement of the care team, involvement of the patient in the design or delivery of the tool, and/or the use of visual aids.12 All primary outcomes were classified according to 3 categories: improved knowledge/comprehension, patient experience (patient satisfaction, self-management/efficacy such as functional status, both physical and mental), and health outcomes (unscheduled visits or readmissions, adherence with medications, diet, exercise, or follow-up, and mortality).
No quantitative pooling of results or meta-analysis was done given the variability and heterogeneity of studies reviewed. However, following guidelines for Effect Practice and Organisation of Care (EPOC) Risk of Bias criteria,13 studies that had a higher risk of bias such as uncontrolled before-after studies or studies with only 1 intervention or control site (historical controls, eg) were excluded from the final review because of the difficulties in attributing causation. Only primary outcomes were reported in order to minimize type II errors.
RESULTS
Our search revealed a total of 3699 studies after duplicates had been removed (Figure). A total of 714 references were included after initial review by title and abstract and 30 studies after full-text review. Agreement on a 10% random sample of all abstracts and full text was 79% (k=0.58) and 86% (k=0.72), respectively. Discussion was needed for fewer than 100 references, and agreement was subsequently reached for 100%.
There were 22 randomized controlled trials and 8 nonrandomized studies (5 nonrandomized controlled trials and 3 controlled before-after studies). Most of these studies were conducted in the United States (13/30 studies), followed by other European countries (5 studies), and the United Kingdom (4 studies). A large number of studies were conducted among patients with cardiovascular disease or risk factors (10 studies), followed by postsurgical patients such as coronary artery bypass graft surgery or orthopaedic surgery (5 studies). Five of 30 studies were conducted among individuals older than 65 years. Most studies excluded patients who did not speak English or the country’s official language; only 3 studies included patients with limited literacy, patients who spoke other languages, or caregivers if the patients could not communicate.
Most studies tested the impact of educational discharge interventions (28 of 30 studies) (Table 1). Quite often, it was a member of the research team who carried out the patient education. Only 3 studies involved multiple members of the care team in designing or reviewing the discharge tool with the patient. Almost half (12 studies) targeted multiple aspects of postdischarge care, including medications and side effects, signs and symptoms to consider, plans for follow-up, dietary restrictions, and/or exercise modifications. Many (19 studies) provided education using one-on-one teaching in association with a discharge tool, accompanied by a written handout (13 studies), audiotape (2 studies), or video (3 studies). While 13 studies had patients involved in creating what content was discussed and 14 studies had patients involved in the delivery of the tool, only 6 studies had patients involved in both design and delivery of the tool. Nine studies also used visual aids such as pictures, larger font, or use of a tool enhanced for patients with language barriers or limited health literacy.
Among all 30 studies included, 16 studies tested the impact of their tool on comprehension postdischarge, with 10 studies demonstrating an improvement among patients who had received the tool (Table 2). Five studies evaluated healthcare utilization outcomes such as readmission, length of stay, or physician visits after discharge and 2 studies found improvements. Twelve studies also studied the impact on adherence with medications, diet, exercise, or follow-up instructions postdischarge. However, only 4 of these 12 studies showed a positive impact. Only 2 studies tested the impact on a patient’s ability to self-manage once at home, and both studies reported positive statistical outcomes. Few studies measured patient experience (such as patient satisfaction or improvement in self-efficacy) or mortality postdischarge.
DISCUSSION/CONCLUSION
Our systematic review found 30 studies that engaged patients during the design or the delivery of a discharge instruction tool and that tested the effect of the tool on postdischarge outcomes.6-10,14–38 Our review suggests that there is sufficient evidence that patient-centered discharge tools improve comprehension. However, evidence is currently insufficient to determine if patient-centered tools improve adherence with discharge instructions. Moreover, though limited studies show promising results, more studies are needed to determine if patient engagement improves self-efficacy and healthcare utilization after discharge.
A major limitation of current studies is the variability in the level of patient engagement in tool design or delivery. Patients were involved in the design mostly through targeted development of a discharge management plan and the delivery by encouraging them to ask questions. Few studies involved patients in the design of the tool such that patients were responsible for coming up with content that was of interest to them. The few that did, often with the additional use of video media, demonstrated significant outcomes. Only a minority of studies used an interactive process to assess understanding such as “teach-back” or maximize patient comprehension such as visual aids. Even fewer studies engaged patients in both developing the discharge tool and providing discharge instructions.
Several previous studies have demonstrated that most complications after discharge are the result of ineffective communication, which can be exacerbated by lack of fluency in English or by limited health literacy.2,39-43 As a result, poor understanding of discharge instructions by patients and their caregivers can create an important care gap.44 Therefore, the use of patient-centered tools to engage patients at discharge in their own care is needed. How to engage patients consistently and effectively is perhaps less evident, as demonstrated in this review of the literature in which different levels of patient engagement were found. Many of the tools tested placed attention on patient education, sometimes in the context of bundled care along with home visits or follow-up, all of which can require extensive resources and time. Providing patients with information that the patients themselves state is of value may be the easiest refinement to a discharge educational tool, although this was surprisingly uncommon.6,9,10,17,23,33,37 Only 2 studies were found that engaged patients in the initial stage of design of the discharge tool, by incorporating information of interest to them.23,32 For example, a study testing the impact of a computer-generated written education package on poststroke outcomes designed the information by asking patients to identify which topics they would like to receive information about (along with the amount of information and font size).23 Secondly, although most of the discharge tools reviewed included the use of one-on-one teaching and the use of media such as patient handouts, these tools were often used in such a way that patients were passive recipients. In fact, studies that used additional video media that incorporated personalized content were the most likely to demonstrate positive outcomes.17,34 The next level of patient engagement may therefore be to involve the patient as an interactive partner when delivering the tool in order to empower patients to self-care. For example, 1 study designed a structured education program by first assessing lifestyle risk factors related to hypertension that were modifiable along with preconceived notions through open-ended questions during a one-on-one interview.37 Patients were subsequently educated on any knowledge deficits regarding the management of their lifestyle. Another level of patient engagement may be to use visual aids during discussions, as a well-known complement to verbal instructions.45,46 For example, in a controlled study that randomized a ward of elderly patients with 4 or more prescriptions to predischarge counseling, the counseling session aimed to review reasons for their prescriptions along with corresponding side effects, doses, and dosage times with the help of a medicine reminder card. Other uses of visual aid tools identified in our review included the use of pictograms or illustrations or, at minimum, attention to font size.7,8,16,29,33,35 In the absence of a visual aid, asking the patient to repeat or demonstrate what was just communicated can be used to assess the amount of information retained.18,33
An important result discovered in our review of the literature was also the lack of studies that tested the impact of discharge tools on usability of discharge information once at home. Conducting an evaluation of the benefits to patients after discharge can help objectify vague outcomes like health gains or qualify benefits in patient’s views. This might also explain why many studies with documented patient engagement at the time of discharge were able to demonstrate improvements in comprehension but not adherence to instructions. Although patients and caregivers may understand the information, this comprehension does not necessarily mean they will find the information useful or adhere to it once at home. For example, in 1 study, patients discharged with at least 1 medication were randomized to a structured discharge interview during which the treatment plan was reviewed verbally and questions clarified along with a visually enhanced treatment card.26 Although knowledge of medications increased, no effect was found on adherence at 1 week postdischarge. However, use of the treatment card at home was not assessed. Similarly, another study tested the effect of an individualized video of exercises and failed to find a difference in patient adherence at 4 weeks.28 The authors suggested that the lack of benefit may have been because patients were not using the video once at home. This is in contrast to 2 studies that involved patients in their own care by requiring them to request their medication as part of a self-medication tool predischarge.16,30 Patients were engaged in the process such that increasing independence was given to patients based on their demonstration of understanding and adherence to their treatment while still in the hospital, a learning tool that can be applied once at home. Feeling knowledgeable and involved, as others have suggested, may be the intermediary outcomes that led to improved adherence.47 It is also possible that adherence to discharge instructions may vary based on complexity of the information provided, such that instructions focusing solely on medication use may require less patient engagement than discharge instructions that include information on medications, diet, exercise modifications, and follow-up.48
Our review has a few limitations. Previous systematic reviews have demonstrated that bundled discharge interventions that include patient-centered education have a positive effect on outcomes postdischarge.2,5 However, we sought to describe and study the individual and distinct impact of patient engagement in the creation and delivery of discharge tools on outcomes postdischarge. We hoped that this may provide others with key information regarding elements of patient engagement that were particularly useful when designing a new discharge tool. The variability of the studies we identified, however, made it difficult to ascertain what level of patient engagement is required to observe improvements in health outcomes. It is also possible that a higher level of patient engagement may have been used but not described in the studies we reviewed. As only primary outcomes were included, we may have underestimated the effect of patient-centered discharge tools on outcomes that were reported as secondary outcomes. As we were interested in reviewing as many studies of patient-centered discharge tools as possible, we did not assess the quality of the studies and cannot comment on the role of bias in these studies. However, we excluded studies with study designs known to have the highest risk of bias. Lastly, we also cannot comment on whether patient-centered tools may have an effect on outcomes more than 3 months after a hospital discharge. However, several studies included in this review suggest a sustained effect beyond this time period.8,25,32,37
Patient-centered discharge tools in which patients were engaged in the design or the delivery were found to improve comprehension of but not adherence with discharge instructions. The perceived lack of improved adherence may be due to a lack of studies that measured the usefulness and utilization of information for patients once at home. There was also substantial variability in the extent of patient involvement in designing the style and content of information provided to patients at discharge, as well as the extent of patient engagement when receiving discharge instructions. Future studies would benefit from detailing the level of patient engagement needed in designing and delivery of discharge tools. This information may lead to the discovery of barriers and facilitators to utilization of discharge information once at home and lead to a better understanding of the patient’s journey from hospital to home and onwards.
C.M.B. and this work were funded by a CIHR Canadian Patient Safety Institute Chair in Patient Safety and Continuity of Care. Funding was provided to cover fees to obtain articles from the Donald J. Matthews Complex Care Fund of the University Health Network in Toronto, Canada. The Toronto Central Local Health Integration Network provided funding for the design and implementation of a patient-oriented discharge summary. None of the funding or supportive agencies were involved in the design or conduct of the present study, analysis, or interpretation of the data, or approval of the manuscript.
Disclosures
The authors report no conflicts of interest.
1. Hurtad
2. Mistiaen P, Francke AL, Poot E. Interventions aimed at reducing problems in adult patients discharged from hospital to home: a systematic meta-review. BMC Health Serv Res. 2007;7:47. PubMed
3. Coleman EA, Parry C, Chalmers S, Min SJ. The care transitions intervention: results of a randomized controlled trial. Arch Intern Med. 2006;166(17):1822-1828. PubMed
4. Hansen LO, Greenwald JL, Budnitz T, et al. Project BOOST: effectiveness of a multihospital effort to reduce rehospitalization. J Hosp Med. 2013;8(8):421-427. PubMed
5. Hansen LO, Young RS, Hinami K, et al. Interventions to reduce 30-day rehospitalization: a systematic review. Ann Intern Med. 2011;155(8):520-528. PubMed
6. Osman LM, Calder C, Godden DJ, et al. A randomised trial of self-management planning for adult patients admitted to hospital with acute asthma. Thorax. 2002;57(10):869-874. PubMed
7. Cordasco KM, Asch SM, Bell DS, et al. A low-literacy medication education tool for safety-net hospital patients. Am J Prev Med. 2009;37(6 suppl 1):S209-S216. PubMed
8. Morice AH, Wrench C. The role of the asthma nurse in treatment compliance and self-management following hospital admission. Resp Med. 2001;95(11):851-856. PubMed
9. Haerem JW, Ronning EJ, Leidal R. Home access to hospital discharge information on audiotape reduces sick leave and readmissions in patients with first-time myocardial infarction. Scand Cardiovasc J. 2000;34(2):219-222. PubMed
10. Legrain S, Tubach F, Bonnet-Zamponi D, et al. A new multimodal geriatric discharge-planning intervention to prevent emergency visits and rehospitalizations of older adults: the optimization of medication in AGEd multicenter randomized controlled trial. J Am Geriatr Soc. 2011;59(11):2017-2028. PubMed
11. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264-269. PubMed
12. Partnership NP. National Priorities and Goals: Aligning Our Efforts to Transform America’s Healthcare. Washington, DC: National Quality Forum; 2008.
13. Effective Practice and Organisation of Care (EPOC). EPOC-specific resources for review authors. Oslo, Norway: Norwegian Knowledge Centre for the Health Services; 2013. http://epoc.cochrane.org/epoc-specific-resources-review-authors. Accessed December 21, 2016.
14. Manning DM, O’Meara JG, Williams AR, et al. 3D: a tool for medication discharge education. Qual Saf Health Care. 2007;16(1):71-76. PubMed
15. Perera KY, Ranasinghe P, Adikari AM, et al. Medium of language in discharge summaries: would the use of native language improve patients’ knowledge of their illness and medications? J Health Commun. 2012;17(2):141-148. PubMed
16. Lowe CJ, Raynor DK, Courtney EA, et al. Effects of self medication programme on knowledge of drugs and compliance with treatment in elderly patients. BMJ. 1995;310(6989):1229-1231. PubMed
17. Mahler HI, Kulik JA, Tarazi RY. Effects of a videotape information intervention at discharge on diet and exercise compliance after coronary bypass surgery. J Cardiopulm Rehabil. 1999;19(3):170-177. PubMed
18. Al-Rashed SA, Wright DJ, Roebuck N, et al. The value of inpatient pharmaceutical counseling to elderly patients prior to discharge. Br J Clin Pharmacol. 2002;54(6):657-664. PubMed
19. Drenth-van Maanen AC, Wilting I, Jansen PA, et al. Effect of a discharge medication intervention on the incidence and nature of medication discrepancies in older adults. J Am Geriatr Soc. 2013;61(3):456-458. PubMed
20. Eshah NF. Predischarge education improves adherence to a healthy lifestyle among Jordanian patients with acute coronary syndrome. Nurs Health Sci. 2013;15(3):273-279. PubMed
21. Gwadry-Sridhar FH, Arnold JM, Zhang Y,et al. Pilot study to determine the impact of a multidisciplinary educational intervention in patients hospitalized with heart failure. Am Heart J. 2005;150(5):982. PubMed
22. Ho SM, Heh SS, Jevitt CM, et al. Effectiveness of a discharge education program in reducing the severity of postpartum depression: a randomized controlled evaluation study. Patient Educ Couns. 2009;77(1):68-71. PubMed
23. Hoffmann T, McKenna K, Worrall L, et al. Randomised trial of a computer-generated tailored written education package for patients following stroke. Age Ageing. 2007;36(3):280-286. PubMed
24. Jenkins HM, Blank V, Miller K, et al. A randomized single-blind evaluation of a discharge teaching book for pediatric patients with burns. J Burn Care Rehabil. 1996;17(1):49-61. PubMed
25. Kommuri NV, Johnson ML, Koelling TM. Relationship between improvements in heart failure patient disease specific knowledge and clinical events as part of a randomized controlled trial. Patient Educ Couns. 2012;86(2):233-238. PubMed
26. Louis-Simonet M, Kossovsky MP, Sarasin FP, et al. Effects of a structured patient-centered discharge interview on patients’ knowledge about their medications. Am J Med. 2004;117(8):563-568. PubMed
27. Lucas KS. Outcomes evaluation of a pharmacist discharge medication teaching service. Am J Health Syst Pharm. 1998;55(24 suppl 4):S32-S35. PubMed
28. Lysack C, Dama M, Neufeld S, et al. A compliance and satisfaction with home exercise: a comparison of computer-assisted video instruction and routine rehabilitation practice. J Allied Health. 2005;34(2):76-82. PubMed
29. Moore SM. The effects of a discharge information intervention on recovery outcomes following coronary artery bypass surgery. Int J Nurs Stud. 1996;33(2):181-189. PubMed
30. Pereles L, Romonko L, Murzyn T, et al. Evaluation of a self-medication program. J Am Geriatr Soc. 1996;44(2):161-165. PubMed
31. Reynolds MA. Postoperative pain management discharge teaching in a rural population. Pain Manag Nurs. 2009;10(2):76-84. PubMed
32. Sabariego C, Barrera AE, Neubert S, et al. Evaluation of an ICF-based patient education programme for stroke patients: a randomized, single-blinded, controlled, multicentre trial of the effects on self-efficacy, life satisfaction and functioning. Br J Health Psychol. 2013;18(4):707-728. PubMed
33. Shieh SJ, Chen HL, Liu FC, et al. The effectiveness of structured discharge education on maternal confidence, caring knowledge and growth of premature newborns. J Clin Nurs. 2010;19(23-24):3307-3313. PubMed
34. Steinberg TG, Diercks MJ, Millspaugh J. An evaluation of the effectiveness of a videotape for discharge teaching of organ transplant recipients. J Transpl Coord. 1996;6(2):59-63. PubMed
35. Whitby M, McLaws ML, Doidge S, et al. Post-discharge surgical site surveillance: does patient education improve reliability of diagnosis? J Hosp Infect. 2007;66(3):237-242. PubMed
36. Williford SL, Johnson DF. Impact of pharmacist counseling on medication knowledge and compliance. Mil Med. 1995;160(11):561–564. PubMed
37. Zernike W, Henderson A. Evaluating the effectiveness of two teaching strategies for patients diagnosed with hypertension. J Clin Nurs. 1998;7(1):37–44. PubMed
38. Press VG, Arora V, Constantine KL, et al. Forget me not: a randomized trial of the durability of hospital-based education on inhalers for patients with COPD or asthma [abstract]. J Gen Intern Med. 2014;29(1 suppl):S102.
39. Davis TC, Wolf MS, Bass PF, et al. Literacy and misunderstanding prescription drug labels. Ann Intern Med. 2006;145(12):887–894. PubMed
40. McCarthy DM, Waite KR, Curtis LM, et al. What did the doctor say? Health literacy and recall of medical instructions. Med Care. 2012;50(4):277–282. PubMed
41. Tarn DM, Heritage J, Paterniti DA, et al. Physician communication when prescribing new medications. Arch Intern Med. 2006;166(17):1855–1862. PubMed
42. Cawthon C, Walia S, Osborn CY, et al. Improving care transitions: the patient perspective. J Health Commun. 2012;17(suppl 3):312–324. PubMed
43. Karliner LS, Auerbach A, Nápoles A, et al. Language barriers and understanding of hospital discharge instructions. Med Care. 2012;50(4):283–289. PubMed
44. Enhancing the Continuum of Care. Report of the Avoidable Hospitalization Advisory Panel. http://www.health.gov.on.ca/en/common/ministry/publications/reports/baker_2011/baker_2011.pdf. Published November 2011. Accessed December 22, 2016.
45. Chugh A, Williams MV, Grigsby J, et al. Better transitions: improving comprehension of discharge instructions. Front Health Serv Manage. 2009;25(3):11–32. PubMed
46. Schillinger D, Machtinger EL, Wang F, et al. Language, literacy, and communication regarding medication in an anticoagulation clinic: a comparison of verbal vs. visual assessment. J Health Commun. 2006;11(7):651–664. PubMed
47. Epstein RM, Street RL, Jr. The values and value of patient-centered care. Ann Fam Med. 2011;9(2):100–103. PubMed
48. Albrecht JS, Gruber-Baldini AL, Hirshon JM, et al. Hospital discharge instructions: comprehension and compliance among older adults. J Gen Intern Med. 2014;29(11):1491–1498. PubMed
Patient-centered care, defined by the Institute of Medicine as “health care that establishes a partnership among practitioners, patients, and their families to ensure that decisions respect patients’ wants, needs and preferences and that patients have the education and support they need to make decisions and participate in their own care,” has been recognized as an important factor in improving care transitions after discharge from the hospital.1 Previous efforts to improve the discharge process for hospitalized patients and reduce avoidable readmissions have focused on improving systems surrounding the patient, such as by increasing the availability of outpatient follow-up or standardizing communication between the inpatient and outpatient care teams.1,2 In fact, successful programs such as Project BOOST and the Care Transitions Interventions™ provide healthcare institutions with a “bundle” of evidence-based transitional care guidelines for discharge: they provide postdischarge transition coaches, assistance with medication self-management, timely follow-up tips, and improved patient records in order to improve postdischarge outcomes.3,4 Successful interventions, however, may not provide more services, but also engage the patient in their own care.5,6 The impact of engaging the patient in his or her own care by providing patient-friendly discharge instructions alone, however, is unknown.
A patient-centered discharge may use tools that were designed with patients, or may involve engaging patients in an interactive process of reviewing discharge instructions and empowering them to manage aspects of their own care after leaving the hospital. This endeavour may lead to more effective use of discharge instructions and reduce the need for additional or more intensive (and costly) interventions. For example, a patient-centered discharge tool could include an educational intervention that uses the “teach-back” method, in which patients are asked to restate in their own words what they thought they heard, or in which staff use additional media or a visual design tool meant to enhance comprehension of discharge instructions.6,7 Visual aids and the use of larger fonts are particularly useful design elements for improving comprehension among non-English speakers and patients with low health literacy, who tend to have poorer recall of instructions.8-10 What may constitute essential design elements to include in a discharge instruction tool, however, is not clear.
Moreover, whether the use of discharge tools with a specific focus on patient engagement may improve postdischarge outcomes is not known. Particularly, the ability of patient-centered discharge tools to improve outcomes beyond comprehension such as self-management, adherence to discharge instructions, a reduction in unplanned visits, and a reduction in mortality has not been studied systematically. The objective of this systematic review was to review the literature on discharge instruction tools with a focus on patient engagement and their impact among hospitalized patients.
METHODS
The Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) Statement was followed as a guideline for reporting throughout this review.11
Data Sources
A literature search was undertaken using the following databases from January 1994 or their inception date to May 2014: Medline, Embase, SIGLE, HTA, Bioethics, ASSIA, Psych Lit, CINAHL, Cochrane Library, EconLit, ERIC, and BioMed Central. We also searched relevant design-focused journals such as Design Issues, Journal of Design Research, Information Design Journal, Innovation, Design Studies, and International Journal of Design, as well as reference lists from studies obtained by electronic searching. The following key words and combination of key words were used with the assistance of a medical librarian: patient discharge, patient-centered discharge, patient-centered design, design thinking, user based design, patient education, discharge summary, education. Additional search terms were added when identified from relevant articles (Appendix).
Inclusion Criteria
We included all English-language studies with patients admitted to the hospital irrespective of age, sex, or medical condition, which included a control group or time period and which measured patient outcomes within 3 months of discharge. The 3-month period after discharge is often cited as a time when outcomes could reasonably be associated with an intervention at discharge.2
Exclusion Criteria
Studies that did not have clear implementation of a patient-centered tool, a control group, or those whose tool was used in the emergency department or as an outpatient were excluded. Studies that included postdischarge tools such as home visits or telephone calls were excluded unless independent effects of the predischarge interventions were measured. Studies with outcomes reported after 3 months were excluded unless outcomes before 3 months were also clearly noted.
All searches were entered into Endnote and duplicates were removed. A 2-stage inclusion process was used. Titles and abstracts of articles were first screened for meeting inclusion and exclusion criteria by 1 reviewer. A second reviewer independently checked a 10% random sample of all the abstracts that met the initial screening criteria. If the agreement to exclude studies was less than 95%, criteria were reviewed before checking the rest of the 90% sample. In the second stage, 2 independent reviewers examined paper copies of the full articles selected in the first stage. Disagreement between reviewers was resolved by discussion or a third reviewer if no agreement could be reached.
Data Analysis and Synthesis
The following information was extracted from the full reference: type of study, population studied, control group or time period, tool used, and outcomes measured. Based on the National Health Care Quality report’s priorities and goals on patient and/or family engagement during transitions of care, educational tools were further described based on method of teaching, involvement of the care team, involvement of the patient in the design or delivery of the tool, and/or the use of visual aids.12 All primary outcomes were classified according to 3 categories: improved knowledge/comprehension, patient experience (patient satisfaction, self-management/efficacy such as functional status, both physical and mental), and health outcomes (unscheduled visits or readmissions, adherence with medications, diet, exercise, or follow-up, and mortality).
No quantitative pooling of results or meta-analysis was done given the variability and heterogeneity of studies reviewed. However, following guidelines for Effect Practice and Organisation of Care (EPOC) Risk of Bias criteria,13 studies that had a higher risk of bias such as uncontrolled before-after studies or studies with only 1 intervention or control site (historical controls, eg) were excluded from the final review because of the difficulties in attributing causation. Only primary outcomes were reported in order to minimize type II errors.
RESULTS
Our search revealed a total of 3699 studies after duplicates had been removed (Figure). A total of 714 references were included after initial review by title and abstract and 30 studies after full-text review. Agreement on a 10% random sample of all abstracts and full text was 79% (k=0.58) and 86% (k=0.72), respectively. Discussion was needed for fewer than 100 references, and agreement was subsequently reached for 100%.
There were 22 randomized controlled trials and 8 nonrandomized studies (5 nonrandomized controlled trials and 3 controlled before-after studies). Most of these studies were conducted in the United States (13/30 studies), followed by other European countries (5 studies), and the United Kingdom (4 studies). A large number of studies were conducted among patients with cardiovascular disease or risk factors (10 studies), followed by postsurgical patients such as coronary artery bypass graft surgery or orthopaedic surgery (5 studies). Five of 30 studies were conducted among individuals older than 65 years. Most studies excluded patients who did not speak English or the country’s official language; only 3 studies included patients with limited literacy, patients who spoke other languages, or caregivers if the patients could not communicate.
Most studies tested the impact of educational discharge interventions (28 of 30 studies) (Table 1). Quite often, it was a member of the research team who carried out the patient education. Only 3 studies involved multiple members of the care team in designing or reviewing the discharge tool with the patient. Almost half (12 studies) targeted multiple aspects of postdischarge care, including medications and side effects, signs and symptoms to consider, plans for follow-up, dietary restrictions, and/or exercise modifications. Many (19 studies) provided education using one-on-one teaching in association with a discharge tool, accompanied by a written handout (13 studies), audiotape (2 studies), or video (3 studies). While 13 studies had patients involved in creating what content was discussed and 14 studies had patients involved in the delivery of the tool, only 6 studies had patients involved in both design and delivery of the tool. Nine studies also used visual aids such as pictures, larger font, or use of a tool enhanced for patients with language barriers or limited health literacy.
Among all 30 studies included, 16 studies tested the impact of their tool on comprehension postdischarge, with 10 studies demonstrating an improvement among patients who had received the tool (Table 2). Five studies evaluated healthcare utilization outcomes such as readmission, length of stay, or physician visits after discharge and 2 studies found improvements. Twelve studies also studied the impact on adherence with medications, diet, exercise, or follow-up instructions postdischarge. However, only 4 of these 12 studies showed a positive impact. Only 2 studies tested the impact on a patient’s ability to self-manage once at home, and both studies reported positive statistical outcomes. Few studies measured patient experience (such as patient satisfaction or improvement in self-efficacy) or mortality postdischarge.
DISCUSSION/CONCLUSION
Our systematic review found 30 studies that engaged patients during the design or the delivery of a discharge instruction tool and that tested the effect of the tool on postdischarge outcomes.6-10,14–38 Our review suggests that there is sufficient evidence that patient-centered discharge tools improve comprehension. However, evidence is currently insufficient to determine if patient-centered tools improve adherence with discharge instructions. Moreover, though limited studies show promising results, more studies are needed to determine if patient engagement improves self-efficacy and healthcare utilization after discharge.
A major limitation of current studies is the variability in the level of patient engagement in tool design or delivery. Patients were involved in the design mostly through targeted development of a discharge management plan and the delivery by encouraging them to ask questions. Few studies involved patients in the design of the tool such that patients were responsible for coming up with content that was of interest to them. The few that did, often with the additional use of video media, demonstrated significant outcomes. Only a minority of studies used an interactive process to assess understanding such as “teach-back” or maximize patient comprehension such as visual aids. Even fewer studies engaged patients in both developing the discharge tool and providing discharge instructions.
Several previous studies have demonstrated that most complications after discharge are the result of ineffective communication, which can be exacerbated by lack of fluency in English or by limited health literacy.2,39-43 As a result, poor understanding of discharge instructions by patients and their caregivers can create an important care gap.44 Therefore, the use of patient-centered tools to engage patients at discharge in their own care is needed. How to engage patients consistently and effectively is perhaps less evident, as demonstrated in this review of the literature in which different levels of patient engagement were found. Many of the tools tested placed attention on patient education, sometimes in the context of bundled care along with home visits or follow-up, all of which can require extensive resources and time. Providing patients with information that the patients themselves state is of value may be the easiest refinement to a discharge educational tool, although this was surprisingly uncommon.6,9,10,17,23,33,37 Only 2 studies were found that engaged patients in the initial stage of design of the discharge tool, by incorporating information of interest to them.23,32 For example, a study testing the impact of a computer-generated written education package on poststroke outcomes designed the information by asking patients to identify which topics they would like to receive information about (along with the amount of information and font size).23 Secondly, although most of the discharge tools reviewed included the use of one-on-one teaching and the use of media such as patient handouts, these tools were often used in such a way that patients were passive recipients. In fact, studies that used additional video media that incorporated personalized content were the most likely to demonstrate positive outcomes.17,34 The next level of patient engagement may therefore be to involve the patient as an interactive partner when delivering the tool in order to empower patients to self-care. For example, 1 study designed a structured education program by first assessing lifestyle risk factors related to hypertension that were modifiable along with preconceived notions through open-ended questions during a one-on-one interview.37 Patients were subsequently educated on any knowledge deficits regarding the management of their lifestyle. Another level of patient engagement may be to use visual aids during discussions, as a well-known complement to verbal instructions.45,46 For example, in a controlled study that randomized a ward of elderly patients with 4 or more prescriptions to predischarge counseling, the counseling session aimed to review reasons for their prescriptions along with corresponding side effects, doses, and dosage times with the help of a medicine reminder card. Other uses of visual aid tools identified in our review included the use of pictograms or illustrations or, at minimum, attention to font size.7,8,16,29,33,35 In the absence of a visual aid, asking the patient to repeat or demonstrate what was just communicated can be used to assess the amount of information retained.18,33
An important result discovered in our review of the literature was also the lack of studies that tested the impact of discharge tools on usability of discharge information once at home. Conducting an evaluation of the benefits to patients after discharge can help objectify vague outcomes like health gains or qualify benefits in patient’s views. This might also explain why many studies with documented patient engagement at the time of discharge were able to demonstrate improvements in comprehension but not adherence to instructions. Although patients and caregivers may understand the information, this comprehension does not necessarily mean they will find the information useful or adhere to it once at home. For example, in 1 study, patients discharged with at least 1 medication were randomized to a structured discharge interview during which the treatment plan was reviewed verbally and questions clarified along with a visually enhanced treatment card.26 Although knowledge of medications increased, no effect was found on adherence at 1 week postdischarge. However, use of the treatment card at home was not assessed. Similarly, another study tested the effect of an individualized video of exercises and failed to find a difference in patient adherence at 4 weeks.28 The authors suggested that the lack of benefit may have been because patients were not using the video once at home. This is in contrast to 2 studies that involved patients in their own care by requiring them to request their medication as part of a self-medication tool predischarge.16,30 Patients were engaged in the process such that increasing independence was given to patients based on their demonstration of understanding and adherence to their treatment while still in the hospital, a learning tool that can be applied once at home. Feeling knowledgeable and involved, as others have suggested, may be the intermediary outcomes that led to improved adherence.47 It is also possible that adherence to discharge instructions may vary based on complexity of the information provided, such that instructions focusing solely on medication use may require less patient engagement than discharge instructions that include information on medications, diet, exercise modifications, and follow-up.48
Our review has a few limitations. Previous systematic reviews have demonstrated that bundled discharge interventions that include patient-centered education have a positive effect on outcomes postdischarge.2,5 However, we sought to describe and study the individual and distinct impact of patient engagement in the creation and delivery of discharge tools on outcomes postdischarge. We hoped that this may provide others with key information regarding elements of patient engagement that were particularly useful when designing a new discharge tool. The variability of the studies we identified, however, made it difficult to ascertain what level of patient engagement is required to observe improvements in health outcomes. It is also possible that a higher level of patient engagement may have been used but not described in the studies we reviewed. As only primary outcomes were included, we may have underestimated the effect of patient-centered discharge tools on outcomes that were reported as secondary outcomes. As we were interested in reviewing as many studies of patient-centered discharge tools as possible, we did not assess the quality of the studies and cannot comment on the role of bias in these studies. However, we excluded studies with study designs known to have the highest risk of bias. Lastly, we also cannot comment on whether patient-centered tools may have an effect on outcomes more than 3 months after a hospital discharge. However, several studies included in this review suggest a sustained effect beyond this time period.8,25,32,37
Patient-centered discharge tools in which patients were engaged in the design or the delivery were found to improve comprehension of but not adherence with discharge instructions. The perceived lack of improved adherence may be due to a lack of studies that measured the usefulness and utilization of information for patients once at home. There was also substantial variability in the extent of patient involvement in designing the style and content of information provided to patients at discharge, as well as the extent of patient engagement when receiving discharge instructions. Future studies would benefit from detailing the level of patient engagement needed in designing and delivery of discharge tools. This information may lead to the discovery of barriers and facilitators to utilization of discharge information once at home and lead to a better understanding of the patient’s journey from hospital to home and onwards.
C.M.B. and this work were funded by a CIHR Canadian Patient Safety Institute Chair in Patient Safety and Continuity of Care. Funding was provided to cover fees to obtain articles from the Donald J. Matthews Complex Care Fund of the University Health Network in Toronto, Canada. The Toronto Central Local Health Integration Network provided funding for the design and implementation of a patient-oriented discharge summary. None of the funding or supportive agencies were involved in the design or conduct of the present study, analysis, or interpretation of the data, or approval of the manuscript.
Disclosures
The authors report no conflicts of interest.
Patient-centered care, defined by the Institute of Medicine as “health care that establishes a partnership among practitioners, patients, and their families to ensure that decisions respect patients’ wants, needs and preferences and that patients have the education and support they need to make decisions and participate in their own care,” has been recognized as an important factor in improving care transitions after discharge from the hospital.1 Previous efforts to improve the discharge process for hospitalized patients and reduce avoidable readmissions have focused on improving systems surrounding the patient, such as by increasing the availability of outpatient follow-up or standardizing communication between the inpatient and outpatient care teams.1,2 In fact, successful programs such as Project BOOST and the Care Transitions Interventions™ provide healthcare institutions with a “bundle” of evidence-based transitional care guidelines for discharge: they provide postdischarge transition coaches, assistance with medication self-management, timely follow-up tips, and improved patient records in order to improve postdischarge outcomes.3,4 Successful interventions, however, may not provide more services, but also engage the patient in their own care.5,6 The impact of engaging the patient in his or her own care by providing patient-friendly discharge instructions alone, however, is unknown.
A patient-centered discharge may use tools that were designed with patients, or may involve engaging patients in an interactive process of reviewing discharge instructions and empowering them to manage aspects of their own care after leaving the hospital. This endeavour may lead to more effective use of discharge instructions and reduce the need for additional or more intensive (and costly) interventions. For example, a patient-centered discharge tool could include an educational intervention that uses the “teach-back” method, in which patients are asked to restate in their own words what they thought they heard, or in which staff use additional media or a visual design tool meant to enhance comprehension of discharge instructions.6,7 Visual aids and the use of larger fonts are particularly useful design elements for improving comprehension among non-English speakers and patients with low health literacy, who tend to have poorer recall of instructions.8-10 What may constitute essential design elements to include in a discharge instruction tool, however, is not clear.
Moreover, whether the use of discharge tools with a specific focus on patient engagement may improve postdischarge outcomes is not known. Particularly, the ability of patient-centered discharge tools to improve outcomes beyond comprehension such as self-management, adherence to discharge instructions, a reduction in unplanned visits, and a reduction in mortality has not been studied systematically. The objective of this systematic review was to review the literature on discharge instruction tools with a focus on patient engagement and their impact among hospitalized patients.
METHODS
The Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) Statement was followed as a guideline for reporting throughout this review.11
Data Sources
A literature search was undertaken using the following databases from January 1994 or their inception date to May 2014: Medline, Embase, SIGLE, HTA, Bioethics, ASSIA, Psych Lit, CINAHL, Cochrane Library, EconLit, ERIC, and BioMed Central. We also searched relevant design-focused journals such as Design Issues, Journal of Design Research, Information Design Journal, Innovation, Design Studies, and International Journal of Design, as well as reference lists from studies obtained by electronic searching. The following key words and combination of key words were used with the assistance of a medical librarian: patient discharge, patient-centered discharge, patient-centered design, design thinking, user based design, patient education, discharge summary, education. Additional search terms were added when identified from relevant articles (Appendix).
Inclusion Criteria
We included all English-language studies with patients admitted to the hospital irrespective of age, sex, or medical condition, which included a control group or time period and which measured patient outcomes within 3 months of discharge. The 3-month period after discharge is often cited as a time when outcomes could reasonably be associated with an intervention at discharge.2
Exclusion Criteria
Studies that did not have clear implementation of a patient-centered tool, a control group, or those whose tool was used in the emergency department or as an outpatient were excluded. Studies that included postdischarge tools such as home visits or telephone calls were excluded unless independent effects of the predischarge interventions were measured. Studies with outcomes reported after 3 months were excluded unless outcomes before 3 months were also clearly noted.
All searches were entered into Endnote and duplicates were removed. A 2-stage inclusion process was used. Titles and abstracts of articles were first screened for meeting inclusion and exclusion criteria by 1 reviewer. A second reviewer independently checked a 10% random sample of all the abstracts that met the initial screening criteria. If the agreement to exclude studies was less than 95%, criteria were reviewed before checking the rest of the 90% sample. In the second stage, 2 independent reviewers examined paper copies of the full articles selected in the first stage. Disagreement between reviewers was resolved by discussion or a third reviewer if no agreement could be reached.
Data Analysis and Synthesis
The following information was extracted from the full reference: type of study, population studied, control group or time period, tool used, and outcomes measured. Based on the National Health Care Quality report’s priorities and goals on patient and/or family engagement during transitions of care, educational tools were further described based on method of teaching, involvement of the care team, involvement of the patient in the design or delivery of the tool, and/or the use of visual aids.12 All primary outcomes were classified according to 3 categories: improved knowledge/comprehension, patient experience (patient satisfaction, self-management/efficacy such as functional status, both physical and mental), and health outcomes (unscheduled visits or readmissions, adherence with medications, diet, exercise, or follow-up, and mortality).
No quantitative pooling of results or meta-analysis was done given the variability and heterogeneity of studies reviewed. However, following guidelines for Effect Practice and Organisation of Care (EPOC) Risk of Bias criteria,13 studies that had a higher risk of bias such as uncontrolled before-after studies or studies with only 1 intervention or control site (historical controls, eg) were excluded from the final review because of the difficulties in attributing causation. Only primary outcomes were reported in order to minimize type II errors.
RESULTS
Our search revealed a total of 3699 studies after duplicates had been removed (Figure). A total of 714 references were included after initial review by title and abstract and 30 studies after full-text review. Agreement on a 10% random sample of all abstracts and full text was 79% (k=0.58) and 86% (k=0.72), respectively. Discussion was needed for fewer than 100 references, and agreement was subsequently reached for 100%.
There were 22 randomized controlled trials and 8 nonrandomized studies (5 nonrandomized controlled trials and 3 controlled before-after studies). Most of these studies were conducted in the United States (13/30 studies), followed by other European countries (5 studies), and the United Kingdom (4 studies). A large number of studies were conducted among patients with cardiovascular disease or risk factors (10 studies), followed by postsurgical patients such as coronary artery bypass graft surgery or orthopaedic surgery (5 studies). Five of 30 studies were conducted among individuals older than 65 years. Most studies excluded patients who did not speak English or the country’s official language; only 3 studies included patients with limited literacy, patients who spoke other languages, or caregivers if the patients could not communicate.
Most studies tested the impact of educational discharge interventions (28 of 30 studies) (Table 1). Quite often, it was a member of the research team who carried out the patient education. Only 3 studies involved multiple members of the care team in designing or reviewing the discharge tool with the patient. Almost half (12 studies) targeted multiple aspects of postdischarge care, including medications and side effects, signs and symptoms to consider, plans for follow-up, dietary restrictions, and/or exercise modifications. Many (19 studies) provided education using one-on-one teaching in association with a discharge tool, accompanied by a written handout (13 studies), audiotape (2 studies), or video (3 studies). While 13 studies had patients involved in creating what content was discussed and 14 studies had patients involved in the delivery of the tool, only 6 studies had patients involved in both design and delivery of the tool. Nine studies also used visual aids such as pictures, larger font, or use of a tool enhanced for patients with language barriers or limited health literacy.
Among all 30 studies included, 16 studies tested the impact of their tool on comprehension postdischarge, with 10 studies demonstrating an improvement among patients who had received the tool (Table 2). Five studies evaluated healthcare utilization outcomes such as readmission, length of stay, or physician visits after discharge and 2 studies found improvements. Twelve studies also studied the impact on adherence with medications, diet, exercise, or follow-up instructions postdischarge. However, only 4 of these 12 studies showed a positive impact. Only 2 studies tested the impact on a patient’s ability to self-manage once at home, and both studies reported positive statistical outcomes. Few studies measured patient experience (such as patient satisfaction or improvement in self-efficacy) or mortality postdischarge.
DISCUSSION/CONCLUSION
Our systematic review found 30 studies that engaged patients during the design or the delivery of a discharge instruction tool and that tested the effect of the tool on postdischarge outcomes.6-10,14–38 Our review suggests that there is sufficient evidence that patient-centered discharge tools improve comprehension. However, evidence is currently insufficient to determine if patient-centered tools improve adherence with discharge instructions. Moreover, though limited studies show promising results, more studies are needed to determine if patient engagement improves self-efficacy and healthcare utilization after discharge.
A major limitation of current studies is the variability in the level of patient engagement in tool design or delivery. Patients were involved in the design mostly through targeted development of a discharge management plan and the delivery by encouraging them to ask questions. Few studies involved patients in the design of the tool such that patients were responsible for coming up with content that was of interest to them. The few that did, often with the additional use of video media, demonstrated significant outcomes. Only a minority of studies used an interactive process to assess understanding such as “teach-back” or maximize patient comprehension such as visual aids. Even fewer studies engaged patients in both developing the discharge tool and providing discharge instructions.
Several previous studies have demonstrated that most complications after discharge are the result of ineffective communication, which can be exacerbated by lack of fluency in English or by limited health literacy.2,39-43 As a result, poor understanding of discharge instructions by patients and their caregivers can create an important care gap.44 Therefore, the use of patient-centered tools to engage patients at discharge in their own care is needed. How to engage patients consistently and effectively is perhaps less evident, as demonstrated in this review of the literature in which different levels of patient engagement were found. Many of the tools tested placed attention on patient education, sometimes in the context of bundled care along with home visits or follow-up, all of which can require extensive resources and time. Providing patients with information that the patients themselves state is of value may be the easiest refinement to a discharge educational tool, although this was surprisingly uncommon.6,9,10,17,23,33,37 Only 2 studies were found that engaged patients in the initial stage of design of the discharge tool, by incorporating information of interest to them.23,32 For example, a study testing the impact of a computer-generated written education package on poststroke outcomes designed the information by asking patients to identify which topics they would like to receive information about (along with the amount of information and font size).23 Secondly, although most of the discharge tools reviewed included the use of one-on-one teaching and the use of media such as patient handouts, these tools were often used in such a way that patients were passive recipients. In fact, studies that used additional video media that incorporated personalized content were the most likely to demonstrate positive outcomes.17,34 The next level of patient engagement may therefore be to involve the patient as an interactive partner when delivering the tool in order to empower patients to self-care. For example, 1 study designed a structured education program by first assessing lifestyle risk factors related to hypertension that were modifiable along with preconceived notions through open-ended questions during a one-on-one interview.37 Patients were subsequently educated on any knowledge deficits regarding the management of their lifestyle. Another level of patient engagement may be to use visual aids during discussions, as a well-known complement to verbal instructions.45,46 For example, in a controlled study that randomized a ward of elderly patients with 4 or more prescriptions to predischarge counseling, the counseling session aimed to review reasons for their prescriptions along with corresponding side effects, doses, and dosage times with the help of a medicine reminder card. Other uses of visual aid tools identified in our review included the use of pictograms or illustrations or, at minimum, attention to font size.7,8,16,29,33,35 In the absence of a visual aid, asking the patient to repeat or demonstrate what was just communicated can be used to assess the amount of information retained.18,33
An important result discovered in our review of the literature was also the lack of studies that tested the impact of discharge tools on usability of discharge information once at home. Conducting an evaluation of the benefits to patients after discharge can help objectify vague outcomes like health gains or qualify benefits in patient’s views. This might also explain why many studies with documented patient engagement at the time of discharge were able to demonstrate improvements in comprehension but not adherence to instructions. Although patients and caregivers may understand the information, this comprehension does not necessarily mean they will find the information useful or adhere to it once at home. For example, in 1 study, patients discharged with at least 1 medication were randomized to a structured discharge interview during which the treatment plan was reviewed verbally and questions clarified along with a visually enhanced treatment card.26 Although knowledge of medications increased, no effect was found on adherence at 1 week postdischarge. However, use of the treatment card at home was not assessed. Similarly, another study tested the effect of an individualized video of exercises and failed to find a difference in patient adherence at 4 weeks.28 The authors suggested that the lack of benefit may have been because patients were not using the video once at home. This is in contrast to 2 studies that involved patients in their own care by requiring them to request their medication as part of a self-medication tool predischarge.16,30 Patients were engaged in the process such that increasing independence was given to patients based on their demonstration of understanding and adherence to their treatment while still in the hospital, a learning tool that can be applied once at home. Feeling knowledgeable and involved, as others have suggested, may be the intermediary outcomes that led to improved adherence.47 It is also possible that adherence to discharge instructions may vary based on complexity of the information provided, such that instructions focusing solely on medication use may require less patient engagement than discharge instructions that include information on medications, diet, exercise modifications, and follow-up.48
Our review has a few limitations. Previous systematic reviews have demonstrated that bundled discharge interventions that include patient-centered education have a positive effect on outcomes postdischarge.2,5 However, we sought to describe and study the individual and distinct impact of patient engagement in the creation and delivery of discharge tools on outcomes postdischarge. We hoped that this may provide others with key information regarding elements of patient engagement that were particularly useful when designing a new discharge tool. The variability of the studies we identified, however, made it difficult to ascertain what level of patient engagement is required to observe improvements in health outcomes. It is also possible that a higher level of patient engagement may have been used but not described in the studies we reviewed. As only primary outcomes were included, we may have underestimated the effect of patient-centered discharge tools on outcomes that were reported as secondary outcomes. As we were interested in reviewing as many studies of patient-centered discharge tools as possible, we did not assess the quality of the studies and cannot comment on the role of bias in these studies. However, we excluded studies with study designs known to have the highest risk of bias. Lastly, we also cannot comment on whether patient-centered tools may have an effect on outcomes more than 3 months after a hospital discharge. However, several studies included in this review suggest a sustained effect beyond this time period.8,25,32,37
Patient-centered discharge tools in which patients were engaged in the design or the delivery were found to improve comprehension of but not adherence with discharge instructions. The perceived lack of improved adherence may be due to a lack of studies that measured the usefulness and utilization of information for patients once at home. There was also substantial variability in the extent of patient involvement in designing the style and content of information provided to patients at discharge, as well as the extent of patient engagement when receiving discharge instructions. Future studies would benefit from detailing the level of patient engagement needed in designing and delivery of discharge tools. This information may lead to the discovery of barriers and facilitators to utilization of discharge information once at home and lead to a better understanding of the patient’s journey from hospital to home and onwards.
C.M.B. and this work were funded by a CIHR Canadian Patient Safety Institute Chair in Patient Safety and Continuity of Care. Funding was provided to cover fees to obtain articles from the Donald J. Matthews Complex Care Fund of the University Health Network in Toronto, Canada. The Toronto Central Local Health Integration Network provided funding for the design and implementation of a patient-oriented discharge summary. None of the funding or supportive agencies were involved in the design or conduct of the present study, analysis, or interpretation of the data, or approval of the manuscript.
Disclosures
The authors report no conflicts of interest.
1. Hurtad
2. Mistiaen P, Francke AL, Poot E. Interventions aimed at reducing problems in adult patients discharged from hospital to home: a systematic meta-review. BMC Health Serv Res. 2007;7:47. PubMed
3. Coleman EA, Parry C, Chalmers S, Min SJ. The care transitions intervention: results of a randomized controlled trial. Arch Intern Med. 2006;166(17):1822-1828. PubMed
4. Hansen LO, Greenwald JL, Budnitz T, et al. Project BOOST: effectiveness of a multihospital effort to reduce rehospitalization. J Hosp Med. 2013;8(8):421-427. PubMed
5. Hansen LO, Young RS, Hinami K, et al. Interventions to reduce 30-day rehospitalization: a systematic review. Ann Intern Med. 2011;155(8):520-528. PubMed
6. Osman LM, Calder C, Godden DJ, et al. A randomised trial of self-management planning for adult patients admitted to hospital with acute asthma. Thorax. 2002;57(10):869-874. PubMed
7. Cordasco KM, Asch SM, Bell DS, et al. A low-literacy medication education tool for safety-net hospital patients. Am J Prev Med. 2009;37(6 suppl 1):S209-S216. PubMed
8. Morice AH, Wrench C. The role of the asthma nurse in treatment compliance and self-management following hospital admission. Resp Med. 2001;95(11):851-856. PubMed
9. Haerem JW, Ronning EJ, Leidal R. Home access to hospital discharge information on audiotape reduces sick leave and readmissions in patients with first-time myocardial infarction. Scand Cardiovasc J. 2000;34(2):219-222. PubMed
10. Legrain S, Tubach F, Bonnet-Zamponi D, et al. A new multimodal geriatric discharge-planning intervention to prevent emergency visits and rehospitalizations of older adults: the optimization of medication in AGEd multicenter randomized controlled trial. J Am Geriatr Soc. 2011;59(11):2017-2028. PubMed
11. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264-269. PubMed
12. Partnership NP. National Priorities and Goals: Aligning Our Efforts to Transform America’s Healthcare. Washington, DC: National Quality Forum; 2008.
13. Effective Practice and Organisation of Care (EPOC). EPOC-specific resources for review authors. Oslo, Norway: Norwegian Knowledge Centre for the Health Services; 2013. http://epoc.cochrane.org/epoc-specific-resources-review-authors. Accessed December 21, 2016.
14. Manning DM, O’Meara JG, Williams AR, et al. 3D: a tool for medication discharge education. Qual Saf Health Care. 2007;16(1):71-76. PubMed
15. Perera KY, Ranasinghe P, Adikari AM, et al. Medium of language in discharge summaries: would the use of native language improve patients’ knowledge of their illness and medications? J Health Commun. 2012;17(2):141-148. PubMed
16. Lowe CJ, Raynor DK, Courtney EA, et al. Effects of self medication programme on knowledge of drugs and compliance with treatment in elderly patients. BMJ. 1995;310(6989):1229-1231. PubMed
17. Mahler HI, Kulik JA, Tarazi RY. Effects of a videotape information intervention at discharge on diet and exercise compliance after coronary bypass surgery. J Cardiopulm Rehabil. 1999;19(3):170-177. PubMed
18. Al-Rashed SA, Wright DJ, Roebuck N, et al. The value of inpatient pharmaceutical counseling to elderly patients prior to discharge. Br J Clin Pharmacol. 2002;54(6):657-664. PubMed
19. Drenth-van Maanen AC, Wilting I, Jansen PA, et al. Effect of a discharge medication intervention on the incidence and nature of medication discrepancies in older adults. J Am Geriatr Soc. 2013;61(3):456-458. PubMed
20. Eshah NF. Predischarge education improves adherence to a healthy lifestyle among Jordanian patients with acute coronary syndrome. Nurs Health Sci. 2013;15(3):273-279. PubMed
21. Gwadry-Sridhar FH, Arnold JM, Zhang Y,et al. Pilot study to determine the impact of a multidisciplinary educational intervention in patients hospitalized with heart failure. Am Heart J. 2005;150(5):982. PubMed
22. Ho SM, Heh SS, Jevitt CM, et al. Effectiveness of a discharge education program in reducing the severity of postpartum depression: a randomized controlled evaluation study. Patient Educ Couns. 2009;77(1):68-71. PubMed
23. Hoffmann T, McKenna K, Worrall L, et al. Randomised trial of a computer-generated tailored written education package for patients following stroke. Age Ageing. 2007;36(3):280-286. PubMed
24. Jenkins HM, Blank V, Miller K, et al. A randomized single-blind evaluation of a discharge teaching book for pediatric patients with burns. J Burn Care Rehabil. 1996;17(1):49-61. PubMed
25. Kommuri NV, Johnson ML, Koelling TM. Relationship between improvements in heart failure patient disease specific knowledge and clinical events as part of a randomized controlled trial. Patient Educ Couns. 2012;86(2):233-238. PubMed
26. Louis-Simonet M, Kossovsky MP, Sarasin FP, et al. Effects of a structured patient-centered discharge interview on patients’ knowledge about their medications. Am J Med. 2004;117(8):563-568. PubMed
27. Lucas KS. Outcomes evaluation of a pharmacist discharge medication teaching service. Am J Health Syst Pharm. 1998;55(24 suppl 4):S32-S35. PubMed
28. Lysack C, Dama M, Neufeld S, et al. A compliance and satisfaction with home exercise: a comparison of computer-assisted video instruction and routine rehabilitation practice. J Allied Health. 2005;34(2):76-82. PubMed
29. Moore SM. The effects of a discharge information intervention on recovery outcomes following coronary artery bypass surgery. Int J Nurs Stud. 1996;33(2):181-189. PubMed
30. Pereles L, Romonko L, Murzyn T, et al. Evaluation of a self-medication program. J Am Geriatr Soc. 1996;44(2):161-165. PubMed
31. Reynolds MA. Postoperative pain management discharge teaching in a rural population. Pain Manag Nurs. 2009;10(2):76-84. PubMed
32. Sabariego C, Barrera AE, Neubert S, et al. Evaluation of an ICF-based patient education programme for stroke patients: a randomized, single-blinded, controlled, multicentre trial of the effects on self-efficacy, life satisfaction and functioning. Br J Health Psychol. 2013;18(4):707-728. PubMed
33. Shieh SJ, Chen HL, Liu FC, et al. The effectiveness of structured discharge education on maternal confidence, caring knowledge and growth of premature newborns. J Clin Nurs. 2010;19(23-24):3307-3313. PubMed
34. Steinberg TG, Diercks MJ, Millspaugh J. An evaluation of the effectiveness of a videotape for discharge teaching of organ transplant recipients. J Transpl Coord. 1996;6(2):59-63. PubMed
35. Whitby M, McLaws ML, Doidge S, et al. Post-discharge surgical site surveillance: does patient education improve reliability of diagnosis? J Hosp Infect. 2007;66(3):237-242. PubMed
36. Williford SL, Johnson DF. Impact of pharmacist counseling on medication knowledge and compliance. Mil Med. 1995;160(11):561–564. PubMed
37. Zernike W, Henderson A. Evaluating the effectiveness of two teaching strategies for patients diagnosed with hypertension. J Clin Nurs. 1998;7(1):37–44. PubMed
38. Press VG, Arora V, Constantine KL, et al. Forget me not: a randomized trial of the durability of hospital-based education on inhalers for patients with COPD or asthma [abstract]. J Gen Intern Med. 2014;29(1 suppl):S102.
39. Davis TC, Wolf MS, Bass PF, et al. Literacy and misunderstanding prescription drug labels. Ann Intern Med. 2006;145(12):887–894. PubMed
40. McCarthy DM, Waite KR, Curtis LM, et al. What did the doctor say? Health literacy and recall of medical instructions. Med Care. 2012;50(4):277–282. PubMed
41. Tarn DM, Heritage J, Paterniti DA, et al. Physician communication when prescribing new medications. Arch Intern Med. 2006;166(17):1855–1862. PubMed
42. Cawthon C, Walia S, Osborn CY, et al. Improving care transitions: the patient perspective. J Health Commun. 2012;17(suppl 3):312–324. PubMed
43. Karliner LS, Auerbach A, Nápoles A, et al. Language barriers and understanding of hospital discharge instructions. Med Care. 2012;50(4):283–289. PubMed
44. Enhancing the Continuum of Care. Report of the Avoidable Hospitalization Advisory Panel. http://www.health.gov.on.ca/en/common/ministry/publications/reports/baker_2011/baker_2011.pdf. Published November 2011. Accessed December 22, 2016.
45. Chugh A, Williams MV, Grigsby J, et al. Better transitions: improving comprehension of discharge instructions. Front Health Serv Manage. 2009;25(3):11–32. PubMed
46. Schillinger D, Machtinger EL, Wang F, et al. Language, literacy, and communication regarding medication in an anticoagulation clinic: a comparison of verbal vs. visual assessment. J Health Commun. 2006;11(7):651–664. PubMed
47. Epstein RM, Street RL, Jr. The values and value of patient-centered care. Ann Fam Med. 2011;9(2):100–103. PubMed
48. Albrecht JS, Gruber-Baldini AL, Hirshon JM, et al. Hospital discharge instructions: comprehension and compliance among older adults. J Gen Intern Med. 2014;29(11):1491–1498. PubMed
1. Hurtad
2. Mistiaen P, Francke AL, Poot E. Interventions aimed at reducing problems in adult patients discharged from hospital to home: a systematic meta-review. BMC Health Serv Res. 2007;7:47. PubMed
3. Coleman EA, Parry C, Chalmers S, Min SJ. The care transitions intervention: results of a randomized controlled trial. Arch Intern Med. 2006;166(17):1822-1828. PubMed
4. Hansen LO, Greenwald JL, Budnitz T, et al. Project BOOST: effectiveness of a multihospital effort to reduce rehospitalization. J Hosp Med. 2013;8(8):421-427. PubMed
5. Hansen LO, Young RS, Hinami K, et al. Interventions to reduce 30-day rehospitalization: a systematic review. Ann Intern Med. 2011;155(8):520-528. PubMed
6. Osman LM, Calder C, Godden DJ, et al. A randomised trial of self-management planning for adult patients admitted to hospital with acute asthma. Thorax. 2002;57(10):869-874. PubMed
7. Cordasco KM, Asch SM, Bell DS, et al. A low-literacy medication education tool for safety-net hospital patients. Am J Prev Med. 2009;37(6 suppl 1):S209-S216. PubMed
8. Morice AH, Wrench C. The role of the asthma nurse in treatment compliance and self-management following hospital admission. Resp Med. 2001;95(11):851-856. PubMed
9. Haerem JW, Ronning EJ, Leidal R. Home access to hospital discharge information on audiotape reduces sick leave and readmissions in patients with first-time myocardial infarction. Scand Cardiovasc J. 2000;34(2):219-222. PubMed
10. Legrain S, Tubach F, Bonnet-Zamponi D, et al. A new multimodal geriatric discharge-planning intervention to prevent emergency visits and rehospitalizations of older adults: the optimization of medication in AGEd multicenter randomized controlled trial. J Am Geriatr Soc. 2011;59(11):2017-2028. PubMed
11. Moher D, Liberati A, Tetzlaff J, et al. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. Ann Intern Med. 2009;151(4):264-269. PubMed
12. Partnership NP. National Priorities and Goals: Aligning Our Efforts to Transform America’s Healthcare. Washington, DC: National Quality Forum; 2008.
13. Effective Practice and Organisation of Care (EPOC). EPOC-specific resources for review authors. Oslo, Norway: Norwegian Knowledge Centre for the Health Services; 2013. http://epoc.cochrane.org/epoc-specific-resources-review-authors. Accessed December 21, 2016.
14. Manning DM, O’Meara JG, Williams AR, et al. 3D: a tool for medication discharge education. Qual Saf Health Care. 2007;16(1):71-76. PubMed
15. Perera KY, Ranasinghe P, Adikari AM, et al. Medium of language in discharge summaries: would the use of native language improve patients’ knowledge of their illness and medications? J Health Commun. 2012;17(2):141-148. PubMed
16. Lowe CJ, Raynor DK, Courtney EA, et al. Effects of self medication programme on knowledge of drugs and compliance with treatment in elderly patients. BMJ. 1995;310(6989):1229-1231. PubMed
17. Mahler HI, Kulik JA, Tarazi RY. Effects of a videotape information intervention at discharge on diet and exercise compliance after coronary bypass surgery. J Cardiopulm Rehabil. 1999;19(3):170-177. PubMed
18. Al-Rashed SA, Wright DJ, Roebuck N, et al. The value of inpatient pharmaceutical counseling to elderly patients prior to discharge. Br J Clin Pharmacol. 2002;54(6):657-664. PubMed
19. Drenth-van Maanen AC, Wilting I, Jansen PA, et al. Effect of a discharge medication intervention on the incidence and nature of medication discrepancies in older adults. J Am Geriatr Soc. 2013;61(3):456-458. PubMed
20. Eshah NF. Predischarge education improves adherence to a healthy lifestyle among Jordanian patients with acute coronary syndrome. Nurs Health Sci. 2013;15(3):273-279. PubMed
21. Gwadry-Sridhar FH, Arnold JM, Zhang Y,et al. Pilot study to determine the impact of a multidisciplinary educational intervention in patients hospitalized with heart failure. Am Heart J. 2005;150(5):982. PubMed
22. Ho SM, Heh SS, Jevitt CM, et al. Effectiveness of a discharge education program in reducing the severity of postpartum depression: a randomized controlled evaluation study. Patient Educ Couns. 2009;77(1):68-71. PubMed
23. Hoffmann T, McKenna K, Worrall L, et al. Randomised trial of a computer-generated tailored written education package for patients following stroke. Age Ageing. 2007;36(3):280-286. PubMed
24. Jenkins HM, Blank V, Miller K, et al. A randomized single-blind evaluation of a discharge teaching book for pediatric patients with burns. J Burn Care Rehabil. 1996;17(1):49-61. PubMed
25. Kommuri NV, Johnson ML, Koelling TM. Relationship between improvements in heart failure patient disease specific knowledge and clinical events as part of a randomized controlled trial. Patient Educ Couns. 2012;86(2):233-238. PubMed
26. Louis-Simonet M, Kossovsky MP, Sarasin FP, et al. Effects of a structured patient-centered discharge interview on patients’ knowledge about their medications. Am J Med. 2004;117(8):563-568. PubMed
27. Lucas KS. Outcomes evaluation of a pharmacist discharge medication teaching service. Am J Health Syst Pharm. 1998;55(24 suppl 4):S32-S35. PubMed
28. Lysack C, Dama M, Neufeld S, et al. A compliance and satisfaction with home exercise: a comparison of computer-assisted video instruction and routine rehabilitation practice. J Allied Health. 2005;34(2):76-82. PubMed
29. Moore SM. The effects of a discharge information intervention on recovery outcomes following coronary artery bypass surgery. Int J Nurs Stud. 1996;33(2):181-189. PubMed
30. Pereles L, Romonko L, Murzyn T, et al. Evaluation of a self-medication program. J Am Geriatr Soc. 1996;44(2):161-165. PubMed
31. Reynolds MA. Postoperative pain management discharge teaching in a rural population. Pain Manag Nurs. 2009;10(2):76-84. PubMed
32. Sabariego C, Barrera AE, Neubert S, et al. Evaluation of an ICF-based patient education programme for stroke patients: a randomized, single-blinded, controlled, multicentre trial of the effects on self-efficacy, life satisfaction and functioning. Br J Health Psychol. 2013;18(4):707-728. PubMed
33. Shieh SJ, Chen HL, Liu FC, et al. The effectiveness of structured discharge education on maternal confidence, caring knowledge and growth of premature newborns. J Clin Nurs. 2010;19(23-24):3307-3313. PubMed
34. Steinberg TG, Diercks MJ, Millspaugh J. An evaluation of the effectiveness of a videotape for discharge teaching of organ transplant recipients. J Transpl Coord. 1996;6(2):59-63. PubMed
35. Whitby M, McLaws ML, Doidge S, et al. Post-discharge surgical site surveillance: does patient education improve reliability of diagnosis? J Hosp Infect. 2007;66(3):237-242. PubMed
36. Williford SL, Johnson DF. Impact of pharmacist counseling on medication knowledge and compliance. Mil Med. 1995;160(11):561–564. PubMed
37. Zernike W, Henderson A. Evaluating the effectiveness of two teaching strategies for patients diagnosed with hypertension. J Clin Nurs. 1998;7(1):37–44. PubMed
38. Press VG, Arora V, Constantine KL, et al. Forget me not: a randomized trial of the durability of hospital-based education on inhalers for patients with COPD or asthma [abstract]. J Gen Intern Med. 2014;29(1 suppl):S102.
39. Davis TC, Wolf MS, Bass PF, et al. Literacy and misunderstanding prescription drug labels. Ann Intern Med. 2006;145(12):887–894. PubMed
40. McCarthy DM, Waite KR, Curtis LM, et al. What did the doctor say? Health literacy and recall of medical instructions. Med Care. 2012;50(4):277–282. PubMed
41. Tarn DM, Heritage J, Paterniti DA, et al. Physician communication when prescribing new medications. Arch Intern Med. 2006;166(17):1855–1862. PubMed
42. Cawthon C, Walia S, Osborn CY, et al. Improving care transitions: the patient perspective. J Health Commun. 2012;17(suppl 3):312–324. PubMed
43. Karliner LS, Auerbach A, Nápoles A, et al. Language barriers and understanding of hospital discharge instructions. Med Care. 2012;50(4):283–289. PubMed
44. Enhancing the Continuum of Care. Report of the Avoidable Hospitalization Advisory Panel. http://www.health.gov.on.ca/en/common/ministry/publications/reports/baker_2011/baker_2011.pdf. Published November 2011. Accessed December 22, 2016.
45. Chugh A, Williams MV, Grigsby J, et al. Better transitions: improving comprehension of discharge instructions. Front Health Serv Manage. 2009;25(3):11–32. PubMed
46. Schillinger D, Machtinger EL, Wang F, et al. Language, literacy, and communication regarding medication in an anticoagulation clinic: a comparison of verbal vs. visual assessment. J Health Commun. 2006;11(7):651–664. PubMed
47. Epstein RM, Street RL, Jr. The values and value of patient-centered care. Ann Fam Med. 2011;9(2):100–103. PubMed
48. Albrecht JS, Gruber-Baldini AL, Hirshon JM, et al. Hospital discharge instructions: comprehension and compliance among older adults. J Gen Intern Med. 2014;29(11):1491–1498. PubMed
Using Co-Design Methods to Create a Patient-Oriented Discharge Summary
From the OpenLab, University Health Network, Toronto, Canada (Dr. Hahn-Goldberg, Dr. Okrainec, Dr. Abrams, Mr. Huynh); School of Health Policy and Management, York University, Toronto (Dr. Hahn-Goldberg); Toronto Central Local Health Integration Network (Ms. Damba); Centre for Addiction and Mental Health, Toronto (Ms. Solomon); and the Department of Medicine, University Health Network, Toronto (Dr. Okrainec, Dr. Abrams).
Abstract
- Objective: To describe the co-design process we under-took to create a patient-oriented discharge summary (PODS) with patients, caregivers, and providers.
- Method: Descriptive report.
- Results: We designed and produced a prototype PODS, based on best practices in information design, graphic design, and patient education. Through a co-design process, patients, health care providers, designers and system planners worked together to establish what content needed to be included, as well as how it would be organized and presented. From an initial prototype, we then refined the PODS through an iterative participatory design process involving patients, including those from hard-to-reach groups such as patients with language barriers and/or low health literacy and patients with a primary psychiatric diagnosis.
- Conclusion: Co-design events and targeted focus groups are very useful for engaging patients and caregivers in the design and development of solutions aimed at improving their experience of care. It is important to include all users, especially those who are harder to reach, such as patients with language barriers and mental health conditions. Engaging health care providers is essential to ensure feasibility of those solutions.
Traditional discharge summaries are written primarily for the patient’s primary care provider and are not designed as tools to support communication between the clinician and patient regarding instructions for patients to follow at home post discharge. A more patient-centered version of the discharge summary is needed to complement the traditional format.
To enhance our patients’ care experience in the post-discharge period, we set out to co-design a patient-oriented discharge summary (PODS) with patients, caregivers, and providers. The main objective of this project was to develop a prototype PODS that not only addressed critical information that patients felt was the most important to know following discharge, but also provided this information in the most comprehensible format at hospitals within the Toronto area. The project focused on reformatting patient-care instructions for patients discharged from inpatient medical wards as these instructions presented the best opportunity for improvement.
This project drew on work done in countries such as India, South Africa, and Pakistan, where challenges with general and health literacy have led to the introduction of simplified discharge forms and medication instructions that place a greater emphasis on visual communication to improve information comprehension. For example, the use of pictograms in patient materials has been shown to increase patient understanding of and compliance with care instructions in these countries [1–3].
We have provided an overview of the PODS project elsewhere [4]. In this article, we describe the co-design process we undertook with patients, health care providers, and designers in creating a PODS.
Design Methods
We used several methods to design and develop the PODS and to engage multiple stakeholders in the design process. Among these methods were innovative techniques for understanding the patient experience of discharge, such as cultural probes [5], where patients were given journals and cameras to document their time at home after discharge, as described by Hahn-Goldberg et al [4]. Other key methods for determining the design of the PODS included:
Patient education consultation. A patient education representative with training and expertise in designing materials for patients with low health literacy was added to the team advisory committee to act as a consultant at all stages of the study. This helped to ensure that we would be following best practices in design for our target population.
Review of literature. We reviewed the literature pertaining to design for patients with low health literacy and language barriers, including the resources available through the patient education department at the University Health Network.
Review of Toronto Central Local Health Integration Network (TCLHIN) hospitals’ tools: current discharge summaries, components they included and how they were formatted.
Co-design event. We held an interprofessional design event where teams of patients, health care providers, and designers worked together to create draft PODS for 4 hypothetical patient cases.
Focus groups and surveys. We used feedback from focus groups and surveys to revise and improve the first PODS prototype.
Insights from the Literature
Studies have shown that multiple interventions tend to increase adherence, that self-management should be encouraged, and that modes of communication other than verbal must be used [6]. Visual cues, such as pictures or symbols, are useful to help with recall of medications and instructions for people with language barriers or limited health literacy [7]. Simplified written instructions and larger fonts have been found to be effective in patients with language barriers or limited health literacy, as have use of illustrated medication schedules [8]. Other guidelines include using short words and sentences, writing directly to the reader, listing important points in list format, and using left justification so there is even spacing between words.
The literature is consistent with our findings from speaking with patient education representatives and patients. Patients and caregivers noted that the PODS should be written in plain language, use large fonts, include illustrations of care and medication schedules, and include headings that are meaningful to the patient. Patients also expressed the desire for charts and lists that they could use while completing their follow-up care plan.
“My mom made me a chart of when to drink water and how much (patient).”
“We were given a sheet to record all feedings (caregiver).”
“We can provide a list of patient meds in a grid format with days of the week and times of day. We use our judgement to give this to patients. It is not standard practice (pharmacist).”
“A discharge form in ‘plain English’ should be standardized (patient).”
The Co-design Event
Solutions resulting from the design event ranged from more traditional discharge summaries that were enhanced with multiple languages and images to make things clear for patients, to solutions including interactive patient portals. There were solutions that came with stickers to color-code your medications, areas for patients to write notes, and checklists for them to keep track of all their follow-up plans.
Refining the Design Using Focus Groups and Surveys
The ideas and concepts generated during the design event were analyzed by the interdisciplinary advisory team at OpenLab. In addition, several team sessions were held with health care
This is a great piece. You guys are doing an awesome job. This would have saved me so much anxiety and fear of doing something wrong when I was discharged. I didn’t want to bother my doctors and went on a hope and prayer. Even my home care people weren’t always sure of what to do. Again this would be a great step forward in easing patients’ fears, especially senior citizens. GREAT WORK. THANKS FOR CARING.
Discussion
Innovative methods such as co-design events and targeted focus groups are very useful for
Future Plans
The PODS template has now been adapted and implemented in several hospitals in Toronto, Canada, using a supported early adopter process [10]. Future plans are to test the impact of the PODS on patient experience and health outcomes using a randomized controlled trial. Also, for now, we have focused on a paper version of PODS, but with the increasing prevalence of electronic health records and consumer-oriented health care apps, future consideration for a digital and mobile version of PODS is warranted.
Conclusion
Patients need to be prepared for discharge so that they can engage in supported self-management once they return home.
Corresponding author: Shoshana Hahn-Goldberg, PhD, 294 Mullen Dr., Thornhill, ON L4J 2P2.
Funding/support: The PODS project has been funded by the Toronto Central Local Health Integration Network.
Financial disclosures: None.
1. Rajesh R, Vidyasagar S, Varma M, Sharma S. Design And evaluation of pictograms for communicating information about adverse drug reactions to antiretroviral therapy in Indian human immunodeficiency virus positive patients. J Pharm Biomed Sci 2012;16:1–11.
2. Dowse R, Ehlers MS. The evaluation of pharmaceutical pictograms in a low-literate South African population. Patient Educ Couns 2001;45:87–99.
3. Clayton M, Syed F, Rashid A, Fayyaz U. Improving illiterate patients’ understanding and adherence to discharge medications. BMJ Qual Improv Rep 2012;1:u496.w167.
4. Hahn-Goldberg S, Okrainec K, Huynh T, et al. Co-creating patient-oriented instructions with patients, caregivers, and providers. J Hosp Med 2015;10:804–7.
5. Gaver B, Dunne T, Pacenti E. Design: cultural probes. Interactions 1999;6:21–9.
6. Sheridan SL, Halpern DJ, Viera AJ, et al. Interventions for individuals with low health literacy: a systematic review. J Health Commun 2011;16 Suppl 3:30–54.
7. Schillinger D, Machtinger EL, Wang F, et al. Language, literacy, and communication regarding medications in an anticoagulation clinic: A comparison of verbal vs. visual assessment. J Health Commun 2006;11:651–4.
8. Chugh A, Williams MV, Grigsby J, Coleman EA. Better transitions: Improving comprehension of discharge instructions. Front Health Serv Manage 2009;25:11–32.
9. IDEO. Design thinking for educators toolkit. 2nd ed. New York: IDEObooks; 2013.
10. Hahn-Goldberg S, Okrainec K, Damba C, et al. Implementing patient oriented discharge summaries (PODS): A multi-site pilot across early adopter hospitals. Healthc Q 2016;19:42–8.
From the OpenLab, University Health Network, Toronto, Canada (Dr. Hahn-Goldberg, Dr. Okrainec, Dr. Abrams, Mr. Huynh); School of Health Policy and Management, York University, Toronto (Dr. Hahn-Goldberg); Toronto Central Local Health Integration Network (Ms. Damba); Centre for Addiction and Mental Health, Toronto (Ms. Solomon); and the Department of Medicine, University Health Network, Toronto (Dr. Okrainec, Dr. Abrams).
Abstract
- Objective: To describe the co-design process we under-took to create a patient-oriented discharge summary (PODS) with patients, caregivers, and providers.
- Method: Descriptive report.
- Results: We designed and produced a prototype PODS, based on best practices in information design, graphic design, and patient education. Through a co-design process, patients, health care providers, designers and system planners worked together to establish what content needed to be included, as well as how it would be organized and presented. From an initial prototype, we then refined the PODS through an iterative participatory design process involving patients, including those from hard-to-reach groups such as patients with language barriers and/or low health literacy and patients with a primary psychiatric diagnosis.
- Conclusion: Co-design events and targeted focus groups are very useful for engaging patients and caregivers in the design and development of solutions aimed at improving their experience of care. It is important to include all users, especially those who are harder to reach, such as patients with language barriers and mental health conditions. Engaging health care providers is essential to ensure feasibility of those solutions.
Traditional discharge summaries are written primarily for the patient’s primary care provider and are not designed as tools to support communication between the clinician and patient regarding instructions for patients to follow at home post discharge. A more patient-centered version of the discharge summary is needed to complement the traditional format.
To enhance our patients’ care experience in the post-discharge period, we set out to co-design a patient-oriented discharge summary (PODS) with patients, caregivers, and providers. The main objective of this project was to develop a prototype PODS that not only addressed critical information that patients felt was the most important to know following discharge, but also provided this information in the most comprehensible format at hospitals within the Toronto area. The project focused on reformatting patient-care instructions for patients discharged from inpatient medical wards as these instructions presented the best opportunity for improvement.
This project drew on work done in countries such as India, South Africa, and Pakistan, where challenges with general and health literacy have led to the introduction of simplified discharge forms and medication instructions that place a greater emphasis on visual communication to improve information comprehension. For example, the use of pictograms in patient materials has been shown to increase patient understanding of and compliance with care instructions in these countries [1–3].
We have provided an overview of the PODS project elsewhere [4]. In this article, we describe the co-design process we undertook with patients, health care providers, and designers in creating a PODS.
Design Methods
We used several methods to design and develop the PODS and to engage multiple stakeholders in the design process. Among these methods were innovative techniques for understanding the patient experience of discharge, such as cultural probes [5], where patients were given journals and cameras to document their time at home after discharge, as described by Hahn-Goldberg et al [4]. Other key methods for determining the design of the PODS included:
Patient education consultation. A patient education representative with training and expertise in designing materials for patients with low health literacy was added to the team advisory committee to act as a consultant at all stages of the study. This helped to ensure that we would be following best practices in design for our target population.
Review of literature. We reviewed the literature pertaining to design for patients with low health literacy and language barriers, including the resources available through the patient education department at the University Health Network.
Review of Toronto Central Local Health Integration Network (TCLHIN) hospitals’ tools: current discharge summaries, components they included and how they were formatted.
Co-design event. We held an interprofessional design event where teams of patients, health care providers, and designers worked together to create draft PODS for 4 hypothetical patient cases.
Focus groups and surveys. We used feedback from focus groups and surveys to revise and improve the first PODS prototype.
Insights from the Literature
Studies have shown that multiple interventions tend to increase adherence, that self-management should be encouraged, and that modes of communication other than verbal must be used [6]. Visual cues, such as pictures or symbols, are useful to help with recall of medications and instructions for people with language barriers or limited health literacy [7]. Simplified written instructions and larger fonts have been found to be effective in patients with language barriers or limited health literacy, as have use of illustrated medication schedules [8]. Other guidelines include using short words and sentences, writing directly to the reader, listing important points in list format, and using left justification so there is even spacing between words.
The literature is consistent with our findings from speaking with patient education representatives and patients. Patients and caregivers noted that the PODS should be written in plain language, use large fonts, include illustrations of care and medication schedules, and include headings that are meaningful to the patient. Patients also expressed the desire for charts and lists that they could use while completing their follow-up care plan.
“My mom made me a chart of when to drink water and how much (patient).”
“We were given a sheet to record all feedings (caregiver).”
“We can provide a list of patient meds in a grid format with days of the week and times of day. We use our judgement to give this to patients. It is not standard practice (pharmacist).”
“A discharge form in ‘plain English’ should be standardized (patient).”
The Co-design Event
Solutions resulting from the design event ranged from more traditional discharge summaries that were enhanced with multiple languages and images to make things clear for patients, to solutions including interactive patient portals. There were solutions that came with stickers to color-code your medications, areas for patients to write notes, and checklists for them to keep track of all their follow-up plans.
Refining the Design Using Focus Groups and Surveys
The ideas and concepts generated during the design event were analyzed by the interdisciplinary advisory team at OpenLab. In addition, several team sessions were held with health care
This is a great piece. You guys are doing an awesome job. This would have saved me so much anxiety and fear of doing something wrong when I was discharged. I didn’t want to bother my doctors and went on a hope and prayer. Even my home care people weren’t always sure of what to do. Again this would be a great step forward in easing patients’ fears, especially senior citizens. GREAT WORK. THANKS FOR CARING.
Discussion
Innovative methods such as co-design events and targeted focus groups are very useful for
Future Plans
The PODS template has now been adapted and implemented in several hospitals in Toronto, Canada, using a supported early adopter process [10]. Future plans are to test the impact of the PODS on patient experience and health outcomes using a randomized controlled trial. Also, for now, we have focused on a paper version of PODS, but with the increasing prevalence of electronic health records and consumer-oriented health care apps, future consideration for a digital and mobile version of PODS is warranted.
Conclusion
Patients need to be prepared for discharge so that they can engage in supported self-management once they return home.
Corresponding author: Shoshana Hahn-Goldberg, PhD, 294 Mullen Dr., Thornhill, ON L4J 2P2.
Funding/support: The PODS project has been funded by the Toronto Central Local Health Integration Network.
Financial disclosures: None.
From the OpenLab, University Health Network, Toronto, Canada (Dr. Hahn-Goldberg, Dr. Okrainec, Dr. Abrams, Mr. Huynh); School of Health Policy and Management, York University, Toronto (Dr. Hahn-Goldberg); Toronto Central Local Health Integration Network (Ms. Damba); Centre for Addiction and Mental Health, Toronto (Ms. Solomon); and the Department of Medicine, University Health Network, Toronto (Dr. Okrainec, Dr. Abrams).
Abstract
- Objective: To describe the co-design process we under-took to create a patient-oriented discharge summary (PODS) with patients, caregivers, and providers.
- Method: Descriptive report.
- Results: We designed and produced a prototype PODS, based on best practices in information design, graphic design, and patient education. Through a co-design process, patients, health care providers, designers and system planners worked together to establish what content needed to be included, as well as how it would be organized and presented. From an initial prototype, we then refined the PODS through an iterative participatory design process involving patients, including those from hard-to-reach groups such as patients with language barriers and/or low health literacy and patients with a primary psychiatric diagnosis.
- Conclusion: Co-design events and targeted focus groups are very useful for engaging patients and caregivers in the design and development of solutions aimed at improving their experience of care. It is important to include all users, especially those who are harder to reach, such as patients with language barriers and mental health conditions. Engaging health care providers is essential to ensure feasibility of those solutions.
Traditional discharge summaries are written primarily for the patient’s primary care provider and are not designed as tools to support communication between the clinician and patient regarding instructions for patients to follow at home post discharge. A more patient-centered version of the discharge summary is needed to complement the traditional format.
To enhance our patients’ care experience in the post-discharge period, we set out to co-design a patient-oriented discharge summary (PODS) with patients, caregivers, and providers. The main objective of this project was to develop a prototype PODS that not only addressed critical information that patients felt was the most important to know following discharge, but also provided this information in the most comprehensible format at hospitals within the Toronto area. The project focused on reformatting patient-care instructions for patients discharged from inpatient medical wards as these instructions presented the best opportunity for improvement.
This project drew on work done in countries such as India, South Africa, and Pakistan, where challenges with general and health literacy have led to the introduction of simplified discharge forms and medication instructions that place a greater emphasis on visual communication to improve information comprehension. For example, the use of pictograms in patient materials has been shown to increase patient understanding of and compliance with care instructions in these countries [1–3].
We have provided an overview of the PODS project elsewhere [4]. In this article, we describe the co-design process we undertook with patients, health care providers, and designers in creating a PODS.
Design Methods
We used several methods to design and develop the PODS and to engage multiple stakeholders in the design process. Among these methods were innovative techniques for understanding the patient experience of discharge, such as cultural probes [5], where patients were given journals and cameras to document their time at home after discharge, as described by Hahn-Goldberg et al [4]. Other key methods for determining the design of the PODS included:
Patient education consultation. A patient education representative with training and expertise in designing materials for patients with low health literacy was added to the team advisory committee to act as a consultant at all stages of the study. This helped to ensure that we would be following best practices in design for our target population.
Review of literature. We reviewed the literature pertaining to design for patients with low health literacy and language barriers, including the resources available through the patient education department at the University Health Network.
Review of Toronto Central Local Health Integration Network (TCLHIN) hospitals’ tools: current discharge summaries, components they included and how they were formatted.
Co-design event. We held an interprofessional design event where teams of patients, health care providers, and designers worked together to create draft PODS for 4 hypothetical patient cases.
Focus groups and surveys. We used feedback from focus groups and surveys to revise and improve the first PODS prototype.
Insights from the Literature
Studies have shown that multiple interventions tend to increase adherence, that self-management should be encouraged, and that modes of communication other than verbal must be used [6]. Visual cues, such as pictures or symbols, are useful to help with recall of medications and instructions for people with language barriers or limited health literacy [7]. Simplified written instructions and larger fonts have been found to be effective in patients with language barriers or limited health literacy, as have use of illustrated medication schedules [8]. Other guidelines include using short words and sentences, writing directly to the reader, listing important points in list format, and using left justification so there is even spacing between words.
The literature is consistent with our findings from speaking with patient education representatives and patients. Patients and caregivers noted that the PODS should be written in plain language, use large fonts, include illustrations of care and medication schedules, and include headings that are meaningful to the patient. Patients also expressed the desire for charts and lists that they could use while completing their follow-up care plan.
“My mom made me a chart of when to drink water and how much (patient).”
“We were given a sheet to record all feedings (caregiver).”
“We can provide a list of patient meds in a grid format with days of the week and times of day. We use our judgement to give this to patients. It is not standard practice (pharmacist).”
“A discharge form in ‘plain English’ should be standardized (patient).”
The Co-design Event
Solutions resulting from the design event ranged from more traditional discharge summaries that were enhanced with multiple languages and images to make things clear for patients, to solutions including interactive patient portals. There were solutions that came with stickers to color-code your medications, areas for patients to write notes, and checklists for them to keep track of all their follow-up plans.
Refining the Design Using Focus Groups and Surveys
The ideas and concepts generated during the design event were analyzed by the interdisciplinary advisory team at OpenLab. In addition, several team sessions were held with health care
This is a great piece. You guys are doing an awesome job. This would have saved me so much anxiety and fear of doing something wrong when I was discharged. I didn’t want to bother my doctors and went on a hope and prayer. Even my home care people weren’t always sure of what to do. Again this would be a great step forward in easing patients’ fears, especially senior citizens. GREAT WORK. THANKS FOR CARING.
Discussion
Innovative methods such as co-design events and targeted focus groups are very useful for
Future Plans
The PODS template has now been adapted and implemented in several hospitals in Toronto, Canada, using a supported early adopter process [10]. Future plans are to test the impact of the PODS on patient experience and health outcomes using a randomized controlled trial. Also, for now, we have focused on a paper version of PODS, but with the increasing prevalence of electronic health records and consumer-oriented health care apps, future consideration for a digital and mobile version of PODS is warranted.
Conclusion
Patients need to be prepared for discharge so that they can engage in supported self-management once they return home.
Corresponding author: Shoshana Hahn-Goldberg, PhD, 294 Mullen Dr., Thornhill, ON L4J 2P2.
Funding/support: The PODS project has been funded by the Toronto Central Local Health Integration Network.
Financial disclosures: None.
1. Rajesh R, Vidyasagar S, Varma M, Sharma S. Design And evaluation of pictograms for communicating information about adverse drug reactions to antiretroviral therapy in Indian human immunodeficiency virus positive patients. J Pharm Biomed Sci 2012;16:1–11.
2. Dowse R, Ehlers MS. The evaluation of pharmaceutical pictograms in a low-literate South African population. Patient Educ Couns 2001;45:87–99.
3. Clayton M, Syed F, Rashid A, Fayyaz U. Improving illiterate patients’ understanding and adherence to discharge medications. BMJ Qual Improv Rep 2012;1:u496.w167.
4. Hahn-Goldberg S, Okrainec K, Huynh T, et al. Co-creating patient-oriented instructions with patients, caregivers, and providers. J Hosp Med 2015;10:804–7.
5. Gaver B, Dunne T, Pacenti E. Design: cultural probes. Interactions 1999;6:21–9.
6. Sheridan SL, Halpern DJ, Viera AJ, et al. Interventions for individuals with low health literacy: a systematic review. J Health Commun 2011;16 Suppl 3:30–54.
7. Schillinger D, Machtinger EL, Wang F, et al. Language, literacy, and communication regarding medications in an anticoagulation clinic: A comparison of verbal vs. visual assessment. J Health Commun 2006;11:651–4.
8. Chugh A, Williams MV, Grigsby J, Coleman EA. Better transitions: Improving comprehension of discharge instructions. Front Health Serv Manage 2009;25:11–32.
9. IDEO. Design thinking for educators toolkit. 2nd ed. New York: IDEObooks; 2013.
10. Hahn-Goldberg S, Okrainec K, Damba C, et al. Implementing patient oriented discharge summaries (PODS): A multi-site pilot across early adopter hospitals. Healthc Q 2016;19:42–8.
1. Rajesh R, Vidyasagar S, Varma M, Sharma S. Design And evaluation of pictograms for communicating information about adverse drug reactions to antiretroviral therapy in Indian human immunodeficiency virus positive patients. J Pharm Biomed Sci 2012;16:1–11.
2. Dowse R, Ehlers MS. The evaluation of pharmaceutical pictograms in a low-literate South African population. Patient Educ Couns 2001;45:87–99.
3. Clayton M, Syed F, Rashid A, Fayyaz U. Improving illiterate patients’ understanding and adherence to discharge medications. BMJ Qual Improv Rep 2012;1:u496.w167.
4. Hahn-Goldberg S, Okrainec K, Huynh T, et al. Co-creating patient-oriented instructions with patients, caregivers, and providers. J Hosp Med 2015;10:804–7.
5. Gaver B, Dunne T, Pacenti E. Design: cultural probes. Interactions 1999;6:21–9.
6. Sheridan SL, Halpern DJ, Viera AJ, et al. Interventions for individuals with low health literacy: a systematic review. J Health Commun 2011;16 Suppl 3:30–54.
7. Schillinger D, Machtinger EL, Wang F, et al. Language, literacy, and communication regarding medications in an anticoagulation clinic: A comparison of verbal vs. visual assessment. J Health Commun 2006;11:651–4.
8. Chugh A, Williams MV, Grigsby J, Coleman EA. Better transitions: Improving comprehension of discharge instructions. Front Health Serv Manage 2009;25:11–32.
9. IDEO. Design thinking for educators toolkit. 2nd ed. New York: IDEObooks; 2013.
10. Hahn-Goldberg S, Okrainec K, Damba C, et al. Implementing patient oriented discharge summaries (PODS): A multi-site pilot across early adopter hospitals. Healthc Q 2016;19:42–8.
Patient‐Oriented Discharge Instructions
The period following discharge from the hospital is a vulnerable time for patients that can result in adverse events including avoidable emergency room visits and rehospitalizations.[1] Approximately 8.5% of all visits to the hospital result in readmissions within 30 days.[2] Poor communication of discharge information is even more pronounced for patients with language barriers or limited health literacy, particularly in ethnically diverse communities where up to 60% may speak languages other than English or French at home.[3] Defined as the degree to which individuals can obtain, process, and understand basic health information and services needed to make appropriate health decisions,[4] an estimated 55% of Canadians between the ages of 16 and 65 years have limited health literacy, and only 12% of those above the age of 65 years have adequate health literacy skills.[5]
Previous authors have demonstrated the benefits of using multiple interventions, including nonverbal communication, when designing for individuals with limited literacy.[6] Visual aids have been shown to be particularly useful to non‐English speakers and patients with limited health literacy.[7] In particular, research on medication tools for patients with limited health literacy has shown that illustrated schedules can be helpful.[8]
Typical discharge summaries are documents that are transmitted from the hospital to outpatient physicians to coordinate clinical care. The form codesigned by our team is intended to complement the summary and facilitate patient education and to provide instructions for patients to refer to after discharge.
PURPOSE
The objective of this work was to design instructions for patients going home from the hospital with relevant and actionable information, presented in an easily understandable and usable form.
METHODS
We used participatory action methodology,[9] an approach to research that encourages researchers and those who will benefit from the research to work together across all phases of research, by engaging end‐users of patient instructions from the beginning of the project. Mixed methods were used to understand needs, develop content and design, and iteratively evaluate and refine the instructions. An advisory team of patients, physicians, pharmacists, designers, researchers, and patient‐education professionals gave input into study design and execution.
Although formal inclusion and exclusion criteria were not used, care was taken to engage patients with language barriers, limited health literacy, and mental health issues.
Key methods used are listed below. See Figure 1 for a timeline of the process used to develop the instructions.
Understanding the Current Patient Experience of Discharge
Key methods included: (1) Patient experience mapping[10]a process of capturing and communicating complex patient interactions and their experience in the system by having interdisciplinary groups create a map of the patient experience and feelings through a mock discharge scenario). (2) A cultural probe[11]patients selected as having minor language barriers or limited health literacy were given a journal and disposable camera to document their time at home after discharge. Patients were asked how confident they were in filling out medical forms by themselves as a way of screening for probable health literacy limitations.[12]
Content and Design
The instructions were developed using a codesign methodology,[13] where researchers and the end‐users of a product design the product together. In our case, teams of patients, healthcare providers, and designers worked together to create prototypes using hypothetical patient cases.
Iteratively Evaluating and Refining the Design
The prototype went through 3 design iterations (Figure 1). Feedback from patients, caregivers, and providers using focus groups, interviews, and surveys was used to refine the content and design and validate symbols for each section.
Key methods included: (1) Two focus groups with hard to reach patient groups that would not participate in interviews or surveys. One was with Cantonese‐speaking patients, facilitated by an interpreter. Cantonese is a common language in Toronto, yet the language barrier typically precludes the patients from participating in research. The other group was with patients admitted to the psychiatry unit of the hospital, another group that typically is excluded from research studies. (2) Usability test of a paper‐based version of the instructions across 3 large academic hospitals; physicians and residents in general internal medicine units filled out the instructions by hand for each patient discharged.
RESULTS
Forty‐four patients, 12 caregivers, 30 healthcare personnel, 7 patient‐education professionals, and 8 designers were involved in the design (see Figure 2 for an image of the template) based on best practices in information design, graphic design, and patient education.
Understanding the Patient Experience of Discharge
The analysis of the patient experience at discharge revealed the following themes:
(1) Difficulties in understanding and retaining verbal instructions in the immediate postdischarge period because of exhaustion. (2) Patient concerns at discharge including feeling unprepared to leave the hospital. (3) Family members and caregivers play a large role in a patient's life, which becomes more significant in the postdischarge phase. This was made clear through journal entries from patients using cultural probes.
Content and Design
Patients wanted to know information that was relevant and actionable. They consistently mentioned the following information as being most important: (1) medication instructions, (2) follow‐up appointments with phone numbers, (3) normal expected symptoms, danger signs, and what to do, (4) lifestyle changes and when to resume activities, and (5) information and resources to have handy.
Advice from patient‐education specialists on the team, as well as the feedback from patients and caregivers was that instructions should be written in language at a fifth‐ or sixth‐grade level and be directed to the patient, use large fonts, include illustrations of medication schedules, and headings that are meaningful to the patient. In addition, patients wanted white space to take notes, an activity that has been shown to improve comprehension and recall.[14]
Patients felt having symbols for each section in the instructions helped make the form more readable by differentiating sections and providing a recognizable image for patients who could read English.
Iteratively Evaluating and Refining the Design
The results of the usability test data and surveys of the final version of the template showed that patients and providers felt that they would benefit from using the instructions. Of the patients and providers, 94.8% of patients and 75% of providers said that the instructions would be helpful to have when discharged from the hospital. Physicians filling out the instructions by hand took an average of 9 minutes to fill out the form.
DISCUSSION
This initiative is an example of engaging patients and caregivers as active partners in the healthcare system. Patients and caregivers were engaged as codesigners of the form from the outset and continuously throughout.
The instructions can be given to patients and caregivers at discharge as both a teaching tool and a reference that can be reviewed when at home. Process considerations are very important. As family and caregivers play an instrumental role in postdischarge care, the instructions should be given whenever possible in the presence of family. The form is a simple addition to any discharge process. It can be filled out by a single provider, a multidisciplinary team, or even the patient while undergoing discharge teaching. The time and resources to fill out the instructions will vary depending on the discharge process in place. Good discharge practices,[15] such as engaging the patient in the conversation and teach back, should be followed.
The form has been licensed as creative commons, so that any healthcare organization can use and adapt the materials to meet the needs of their patients.
The development of the form is only the first step in a larger project. Almost all of the study participants involved in the initiative were from the general internal medicine wards in downtown Toronto. We do not know yet if the results can be generalized to different patient and provider populations.
The instructions are currently being implemented in 8 hospitals throughout Toronto, spanning rehabilitation, acute care, surgery, and pediatrics. The form appears to have been appropriate and generalizable to all of these settings, but results from this multisite implementation on patient and provider experience or health outcomes are not available yet. Anticipated barriers include determining who has the responsibility for filling out the instructions and validating the accuracy of the medication list.
Discharge instructions serve many purposes. Though previous authors have developed checklists to ensure critical discharge information is included in discharge teaching, the creation of a patient‐oriented form, codesigned with patients and caregivers to provide the information that patients explicitly want at discharge, has been lacking. Using participatory action research, mixed methods, and codesign methodology, and including hard‐to‐reach patient groups was helpful in creating a design that will provide patients with key information at discharge in an easy‐to‐understand format.
Acknowledgements
The authors acknowledge the financial support and guidance of the Toronto Central Local Health Integration Network. The project was advised by a number of individuals, namely: Cynthia Damba, Michelle Ransom, Paolo Korre, Irene Chong, Dawn Lim, Helen Kang, Derek Leong, Elizabeth Abraham, Elke Ruthig, Grace Eagan, Vivian Lo, Rachel Solomon, Kendra Delicaet, Sara Ahmadi, and Jess Leung.
Disclosures: The funding provided by the Toronto Central Local Health Integration Network that supported much of the work contained in this article also paid for a portion of the salaries of Shoshana Hahn‐Goldberg, Tai Huynh, and Najla Zahr. There are no other conflicts of interest to report.
- The incidence and severity of adverse events affecting patients after discharge from hospital. Ann Intern Med. 2003;138:161–167. , , , , .
- A reengineered hospital discharge program to decrease rehospitalization: a randomized trial. Ann Inter Med. 2009;150(3):178–187. , , , et al.
- Statistics Canada. Visual census. 2011 census. Ottawa. Available at: http://www12.statcan.gc.ca/census‐recensement/index‐eng.cfm. Accessed September 19, 2014.
- Committee on Health Literacy. Board on Neuroscience and Behavioral Health. Institute of Medicine. Health literacy: a prescription to end confusion. Washington, DC: National Academies Press; 2004. Available at: http://www.collaborationhealthcare.com/7‐20‐10IOMHealthLiteracyExecutiveSummary.pdf. Accessed September 19, 2014.
- A vision for a health literate Canada: report of the Expert Panel on Health Literacy. 2008. Available at: http://www.cpha.ca/uploads/portals/h‐l/report_e.pdf. Accessed September 19, 2014. , .
- Interventions for individuals with low health literacy: a systematic review. J Health Commun. 2011;16:30–54. , , , , , .
- Language, literacy, and communication regarding medication in an anticoagulation clinic: a comparison of verbal vs. visual assessment. J Health Commun. 2006;11(7):651–664. , , , , ,
- Development of an illustrated medication schedule as a low‐literacy patient education tool. Patient Educ Couns. 2007;66(3):368–377. , , , et al.
- Participatory action research as a model for conducting family research. J Assoc Pers Sev Handicaps. 1998;23(3):178–188. , , .
- Evaluation and measurement of patient experience. Patient Exp J. 2014;1(1):28–36. , .
- Design: cultural probes. Interactions. 1999;6(1):21–29. , , .
- Can this patient read and understand written health information? JAMA. 2010;304(1):76–84. , , .
- Co‐creation and the new landscapes of design. Int J Cocreat Des Arts. 2008;4(1):5–18. , .
- The pen is mightier that the keyboard: advantages of longhand over laptop note taking. Psychol Sci. 2014;25(6):1159–1168. , .
- Development of a checklist of safe discharge practices for hospital patients. J Hosp Med. 2013;8:444–449. , , , et al.
The period following discharge from the hospital is a vulnerable time for patients that can result in adverse events including avoidable emergency room visits and rehospitalizations.[1] Approximately 8.5% of all visits to the hospital result in readmissions within 30 days.[2] Poor communication of discharge information is even more pronounced for patients with language barriers or limited health literacy, particularly in ethnically diverse communities where up to 60% may speak languages other than English or French at home.[3] Defined as the degree to which individuals can obtain, process, and understand basic health information and services needed to make appropriate health decisions,[4] an estimated 55% of Canadians between the ages of 16 and 65 years have limited health literacy, and only 12% of those above the age of 65 years have adequate health literacy skills.[5]
Previous authors have demonstrated the benefits of using multiple interventions, including nonverbal communication, when designing for individuals with limited literacy.[6] Visual aids have been shown to be particularly useful to non‐English speakers and patients with limited health literacy.[7] In particular, research on medication tools for patients with limited health literacy has shown that illustrated schedules can be helpful.[8]
Typical discharge summaries are documents that are transmitted from the hospital to outpatient physicians to coordinate clinical care. The form codesigned by our team is intended to complement the summary and facilitate patient education and to provide instructions for patients to refer to after discharge.
PURPOSE
The objective of this work was to design instructions for patients going home from the hospital with relevant and actionable information, presented in an easily understandable and usable form.
METHODS
We used participatory action methodology,[9] an approach to research that encourages researchers and those who will benefit from the research to work together across all phases of research, by engaging end‐users of patient instructions from the beginning of the project. Mixed methods were used to understand needs, develop content and design, and iteratively evaluate and refine the instructions. An advisory team of patients, physicians, pharmacists, designers, researchers, and patient‐education professionals gave input into study design and execution.
Although formal inclusion and exclusion criteria were not used, care was taken to engage patients with language barriers, limited health literacy, and mental health issues.
Key methods used are listed below. See Figure 1 for a timeline of the process used to develop the instructions.
Understanding the Current Patient Experience of Discharge
Key methods included: (1) Patient experience mapping[10]a process of capturing and communicating complex patient interactions and their experience in the system by having interdisciplinary groups create a map of the patient experience and feelings through a mock discharge scenario). (2) A cultural probe[11]patients selected as having minor language barriers or limited health literacy were given a journal and disposable camera to document their time at home after discharge. Patients were asked how confident they were in filling out medical forms by themselves as a way of screening for probable health literacy limitations.[12]
Content and Design
The instructions were developed using a codesign methodology,[13] where researchers and the end‐users of a product design the product together. In our case, teams of patients, healthcare providers, and designers worked together to create prototypes using hypothetical patient cases.
Iteratively Evaluating and Refining the Design
The prototype went through 3 design iterations (Figure 1). Feedback from patients, caregivers, and providers using focus groups, interviews, and surveys was used to refine the content and design and validate symbols for each section.
Key methods included: (1) Two focus groups with hard to reach patient groups that would not participate in interviews or surveys. One was with Cantonese‐speaking patients, facilitated by an interpreter. Cantonese is a common language in Toronto, yet the language barrier typically precludes the patients from participating in research. The other group was with patients admitted to the psychiatry unit of the hospital, another group that typically is excluded from research studies. (2) Usability test of a paper‐based version of the instructions across 3 large academic hospitals; physicians and residents in general internal medicine units filled out the instructions by hand for each patient discharged.
RESULTS
Forty‐four patients, 12 caregivers, 30 healthcare personnel, 7 patient‐education professionals, and 8 designers were involved in the design (see Figure 2 for an image of the template) based on best practices in information design, graphic design, and patient education.
Understanding the Patient Experience of Discharge
The analysis of the patient experience at discharge revealed the following themes:
(1) Difficulties in understanding and retaining verbal instructions in the immediate postdischarge period because of exhaustion. (2) Patient concerns at discharge including feeling unprepared to leave the hospital. (3) Family members and caregivers play a large role in a patient's life, which becomes more significant in the postdischarge phase. This was made clear through journal entries from patients using cultural probes.
Content and Design
Patients wanted to know information that was relevant and actionable. They consistently mentioned the following information as being most important: (1) medication instructions, (2) follow‐up appointments with phone numbers, (3) normal expected symptoms, danger signs, and what to do, (4) lifestyle changes and when to resume activities, and (5) information and resources to have handy.
Advice from patient‐education specialists on the team, as well as the feedback from patients and caregivers was that instructions should be written in language at a fifth‐ or sixth‐grade level and be directed to the patient, use large fonts, include illustrations of medication schedules, and headings that are meaningful to the patient. In addition, patients wanted white space to take notes, an activity that has been shown to improve comprehension and recall.[14]
Patients felt having symbols for each section in the instructions helped make the form more readable by differentiating sections and providing a recognizable image for patients who could read English.
Iteratively Evaluating and Refining the Design
The results of the usability test data and surveys of the final version of the template showed that patients and providers felt that they would benefit from using the instructions. Of the patients and providers, 94.8% of patients and 75% of providers said that the instructions would be helpful to have when discharged from the hospital. Physicians filling out the instructions by hand took an average of 9 minutes to fill out the form.
DISCUSSION
This initiative is an example of engaging patients and caregivers as active partners in the healthcare system. Patients and caregivers were engaged as codesigners of the form from the outset and continuously throughout.
The instructions can be given to patients and caregivers at discharge as both a teaching tool and a reference that can be reviewed when at home. Process considerations are very important. As family and caregivers play an instrumental role in postdischarge care, the instructions should be given whenever possible in the presence of family. The form is a simple addition to any discharge process. It can be filled out by a single provider, a multidisciplinary team, or even the patient while undergoing discharge teaching. The time and resources to fill out the instructions will vary depending on the discharge process in place. Good discharge practices,[15] such as engaging the patient in the conversation and teach back, should be followed.
The form has been licensed as creative commons, so that any healthcare organization can use and adapt the materials to meet the needs of their patients.
The development of the form is only the first step in a larger project. Almost all of the study participants involved in the initiative were from the general internal medicine wards in downtown Toronto. We do not know yet if the results can be generalized to different patient and provider populations.
The instructions are currently being implemented in 8 hospitals throughout Toronto, spanning rehabilitation, acute care, surgery, and pediatrics. The form appears to have been appropriate and generalizable to all of these settings, but results from this multisite implementation on patient and provider experience or health outcomes are not available yet. Anticipated barriers include determining who has the responsibility for filling out the instructions and validating the accuracy of the medication list.
Discharge instructions serve many purposes. Though previous authors have developed checklists to ensure critical discharge information is included in discharge teaching, the creation of a patient‐oriented form, codesigned with patients and caregivers to provide the information that patients explicitly want at discharge, has been lacking. Using participatory action research, mixed methods, and codesign methodology, and including hard‐to‐reach patient groups was helpful in creating a design that will provide patients with key information at discharge in an easy‐to‐understand format.
Acknowledgements
The authors acknowledge the financial support and guidance of the Toronto Central Local Health Integration Network. The project was advised by a number of individuals, namely: Cynthia Damba, Michelle Ransom, Paolo Korre, Irene Chong, Dawn Lim, Helen Kang, Derek Leong, Elizabeth Abraham, Elke Ruthig, Grace Eagan, Vivian Lo, Rachel Solomon, Kendra Delicaet, Sara Ahmadi, and Jess Leung.
Disclosures: The funding provided by the Toronto Central Local Health Integration Network that supported much of the work contained in this article also paid for a portion of the salaries of Shoshana Hahn‐Goldberg, Tai Huynh, and Najla Zahr. There are no other conflicts of interest to report.
The period following discharge from the hospital is a vulnerable time for patients that can result in adverse events including avoidable emergency room visits and rehospitalizations.[1] Approximately 8.5% of all visits to the hospital result in readmissions within 30 days.[2] Poor communication of discharge information is even more pronounced for patients with language barriers or limited health literacy, particularly in ethnically diverse communities where up to 60% may speak languages other than English or French at home.[3] Defined as the degree to which individuals can obtain, process, and understand basic health information and services needed to make appropriate health decisions,[4] an estimated 55% of Canadians between the ages of 16 and 65 years have limited health literacy, and only 12% of those above the age of 65 years have adequate health literacy skills.[5]
Previous authors have demonstrated the benefits of using multiple interventions, including nonverbal communication, when designing for individuals with limited literacy.[6] Visual aids have been shown to be particularly useful to non‐English speakers and patients with limited health literacy.[7] In particular, research on medication tools for patients with limited health literacy has shown that illustrated schedules can be helpful.[8]
Typical discharge summaries are documents that are transmitted from the hospital to outpatient physicians to coordinate clinical care. The form codesigned by our team is intended to complement the summary and facilitate patient education and to provide instructions for patients to refer to after discharge.
PURPOSE
The objective of this work was to design instructions for patients going home from the hospital with relevant and actionable information, presented in an easily understandable and usable form.
METHODS
We used participatory action methodology,[9] an approach to research that encourages researchers and those who will benefit from the research to work together across all phases of research, by engaging end‐users of patient instructions from the beginning of the project. Mixed methods were used to understand needs, develop content and design, and iteratively evaluate and refine the instructions. An advisory team of patients, physicians, pharmacists, designers, researchers, and patient‐education professionals gave input into study design and execution.
Although formal inclusion and exclusion criteria were not used, care was taken to engage patients with language barriers, limited health literacy, and mental health issues.
Key methods used are listed below. See Figure 1 for a timeline of the process used to develop the instructions.
Understanding the Current Patient Experience of Discharge
Key methods included: (1) Patient experience mapping[10]a process of capturing and communicating complex patient interactions and their experience in the system by having interdisciplinary groups create a map of the patient experience and feelings through a mock discharge scenario). (2) A cultural probe[11]patients selected as having minor language barriers or limited health literacy were given a journal and disposable camera to document their time at home after discharge. Patients were asked how confident they were in filling out medical forms by themselves as a way of screening for probable health literacy limitations.[12]
Content and Design
The instructions were developed using a codesign methodology,[13] where researchers and the end‐users of a product design the product together. In our case, teams of patients, healthcare providers, and designers worked together to create prototypes using hypothetical patient cases.
Iteratively Evaluating and Refining the Design
The prototype went through 3 design iterations (Figure 1). Feedback from patients, caregivers, and providers using focus groups, interviews, and surveys was used to refine the content and design and validate symbols for each section.
Key methods included: (1) Two focus groups with hard to reach patient groups that would not participate in interviews or surveys. One was with Cantonese‐speaking patients, facilitated by an interpreter. Cantonese is a common language in Toronto, yet the language barrier typically precludes the patients from participating in research. The other group was with patients admitted to the psychiatry unit of the hospital, another group that typically is excluded from research studies. (2) Usability test of a paper‐based version of the instructions across 3 large academic hospitals; physicians and residents in general internal medicine units filled out the instructions by hand for each patient discharged.
RESULTS
Forty‐four patients, 12 caregivers, 30 healthcare personnel, 7 patient‐education professionals, and 8 designers were involved in the design (see Figure 2 for an image of the template) based on best practices in information design, graphic design, and patient education.
Understanding the Patient Experience of Discharge
The analysis of the patient experience at discharge revealed the following themes:
(1) Difficulties in understanding and retaining verbal instructions in the immediate postdischarge period because of exhaustion. (2) Patient concerns at discharge including feeling unprepared to leave the hospital. (3) Family members and caregivers play a large role in a patient's life, which becomes more significant in the postdischarge phase. This was made clear through journal entries from patients using cultural probes.
Content and Design
Patients wanted to know information that was relevant and actionable. They consistently mentioned the following information as being most important: (1) medication instructions, (2) follow‐up appointments with phone numbers, (3) normal expected symptoms, danger signs, and what to do, (4) lifestyle changes and when to resume activities, and (5) information and resources to have handy.
Advice from patient‐education specialists on the team, as well as the feedback from patients and caregivers was that instructions should be written in language at a fifth‐ or sixth‐grade level and be directed to the patient, use large fonts, include illustrations of medication schedules, and headings that are meaningful to the patient. In addition, patients wanted white space to take notes, an activity that has been shown to improve comprehension and recall.[14]
Patients felt having symbols for each section in the instructions helped make the form more readable by differentiating sections and providing a recognizable image for patients who could read English.
Iteratively Evaluating and Refining the Design
The results of the usability test data and surveys of the final version of the template showed that patients and providers felt that they would benefit from using the instructions. Of the patients and providers, 94.8% of patients and 75% of providers said that the instructions would be helpful to have when discharged from the hospital. Physicians filling out the instructions by hand took an average of 9 minutes to fill out the form.
DISCUSSION
This initiative is an example of engaging patients and caregivers as active partners in the healthcare system. Patients and caregivers were engaged as codesigners of the form from the outset and continuously throughout.
The instructions can be given to patients and caregivers at discharge as both a teaching tool and a reference that can be reviewed when at home. Process considerations are very important. As family and caregivers play an instrumental role in postdischarge care, the instructions should be given whenever possible in the presence of family. The form is a simple addition to any discharge process. It can be filled out by a single provider, a multidisciplinary team, or even the patient while undergoing discharge teaching. The time and resources to fill out the instructions will vary depending on the discharge process in place. Good discharge practices,[15] such as engaging the patient in the conversation and teach back, should be followed.
The form has been licensed as creative commons, so that any healthcare organization can use and adapt the materials to meet the needs of their patients.
The development of the form is only the first step in a larger project. Almost all of the study participants involved in the initiative were from the general internal medicine wards in downtown Toronto. We do not know yet if the results can be generalized to different patient and provider populations.
The instructions are currently being implemented in 8 hospitals throughout Toronto, spanning rehabilitation, acute care, surgery, and pediatrics. The form appears to have been appropriate and generalizable to all of these settings, but results from this multisite implementation on patient and provider experience or health outcomes are not available yet. Anticipated barriers include determining who has the responsibility for filling out the instructions and validating the accuracy of the medication list.
Discharge instructions serve many purposes. Though previous authors have developed checklists to ensure critical discharge information is included in discharge teaching, the creation of a patient‐oriented form, codesigned with patients and caregivers to provide the information that patients explicitly want at discharge, has been lacking. Using participatory action research, mixed methods, and codesign methodology, and including hard‐to‐reach patient groups was helpful in creating a design that will provide patients with key information at discharge in an easy‐to‐understand format.
Acknowledgements
The authors acknowledge the financial support and guidance of the Toronto Central Local Health Integration Network. The project was advised by a number of individuals, namely: Cynthia Damba, Michelle Ransom, Paolo Korre, Irene Chong, Dawn Lim, Helen Kang, Derek Leong, Elizabeth Abraham, Elke Ruthig, Grace Eagan, Vivian Lo, Rachel Solomon, Kendra Delicaet, Sara Ahmadi, and Jess Leung.
Disclosures: The funding provided by the Toronto Central Local Health Integration Network that supported much of the work contained in this article also paid for a portion of the salaries of Shoshana Hahn‐Goldberg, Tai Huynh, and Najla Zahr. There are no other conflicts of interest to report.
- The incidence and severity of adverse events affecting patients after discharge from hospital. Ann Intern Med. 2003;138:161–167. , , , , .
- A reengineered hospital discharge program to decrease rehospitalization: a randomized trial. Ann Inter Med. 2009;150(3):178–187. , , , et al.
- Statistics Canada. Visual census. 2011 census. Ottawa. Available at: http://www12.statcan.gc.ca/census‐recensement/index‐eng.cfm. Accessed September 19, 2014.
- Committee on Health Literacy. Board on Neuroscience and Behavioral Health. Institute of Medicine. Health literacy: a prescription to end confusion. Washington, DC: National Academies Press; 2004. Available at: http://www.collaborationhealthcare.com/7‐20‐10IOMHealthLiteracyExecutiveSummary.pdf. Accessed September 19, 2014.
- A vision for a health literate Canada: report of the Expert Panel on Health Literacy. 2008. Available at: http://www.cpha.ca/uploads/portals/h‐l/report_e.pdf. Accessed September 19, 2014. , .
- Interventions for individuals with low health literacy: a systematic review. J Health Commun. 2011;16:30–54. , , , , , .
- Language, literacy, and communication regarding medication in an anticoagulation clinic: a comparison of verbal vs. visual assessment. J Health Commun. 2006;11(7):651–664. , , , , ,
- Development of an illustrated medication schedule as a low‐literacy patient education tool. Patient Educ Couns. 2007;66(3):368–377. , , , et al.
- Participatory action research as a model for conducting family research. J Assoc Pers Sev Handicaps. 1998;23(3):178–188. , , .
- Evaluation and measurement of patient experience. Patient Exp J. 2014;1(1):28–36. , .
- Design: cultural probes. Interactions. 1999;6(1):21–29. , , .
- Can this patient read and understand written health information? JAMA. 2010;304(1):76–84. , , .
- Co‐creation and the new landscapes of design. Int J Cocreat Des Arts. 2008;4(1):5–18. , .
- The pen is mightier that the keyboard: advantages of longhand over laptop note taking. Psychol Sci. 2014;25(6):1159–1168. , .
- Development of a checklist of safe discharge practices for hospital patients. J Hosp Med. 2013;8:444–449. , , , et al.
- The incidence and severity of adverse events affecting patients after discharge from hospital. Ann Intern Med. 2003;138:161–167. , , , , .
- A reengineered hospital discharge program to decrease rehospitalization: a randomized trial. Ann Inter Med. 2009;150(3):178–187. , , , et al.
- Statistics Canada. Visual census. 2011 census. Ottawa. Available at: http://www12.statcan.gc.ca/census‐recensement/index‐eng.cfm. Accessed September 19, 2014.
- Committee on Health Literacy. Board on Neuroscience and Behavioral Health. Institute of Medicine. Health literacy: a prescription to end confusion. Washington, DC: National Academies Press; 2004. Available at: http://www.collaborationhealthcare.com/7‐20‐10IOMHealthLiteracyExecutiveSummary.pdf. Accessed September 19, 2014.
- A vision for a health literate Canada: report of the Expert Panel on Health Literacy. 2008. Available at: http://www.cpha.ca/uploads/portals/h‐l/report_e.pdf. Accessed September 19, 2014. , .
- Interventions for individuals with low health literacy: a systematic review. J Health Commun. 2011;16:30–54. , , , , , .
- Language, literacy, and communication regarding medication in an anticoagulation clinic: a comparison of verbal vs. visual assessment. J Health Commun. 2006;11(7):651–664. , , , , ,
- Development of an illustrated medication schedule as a low‐literacy patient education tool. Patient Educ Couns. 2007;66(3):368–377. , , , et al.
- Participatory action research as a model for conducting family research. J Assoc Pers Sev Handicaps. 1998;23(3):178–188. , , .
- Evaluation and measurement of patient experience. Patient Exp J. 2014;1(1):28–36. , .
- Design: cultural probes. Interactions. 1999;6(1):21–29. , , .
- Can this patient read and understand written health information? JAMA. 2010;304(1):76–84. , , .
- Co‐creation and the new landscapes of design. Int J Cocreat Des Arts. 2008;4(1):5–18. , .
- The pen is mightier that the keyboard: advantages of longhand over laptop note taking. Psychol Sci. 2014;25(6):1159–1168. , .
- Development of a checklist of safe discharge practices for hospital patients. J Hosp Med. 2013;8:444–449. , , , et al.