User login
Evaluation of E-Consults in the VHA: Provider Perspectives
Electronic consultations (e-consults), also called e-referrals, are an alternative method of obtaining general patient information through the electronic health record (EHR) shared by primary care providers (PCPs) and specialists in the VHA. In the e-consult system, test results, medication lists, and other pertinent data are available.1 Many PCPs are willing to use new technologies to maximize practice efficiency and patient convenience.2 In the VHA’s hub-and-spoke model of care, e-consults have the potential to make delivery of specialty care more efficient by prearranging or completing necessary diagnostic testing and redirecting inappropriate referrals to the correct specialists.1
Some early studies of e-consults report better communication, improved referral appropriateness, and greater access to specialty care as well as better continuity of care and information transfer between patients and PCPs.3-5 Researchers at the VA Boston Healthcare System in Massachusetts found that 61% of specialists surveyed agreed that e-consults improve quality of care and found the approach beneficial to help initiate diagnostic testing prior to a face-to-face visit.6 However, researchers at the Michael E. DeBakey VAMC in Houston, Texas, found no improvement in care coordination.7 To date, there have been no large-scale evaluations of e-consult programs or assessments of implementation of e-consult programs.
Related: HHS Grants Fund Health IT in Communities
In early 2011, the VHA Office of Specialty Care Services (OSCS), Office of Specialty Care Transformation launched a national e-consult pilot as part of a broader effort to improve the delivery of patient-centered specialty care. This initiative was based on core concepts advanced by the American College of Physicians, which highlighted the importance of specialty care within a patient- centered medical home and provided a framework for collaboration.8,9 The goals of the e-consult program were to improve access to specialty care for veterans and their PCPs, to enhance the collaborative relationship between PCPs and specialists, and to augment PCP education.
The OSCS created an Electronic Consultation Implementation Guide to help sites develop and implement each of their e-consult programs.10 The Implementation Guide established operating rules, strategies for engaging key stakeholders, and recommendations for provider education and training.
As with face-to-face referrals, e-consults are organized in a hub-and-spoke model, where community-based outpatient clinics (CBOCs) are linked to a central VAMC. An e-consult can be accessed by any CBOC, VAMC, medical center-based primary care clinic or specialist, and between medical centers that share the same EHR. There were 217,014 completed e-consults between May 2011 and December 2013 across VHA.11
Some programs created an e-consult template to aid in the transition to electronic referrals (Figure). Although not mandatory, the template helped organize needed information to expedite the e-consult.
The objective of this evaluation is to describe the implementation of e-consults from the perspectives of PCPs, specialists, and other key staff involved in the pilot. Key findings were related to: (1) how the e-consult pilot was implemented; (2) how implementation of the e-consult pilot affected providers; and (3) to what extent the e-consult pilot achieved programmatic objectives from the provider’s perspective.
Methods
The authors conducted a key informant analysis with 2 waves of interviews at 8 e-consult pilot sites across the U.S., selected for variation on early progress in implementation. The sites cannot be identified based on an agreement with the VA Office of Labor-Management Relations.
Setting
The e-consult pilot involved 15 VAMCs in 2 cohorts: alpha sites, which began using e-consults in May 2011, and beta sites, which began using e-consults in July 2011. The alpha sites included 10 VAMCs in 12 medical specialties, with a total of 21 facility-specialty combinations. For the evaluation, sites were defined based on specialty, regardless of location within the same medical center (eg, cardiology and diabetes at the same VAMC would be 2 sites). Beta sites included 5 VAMCs with 6 medical specialties for a total of 6 sites. For 1 year, alpha sites received $175,000 and beta sites received $150,000 to support start-up activities.
Initial specialties included diabetes, hepatitis C, geriatrics, cardiology, liver transplant, dementia, gastrointestinal disease, pulmonary medicine, rheumatology, pain management, neurosurgery, infectious diseases, hematology/oncology, and vascular surgery. Facilities could add additional e-consult specialties but did not receive further funding.
Sample
Study participants were selected from 8 of the 15 pilot sites (geographic site/specialty combinations). Site selection was based on 2 measures of baseline e-consult implementation: (1) overall e-consult implementation rates, measured as the ratio of e-consults to all consults for the specialties of interest; and (2) CBOC participation, measured as the ratio of e-consults for patients from CBOCs vs e-consults for patients from primary care clinics located within the 152 VAMCs. Participation with CBOCs was important for ensuring that implementation factors that influenced uptake of e-consults within tertiary medical centers and between VAMCs and CBOCs could be identified. Two e-consult sites were randomly selected from each of the 4 resulting categories (VAMC high volume, VAMC low volume, CBOC high volume, and CBOC low volume). Volume data of e-consults were obtained from the VA Corporate Data Warehouse and assessed from the beginning of the pilot period to initial site selection, May 2011 to February 2012.
Respondents were identified using a modified snowball sampling process. Snowball sampling is a qualitative sampling technique that identifies study participants, who then identify other potential participants to participate in the study. The researchers started with the local e-consult initiative lead and then contacted the directors of primary care and specialty care services for help identifying PCPs, specialists, and support staff (nurse practitioners, pharmacists, program managers, informatics staff, and medical support personnel) engaged in the initiative. The goal for follow-up interviews was to interview at least 2 of the following respondents at each site: e-consult project manager, PCP, and/or specialist. Due to turnover and changes in clinic roles, some follow-up interviews were conducted with different individuals from the baseline interviews.
Data Collection
Interviews followed semistructured interview guidelines and included open-ended questions designed to elicit rich responses to a variety of aspects related to e-consult implementation, including patient needs, communication, leadership, resources, priorities, knowledge about the program, and unintended consequences. Follow-up interviews addressed how e-consults impacted the quality of specialty care; the impact of e-consults on Patient Aligned Care Teams (PACTs), the VHA patient-centered medical home initiative for primary care; and how e-consults have been used, eg, whether patients were involved in the decision to seek an e-consult.
Two interviewers who had participated in a 1-day, in-person training covering both data collection and analyzing key informant data conducted the 40 to 60 minute telephone interviews. One team member conducted the interview while the other took field notes. Interviews were also recorded. Follow-up probes were used to elicit specific examples and ensure sufficiently rich data. Following each interview, the notetaker reviewed the audio recording and filled in details in the field notes. The interview team debriefed and reviewed the augmented field notes and audio recordings, which became the primary data sources for the study.
Analysis
This was a qualitative descriptive analysis.12 Interview data were analyzed using an iterative, inductive content analysis method using an open coding approach (ie, a priori codes were not defined for this portion of the analysis).13 Two members of the research team used audio recordings and summary transcripts simultaneously to code data. Summary transcripts were compared with the recorded interviews to assure fidelity.
The researchers used Atlas.ti (Berlin, Germany) qualitative data analysis software to organize the coding process. Emergent codes were iteratively added throughout the analysis to reflect quotations that did not adequately fit previously developed codes. Codes were combined weekly to biweekly. After the combinations were completed, the analytics team met to review meanings of codes to ensure consistency of coding and interpretations.
To create categories, broad themes were identified from interview responses and grouped under high- order headings that described distinct aspects of participant experience. The analysis was intentionally kept close to the original data to reflect and describe the participant’s experience as accurately as possible. In support of analytical rigor, members of the multidisciplinary research team, composed of clinicians, implementation scientists, and mixed methodologists, reviewed findings to assess their thoroughness, comprehensiveness, and representativeness across roles and participating sites.14
Results
The e-consult evaluation period was from November 1, 2011, to July 31, 2013. Key conclusions were drawn from both alpha and beta sites (Table). Baseline interviews were conducted with 37 participants at 8 sites from April 10, 2012, to August 6, 2012. Follow-up interviews were conducted with 21 of the 37 participants at the 8 sites. Follow-up interviews with either a PCP or specialist could not be scheduled at 1 site. Follow-up interviews were conducted from April 16, 2013, to June 18, 2013. Open coding continued until saturation (the point at which subsequent data failed to produce new findings).15 This occurred after analysis of 22 baseline interviews (12 PCPs, 6 specialists, 1 pharmacist, and 4 other staff members) and 17 follow-up interviews (10 PCPs, 4 specialists, 1 pharmacist, and 2 other staff members).
Implementation
The e-consults provided a programmatic structure to the more informal practice of obtaining diagnostic or therapeutic advice from a specialist. Several of the specialists interviewed described having previously used existing informal consult processes that were “like e-consult.” These specialists reported that their practice patterns did not change significantly since implementing e-consults, because they have been “using the Computerized Patient Record System (CPRS) in an e-consult way for many years.” In these cases, the primary change resulting from the initiative was that national VHA workload policy was revised so that e-consults were assigned a CPT (Current Procedural Terminology) code and specialists began receiving workload credit for completing e-consults.
At sites where an informal e-consult practice was already in place, the initiative was consistently described as flexible. Many specialists reported that this degree of flexibility allowed them to make a relatively easy transition to e-consults by adopting new mechanisms to support existing processes. The e-consult initiative also allowed specialists to formally document this work and to increase the efficiency of specialty care.
Specialists drove the implementation process across sites. The e-consults were envisioned as a collaborative process; however, during initial interviews, few specialists mentioned PCPs when describing the development and implementation of the e-consult program. Primary care providers also reported having little awareness of or input into how the initiative was implemented, although this had little consequence on the use of e-consults.
In a rare case, a PCP reported that poorly designed, lengthy e-consult templates were a major barrier to using e-consults for specific specialties. The PCP said, “E-consults have created an elaborate but extraordinarily cumbersome tool that is difficult for PCPs to actually accomplish, because you have a consult menu that requires a lot of data to be entered—a lot of history from the chart, a lot of exam findings, a lot of previous cognitive testing scores; neurologic findings—lab and imaging tests.”
Still, many other PCPs described receiving detailed information and guidance from e-consults. “E-consults help me to be more accurate. Many providers don’t have a comfort with pain management. To get guidance and education and to really hold our hand, this is how to do this…this has been a big change. If they give you a great response, then [for] the next patient [with that condition], you go back to that note and then follow what was said there,” said one PCP.
In follow-up interviews, providers and other key staff stated there were more data available on the patient as a result of the e-consult and, consequently, even when specialists determined that a patient needed an in-person visit, the data obtained in the e-consult improved the quality of the in-person consultation.
Enhanced Communication and Collaboration
Neither the PCPs nor the specialists were aware of the collaborative intent of the initiative. They focused, instead, on other key aims, such as increasing accessibility and minimizing unnecessary patient travel. Most participants were generally positive about e-consults during baseline interviews, and this perception increased over time.
Both the PCPs and the specialists reported improved communication following the launch of e-consults. In follow-up interviews, some PCPs reported that before e-consults, they had trouble getting timely responses from specialists unless they knew them personally. “You had to know the person in the old days,” one respondent said. “After e-consults, responses improved…e-consult is available to have the resources to tap that knowledge base, and the team is answering the question. I think it opens up access and information and knowledge to everybody.”
Many PCPs spoke positively about this new communication tool as an opportunity to learn from specialists and said they valued the input they received. They felt the increased interaction between the 2 groups positively benefited patient care. One example cited that collaborative communication improved care coordination for veterans: “We are able to step in with e-consults to coordinate services, and this has been huge in improving care.”
Furthermore, follow-up interviews found that all participating PCPs and specialists were communicating more frequently and effectively. “Services that have embraced e-consult give a lot of great information flowing back; it’s closer to a real-time conversation,” said one respondent.
Related: Home-Based Video Telehealth for Veterans With Dementia
In baseline interviews, some specialists described how e-consults went against their belief that patient care is synonymous with face-to-face medical treatment and voiced dissatisfaction with e-consults as “sitting in front of a computer” rather than “seeing patients.” Others were concerned that medical center administration would not recognize the time it takes to conduct an e-consult and therefore not add necessary specialists staff. “E-consults take work and time, just like seeing a patient. I worry that won’t be seen,” one specialist said.
In order to successfully implement the e-consult initiative, providers and staff needed to incorporate new processes into their daily workflow.
Most sites did not develop a mechanism in which specialists received feedback regarding the outcome of their consultations. This lack of response created anxiety for some specialists in the absence of the face-to-face encounter, leaving some wondering whether they or the PCP had missed anything. According to one specialist, “That’s always in the back of your head: ‘Have I [the specialist] missed something?’”
In follow-up interviews, none of these concerns were raised. Primary care providers tended to speak of the care provided by specialists through e-consults in very positive terms, except in those instances where PCPs felt the e-consult template was difficult to use and required too much time to complete. “I was worried in the beginning about patients thinking less of me, but we ask for help all the time. We’re asking for help and not inconveniencing the patient; they seem to like it very much,” one PCP said.
The e-consults also complement PACTs. Initially, a few participants described soliciting patient input regarding the choice to have an e-consult or a face-to-face visit. During follow-up interviews, participants highlighted how well e-consults fit in to the PACT philosophy. One participant said, “The PACT team seeks to improve quality of care. E-consult fits very well with this, because answers to questions can come quickly, and the veteran may not need to come back to the clinic to be seen, even though things are still getting accomplished. E-consult works very well. E-consults were credited with improving access to specialty care as a tool for PACT.”
Achieving Program Objectives
Based on interviews, support for the e-consult program has increased over time as providers have gained experience with the program and have seen its benefits. Respondents at all sites consistently supported the concept of e-consults and expressed their belief in the importance and value of e-consults in improving patient-c entered care, primarily by reducing the need for patients to travel to see specialists, reducing the time to obtain feedback from specialists, and maintaining the provision of high quality care.
“Last year we only had 2 clinics categorized as e-consults. As of now we have 14 e-consults available for our providers. I think the numbers are growing. They are realizing the value of e-consults as far as the provider’s needs being met,” said one respondent.
The e-consults were credited with improving access to specialty care for veterans. Several participants stated that e-consults improved access to specialty care services and decreased travel for veterans. “It’s another way of getting care to the patient when the patient needs it without having to wait,” said one respondent.
Many PCPs described how difficult it was for patients to get to specialty appointments—particularly for their elderly, disabled, and rural patients—before the implementation of e-consults. “I like the fact that patients who live very far don’t have to come back. A lot of our patients are older…diabetic, see me Monday and back on Thursday. Now, they are able to stay home and follow the recommendations I write,” said one PCP.
Most providers were of the opinion that patients liked the program. “I think e-consults are helping patients...It’s been very successful regarding decreasing travel…Quicker response time for specialty care,” said a PCP. Several providers also stated in follow-up interviews that there was a greater degree of patient participation in the e-consult process and that “patients are definitely informed.”
Discussion
Most PCPs reported that the e-consults were an effective means of consultation and contained the information they needed to provide high-quality coordinated care. Most also found e-consult templates easy to complete. A majority of PCPs felt sufficient control over the choice of whether to use e-consults or an in-person visit, and a minority of patients were involved in the decision to receive an e-consult. Although the OSCS outlined guiding principles and operational rules in the Implementation Guide to help sites implement the e-consult program, its contribution was limited. Few examples were found that engaged PCPs in development of the e-consult program locally; involving patients in the decision to obtain a specialty consult electronically or in person; and PCPs feeding back results to specialists.
Implementing e-consults posed a number of challenges, including lack of resources to respond to referral requests, lack of referral policies and standardized procedures, and confusion related to roles and responsibilities. This is consistent with findings from another VHA research project of e-consults in 2 VHA health systems that was conducted prior to this national level e-consult pilot.7
Related: Using Facilitative Coaching to Support Patient Aligned Care Teams
Communication by OSCS of key aspects of the e-consult initiative will be critical as more sites implement e-consults. Since initiation of this pilot, workload specifications and credit have changed from 1 code to 3 codes, to more accurately reflect the amount of time a specialist consultant spends reviewing the EHR and responding to the consult. Without seeing the patient directly, specialists are more reliant on the PCP to describe the problem and provide adequate information in the e-consult request in order to provide recommendations back to the PCP.
Primary care physicians need to know that e-consults are available and determine when they are appropriate. A template or other guidance may be helpful to ensure adequate information is provided in the e-consult request; and the information provided by the specialist in response to the e-consult has to be sufficient for the PCP to provide care. VHA continues to expand the use of e-consults throughout the system, as this pilot found that the electronic option was often more timely than were face-to-face consultations. The result of this evaluation has informed national implementation of this effort.
Limitations
There are 3 main limitations to this study. First, because there was no practical way to preidentify participants who participated in implementing e-consults, a modified snowball sampling was used. However, this limited the degree to which the group was representative of the pilot participants. Second, the authors reported findings from a real-world initiative, not an experimental study. As such, not all participants in the first wave of key informant interviews were available for follow-up interview, which may have introduced bias. Third, the VHA is unlike most of the rest of the U.S. health care system in that it is a fully integrated system with salaried PCPs and specialists and an EHR.
Generalizability of the study may be limited, as a modified snowball sampling approach is not entirely random and has potential for community bias, because initial participants influence subsequent sampling. Additionally, though the sample size (n = 37) was sufficient for qualitative, in-depth analysis, it may be too small for confident generalization of findings. However, as health care moves toward an accountable care organization system, the authors’ analysis may provide insights.
Issues include revision of reimbursement policy for e-consults and developing or coordinating informational technology infrastructures to permit e-consults. It is also important to note that this evaluation reports solely on the extent of implementation of e-consults and the effects of e-consult implementation from the perspectives of staff, including specialists and PCPs.
Evaluating the effectiveness of the program in improving access, care coordination, and patient satisfaction was beyond the scope of the study. Further research is needed, because findings on those outcomes are critical for drawing inferences about this study’s implementation results.
Conclusion
The assessment of the e-consult system by providers and staff was based on a perception that e-consults are a valuable tool in providing greater access to quality care. Currently, e-consults have been expanded across VHA in medical and surgical specialties. VHA policymakers have drafted field guidance and a communication plan to support these efforts.
Acknowledgement
This material is based on work supported by the VA Office of Specialty Care Transformation, the office overseeing the e-consult initiative, and the Office of Research and Development Quality Enhancement Research Initiative.
Author disclosures
The authors report no actual or potential conflicts of interest with regard to this article.
Disclaimer
The opinions expressed herein are those of the authors and do not necessarily reflect those of Federal Practitioner, Frontline Medical Communications Inc., the U.S. Government, or any of its agencies. This article may discuss unlabeled or investigational use of certain drugs. Please review the complete prescribing information for specific drugs or drug combinations—including indications, contraindications, warnings, and adverse effects—before administering pharmacologic therapy to patients.
1. Chen AH, Murphy EJ, Yee HF Jr. eReferral—a new model for integrated care. N Engl J Med. 2013;368(26):2450-2453.
2. Hanna L, May C, Fairhurst K. The place of information and communication technology-mediated consultations in primary care: GPs’ perspectives. Fam Pract. 2012;29(3):361-366.
3. Kim-Hwang JE, Chen AH, Bell DS, Guzman D, Yee HF Jr, Kushel MB. Evaluating electronic referrals for specialty care at a public hospital. J Gen Intern Med. 2010;25(10):1123-1128.
4. Straus SG, Chen AH, Yee HF Jr, Kushel MB, Bell DS. Implementation of an electronic referral system for outpatient specialty care. AMIA Annu Symp Proc. 2011;2011:1337-1346.
5. Horner K, Wagner E, Tufano J. Electronic consultations between primary and specialty care clinicians: early insights. Issue Brief (Commonw Fund). 2011;23:1-14.
6. McAdams M, Cannavo L, Orlander JD. A medical specialty e-consult program in a VA health care system. Fed Pract. 2014;31(5):26-31.
7. Hysong SJ, Esquivel A, Sittig DF, et al. Towards successful coordination of electronic health record based-referrals: a qualitative analysis. Implement Sci. 2011;6:84.
8. American College of Physicians. The Patient- Centered Medical Home Neighbor: The Interface of the Patient-Centered Medical Home with Specialty/Subspecialty Practices. Philadelphia, PA: American College of Physicians; 2010. Policy paper.
9. Fisher ES. Building a medical neighborhood for the medical home. N Engl J Med. 2008;359(12): 1202-1205.
10. Department of Veterans Affairs. Electronic Consultation (E-Consult) Implementation Guide, Version 1.2. Washington, DC: Department of Veterans Affairs, Office of Specialty Care Services, Specialty Care Transformation. 2013.
11. Kirsh S, Cary E, Aron DC et al. Results of a national pilot project for specialty care e-consultation in primary care medical homes: the impact of specialty e-consultation on access. Am J Manag Care. In press.
12. Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334-340.
13. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-115.
14. Giacomini MK, Cook DJ. Users’ guides to the medical literature: XXIII. Qualitative research in health care A. Are the results of the study valid? Evidence-Based Medicine Working Group. JAMA. 2000;284(3):357-362.
15. Sandelowski M. The problem of rigor in qualitative research. ANS Adv Nurs Sci. 1986;8(3):27-37.
Electronic consultations (e-consults), also called e-referrals, are an alternative method of obtaining general patient information through the electronic health record (EHR) shared by primary care providers (PCPs) and specialists in the VHA. In the e-consult system, test results, medication lists, and other pertinent data are available.1 Many PCPs are willing to use new technologies to maximize practice efficiency and patient convenience.2 In the VHA’s hub-and-spoke model of care, e-consults have the potential to make delivery of specialty care more efficient by prearranging or completing necessary diagnostic testing and redirecting inappropriate referrals to the correct specialists.1
Some early studies of e-consults report better communication, improved referral appropriateness, and greater access to specialty care as well as better continuity of care and information transfer between patients and PCPs.3-5 Researchers at the VA Boston Healthcare System in Massachusetts found that 61% of specialists surveyed agreed that e-consults improve quality of care and found the approach beneficial to help initiate diagnostic testing prior to a face-to-face visit.6 However, researchers at the Michael E. DeBakey VAMC in Houston, Texas, found no improvement in care coordination.7 To date, there have been no large-scale evaluations of e-consult programs or assessments of implementation of e-consult programs.
Related: HHS Grants Fund Health IT in Communities
In early 2011, the VHA Office of Specialty Care Services (OSCS), Office of Specialty Care Transformation launched a national e-consult pilot as part of a broader effort to improve the delivery of patient-centered specialty care. This initiative was based on core concepts advanced by the American College of Physicians, which highlighted the importance of specialty care within a patient- centered medical home and provided a framework for collaboration.8,9 The goals of the e-consult program were to improve access to specialty care for veterans and their PCPs, to enhance the collaborative relationship between PCPs and specialists, and to augment PCP education.
The OSCS created an Electronic Consultation Implementation Guide to help sites develop and implement each of their e-consult programs.10 The Implementation Guide established operating rules, strategies for engaging key stakeholders, and recommendations for provider education and training.
As with face-to-face referrals, e-consults are organized in a hub-and-spoke model, where community-based outpatient clinics (CBOCs) are linked to a central VAMC. An e-consult can be accessed by any CBOC, VAMC, medical center-based primary care clinic or specialist, and between medical centers that share the same EHR. There were 217,014 completed e-consults between May 2011 and December 2013 across VHA.11
Some programs created an e-consult template to aid in the transition to electronic referrals (Figure). Although not mandatory, the template helped organize needed information to expedite the e-consult.
The objective of this evaluation is to describe the implementation of e-consults from the perspectives of PCPs, specialists, and other key staff involved in the pilot. Key findings were related to: (1) how the e-consult pilot was implemented; (2) how implementation of the e-consult pilot affected providers; and (3) to what extent the e-consult pilot achieved programmatic objectives from the provider’s perspective.
Methods
The authors conducted a key informant analysis with 2 waves of interviews at 8 e-consult pilot sites across the U.S., selected for variation on early progress in implementation. The sites cannot be identified based on an agreement with the VA Office of Labor-Management Relations.
Setting
The e-consult pilot involved 15 VAMCs in 2 cohorts: alpha sites, which began using e-consults in May 2011, and beta sites, which began using e-consults in July 2011. The alpha sites included 10 VAMCs in 12 medical specialties, with a total of 21 facility-specialty combinations. For the evaluation, sites were defined based on specialty, regardless of location within the same medical center (eg, cardiology and diabetes at the same VAMC would be 2 sites). Beta sites included 5 VAMCs with 6 medical specialties for a total of 6 sites. For 1 year, alpha sites received $175,000 and beta sites received $150,000 to support start-up activities.
Initial specialties included diabetes, hepatitis C, geriatrics, cardiology, liver transplant, dementia, gastrointestinal disease, pulmonary medicine, rheumatology, pain management, neurosurgery, infectious diseases, hematology/oncology, and vascular surgery. Facilities could add additional e-consult specialties but did not receive further funding.
Sample
Study participants were selected from 8 of the 15 pilot sites (geographic site/specialty combinations). Site selection was based on 2 measures of baseline e-consult implementation: (1) overall e-consult implementation rates, measured as the ratio of e-consults to all consults for the specialties of interest; and (2) CBOC participation, measured as the ratio of e-consults for patients from CBOCs vs e-consults for patients from primary care clinics located within the 152 VAMCs. Participation with CBOCs was important for ensuring that implementation factors that influenced uptake of e-consults within tertiary medical centers and between VAMCs and CBOCs could be identified. Two e-consult sites were randomly selected from each of the 4 resulting categories (VAMC high volume, VAMC low volume, CBOC high volume, and CBOC low volume). Volume data of e-consults were obtained from the VA Corporate Data Warehouse and assessed from the beginning of the pilot period to initial site selection, May 2011 to February 2012.
Respondents were identified using a modified snowball sampling process. Snowball sampling is a qualitative sampling technique that identifies study participants, who then identify other potential participants to participate in the study. The researchers started with the local e-consult initiative lead and then contacted the directors of primary care and specialty care services for help identifying PCPs, specialists, and support staff (nurse practitioners, pharmacists, program managers, informatics staff, and medical support personnel) engaged in the initiative. The goal for follow-up interviews was to interview at least 2 of the following respondents at each site: e-consult project manager, PCP, and/or specialist. Due to turnover and changes in clinic roles, some follow-up interviews were conducted with different individuals from the baseline interviews.
Data Collection
Interviews followed semistructured interview guidelines and included open-ended questions designed to elicit rich responses to a variety of aspects related to e-consult implementation, including patient needs, communication, leadership, resources, priorities, knowledge about the program, and unintended consequences. Follow-up interviews addressed how e-consults impacted the quality of specialty care; the impact of e-consults on Patient Aligned Care Teams (PACTs), the VHA patient-centered medical home initiative for primary care; and how e-consults have been used, eg, whether patients were involved in the decision to seek an e-consult.
Two interviewers who had participated in a 1-day, in-person training covering both data collection and analyzing key informant data conducted the 40 to 60 minute telephone interviews. One team member conducted the interview while the other took field notes. Interviews were also recorded. Follow-up probes were used to elicit specific examples and ensure sufficiently rich data. Following each interview, the notetaker reviewed the audio recording and filled in details in the field notes. The interview team debriefed and reviewed the augmented field notes and audio recordings, which became the primary data sources for the study.
Analysis
This was a qualitative descriptive analysis.12 Interview data were analyzed using an iterative, inductive content analysis method using an open coding approach (ie, a priori codes were not defined for this portion of the analysis).13 Two members of the research team used audio recordings and summary transcripts simultaneously to code data. Summary transcripts were compared with the recorded interviews to assure fidelity.
The researchers used Atlas.ti (Berlin, Germany) qualitative data analysis software to organize the coding process. Emergent codes were iteratively added throughout the analysis to reflect quotations that did not adequately fit previously developed codes. Codes were combined weekly to biweekly. After the combinations were completed, the analytics team met to review meanings of codes to ensure consistency of coding and interpretations.
To create categories, broad themes were identified from interview responses and grouped under high- order headings that described distinct aspects of participant experience. The analysis was intentionally kept close to the original data to reflect and describe the participant’s experience as accurately as possible. In support of analytical rigor, members of the multidisciplinary research team, composed of clinicians, implementation scientists, and mixed methodologists, reviewed findings to assess their thoroughness, comprehensiveness, and representativeness across roles and participating sites.14
Results
The e-consult evaluation period was from November 1, 2011, to July 31, 2013. Key conclusions were drawn from both alpha and beta sites (Table). Baseline interviews were conducted with 37 participants at 8 sites from April 10, 2012, to August 6, 2012. Follow-up interviews were conducted with 21 of the 37 participants at the 8 sites. Follow-up interviews with either a PCP or specialist could not be scheduled at 1 site. Follow-up interviews were conducted from April 16, 2013, to June 18, 2013. Open coding continued until saturation (the point at which subsequent data failed to produce new findings).15 This occurred after analysis of 22 baseline interviews (12 PCPs, 6 specialists, 1 pharmacist, and 4 other staff members) and 17 follow-up interviews (10 PCPs, 4 specialists, 1 pharmacist, and 2 other staff members).
Implementation
The e-consults provided a programmatic structure to the more informal practice of obtaining diagnostic or therapeutic advice from a specialist. Several of the specialists interviewed described having previously used existing informal consult processes that were “like e-consult.” These specialists reported that their practice patterns did not change significantly since implementing e-consults, because they have been “using the Computerized Patient Record System (CPRS) in an e-consult way for many years.” In these cases, the primary change resulting from the initiative was that national VHA workload policy was revised so that e-consults were assigned a CPT (Current Procedural Terminology) code and specialists began receiving workload credit for completing e-consults.
At sites where an informal e-consult practice was already in place, the initiative was consistently described as flexible. Many specialists reported that this degree of flexibility allowed them to make a relatively easy transition to e-consults by adopting new mechanisms to support existing processes. The e-consult initiative also allowed specialists to formally document this work and to increase the efficiency of specialty care.
Specialists drove the implementation process across sites. The e-consults were envisioned as a collaborative process; however, during initial interviews, few specialists mentioned PCPs when describing the development and implementation of the e-consult program. Primary care providers also reported having little awareness of or input into how the initiative was implemented, although this had little consequence on the use of e-consults.
In a rare case, a PCP reported that poorly designed, lengthy e-consult templates were a major barrier to using e-consults for specific specialties. The PCP said, “E-consults have created an elaborate but extraordinarily cumbersome tool that is difficult for PCPs to actually accomplish, because you have a consult menu that requires a lot of data to be entered—a lot of history from the chart, a lot of exam findings, a lot of previous cognitive testing scores; neurologic findings—lab and imaging tests.”
Still, many other PCPs described receiving detailed information and guidance from e-consults. “E-consults help me to be more accurate. Many providers don’t have a comfort with pain management. To get guidance and education and to really hold our hand, this is how to do this…this has been a big change. If they give you a great response, then [for] the next patient [with that condition], you go back to that note and then follow what was said there,” said one PCP.
In follow-up interviews, providers and other key staff stated there were more data available on the patient as a result of the e-consult and, consequently, even when specialists determined that a patient needed an in-person visit, the data obtained in the e-consult improved the quality of the in-person consultation.
Enhanced Communication and Collaboration
Neither the PCPs nor the specialists were aware of the collaborative intent of the initiative. They focused, instead, on other key aims, such as increasing accessibility and minimizing unnecessary patient travel. Most participants were generally positive about e-consults during baseline interviews, and this perception increased over time.
Both the PCPs and the specialists reported improved communication following the launch of e-consults. In follow-up interviews, some PCPs reported that before e-consults, they had trouble getting timely responses from specialists unless they knew them personally. “You had to know the person in the old days,” one respondent said. “After e-consults, responses improved…e-consult is available to have the resources to tap that knowledge base, and the team is answering the question. I think it opens up access and information and knowledge to everybody.”
Many PCPs spoke positively about this new communication tool as an opportunity to learn from specialists and said they valued the input they received. They felt the increased interaction between the 2 groups positively benefited patient care. One example cited that collaborative communication improved care coordination for veterans: “We are able to step in with e-consults to coordinate services, and this has been huge in improving care.”
Furthermore, follow-up interviews found that all participating PCPs and specialists were communicating more frequently and effectively. “Services that have embraced e-consult give a lot of great information flowing back; it’s closer to a real-time conversation,” said one respondent.
Related: Home-Based Video Telehealth for Veterans With Dementia
In baseline interviews, some specialists described how e-consults went against their belief that patient care is synonymous with face-to-face medical treatment and voiced dissatisfaction with e-consults as “sitting in front of a computer” rather than “seeing patients.” Others were concerned that medical center administration would not recognize the time it takes to conduct an e-consult and therefore not add necessary specialists staff. “E-consults take work and time, just like seeing a patient. I worry that won’t be seen,” one specialist said.
In order to successfully implement the e-consult initiative, providers and staff needed to incorporate new processes into their daily workflow.
Most sites did not develop a mechanism in which specialists received feedback regarding the outcome of their consultations. This lack of response created anxiety for some specialists in the absence of the face-to-face encounter, leaving some wondering whether they or the PCP had missed anything. According to one specialist, “That’s always in the back of your head: ‘Have I [the specialist] missed something?’”
In follow-up interviews, none of these concerns were raised. Primary care providers tended to speak of the care provided by specialists through e-consults in very positive terms, except in those instances where PCPs felt the e-consult template was difficult to use and required too much time to complete. “I was worried in the beginning about patients thinking less of me, but we ask for help all the time. We’re asking for help and not inconveniencing the patient; they seem to like it very much,” one PCP said.
The e-consults also complement PACTs. Initially, a few participants described soliciting patient input regarding the choice to have an e-consult or a face-to-face visit. During follow-up interviews, participants highlighted how well e-consults fit in to the PACT philosophy. One participant said, “The PACT team seeks to improve quality of care. E-consult fits very well with this, because answers to questions can come quickly, and the veteran may not need to come back to the clinic to be seen, even though things are still getting accomplished. E-consult works very well. E-consults were credited with improving access to specialty care as a tool for PACT.”
Achieving Program Objectives
Based on interviews, support for the e-consult program has increased over time as providers have gained experience with the program and have seen its benefits. Respondents at all sites consistently supported the concept of e-consults and expressed their belief in the importance and value of e-consults in improving patient-c entered care, primarily by reducing the need for patients to travel to see specialists, reducing the time to obtain feedback from specialists, and maintaining the provision of high quality care.
“Last year we only had 2 clinics categorized as e-consults. As of now we have 14 e-consults available for our providers. I think the numbers are growing. They are realizing the value of e-consults as far as the provider’s needs being met,” said one respondent.
The e-consults were credited with improving access to specialty care for veterans. Several participants stated that e-consults improved access to specialty care services and decreased travel for veterans. “It’s another way of getting care to the patient when the patient needs it without having to wait,” said one respondent.
Many PCPs described how difficult it was for patients to get to specialty appointments—particularly for their elderly, disabled, and rural patients—before the implementation of e-consults. “I like the fact that patients who live very far don’t have to come back. A lot of our patients are older…diabetic, see me Monday and back on Thursday. Now, they are able to stay home and follow the recommendations I write,” said one PCP.
Most providers were of the opinion that patients liked the program. “I think e-consults are helping patients...It’s been very successful regarding decreasing travel…Quicker response time for specialty care,” said a PCP. Several providers also stated in follow-up interviews that there was a greater degree of patient participation in the e-consult process and that “patients are definitely informed.”
Discussion
Most PCPs reported that the e-consults were an effective means of consultation and contained the information they needed to provide high-quality coordinated care. Most also found e-consult templates easy to complete. A majority of PCPs felt sufficient control over the choice of whether to use e-consults or an in-person visit, and a minority of patients were involved in the decision to receive an e-consult. Although the OSCS outlined guiding principles and operational rules in the Implementation Guide to help sites implement the e-consult program, its contribution was limited. Few examples were found that engaged PCPs in development of the e-consult program locally; involving patients in the decision to obtain a specialty consult electronically or in person; and PCPs feeding back results to specialists.
Implementing e-consults posed a number of challenges, including lack of resources to respond to referral requests, lack of referral policies and standardized procedures, and confusion related to roles and responsibilities. This is consistent with findings from another VHA research project of e-consults in 2 VHA health systems that was conducted prior to this national level e-consult pilot.7
Related: Using Facilitative Coaching to Support Patient Aligned Care Teams
Communication by OSCS of key aspects of the e-consult initiative will be critical as more sites implement e-consults. Since initiation of this pilot, workload specifications and credit have changed from 1 code to 3 codes, to more accurately reflect the amount of time a specialist consultant spends reviewing the EHR and responding to the consult. Without seeing the patient directly, specialists are more reliant on the PCP to describe the problem and provide adequate information in the e-consult request in order to provide recommendations back to the PCP.
Primary care physicians need to know that e-consults are available and determine when they are appropriate. A template or other guidance may be helpful to ensure adequate information is provided in the e-consult request; and the information provided by the specialist in response to the e-consult has to be sufficient for the PCP to provide care. VHA continues to expand the use of e-consults throughout the system, as this pilot found that the electronic option was often more timely than were face-to-face consultations. The result of this evaluation has informed national implementation of this effort.
Limitations
There are 3 main limitations to this study. First, because there was no practical way to preidentify participants who participated in implementing e-consults, a modified snowball sampling was used. However, this limited the degree to which the group was representative of the pilot participants. Second, the authors reported findings from a real-world initiative, not an experimental study. As such, not all participants in the first wave of key informant interviews were available for follow-up interview, which may have introduced bias. Third, the VHA is unlike most of the rest of the U.S. health care system in that it is a fully integrated system with salaried PCPs and specialists and an EHR.
Generalizability of the study may be limited, as a modified snowball sampling approach is not entirely random and has potential for community bias, because initial participants influence subsequent sampling. Additionally, though the sample size (n = 37) was sufficient for qualitative, in-depth analysis, it may be too small for confident generalization of findings. However, as health care moves toward an accountable care organization system, the authors’ analysis may provide insights.
Issues include revision of reimbursement policy for e-consults and developing or coordinating informational technology infrastructures to permit e-consults. It is also important to note that this evaluation reports solely on the extent of implementation of e-consults and the effects of e-consult implementation from the perspectives of staff, including specialists and PCPs.
Evaluating the effectiveness of the program in improving access, care coordination, and patient satisfaction was beyond the scope of the study. Further research is needed, because findings on those outcomes are critical for drawing inferences about this study’s implementation results.
Conclusion
The assessment of the e-consult system by providers and staff was based on a perception that e-consults are a valuable tool in providing greater access to quality care. Currently, e-consults have been expanded across VHA in medical and surgical specialties. VHA policymakers have drafted field guidance and a communication plan to support these efforts.
Acknowledgement
This material is based on work supported by the VA Office of Specialty Care Transformation, the office overseeing the e-consult initiative, and the Office of Research and Development Quality Enhancement Research Initiative.
Author disclosures
The authors report no actual or potential conflicts of interest with regard to this article.
Disclaimer
The opinions expressed herein are those of the authors and do not necessarily reflect those of Federal Practitioner, Frontline Medical Communications Inc., the U.S. Government, or any of its agencies. This article may discuss unlabeled or investigational use of certain drugs. Please review the complete prescribing information for specific drugs or drug combinations—including indications, contraindications, warnings, and adverse effects—before administering pharmacologic therapy to patients.
Electronic consultations (e-consults), also called e-referrals, are an alternative method of obtaining general patient information through the electronic health record (EHR) shared by primary care providers (PCPs) and specialists in the VHA. In the e-consult system, test results, medication lists, and other pertinent data are available.1 Many PCPs are willing to use new technologies to maximize practice efficiency and patient convenience.2 In the VHA’s hub-and-spoke model of care, e-consults have the potential to make delivery of specialty care more efficient by prearranging or completing necessary diagnostic testing and redirecting inappropriate referrals to the correct specialists.1
Some early studies of e-consults report better communication, improved referral appropriateness, and greater access to specialty care as well as better continuity of care and information transfer between patients and PCPs.3-5 Researchers at the VA Boston Healthcare System in Massachusetts found that 61% of specialists surveyed agreed that e-consults improve quality of care and found the approach beneficial to help initiate diagnostic testing prior to a face-to-face visit.6 However, researchers at the Michael E. DeBakey VAMC in Houston, Texas, found no improvement in care coordination.7 To date, there have been no large-scale evaluations of e-consult programs or assessments of implementation of e-consult programs.
Related: HHS Grants Fund Health IT in Communities
In early 2011, the VHA Office of Specialty Care Services (OSCS), Office of Specialty Care Transformation launched a national e-consult pilot as part of a broader effort to improve the delivery of patient-centered specialty care. This initiative was based on core concepts advanced by the American College of Physicians, which highlighted the importance of specialty care within a patient- centered medical home and provided a framework for collaboration.8,9 The goals of the e-consult program were to improve access to specialty care for veterans and their PCPs, to enhance the collaborative relationship between PCPs and specialists, and to augment PCP education.
The OSCS created an Electronic Consultation Implementation Guide to help sites develop and implement each of their e-consult programs.10 The Implementation Guide established operating rules, strategies for engaging key stakeholders, and recommendations for provider education and training.
As with face-to-face referrals, e-consults are organized in a hub-and-spoke model, where community-based outpatient clinics (CBOCs) are linked to a central VAMC. An e-consult can be accessed by any CBOC, VAMC, medical center-based primary care clinic or specialist, and between medical centers that share the same EHR. There were 217,014 completed e-consults between May 2011 and December 2013 across VHA.11
Some programs created an e-consult template to aid in the transition to electronic referrals (Figure). Although not mandatory, the template helped organize needed information to expedite the e-consult.
The objective of this evaluation is to describe the implementation of e-consults from the perspectives of PCPs, specialists, and other key staff involved in the pilot. Key findings were related to: (1) how the e-consult pilot was implemented; (2) how implementation of the e-consult pilot affected providers; and (3) to what extent the e-consult pilot achieved programmatic objectives from the provider’s perspective.
Methods
The authors conducted a key informant analysis with 2 waves of interviews at 8 e-consult pilot sites across the U.S., selected for variation on early progress in implementation. The sites cannot be identified based on an agreement with the VA Office of Labor-Management Relations.
Setting
The e-consult pilot involved 15 VAMCs in 2 cohorts: alpha sites, which began using e-consults in May 2011, and beta sites, which began using e-consults in July 2011. The alpha sites included 10 VAMCs in 12 medical specialties, with a total of 21 facility-specialty combinations. For the evaluation, sites were defined based on specialty, regardless of location within the same medical center (eg, cardiology and diabetes at the same VAMC would be 2 sites). Beta sites included 5 VAMCs with 6 medical specialties for a total of 6 sites. For 1 year, alpha sites received $175,000 and beta sites received $150,000 to support start-up activities.
Initial specialties included diabetes, hepatitis C, geriatrics, cardiology, liver transplant, dementia, gastrointestinal disease, pulmonary medicine, rheumatology, pain management, neurosurgery, infectious diseases, hematology/oncology, and vascular surgery. Facilities could add additional e-consult specialties but did not receive further funding.
Sample
Study participants were selected from 8 of the 15 pilot sites (geographic site/specialty combinations). Site selection was based on 2 measures of baseline e-consult implementation: (1) overall e-consult implementation rates, measured as the ratio of e-consults to all consults for the specialties of interest; and (2) CBOC participation, measured as the ratio of e-consults for patients from CBOCs vs e-consults for patients from primary care clinics located within the 152 VAMCs. Participation with CBOCs was important for ensuring that implementation factors that influenced uptake of e-consults within tertiary medical centers and between VAMCs and CBOCs could be identified. Two e-consult sites were randomly selected from each of the 4 resulting categories (VAMC high volume, VAMC low volume, CBOC high volume, and CBOC low volume). Volume data of e-consults were obtained from the VA Corporate Data Warehouse and assessed from the beginning of the pilot period to initial site selection, May 2011 to February 2012.
Respondents were identified using a modified snowball sampling process. Snowball sampling is a qualitative sampling technique that identifies study participants, who then identify other potential participants to participate in the study. The researchers started with the local e-consult initiative lead and then contacted the directors of primary care and specialty care services for help identifying PCPs, specialists, and support staff (nurse practitioners, pharmacists, program managers, informatics staff, and medical support personnel) engaged in the initiative. The goal for follow-up interviews was to interview at least 2 of the following respondents at each site: e-consult project manager, PCP, and/or specialist. Due to turnover and changes in clinic roles, some follow-up interviews were conducted with different individuals from the baseline interviews.
Data Collection
Interviews followed semistructured interview guidelines and included open-ended questions designed to elicit rich responses to a variety of aspects related to e-consult implementation, including patient needs, communication, leadership, resources, priorities, knowledge about the program, and unintended consequences. Follow-up interviews addressed how e-consults impacted the quality of specialty care; the impact of e-consults on Patient Aligned Care Teams (PACTs), the VHA patient-centered medical home initiative for primary care; and how e-consults have been used, eg, whether patients were involved in the decision to seek an e-consult.
Two interviewers who had participated in a 1-day, in-person training covering both data collection and analyzing key informant data conducted the 40 to 60 minute telephone interviews. One team member conducted the interview while the other took field notes. Interviews were also recorded. Follow-up probes were used to elicit specific examples and ensure sufficiently rich data. Following each interview, the notetaker reviewed the audio recording and filled in details in the field notes. The interview team debriefed and reviewed the augmented field notes and audio recordings, which became the primary data sources for the study.
Analysis
This was a qualitative descriptive analysis.12 Interview data were analyzed using an iterative, inductive content analysis method using an open coding approach (ie, a priori codes were not defined for this portion of the analysis).13 Two members of the research team used audio recordings and summary transcripts simultaneously to code data. Summary transcripts were compared with the recorded interviews to assure fidelity.
The researchers used Atlas.ti (Berlin, Germany) qualitative data analysis software to organize the coding process. Emergent codes were iteratively added throughout the analysis to reflect quotations that did not adequately fit previously developed codes. Codes were combined weekly to biweekly. After the combinations were completed, the analytics team met to review meanings of codes to ensure consistency of coding and interpretations.
To create categories, broad themes were identified from interview responses and grouped under high- order headings that described distinct aspects of participant experience. The analysis was intentionally kept close to the original data to reflect and describe the participant’s experience as accurately as possible. In support of analytical rigor, members of the multidisciplinary research team, composed of clinicians, implementation scientists, and mixed methodologists, reviewed findings to assess their thoroughness, comprehensiveness, and representativeness across roles and participating sites.14
Results
The e-consult evaluation period was from November 1, 2011, to July 31, 2013. Key conclusions were drawn from both alpha and beta sites (Table). Baseline interviews were conducted with 37 participants at 8 sites from April 10, 2012, to August 6, 2012. Follow-up interviews were conducted with 21 of the 37 participants at the 8 sites. Follow-up interviews with either a PCP or specialist could not be scheduled at 1 site. Follow-up interviews were conducted from April 16, 2013, to June 18, 2013. Open coding continued until saturation (the point at which subsequent data failed to produce new findings).15 This occurred after analysis of 22 baseline interviews (12 PCPs, 6 specialists, 1 pharmacist, and 4 other staff members) and 17 follow-up interviews (10 PCPs, 4 specialists, 1 pharmacist, and 2 other staff members).
Implementation
The e-consults provided a programmatic structure to the more informal practice of obtaining diagnostic or therapeutic advice from a specialist. Several of the specialists interviewed described having previously used existing informal consult processes that were “like e-consult.” These specialists reported that their practice patterns did not change significantly since implementing e-consults, because they have been “using the Computerized Patient Record System (CPRS) in an e-consult way for many years.” In these cases, the primary change resulting from the initiative was that national VHA workload policy was revised so that e-consults were assigned a CPT (Current Procedural Terminology) code and specialists began receiving workload credit for completing e-consults.
At sites where an informal e-consult practice was already in place, the initiative was consistently described as flexible. Many specialists reported that this degree of flexibility allowed them to make a relatively easy transition to e-consults by adopting new mechanisms to support existing processes. The e-consult initiative also allowed specialists to formally document this work and to increase the efficiency of specialty care.
Specialists drove the implementation process across sites. The e-consults were envisioned as a collaborative process; however, during initial interviews, few specialists mentioned PCPs when describing the development and implementation of the e-consult program. Primary care providers also reported having little awareness of or input into how the initiative was implemented, although this had little consequence on the use of e-consults.
In a rare case, a PCP reported that poorly designed, lengthy e-consult templates were a major barrier to using e-consults for specific specialties. The PCP said, “E-consults have created an elaborate but extraordinarily cumbersome tool that is difficult for PCPs to actually accomplish, because you have a consult menu that requires a lot of data to be entered—a lot of history from the chart, a lot of exam findings, a lot of previous cognitive testing scores; neurologic findings—lab and imaging tests.”
Still, many other PCPs described receiving detailed information and guidance from e-consults. “E-consults help me to be more accurate. Many providers don’t have a comfort with pain management. To get guidance and education and to really hold our hand, this is how to do this…this has been a big change. If they give you a great response, then [for] the next patient [with that condition], you go back to that note and then follow what was said there,” said one PCP.
In follow-up interviews, providers and other key staff stated there were more data available on the patient as a result of the e-consult and, consequently, even when specialists determined that a patient needed an in-person visit, the data obtained in the e-consult improved the quality of the in-person consultation.
Enhanced Communication and Collaboration
Neither the PCPs nor the specialists were aware of the collaborative intent of the initiative. They focused, instead, on other key aims, such as increasing accessibility and minimizing unnecessary patient travel. Most participants were generally positive about e-consults during baseline interviews, and this perception increased over time.
Both the PCPs and the specialists reported improved communication following the launch of e-consults. In follow-up interviews, some PCPs reported that before e-consults, they had trouble getting timely responses from specialists unless they knew them personally. “You had to know the person in the old days,” one respondent said. “After e-consults, responses improved…e-consult is available to have the resources to tap that knowledge base, and the team is answering the question. I think it opens up access and information and knowledge to everybody.”
Many PCPs spoke positively about this new communication tool as an opportunity to learn from specialists and said they valued the input they received. They felt the increased interaction between the 2 groups positively benefited patient care. One example cited that collaborative communication improved care coordination for veterans: “We are able to step in with e-consults to coordinate services, and this has been huge in improving care.”
Furthermore, follow-up interviews found that all participating PCPs and specialists were communicating more frequently and effectively. “Services that have embraced e-consult give a lot of great information flowing back; it’s closer to a real-time conversation,” said one respondent.
Related: Home-Based Video Telehealth for Veterans With Dementia
In baseline interviews, some specialists described how e-consults went against their belief that patient care is synonymous with face-to-face medical treatment and voiced dissatisfaction with e-consults as “sitting in front of a computer” rather than “seeing patients.” Others were concerned that medical center administration would not recognize the time it takes to conduct an e-consult and therefore not add necessary specialists staff. “E-consults take work and time, just like seeing a patient. I worry that won’t be seen,” one specialist said.
In order to successfully implement the e-consult initiative, providers and staff needed to incorporate new processes into their daily workflow.
Most sites did not develop a mechanism in which specialists received feedback regarding the outcome of their consultations. This lack of response created anxiety for some specialists in the absence of the face-to-face encounter, leaving some wondering whether they or the PCP had missed anything. According to one specialist, “That’s always in the back of your head: ‘Have I [the specialist] missed something?’”
In follow-up interviews, none of these concerns were raised. Primary care providers tended to speak of the care provided by specialists through e-consults in very positive terms, except in those instances where PCPs felt the e-consult template was difficult to use and required too much time to complete. “I was worried in the beginning about patients thinking less of me, but we ask for help all the time. We’re asking for help and not inconveniencing the patient; they seem to like it very much,” one PCP said.
The e-consults also complement PACTs. Initially, a few participants described soliciting patient input regarding the choice to have an e-consult or a face-to-face visit. During follow-up interviews, participants highlighted how well e-consults fit in to the PACT philosophy. One participant said, “The PACT team seeks to improve quality of care. E-consult fits very well with this, because answers to questions can come quickly, and the veteran may not need to come back to the clinic to be seen, even though things are still getting accomplished. E-consult works very well. E-consults were credited with improving access to specialty care as a tool for PACT.”
Achieving Program Objectives
Based on interviews, support for the e-consult program has increased over time as providers have gained experience with the program and have seen its benefits. Respondents at all sites consistently supported the concept of e-consults and expressed their belief in the importance and value of e-consults in improving patient-c entered care, primarily by reducing the need for patients to travel to see specialists, reducing the time to obtain feedback from specialists, and maintaining the provision of high quality care.
“Last year we only had 2 clinics categorized as e-consults. As of now we have 14 e-consults available for our providers. I think the numbers are growing. They are realizing the value of e-consults as far as the provider’s needs being met,” said one respondent.
The e-consults were credited with improving access to specialty care for veterans. Several participants stated that e-consults improved access to specialty care services and decreased travel for veterans. “It’s another way of getting care to the patient when the patient needs it without having to wait,” said one respondent.
Many PCPs described how difficult it was for patients to get to specialty appointments—particularly for their elderly, disabled, and rural patients—before the implementation of e-consults. “I like the fact that patients who live very far don’t have to come back. A lot of our patients are older…diabetic, see me Monday and back on Thursday. Now, they are able to stay home and follow the recommendations I write,” said one PCP.
Most providers were of the opinion that patients liked the program. “I think e-consults are helping patients...It’s been very successful regarding decreasing travel…Quicker response time for specialty care,” said a PCP. Several providers also stated in follow-up interviews that there was a greater degree of patient participation in the e-consult process and that “patients are definitely informed.”
Discussion
Most PCPs reported that the e-consults were an effective means of consultation and contained the information they needed to provide high-quality coordinated care. Most also found e-consult templates easy to complete. A majority of PCPs felt sufficient control over the choice of whether to use e-consults or an in-person visit, and a minority of patients were involved in the decision to receive an e-consult. Although the OSCS outlined guiding principles and operational rules in the Implementation Guide to help sites implement the e-consult program, its contribution was limited. Few examples were found that engaged PCPs in development of the e-consult program locally; involving patients in the decision to obtain a specialty consult electronically or in person; and PCPs feeding back results to specialists.
Implementing e-consults posed a number of challenges, including lack of resources to respond to referral requests, lack of referral policies and standardized procedures, and confusion related to roles and responsibilities. This is consistent with findings from another VHA research project of e-consults in 2 VHA health systems that was conducted prior to this national level e-consult pilot.7
Related: Using Facilitative Coaching to Support Patient Aligned Care Teams
Communication by OSCS of key aspects of the e-consult initiative will be critical as more sites implement e-consults. Since initiation of this pilot, workload specifications and credit have changed from 1 code to 3 codes, to more accurately reflect the amount of time a specialist consultant spends reviewing the EHR and responding to the consult. Without seeing the patient directly, specialists are more reliant on the PCP to describe the problem and provide adequate information in the e-consult request in order to provide recommendations back to the PCP.
Primary care physicians need to know that e-consults are available and determine when they are appropriate. A template or other guidance may be helpful to ensure adequate information is provided in the e-consult request; and the information provided by the specialist in response to the e-consult has to be sufficient for the PCP to provide care. VHA continues to expand the use of e-consults throughout the system, as this pilot found that the electronic option was often more timely than were face-to-face consultations. The result of this evaluation has informed national implementation of this effort.
Limitations
There are 3 main limitations to this study. First, because there was no practical way to preidentify participants who participated in implementing e-consults, a modified snowball sampling was used. However, this limited the degree to which the group was representative of the pilot participants. Second, the authors reported findings from a real-world initiative, not an experimental study. As such, not all participants in the first wave of key informant interviews were available for follow-up interview, which may have introduced bias. Third, the VHA is unlike most of the rest of the U.S. health care system in that it is a fully integrated system with salaried PCPs and specialists and an EHR.
Generalizability of the study may be limited, as a modified snowball sampling approach is not entirely random and has potential for community bias, because initial participants influence subsequent sampling. Additionally, though the sample size (n = 37) was sufficient for qualitative, in-depth analysis, it may be too small for confident generalization of findings. However, as health care moves toward an accountable care organization system, the authors’ analysis may provide insights.
Issues include revision of reimbursement policy for e-consults and developing or coordinating informational technology infrastructures to permit e-consults. It is also important to note that this evaluation reports solely on the extent of implementation of e-consults and the effects of e-consult implementation from the perspectives of staff, including specialists and PCPs.
Evaluating the effectiveness of the program in improving access, care coordination, and patient satisfaction was beyond the scope of the study. Further research is needed, because findings on those outcomes are critical for drawing inferences about this study’s implementation results.
Conclusion
The assessment of the e-consult system by providers and staff was based on a perception that e-consults are a valuable tool in providing greater access to quality care. Currently, e-consults have been expanded across VHA in medical and surgical specialties. VHA policymakers have drafted field guidance and a communication plan to support these efforts.
Acknowledgement
This material is based on work supported by the VA Office of Specialty Care Transformation, the office overseeing the e-consult initiative, and the Office of Research and Development Quality Enhancement Research Initiative.
Author disclosures
The authors report no actual or potential conflicts of interest with regard to this article.
Disclaimer
The opinions expressed herein are those of the authors and do not necessarily reflect those of Federal Practitioner, Frontline Medical Communications Inc., the U.S. Government, or any of its agencies. This article may discuss unlabeled or investigational use of certain drugs. Please review the complete prescribing information for specific drugs or drug combinations—including indications, contraindications, warnings, and adverse effects—before administering pharmacologic therapy to patients.
1. Chen AH, Murphy EJ, Yee HF Jr. eReferral—a new model for integrated care. N Engl J Med. 2013;368(26):2450-2453.
2. Hanna L, May C, Fairhurst K. The place of information and communication technology-mediated consultations in primary care: GPs’ perspectives. Fam Pract. 2012;29(3):361-366.
3. Kim-Hwang JE, Chen AH, Bell DS, Guzman D, Yee HF Jr, Kushel MB. Evaluating electronic referrals for specialty care at a public hospital. J Gen Intern Med. 2010;25(10):1123-1128.
4. Straus SG, Chen AH, Yee HF Jr, Kushel MB, Bell DS. Implementation of an electronic referral system for outpatient specialty care. AMIA Annu Symp Proc. 2011;2011:1337-1346.
5. Horner K, Wagner E, Tufano J. Electronic consultations between primary and specialty care clinicians: early insights. Issue Brief (Commonw Fund). 2011;23:1-14.
6. McAdams M, Cannavo L, Orlander JD. A medical specialty e-consult program in a VA health care system. Fed Pract. 2014;31(5):26-31.
7. Hysong SJ, Esquivel A, Sittig DF, et al. Towards successful coordination of electronic health record based-referrals: a qualitative analysis. Implement Sci. 2011;6:84.
8. American College of Physicians. The Patient- Centered Medical Home Neighbor: The Interface of the Patient-Centered Medical Home with Specialty/Subspecialty Practices. Philadelphia, PA: American College of Physicians; 2010. Policy paper.
9. Fisher ES. Building a medical neighborhood for the medical home. N Engl J Med. 2008;359(12): 1202-1205.
10. Department of Veterans Affairs. Electronic Consultation (E-Consult) Implementation Guide, Version 1.2. Washington, DC: Department of Veterans Affairs, Office of Specialty Care Services, Specialty Care Transformation. 2013.
11. Kirsh S, Cary E, Aron DC et al. Results of a national pilot project for specialty care e-consultation in primary care medical homes: the impact of specialty e-consultation on access. Am J Manag Care. In press.
12. Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334-340.
13. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-115.
14. Giacomini MK, Cook DJ. Users’ guides to the medical literature: XXIII. Qualitative research in health care A. Are the results of the study valid? Evidence-Based Medicine Working Group. JAMA. 2000;284(3):357-362.
15. Sandelowski M. The problem of rigor in qualitative research. ANS Adv Nurs Sci. 1986;8(3):27-37.
1. Chen AH, Murphy EJ, Yee HF Jr. eReferral—a new model for integrated care. N Engl J Med. 2013;368(26):2450-2453.
2. Hanna L, May C, Fairhurst K. The place of information and communication technology-mediated consultations in primary care: GPs’ perspectives. Fam Pract. 2012;29(3):361-366.
3. Kim-Hwang JE, Chen AH, Bell DS, Guzman D, Yee HF Jr, Kushel MB. Evaluating electronic referrals for specialty care at a public hospital. J Gen Intern Med. 2010;25(10):1123-1128.
4. Straus SG, Chen AH, Yee HF Jr, Kushel MB, Bell DS. Implementation of an electronic referral system for outpatient specialty care. AMIA Annu Symp Proc. 2011;2011:1337-1346.
5. Horner K, Wagner E, Tufano J. Electronic consultations between primary and specialty care clinicians: early insights. Issue Brief (Commonw Fund). 2011;23:1-14.
6. McAdams M, Cannavo L, Orlander JD. A medical specialty e-consult program in a VA health care system. Fed Pract. 2014;31(5):26-31.
7. Hysong SJ, Esquivel A, Sittig DF, et al. Towards successful coordination of electronic health record based-referrals: a qualitative analysis. Implement Sci. 2011;6:84.
8. American College of Physicians. The Patient- Centered Medical Home Neighbor: The Interface of the Patient-Centered Medical Home with Specialty/Subspecialty Practices. Philadelphia, PA: American College of Physicians; 2010. Policy paper.
9. Fisher ES. Building a medical neighborhood for the medical home. N Engl J Med. 2008;359(12): 1202-1205.
10. Department of Veterans Affairs. Electronic Consultation (E-Consult) Implementation Guide, Version 1.2. Washington, DC: Department of Veterans Affairs, Office of Specialty Care Services, Specialty Care Transformation. 2013.
11. Kirsh S, Cary E, Aron DC et al. Results of a national pilot project for specialty care e-consultation in primary care medical homes: the impact of specialty e-consultation on access. Am J Manag Care. In press.
12. Sandelowski M. Whatever happened to qualitative description? Res Nurs Health. 2000;23(4):334-340.
13. Elo S, Kyngäs H. The qualitative content analysis process. J Adv Nurs. 2008;62(1):107-115.
14. Giacomini MK, Cook DJ. Users’ guides to the medical literature: XXIII. Qualitative research in health care A. Are the results of the study valid? Evidence-Based Medicine Working Group. JAMA. 2000;284(3):357-362.
15. Sandelowski M. The problem of rigor in qualitative research. ANS Adv Nurs Sci. 1986;8(3):27-37.