Assessing Telehealth Through the Lens of the Provider: Considerations for the Post-COVID-19 Era
Introduction
COVID-19 has changed the way that patients, providers, and health systems think about health care. The need to deliver health care services safely and efficiently, while maintaining a connection with patients, remains a key issue. During the early stages of the pandemic, telehealth offered an answer; usage consequently accelerated as a matter of necessity.1,2 Now, as we begin to consider our “new normal” and how telehealth will be utilized in a postpandemic world, other questions arise: For which specialties and types of visits does telehealth make sense? Do different sites of care offer different benefits for telehealth? Provider opinions on how, when, and why telehealth should be used will need to be part of the conversation.
Prepandemic adoption of telehealth was mostly driven by patient satisfaction.1,3 Patient surveys described that the majority were very satisfied with telehealth visits and reported no significant difference in overall quality compared with in-office visits for certain types of encounters.3–5 Contrary to patient satisfaction, there is limited literature on the provider’s perspective of telehealth before and after the coronavirus disease (COVID-19)-era easement of restrictions. The most cited reasons for pursuing virtual patient care among providers were increased patient access to care and increased efficiency compared with in-person visits.1
In addition, the literature shows that telehealth can decrease costs and missed appointment rates while improving care outcomes.3,6–9 The main concerns cited by providers regarding telehealth utilization before the COVID-19 pandemic involved ambiguous reimbursements, clinical quality concerns, and poor leadership and infrastructure.4 Despite these concerns, COVID-19 caused a drastic increase in telehealth utilization by providers in 2020 as 80% had adopted it as part of their practice.1
This new era has fostered a need to adapt technology to provide care delivery in varied health care settings. Early in the pandemic, the Office for Civil Rights and the Department of Health and Human Services lifted the restrictions of telehealth usage.10 This action helped spur a new tide of virtual platform utilization as many practices pivoted toward digital care delivery. Although changes in fundamental workflow can be difficult, this new technology has the potential to expand patient load, reduce no-show rates, and minimize travel times, allowing providers to optimize overall efficiency.5,11,12
With interest in telehealth on the rise, provider preference must be studied to ensure successful adoption. To this end, a quaternary-care academic health system in Ohio conducted an attitudinal, system-wide provider survey to better understand ranges of utilization of telehealth by different specialties, in different care settings, and provider opinions on the reasons behind usage or reticence.
The primary aim of this study was to utilize the survey results, including qualitative and quantitative data, and determine if providers from different specialties and care settings were aligned on the utility, benefits, and concerns surrounding telehealth during the height of the pandemic. The hope is that some themes in provider opinions may better inform discussion on how telehealth can be used in future clinical practice.
Methods
From May to June 2020, an attitudinal survey was sent to 2,633 health care providers engaging in direct patient care in a quaternary academic health system. The survey consisted of 15 questions and collected deidentified data on factors influencing provider utility, satisfaction, and concerns with telehealth. This was a mixed-methods study and the survey was designed and sent through the Qualtrics XM platform.13 Survey results were returned shortly after in-person visits resumed. The long-term COVID-19 limitations, such as universal masking and symptom screening, remained in effect during this time period.
This survey defined a telehealth visit as any interaction between a provider and a patient at a remote site using a live audio–video connection. This project was approved by the IRB as a nonhuman research project involving deidentified databases. Access to answers and analytics from the initial pulse survey was then granted by the Qualtrics team.
The survey data collected included information about the practice setting (inpatient, outpatient, or both), type of practice, and years of practice; telehealth platforms used if any; feature importance of telehealth platforms (e.g., audio/video, security/privacy); and reasons and concerns for telehealth usage. The survey included qualitative questions that were directed toward learning about specific features sought in a telehealth platform such as reasons for usage. A free-form question was also asked for providers to impart additional qualitative thoughts on telehealth usage.
To gauge reasons for telehealth use, the following options were given: (1) new patient volume growth (locally or regionally), (2) improvement in patient access, (3) improvement in quality outcomes, (4) time savings, (5) staffing/office savings, (6) consumer/patient interest, (7) innovation and new health care delivery, (8) academic and research purposes, and (9) other, with the option of an open answer.
To gauge concerns for telehealth use, the following responses were provided: (1) reimbursement, (2) compensation, (3) clinical time, (4) clinical quality, (5) practice/provider technology adoption, (6) practice/provider clinical support activities, (7) consumer/patient technology ownership, (8) consumer/patient interest, (9) platform or technology limitations, (10) reduction of educational benefit/inability to effectively teach learners, and (11) other, with the option of an open answer. Providers were asked to select their top three considerations and concerns.
A 5-point Likert scale was used to evaluate interest in telehealth by setting/type of care and interest during and after the easing of COVID-19 in-person restrictions (Table 1). Descriptive statistics and statistical analyses were performed directly on the survey platform. Provider comments were grouped into central themes for further qualitative analysis.
(Q2) Which of the following best describes your clinical practice? | ||||||||
Adult Primary Care | Adult Medicine | Adult Surgical Subspecialty | Pediatric Primary Care | Pediatric Medicine | Pediatric Surgical Subspecialty | |||
(Q5) How many years have you been in active practice (not including residency/fellowship/postgraduate training years)? | ||||||||
0–5 | 6–10 | 11–20 | More than 20 | |||||
(Q11) Please rate your interest in using telehealth in the following sites/types of care ((1) least interested, (2) slightly interested, (3) moderately interested, (4) very interested, and (5) extremely interested): | ||||||||
Emergency Department (patient in ED) | ||||||||
Inpatient (patient in hospital) | ||||||||
Outpatient (patient physically located at a remote clinical site) | ||||||||
Direct to patient (patient physically located at home or nonclinical setting) | ||||||||
e-Consultation (provider to provider interaction) | ||||||||
Research (patient contact for clinical protocols) | ||||||||
(Q12) Please choose the top three reasons why you would use telehealth in your practice | ||||||||
New patient volume growth (locally or regionally) | ||||||||
Improvement in patient access | ||||||||
Improvement in quality outcomes | ||||||||
Time savings | ||||||||
Staffing/office savings | ||||||||
Consumer/patient interest | ||||||||
Innovation and new health care delivery | ||||||||
Academic and research purposes | ||||||||
Other: please specify | ||||||||
(Q13) Please choose the top three areas of concern that impact your ability to implement telehealth in your practice | ||||||||
Reimbursement (payer restrictions) | ||||||||
Compensation (wRVU or payment) | ||||||||
Clinical time | ||||||||
Clinical quality | ||||||||
Practice/provider technology adoption | ||||||||
Practice/provider clinical support activities | ||||||||
Consumer/patient technology ownership (e.g., internet access or smartphone) | ||||||||
Consumer/patient interest | ||||||||
Platform or technology limitations | ||||||||
Reduction of educational benefit/inability to effectively teach learners | ||||||||
Other: please specify | ||||||||
(Q14) Please rate your interest in using telehealth visits to augment your practice in the following time periods ((1) least interested, (2) slightly interested, (3) moderately interested, (4) very interested, and (5) extremely interested): | ||||||||
During the COVID-19 pandemic, in-person restrictions (started March 2020) | ||||||||
After the COVID-19 pandemic, once public health emergency restrictions have been lifted |
Results
DEMOGRAPHICS
The survey received a total of 518 responses (19.7% response rate), divided into subspecialties as follows: 25.3% adult primary care, 32.6% adult medicine, 17.6% adult surgery, 12.4% pediatric medicine, 9.5% pediatric primary care, and 2.7% pediatric surgery; 54.8% of providers’ practices were predominantly outpatient based, 34% were both hospital and outpatient based, and 11.2% were predominantly inpatient based (Table 2).
ADULT PRIMARY CARE | ADULT MEDICINE | ADULT SURGICAL SUBSPECIALTY | PEDIATRIC PRIMARY CARE | PEDIATRIC MEDICINE | PEDIATRIC SURGICAL SUBSPECIALTY | |
---|---|---|---|---|---|---|
N | 131 | 169 | 91 | 49 | 64 | 14 |
Hospital based | 6 (4.58%) | 19 (11.24%) | 17 (18.68%) | 1 (2.04%) | 10 (15.63%) | 5 (35.71%) |
Outpatient practice | 117 (89.31%) | 65 (38.46%) | 24 (26.37%) | 47 (95.92%) | 30 (46.88%) | 1 (7.14%) |
Both hospital and outpatient practice | 8 (6.11%) | 85 (50.3%) | 50 (54.95%) | 1 (2.04%) | 24 (37.5%) | 8 (57.14%) |
Overall, 21.6% of providers had been practicing for 0–5 years, 16.4% for 6–10 years, 22.8% for 11–20 years, and 39.2% for greater than 20 years. Within this survey, the majority of pediatric surgical providers had between 6 and 10 years of experience. The remaining providers predominantly had more than 20 years of experience (Table 3).
ADULT PRIMARY CARE | ADULT MEDICINE | ADULT SURGICAL SUBSPECIALTY | PEDIATRIC PRIMARY CARE | PEDIATRIC MEDICINE | PEDIATRIC SURGICAL SUBSPECIALTY | |
---|---|---|---|---|---|---|
N | 131 | 169 | 91 | 49 | 64 | 14 |
0–5 Years | 20 (15.27%) | 44 (26.04%) | 21 (23.08%) | 8 (16.33%) | 15 (23.44%) | 4 (28.57%) |
6–10 Years | 14 (10.69%) | 30 (17.75%) | 16 (17.58%) | 5 (10.20%) | 13 (20.31%) | 7 (50.00%) |
11–20 Years | 34 (25.95%) | 31 (18.34%) | 25 (27.47%) | 10 (20.41%) | 17 (26.56%) | 1 (7.14%) |
More than 20 years | 63 (48.09%) | 64 (37.87%) | 29 (31.87%) | 26 (53.06%) | 19 (29.69%) | 2 (14.29%) |
REASONS AND CONCERNS FOR TELEHEALTH USE
Among health care providers, the top three reasons for telehealth use were ranked as follows: (1) improvement in patient access (mean 29.3%; range 28–31.6%), (2) consumer/patient interest (mean 23%; range 17.1–28.8%), and (3) innovation and new health care delivery (mean 12.3%; range 9.5–13.7%). The three considered the least important were (9) academic and research purposes (mean 2%; range 0–6.6%), (8) improvement in quality outcomes (mean 4.5%; range 2.9–5.8%, and (7) staffing/office savings (mean 4.6%; range 0–7.6%).
When separated by specialty, all provider groups ranked improving patient access as the most important reason. Consumer/patient interest was ranked as the second most important reason by all specialties except pediatric surgery providers, who instead chose new patient volume growth (mean 9.4%; range 3.8–20%). The third reason varied by subspecialty; innovation and new health care delivery, time savings (mean 9.4%; range 3.8–13.5%), new patient volume growth, and consumer/patient interest were the next most selected (Fig. 1).
Comparable benefits were echoed in the open-ended comments. Most frequently mentioned were increased health care access, patient retention, patient communication and reassurance, COVID-19 safety, and physician convenience, as well as utility in behavioral health assessments, follow-up visits for laboratory and imaging results, medication management, and self-monitoring chronic conditions.
When analyzing respondents’ concerns for telehealth utilization, results showed that the three main concerns were (1) platform or technology limitations (mean 16.1%, range 12.4–23.8%), (2) reimbursements (mean 15.2%; range 4.8–18.8%), and (3) consumer/patient technology ownership (mean 14.4%; range 10.7–16.9%). Contrarily, minor concerns were (10) practice/provider technology adoption (mean 2.7%; range 0.7–4.8%), (9) consumer/patient interest (mean 3.8%; range 0–5.6%), and (8) reduction of educational benefit (mean 3.9%; range 1.8–6.7%).
TECHNOLOGY, REIMBURSEMENT, AND DATA SAFETY
Payment restrictions, technology limitations, and consumer technology ownership were the highest ranked concerns for all adult providers. Additionally, among the pediatric providers, clinical quality (mean 13.7%; range 11.2–22.8%) was also a clear area of concern in using telehealth. From the 518 responses, 10.4% of providers chose to give an answer in free text form; central themes included difficulty performing appropriate physical examinations and current software incompatibility (Fig. 2).
Data and privacy concerns were directed toward both sides; comments included providers taking calls in a shared workroom or patients attending appointments in public locations (e.g., patient does not have internet at home).
INTEREST IN TELEHEALTH BY SITE
With respect to interest in using telehealth, data were divided into utility in the emergency room, inpatient units, outpatient sites (patient and provider at separate clinic sites), direct-to-patient care (patient at a nonclinical site such as their home), e-consultations (asynchronous provider to provider consultation), and research.
Overall, the majority of providers reported being extremely interested in the use of telehealth in the ambulatory setting when the patient is located at a remote clinic site (29%) and for when the patient is located at home or a nonclinical setting (45.9%). For inpatient care and the emergency department, the majority reported being not at all interested (42.9% and 57.9%, respectively) (Fig. 3).
INTEREST IN TELEHEALTH BEFORE AND AFTER COVID-19 RESTRICTIONS
Overall, 96% of the responses ranged from moderately interested to most interested in using telehealth during COVID-19 in-person restrictions; this percentage decreased to 82% when asked about interest after all in-person restrictions were lifted. This was true when the responses were evaluated by specialty as well. The largest differences were seen in pediatric primary care and pediatric surgical specialties (Fig. 4).
Discussion
The restrictions set in place due to COVID-19 rapidly shifted to the forefront of care delivery and allowed telehealth to emerge as a legitimate alternative to in-person management.
TOP CONSIDERATIONS
From the 518 provider responses, the most cited reason for using telehealth was improving patient access. This motivation was prevalent among all medical and surgical specialties. Before the pandemic, telehealth utilization was on the rise, largely to meet the demand for accessible care services.3,6–9,14 Increasing patient access allows providers to keep up with consumer preferences without sacrificing exceptional care, thereby promoting a consumer-centric care delivery model.
Clearly, this theme that telehealth is important for improving patient access appears to have been widely adopted across all providers regardless of specialty. We believe this article is among the first to identify this leading insight among a large academic provider group in the setting of the COVID-19 pandemic.
Improving patient access to health care and overall patient satisfaction are two of the most commonly reported benefits of telehealth.2,3 These themes were supported in the qualitative free-form answers. For example, many providers remarked on the ability of telehealth to increase access to care especially for those with difficulty due to “transportation, distance, out of state [location], busy schedule, inconvenience, fear,” “rural areas or remote locations,” “childcare [needs],” and “mobility issues.”
In this respect, digital care was noted to be “a paradigm shift allowing patient access and healing” through “voice and visual reassurance.” Patient satisfaction was also noted by providers in the form of increased follow-up, retention rates, and patient reassurance.
The consumer-centric care delivery model focuses on many things, including providing care with minimal disruption to a patient’s routine.3 In general, consumers do not wish to spend more time than necessary seeking appropriate care during times of sickness. Telehealth allows for providers to meet patients at an ideal time and in a comfortable situation and provide care in a way that yields value to consumers.
This survey found that another top reason that providers chose to continue telehealth usage was to improve patient satisfaction. In fact, this idea was prevalent among all specialties, indicating further sensitivity of a consumer-centric approach to care among providers. Similarly, nearly all providers, regardless of years in practice, supported telehealth as a means to increase patient access to care (Fig. 5).
With value-based care flourishing, responses from the survey indicate that all providers believe telehealth has a key role in patient centricity. Creating standardized practices to promote patient retention, satisfaction, and superior outcomes is a goal in value-based care models.2,15–17 This survey provides some evidence that many providers are ready and willing to redefine their strategies in patient care.
TOP CONCERNS
Technology limitations were noted to be one of the main barriers in achieving universal telehealth usage. It is of note that this was also a concern before the COVID-19 pandemic.1,4 For telehealth to serve as a viable alternative, provider offices and hospitals need to invest in appropriate technology infrastructure, including broadband internet, smart device registration, digital peripherals, appropriate data security, and device sanitization protocols.18 Our respondents noted that the current guidelines were substandard.
An important consideration with digital care is patient privacy. Respondents noted that there is a need for a real plan for how to protect patient privacy. This concern was commented on by respondents as having to perform visits from a shared workroom or patients participating in visits in a public setting. Additional privacy concerns included data monitoring and transmission by third-party telehealth vendors. This can become a possible security threat when integrating new technology.19
To mitigate this, it is important for health care organizations to use only platforms that comply with data privacy policies already in place, such as the Health Insurance Portability and Accountability Act (HIPAA), and offer additional network security protocols and safety features.
It is known that technology transition in health care can be difficult and cumbersome. However, current literature shows that once appropriate technology is implemented, numerous benefits follow, including decreased patient waiting times, decreased no-show rates, and improved quality outcomes.3,20
Yet, even if the technology hurdle can be overcome, providers may worry about the quality of care following the switch to digital interactions. For instance, a pulse survey in 2020 found that of the providers who decided not to utilize virtual services, almost half cited the possibility of reduced quality of care as their main concern.21 This sentiment was reproduced in our survey, where clinical quality was cited as a top concern among all pediatric providers.
In the same respect, the most reported criticism regarding telehealth use was a concern over diagnostic limitations and subsequent quality limitations. However, similar to other concerns, the ability to ensure clinical quality will come with more advanced technology and familiarization with its usage.5 As telehealth becomes a convention, implementation of clinical care standards will be helpful in not only establishing value but also tracking quality improvements in digital care delivery.22
Naturally, provider concerns about technology arise not only from the vendor end but also the consumer side. Implementation of universal telehealth services will be challenged by the digital divide. Socioeconomic disparities continue to make vulnerable populations difficult to reach; telehealth is not a panacea and does have limitations in this respect.23 Patients of low socioeconomic status, limited English and technology proficiency, rural habitations, and disabilities do not see the same benefits with telehealth.24,25
Limitations include lack of access to appropriate hardware and sustainable infrastructure to take advantage of digital care delivery. The need and preference for telehealth are increasing from both patient and provider perspectives; however, the difficulty in addressing these common barriers continues to be a concern for providers, as indicated in our survey. This demonstrates that advanced systems cannot stand alone and they need to be coupled with community-specific blueprints to reach those most vulnerable.23
Another concern cited by providers is the lack of reimbursements in place for providers and health care practices. These compensation restrictions have been in place even before pandemic-era usage of telehealth. Historically, Medicare coverage of telemedicine was limited to patients in rural areas. Temporary changes by the Centers for Medicare & Medicaid Services removed restrictions on location, payment parity, and eligible services; private insurers also adopted this model.10,26
These reimbursement changes have allowed health care systems to invest in virtual care models, thereby exceeding the expected number of video visits by factors of four to five in many regions.9,27 Although provider reimbursements for telehealth services have temporarily increased, it is uncertain if any of these modifications will be maintained by payers postpandemic. This continues to be a source of anxiety for providers.
For example, the State Medical Board of Ohio issued a recent update suggesting reinforcement of prior requirements that patients must be seen in person before telehealth is available to them.28 Many telehealth waivers are set to expire in other states as well.29 Provider concerns seem justified as a newer, value-based care model must be adapted to fit the virtual care demands of consumers.
DIGITAL HEALTH ADOPTION DURING COVID-19
At the beginning of the pandemic, telehealth became one of the only reasonable modalities in which patients could receive ambulatory medical attention, resulting in a surge of usage. Overall, consumer utilization of telehealth grew by nearly threefold in 2020, from 8% to 22%.1 The literature has also described continuous satisfaction levels and decreased no-show rates.2,15–17 Although patient interest was on the rise before the pandemic, COVID-19 served as a catalyst to prioritize this 21st-century health care approach as a top consumer demand.
It is notable that the reported favored settings of utilization coincide with not only provider opinion but also patient preference. Providers reported being most interested in using telehealth for direct-to-patient care and least interested in the emergency department and inpatient care. Telehealth in the direct-to-patient care setting taps into a consumer-centric market, and providers prefer an environment that augments the patient experience by making access to care more convenient and affordable. Specifically, many providers referenced the utility of digital care for behavioral health visits, follow-up visits for results, medication management, and self-monitoring of chronic conditions.
In prior surveys, patient preference similarly aligned with the outpatient setting for telehealth purposes.2,16,17 Patient convenience coupled with minimal reductions in the quality of their health care allows virtual platforms to flourish in the outpatient setting.2,30 Regardless of pandemic restrictions, telehealth offers clear benefits for the provider–patient relationship and promotes positive effects on continuity of care.4,17,31
On the other hand, the least preferred settings, inpatient care and emergency department care, are those in which the acute nature of the visit may potentially supersede patient savings. Although limited, current literature finds that patient preference toward telehealth in the emergency department and inpatient settings is not unanimous.32,33 Of those not satisfied with a virtual platform for acute care, physical examinations are listed as the primary limitation.32 Similarly, provider satisfaction with performing physical examinations through a telehealth platform is quite disparate.34,35
All provider groups reported interest in telehealth usage following the easing of COVID-19-era restrictions. Overall, adult providers seemed to sustain postpandemic interest more compared with pediatric providers (average interest scores of 3.64 vs. 3.32, respectively). This may suggest various levels of utility among patient populations. For example, telehealth may not be suited to accommodate the unique needs of pediatric populations. Suggested barriers include involvement of caregivers during pediatric testing and difficulty with confidentiality.36,37
With objective assessments, such as physical examinations, it may be difficult to have children cooperate in a virtual setting; this concern was echoed in the open-ended option of the survey, where many providers expressed hesitancy regarding the ability to provide appropriate physical examinations. Overall, this preference for telehealth in adult providers compared with pediatric providers speaks to limitations that may exist in different populations.
Considering the exponential growth of telehealth usage, the ramifications of these findings are important for providers, hospital systems, and patients alike. Among the qualitative suggestions given to improve telehealth, providers stressed the importance of continually optimizing telehealth platforms. Specifically mentioned were leveraging of technology to include previsit interaction (i.e., symptom or medication questionnaire), multidisciplinary group medical visits, browser compatibility, electronic medical record integration, screen sharing, and additional documentation capabilities.
LIMITATIONS
This Qualtrics survey was sent with the purposes of comparing feedback versus use in a research setting. As surveys are inherently subject to error and bias, it is possible that those who did not respond had varying perspectives. However, within our responses, there was considerable variation with regard to experience and specialty.
A second limitation is that the survey is based on questions about hypothetical interest after the COVID-19 pandemic as a follow-up survey was not available. However, considering the increase in frequency and confidence of telehealth technology, we believe the described interest level can translate to actual use extrapolated from the hypothetical results.
Understanding provider preferences in the past may help us understand future needs of different provider populations seeing patients in a multitude of care settings.
Conclusions
Health care systems have seen a dramatic surge in telehealth services since the beginning of the COVID-19 pandemic. Physician interest in telehealth within a large academic health system is based on a consumer-centric philosophy of patient care, including improved patient access to care, while common boundaries include technology and reimbursement uncertainties. These themes are consistent across specialties and sites of practice.
It is clear that despite concerns around quality and the need to manage patient privacy, providers are encouraged about the emerging virtual landscape. While a postpandemic future is hard to predict, today both provider and patient preferences appear to be aligned around the utility of telehealth.
Authors’ Contributions
D.B., C.I.C., B.Z., S.P., J.S., and B.D. were responsible for data analysis and manuscript writing. C.I.C. and B.D. were responsible for experimental design. All authors reviewed, edited, and approved the final version of the manuscript.
Disclosure Statement
The authors declare that there are no conflicts of interest.
Funding Information
The authors received no financial support for the research, authorship, and/or publication of this article.
REFERENCES
- 1.
Amwell. From virtual care to hybrid care: COVID-19 and the future of telehealth insights from the 2020 Amwell physician and consumer survey. 2020. Available at https://business.amwell.com/resources/from-virtual-care-to-hybrid-care-covid-19-and-the-future-of-healthcare (last accessedAugust 1, 2021 ). Google Scholar - 2. Patient and physician satisfaction with telehealth during the COVID-19 pandemic: Sports medicine perspective. Telemed J E Health 2021;27:1151–1159. Link, Google Scholar
- 3. Patient and clinician experiences with telehealth for patient follow-up care. Am J Manag Care 2019;25:40–44. Medline, Google Scholar
- 4.
Amwell. American Well’s 2019 consumer survey finds majority of consumers open to telehealth, adoption continues to grow. 2019. Available at https://business.amwell.com/press-release/american-wells-2019-consumer-survey-finds-majority-of-consumers-open-to-telehealth-adoption-continues-to-grow (last accessedAugust 1, 2021 ). Google Scholar - 5. Digital health: Unlocking value in a post-pandemic world. Popul Health Manag 2021;25:11–22. Link, Google Scholar .
- 6. Enhancing access to care in northern rural communities via telehealth. Int J Circumpolar Health 2019;78:1554174. Crossref, Medline, Google Scholar .
- 7. Improving patient access to specialized health care: The Telehealth Network of Minas Gerais, Brazil. Bull World Health Organ 2012;90:373–378. Crossref, Medline, Google Scholar
- 8. Cost-effectiveness of telehealth interventions for chronic heart failure patients: A literature review. Int J Technol Assess Health Care 2014;30:59–68. Crossref, Medline, Google Scholar
- 9. Leveraging telehealth to improve access to care: A qualitative evaluation of Veterans’ experience with the VA TeleSleep program. BMC Health Serv Res 2021;21:77. Crossref, Medline, Google Scholar
- 10.
U.S. Department of Health & Human Services . Notification of enforcement discretion for telehealth remote communications during the COVID-19 nationwide public health emergency. 2021. Available at https://www.hhs.gov/hipaa/for-professionals/special-topics/emergency-preparedness/notification-enforcement-discretion-telehealth/index.html (last accessedAugust 1, 2021 ). Google Scholar - 11. Web-based medical appointment systems: A systematic review. J Med Internet Res 2017;19:e134. Crossref, Medline, Google Scholar
- 12. Effect of an online appointment scheduling system on evaluation metrics of outpatient scheduling system: A before-after multicenter study. J Med Syst 2019;43:281. Crossref, Medline, Google Scholar
- 13.
Qualtrics . Computer software. Version May 2020. Provo, UT: Qualtrics, 2005. Google Scholar - 14. Family physicians report considerable interest in, but limited use of, telehealth services. J Am Board Fam Med 2017;30:320–330. Crossref, Medline, Google Scholar
- 15. Patient satisfaction with partial hospital telehealth treatment during the COVID-19 pandemic: Comparison to in-person treatment. Psychiatry Res 2021;301:113966. Crossref, Medline, Google Scholar .
- 16. Patient satisfaction for telehealth physical therapy services was comparable to that of in-person services during the COVID-19 pandemic. HSS J 2020;16:10–16. Crossref, Medline, Google Scholar
- 17. Reduced no-show rates and sustained patient satisfaction of telehealth during the COVID-19 pandemic. Telemed J E Health 2021;27:1409–1415. Link, Google Scholar .
- 18. Telehealth transformation: COVID-19 and the rise of virtual care. J Am Med Inform Assoc 2020;27:957–962. Crossref, Medline, Google Scholar
- 19. For telehealth to succeed, privacy and security risks must be identified and addressed. Health Aff (Millwood) 2014;33:216–221. Crossref, Medline, Google Scholar .
- 20. Advanced telehealth technology improves home-based exercise therapy for people with stable chronic obstructive pulmonary disease: A systematic review. J Physiother 2021;67:27–40. Crossref, Medline, Google Scholar
- 21.
Decision Resources Group. Taking the Pulse® 2020 physician survey shows 4 in 5 U.S. physicians have conducted virtual patient consults amid the COVID-19 pandemic. 2020. Available at https://decisionresourcesgroup.com/news/taking-the-pulse-2020-physician-survey (last accessedAugust 1, 2021 ). Google Scholar - 22. Ensuring clinical quality in telemedicine. NEJM Catalyst 2018. Available at https://catalyst.nejm.org/clinical-quality-telemedicine-online-care/ (last accessed
August 2, 2021 ). Google Scholar - 23. Equity in the age of health care information technology and innovation: Addressing the digital divide. Med Care 2019;57(Suppl 6 Suppl 2):S106–S107. Crossref, Medline, Google Scholar .
- 24. Telehealth, Rural America, and the digital divide. J Ambul Care Manage 2020;43:319–322. Crossref, Medline, Google Scholar .
- 25. The limitations of poor broadband internet access for telemedicine use in Rural America: An observational study. Ann Intern Med 2019;171:382–384. Crossref, Medline, Google Scholar .
- 26. Telehealth beyond COVID-19. Psychiatric Serv 2020;72:100–103. Crossref, Medline, Google Scholar
- 27. COVID-19 and its global impact on primary care virtual consultations. HIT Consultant. 2020. Available at https://hitconsultant.net/2020/05/14/covid-19-global-impact-primary-care-virtual-consultations (last accessed
August 1, 2021 ). Google Scholar - 28.
State Medical Board of Ohio . Telemedicine update. 2021. Available at https://med.ohio.gov/Publications/Recent-News/telemedicine-in-ohio (last accessedAugust 1, 2021 ). Google Scholar - 29.
Federation of State Medical Boards . State and territory COVID telehealth waivers. 2021. Available at https://www.fsmb.org/siteassets/advocacy/pdf/state-by-state-emergency-telehealth-information.pdf (last accessedAugust 1, 2021 ). Google Scholar - 30. Can telemedicine replace the first post op visit for knee arthroscopy in adolescents? Pediatrics 2018;141(1 MeetingAbstract):663. Google Scholar
- 31. What was the change in telehealth usage and proportion of no-show visits for an orthopaedic trauma clinic during the COVID-19 pandemic? Clin Orthop Relat Res 2020;478:2257–2263. Crossref, Medline, Google Scholar
- 32. Telemedicine in burn patients: Reliability and patient preference. Burns 2021;47:1873–1877. Crossref, Medline, Google Scholar .
- 33. Telemedicine evaluations for low-acuity patients presenting to the emergency department: Implications for safety and patient satisfaction. Telemed J E Health 2020;26:1010–1015. Link, Google Scholar
- 34. Telemedicine physical examination utilizing a consumer device demonstrates poor concordance with in-person physical examination in emergency department patients with sore throat: A prospective blinded study. Telemed J E Health 2018;24:790–796. Link, Google Scholar
- 35. Perceptions and perceived utility of rural emergency department telemedicine services: A needs assessment. Telemed J E Health 2020;26:855–864. Link, Google Scholar .
- 36. Transitioning to telehealth neuropsychology service: Considerations across adult and pediatric care settings. Clin Neuropsychol 2020;34:1335–1351. Crossref, Medline, Google Scholar
- 37. Rapid development of telehealth capabilities within pediatric patient portal infrastructure for COVID-19 care: Barriers, solutions, results. J Am Med Inform Assoc 2020;27:1116–1120. Crossref, Medline, Google Scholar