Telemedicine for Contraceptive Counseling During the COVID-19 Pandemic: Referral Patterns and Attendance at Follow-Up Visits
Introduction
The term telemedicine, “healing at a distance,” was first coined in the 1970s. The World Health Organization defines it as “the delivery of health care services, where distance is a critical factor, by all health care professionals using information and communication technologies.”1 The American College of Obstetricians & Gynecologists (ACOG) specifies that “telemedicine” refers to “traditional clinical diagnosis and monitoring that is delivered by technology,” whereas “telehealth” refers to the “technology-enhanced healthcare framework” that includes several modalities, such as live, two-way synchronous audio and video, store and forward, remote patient monitoring, and m-Health.2
Within the field of obstetrics and gynecology, telemedicine has been established as a safe way to provide medication abortion, with comparable outcomes to in-person care.3,4 This technology can also increase access in locations where abortion care would otherwise be limited.5–7 Remote visits have also been used to enhance prenatal care.4,8 Some studies have also examined the use of other telehealth modalities such as text messages to improve uptake, adherence, and continuation of contraceptives.9
A few studies have described using virtual video or phone visits (live, two-way synchronous telemedicine) to provide contraceptive counseling. One study did describe the provision of contraceptive counseling either via phone or via in-person at the time of abortion. Its authors found that women who had previously had difficulty accessing contraception and women of color preferred counseling via phone, and that those counseled via phone were more likely to choose more effective contraceptive methods.10 Other efforts to use telehealth modalities to provide contraception have focused on low-resource settings.
These have included digital counseling platforms as a means to provide high-quality services where access to providers is limited,11 and interactive voice-response-based digital tools as an alternative to live provider-based counseling.12 Two studies described telecontraception, or the provision of contraception prescriptions through a website or smartphone application, as a safe alternative to clinic visits, with high rates of adherence to the Centers for Disease Control and Prevention’s Medical Eligibility Criteria for contraceptive use.13,14 However, long-acting reversible contraception (LARC) options are not typically included and may sometimes not be mentioned as alternatives.14
Before the COVID-19 pandemic, telemedicine and other digital health platforms were considered promising solutions yielding high patient satisfaction rates and equivalent clinical outcomes.4,15,16 A February 2020 Committee Opinion by ACOG not only described telemedicine as a way to enhance reproductive health care, but it also highlighted some of the remaining barriers (legal and logistical) to its widespread implementation.2
With the COVID-19 pandemic, many health care providers in the United States and around the world expanded telemedicine services.17,18 During this time, family planning providers across the United States rapidly increased the use of telemedicine for abortion and contraception care.19 However, the extent to which telemedicine can meet the needs of patients who are seeking contraceptive counseling is unclear.
Considering the rapid expansion of telemedicine for contraceptive counseling, this study’s objective is to describe the referral patterns and attendance at follow-up visits for patients who received contraceptive counseling via telemedicine during the early phase of the COVID-19 pandemic in New York City.
Methods
We conducted a mixed-methods study to describe the experiences of patients who had telemedicine visits for contraceptive counseling. The study is described in detail elsewhere20 but in brief, it included patient surveys, in-depth interviews, and prospective follow-up by using both chart reviews and 6-month follow-up surveys. Here, we present the results of the prospective chart review and 6-month follow-up surveys. We follow the guidelines set forth by the STROBE (Strengthening the Reporting of observational Studies in Epidemiology) statement for the reporting of cohort studies.21
STUDY PARTICIPANTS AND SETTING
In our practice, the Family Planning Division of a large academic medical center located in New York City, we started offering telemedicine visits during the early phase of the COVID-19 pandemic (April 2020). Our hospital is in the city’s poorest borough (Bronx), which was the most heavily affected by the pandemic.22 At our center, in-person clinical services remained available, including LARC insertions, removals, and abortion care. However, during this period, all patients had a telehealth visit first to ensure that an in-person visit was necessary and to maximize the efficiency of in-person visits.
For this study, we screened all patients who had a phone or video visit through our Division between April 1 and June 30, 2020. We identified the visits through the clinic’s electronic medical record schedule and reviewed all visit notes to determine whether the visits met inclusion criteria for the study. We included patients 18 years or older, who spoke English or Spanish, and who had visits primarily focused on contraceptive counseling or other issues related to contraception (such as problems with their current method or desire to change or discontinue methods).
We did not conduct an a priori sample size calculation because at the time when we initiated the study, we could not predict the course of the pandemic and therefore the length of time during which we would be conducting telemedicine visits as described here. Starting in July of 2020, COVID-19 case numbers decreased enough that our clinic policy changed, and patients self-triaged between telemedicine and in-person visits. Given the change in circumstances, we ended the study, which aimed at capturing patient experiences during a particular time where telemedicine visits were a required initial step for all patients.
STUDY DESIGN AND DATA COLLECTION
For this portion of the study, we prospectively followed patients for 6 months from the index telemedicine visit. At 6 months, we conducted chart reviews of all patients. At that time, we also contacted patients via phone, e-mail, or text message and invited them to participate in a follow-up survey. Before completing the survey, patients read or listened to an informed consent document and provided informed consent. We offered a $10 Amazon gift card incentive for responding to the 6-month survey.
We designed the survey questions to explore patients’ current contraceptive use and to ask about patients’ future projected use of telemedicine for contraceptive counseling. We also asked patients how the COVID-19 pandemic impacted their lives.
During the chart reviews, we collected information on several outcomes. First, we determined whether patients were referred for an in-person visit. For those who were, we collected referral reason and examined whether they attended an in-person visit within 30 days of the referral. At the 6-month mark, we examined whether patients had any additional in-person, video, or phone visits related to contraception.
DATA ANALYSIS
Using Stata SE (version 16), we conducted descriptive statistical analyses. We also compared the characteristics of 6-month survey respondents and non-respondents by using the Chi-Square or Fisher’s Exact tests for categorical variables and the Mann-Whitney test for continuous nonparametric variables. To examine the predictors of attendance at an in-person visit within 30 days of referral, we aimed to estimate a relative risk (RR) given that the outcome (attendance) was common.
To do so, we used a “modified Poisson” approach with robust error variances.23 We built a multivariable regression model by using a stepwise, backward selection approach. We first included all covariates with p < 0.25 on bivariate analyses and then sequentially removed covariates with the highest p-value until all variables were significant. For the regression, we dichotomized referral reason to compare LARC removal with all other referral reasons, because attendance rates for patients referred for LARC insertion and for other reasons were identical. For all analyses, we set the level of significance at 5%. We list any variable with missing data in the tables.
ETHICS APPROVAL
The Institutional Review Board of the Albert Einstein College of Medicine approved this study, which did not receive any external funding but did receive internal funding from the Montefiore Family Planning Division.
Results
Our division conducted a total of 439 telemedicine visits between April 1 and June 30, 2020. Of these, 169 (38.5%) met inclusion criteria for this study. Figure 1 shows exclusion reasons, referral rates, attendance rates at in-person visits, and attendance at any additional contraceptive visits during the follow-up period. A total of 109 (64.5%) patients were referred for in-person visits at the time of the telemedicine visit. Most patients (76.1%) who were referred attended an in-person visit within 30 days. Of those who were not initially referred, 30.0% had additional in-person and/or telemedicine visits in the 6-month follow-up period.
Table 1 shows the demographic and visit characteristics of patients included in the study. Of note, most patients were either Black or Hispanic, and more than half (60.4%) were publicly insured. Most telemedicine visits (93.5%) were conducted via phone.
N (%) | |
---|---|
Demographics | |
Age | |
18–25 | 44 (26.0) |
26–35 | 81 (47.9) |
36–45 | 35 (20.7) |
46 or older | 9 (5.3) |
Race | |
Black | 55 (32.5) |
White | 15 (8.9) |
Other | 83 (49.1) |
Asian | 3 (1.8) |
Missing | 13 (7.7) |
Ethnicity | |
Not Hispanic | 69 (40.8) |
Hispanic | 88 (52.1) |
Missing | 12 (7.1) |
Insurance | |
Public | 102 (60.4) |
Private | 66 (39.1) |
Self-pay | 1 (0.6) |
Parity | |
0 | 55 (32.5) |
1 or 2 | 76 (45.0) |
3 or more | 37 (21.9) |
Missing | 1 (0.6) |
Visit characteristics | |
Visit type | |
Telephone | 158 (93.5) |
Video | 11 (6.5) |
Visit duration (median, IQR) | 15 (9.0) |
Visit language | |
English | 154 (91.1) |
Spanish (no interpreter) | 10 (5.9) |
Spanish (interpreter) | 5 (3.0) |
Referred for in-person visit | |
Yes | 109 (65.5) |
No | 60 (35.5) |
Referral reason | |
N/A—not referred | 60 (35.5) |
LARC insertion | 42 (24.9) |
LARC removal | 52 (30.8) |
Other | 15 (8.9) |
Table 2 shows the characteristics of the patients who were referred for in-person visits, and who did or did not attend such visits within 30 days of referral. On univariate analyses, the only significant variable associated with attendance was age (p = 0.041). There was a trend toward referral reason being associated with attendance, but this did not meet statistical significance (p = 0.052).
ATTENDED VISIT (N = 83) | DID NOT ATTEND VISIT (N = 26) | pa | |
---|---|---|---|
n (%) | n (%) | ||
Demographic characteristics | |||
Age | 0.041 | ||
18–25 | 16 (57.1) | 12 (42.9) | |
26–35 | 48 (84.2) | 9 (15.8) | |
36–45 | 17 (77.3) | 5 (22.7) | |
46 or older | 2 (100.0) | 0 (0.0) | |
Race | 0.275 | ||
Black | 29 (85.3) | 5 (14.7) | |
White | 5 (62.5) | 3 (37.5) | |
Other | 39 (69.6) | 17 (30.4) | |
Asian | 2 (100.0) | 0 (0.0) | |
Missing | 8 (88.9) | 1 (11.1) | |
Ethnicity | 0.627 | ||
Not Hispanic | 31 (79.5) | 8 (20.5) | |
Hispanic | 46 (73.0) | 17 (27.0) | |
Missing | 6 (85.7) | 1 (14.3) | |
Insurance | 0.85 | ||
Public | 56 (75.7) | 18 (24.3) | |
Private | 26 (76.5) | 8 (23.5) | |
Self-pay | 1 (100.0) | 0 (0.0) | |
Parity | 0.881 | ||
0 | 22 (73.3) | 8 (26.7) | |
1 or 2 | 42 (76.4) | 13 (23.6) | |
3 or more | 19 (79.2) | 5 (20.8) | |
Visit characteristics | |||
Visit type | 0.13 | ||
Telephone | 78 (78.0) | 22 (22.0) | |
Video | 5 (55.6) | 4 (44.4) | |
Visit duration, median (IQR), minutes | 15 (9.0) | 15 (10.0) | 0.712 |
Visit language | 0.303 | ||
English | 71 (74.0) | 25 (26.0) | 0.303 |
Spanish (no interpreter) | 7 (87.5) | 1 (12.5) | |
Spanish (interpreter) | 5 (100.0) | 0 (0.0) | |
Referral reason | 0.052 | ||
LARC insertion | 28 (66.7) | 14 (33.3) | |
LARC removal | 45 (86.5) | 7 (13.5) | |
Other | 10 (66.7) | 5 (33.3) |
Table 3 shows the results of a multivariable modified Poisson regression model with robust error variances. The covariates that were included in the final model were referral reason and age, as these were the only ones that reached statistical significance as per the backward selection strategy described earlier. The RR of attendance at an in-person visit within 30 days was 24% higher among patients referred for LARC removal compared with those referred for other reasons (RR 1.24, 95% confidence interval [CI] 1.08–1.69, p = 0.048). It was 29% lower among younger patients (age 18–25) compared with those in the reference category (age 26–35, RR 0.71, 95% CI 0.51–0.98, p = 0.035).
RRa | p | 95% CI | |
---|---|---|---|
Referral reason | |||
Other | Ref. | Ref. | Ref. |
LARC removal | 1.24 | 0.048 | 1.08–1.69 |
Age | |||
18–25 | 0.71 | 0.035 | 0.51–0.98 |
26–35 | Ref. | Ref. | Ref. |
36–45 | 0.94 | 0.682 | 0.72–1.24 |
46 or older | 1.08 | 0.190 | 0.96–1.22 |
A total of 63 patients responded to the 6-month follow-up survey (37.3% response rate). There were no significant differences in terms of demographic or visit characteristics among patients who did and did not respond to the 6-month follow-up survey (Supplementary Table S1). As shown in Table 4, most (69.4%) survey respondents were still using the contraceptive method they had decided on at the telemedicine visit.
n (%) | |
---|---|
Still using method decided on at telemedicine visit? | |
Yes | 44 (69.4) |
No | 15 (23.8) |
Don’t know or not applicable | 4 (6.3) |
Current contraceptive use | |
IUD | 24 (38.1) |
Implant | 9 (14.3) |
Pill, patch, ring | 9 (14.3) |
DMPA | 2 (3.2) |
Tubal ligation | 1 (1.6) |
Other | 3 (4.8) |
No method | 13 (20.6) |
N/A—currently pregnant | 3 (4.8) |
COVID-19 experiences | |
Friends or family sick with COVID-19 | 22 (34.9) |
Lost job | 14 (22.2) |
Household member lost job | 14 (22.2) |
Friends or family died | 10 (15.9) |
Respondent sick with COVID-19 | 4 (6.4) |
None of the above | 23 (36.5) |
Preference for next contraception visit | |
In-person | 35 (55.6) |
Phone | 18 (28.6) |
Video | 10 (15.9) |
Many respondents were affected by the COVID-19 pandemic; notably, 22.2% lost their job, and 15.9% experienced the death of a friend or family member. When asked about their preferred visit type for their next contraception visit, about half (55.6%) opted for an in-person visit, whereas the rest opted for a phone (28.6%) or video visit (15.9%).
Discussion
In this study, we describe the referral patterns and outcomes of patients who sought contraceptive care during the COVID-19 pandemic and who were required to have telemedicine visits, with in-person referrals as needed. We found that more than a third of patients were not initially referred for in-person visits. Over the 6-month follow-up period, approximately one quarter of patients in the entire telemedicine cohort did not have any additional visits related to contraception.
At 6 months, almost 70% of patients were still using the method they decided on at the visit, and almost half said they would choose video or phone for their next contraception visit. Although the need for further contraception visits is an imperfect measure of whether telemedicine meets patients’ needs, these results suggest that telemedicine could be sufficient for many of those who are seeking comprehensive contraceptive care.
These findings are new to the literature, because studies that follow patients up after telemedicine visits are rare, and to our knowledge this has not been examined in the context of contraceptive counseling. We do know that the acceptability of telemedicine tends to be high for both patients and providers across various fields of medicine. In another analysis from this research project, for example, we found that patients are highly satisfied with telemedicine visits for contraceptive counseling, and that 63% said the initial telemedicine visit completely met their needs.20
The findings of this analysis confirm that many patients are well served by telemedicine for contraceptive counseling. This is in line with other work on telemedicine in various areas of medicine, including medication abortion, which has demonstrated high patient and provider satisfaction rates.24–27
In the realm of contraception, one study conducted in the United Kingdom found that patients who received contraceptive counseling via phone before an abortion visit were more likely to choose a highly effective contraceptive method than those who received counseling at the abortion visit,10 which raises the possibility that telemedicine could serve as a helpful adjunct to in-person visits for contraceptive counseling. However, that study does not assess the extent to which telemedicine alone can meet patients’ needs, as all patients were also scheduled for in-person visits.
Interestingly, most of the telemedicine visits our study were phone rather than video visits. This is in part because our hospital did not have an existing video platform when services first started during the pandemic. However, once the video platform was implemented, many patients chose phone over video visits, as discussed in our previous work.20 As this preference for phone visits may have billing implications, it is worth examining further whether it is specific to our patient population, and how it may impact, if at all, the ability to meet patients’ needs remotely. Of note, our population comprises mostly women of color who reside in a poor borough, and our findings may be particularly relevant to other underserved populations.
One concern about telemedicine in the context of contraceptive care is whether these visits could be considered an extra step or barrier to accessing contraceptives, especially LARC. By analyzing attendance at in-person visits, we sought to examine whether patients who needed to be seen in-person would present for those visits, or whether they might get lost to follow-up after the telemedicine visit. It was encouraging to see that most patients did show within 30 days of referral, and that several others came between 30 days and 6 months.
That patients who sought LARC removals were more likely to attend suggests some patients may be particularly motivated to seek services, perhaps in the setting of contraceptive side effects or if they are seeking pregnancy. That younger patients were less likely to attend may raise concerns about the suitability of telemedicine for adolescent populations. However, adolescents likely have lower show rates regardless of visit type; at least one prior study examined no-shows to primary care appointments, for example, and found that patients who no-showed were younger than others.28
This study has several limitations. First, its generalizability is limited by the particular pandemic circumstances in which it was conducted, and by the fact that most visits were phone rather than video visits. Also, there is no comparison group, so we cannot make any conclusions about how telemedicine visits compare with in-person visits for contraceptive counseling in terms of any of the outcomes we examined. However, given the context in which the study was carried out, it was not possible to have a control group.
Another limitation is that the outcomes we selected (such as additional clinical visits, show rates at in-person visits, and self-reported method continuation) were arbitrary, based on our theory of what it means for telemedicine to “meet patients’ needs” in this realm.
As far as we know, there are no standardized outcomes for this kind of research question. Further, we could not accurately measure unintended pregnancies, as not all patients were seeking contraception (some were seeking contraceptive discontinuation before pregnancy). This would have been a useful measure to determine whether unintended pregnancy rates are higher in those who receive counseling via telemedicine.
Finally, we did rely on a patient survey with a low response rate for some of our outcomes, which raises concerns about response bias. However, it is encouraging that respondents and non-respondents did not differ significantly in terms of demographic or visit characteristics.
This study also has strengths, including its prospective design, and its use of multiple modalities to collect patient outcomes, including chart reviews and survey responses. It also examines an underserved, mostly minority population that was heavily affected by COVID-19, as evidenced by the high proportion of patients who reported job loss, death of a friend or family member, and other tragic consequences of the pandemic. That this population had positive outcomes with telemedicine for contraceptive counseling is promising for the ability of this technology to address some of the health disparities that plague our health care system.
In conclusion, this study offers encouraging results that support the expansion of telemedicine for contraceptive counseling. It is essential that the ongoing use of this technology post-pandemic be examined, in a world where patients can self-triage between in-person and telemedicine visits.
Authors’ Contributions
The authors confirm that all authors of this article meet authorship criteria according to the International Committee of Medical Journal Editors in Roles and Responsibilities. B.M.S., E.E.L., and N.C.B. designed the study. B.M.S., A.S., and K.A. collected the data. All authors contributed to the article and approved the final version submitted.
Acknowledgments
The authors are grateful to the patients who were willing to share their experiences with them, as well as to the family planning providers who rapidly adapted to providing a new service in challenging times.
Disclosure Statement
None of the authors have any conflicts of interest to disclose.
Funding Information
The study did not receive external funding but did receive internal funding from the Division of Family Planning in the Department of Obstetrics, Gynecology and Women’s Health at Montefiore Medical Center.
Supplementary Material
References
- 1.
World Health Organization (WHO) . Telemedicine: Opportunities and developments in member states. 2010. Available at https://www.who.int/goe/publications/goe_telemedicine_2010.pdf (last accessedOctober 1, 2020 ). Google Scholar - 2.
Implementing telehealth in practice : ACOG Committee Opinion, number 798. Obstet Gynecol 2020;135:493–494. Google Scholar - 3. Telemedicine for medical abortion: A systematic review. BJOG 2019;126:1094–1102. Crossref, Medline, Google Scholar .
- 4. Telehealth interventions to improve obstetric and gynecologic health outcomes: A systematic review. Obstet Gynecol 2020;135:371–382. Crossref, Medline, Google Scholar
- 5. Spatial dimensions of telemedicine and abortion access: A qualitative study of women’s experiences. Reprod Health 2019;16:94. Crossref, Medline, Google Scholar .
- 6. Increasing access to abortion with telemedicine. JAMA Intern Med 2016;176:585–586. Crossref, Medline, Google Scholar .
- 7. Changes in service delivery patterns after introduction of telemedicine provision of medical abortion in Iowa. Am J Public Health 2013;103:73–78. Crossref, Medline, Google Scholar .
- 8. Randomized comparison of a reduced-visit prenatal care model enhanced with remote monitoring. Am J Obstet Gynecol 2019;221:638.e1–e638.e8. Crossref, Medline, Google Scholar
- 9. Telemedicine for family planning: A scoping review. Obstet Gynecol Clin North Am 2020;47:287–316. Crossref, Medline, Google Scholar .
- 10. Telephone or integrated contraception counselling before abortion: Impact on method choice and receipt. BMJ Sex Reprod Health 2018;44:114–121. Crossref, Medline, Google Scholar .
- 11. Evaluating the impact of Marie Stopes International’s digital family planning counselling application on the uptake of long-acting and permanent methods of contraception in Vietnam and Ethiopia: A study protocol for a multi-country cluster randomised controlled trial. Trials 2018;19:556. Medline, Google Scholar .
- 12. Efficacy of a digital health tool on contraceptive ideation and use in Nigeria: Results of a cluster-randomized control trial. Glob Health Sci Pract 2019;7:273–288. Crossref, Medline, Google Scholar .
- 13. A study of telecontraception. N Engl J Med 2019;381:1287–1288. Crossref, Medline, Google Scholar .
- 14. Breaking down barriers to birth control access: An assessment of online platforms prescribing birth control in the USA. J Telemed Telecare 2020;26:322–331. Crossref, Medline, Google Scholar .
- 15. Virtual visits: Managing prenatal care with modern technology. MCN Am J Matern Child Nurs 2016;41:24–30. Crossref, Medline, Google Scholar .
- 16. Patient satisfaction with virtual obstetric care. Matern Child Health J 2017;21:1544–1551. Crossref, Medline, Google Scholar .
- 17. COVID-19 transforms health care through telemedicine: Evidence from the field. J Am Med Inform Assoc 2020;27:1132–1135. Crossref, Medline, Google Scholar .
- 18. Telehealth transformation: COVID-19 and the rise of virtual care. J Am Med Inform Assoc 2020;27:957–962. Crossref, Medline, Google Scholar
- 19. Telemedicine for contraceptive counseling: Experience of US family planning providers during the COVID-19 pandemic. Contraception 2021;103:157–162. Crossref, Medline, Google Scholar .
- 20. Telemedicine for contraceptive counseling: Patient experiences during the early phase of the COVID-19 pandemic in New York City. Contraception 2021;104:254–261. Crossref, Medline, Google Scholar
- 21. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: Guidelines for reporting observational studies. Lancet 2007;370:1453–1457. Crossref, Medline, Google Scholar .
- 22. It’s the death towers: How the Bronx became New York’s virus hot spot. The New York Times, May 26, 2020. Google Scholar
- 23. A modified Poisson regression approach to prospective studies with binary data. Am J Epidemiol 2004;159:702–706. Crossref, Medline, Google Scholar
- 24. Women’s and providers’ experiences with medical abortion provided through telemedicine: A qualitative study. Womens Health Issues 2013;23:e117–e122. Crossref, Medline, Google Scholar .
- 25. Telemedicine provision of medical abortion in Alaska: Through the provider’s lens. J Telemed Telecare 2017;23:680–685. Crossref, Medline, Google Scholar .
- 26. Patient and clinician experiences with telehealth for patient follow-up care. Am J Manag Care 2019;25:40–44. Medline, Google Scholar .
- 27. Presurgical assessment using telemedicine technology: Impact on efficiency, effectiveness, and patient experience of care. Telemed J E Health 2019;25:137–142. Link, Google Scholar
- 28. No-show to primary care appointments: Why patients do not come. J Prim Care Community Health 2013;4:251–255. Crossref, Medline, Google Scholar .