Acceptance of Telehealth Therapy to Replace In-Person Therapy for Autism Treatment During COVID-19 Pandemic: An Assessment of Patient Variables
Introduction
Access to intervention for children with autism spectrum disorder (ASD) has been gravely affected with the COVID-19 pandemic due to the limited availability of in-person services.1 This loss of services is of concern for young children enrolled in evidence-based intensive interventions that lead to optimal outcomes for children with ASD.2,3 Historically, ethnically and linguistically diverse families of children with autism have experienced even greater difficulty in accessing intervention services.4 For example, families with limited English language skills,5 lower socioeconomic status,6 and a race/ethnicity other than white/Caucasian6,7 have experienced decreased and delayed access to interventions. The COVID-19 pandemic has only magnified this disparity in access to ASD interventions and intensified the need for a solution.
The mandated lockdowns during the COVID-19 pandemic resulted in many health care interventions to transition to telehealth.8 The Health Resources and Services Administration of the U.S. Department of Health and Human Services defines telehealth as the use of electronic information and telecommunications technologies to support and promote long-distance clinical health care, patient and professional health-related education, as well as public health and health administration. One particular health care service that transitioned to telehealth during the pandemic was applied behavior analysis (ABA) interventions for autism.
ABA is an evidence-based intervention that is commonly prescribed to children with ASD.9 However, there are some known barriers in the delivery of telehealth, including health literacy10 and health information.11 Specific to autism and ABA, there are practical barriers that make it difficult to utilize telehealth to teach certain skills without caretaker facilitation.12 In spite of these barriers, telehealth delivery of ABA services has provided promising outcomes and resulted in increased access to interventions for many individuals.13,14
Telehealth ASD studies have generally evaluated the feasibility and outcomes of remote assessments and trainings for caretakers. For example, telehealth language assessments for school-aged children and for ASD diagnostics have been implemented successfully.15–18 A large portion of telehealth ABA interventions for autism have focused on remotely training parents to implement interventions for behavior excess,19–22 to address language and communication deficits,23,24 and for social imitation skills.25 A challenge with the telehealth delivery and parent training is the inability to use various prompting procedures (e.g., gestures and model prompts) and the over reliance on verbal instructions.12 Far fewer studies have examined the effectiveness of telehealth ABA interventions that involved a therapist and child interaction without caretaker facilitation until recently.
Historically, ABA interventions have been delivered in-person by a behavior interventionist in the participant’s home or in a clinic setting. Since the pandemic, a growing number of studies have demonstrated telehealth efficacy for participants with autism.14,26 One study assessed a small cohort of 17 children with autism that moved from in-person intervention to telehealth. Their learning trajectory was similar after the transition to telehealth.27 Some studies have evaluated telehealth to increase access to interventions in rural areas and to low-resource communities, particularly to provide specialty care that may not be available in the geographical region.28–31
On the onset of social distancing and the requirement of telehealth to replace face-to-face intervention, parents of children with ASD at a large California service provider were asked to accept or decline telehealth service delivery to replace their in-person ABA services. The intent of the telehealth delivery of ABA services was to provide some continuity of care during the COVID-19 pandemic. A large portion of the participants declined telehealth ABA intervention at the onset of the treatment transitioning from in-person to telehealth. The purpose of the present study was to assess the variables that may have been associated with participants who accepted versus those who declined telehealth ABA interventions during the COVID-19 pandemic.
Methods
Participants
A total of 200 children diagnosed with autism who had been receiving some level of direct intervention of ABA services before the COVID-19 pandemic participated in the study. Institutional Review Board approval was obtained for all subjects in this study. We obtained a cumulative list of 1,547 participants who were currently receiving ABA services at a large social service organization. We then filtered the list to include those who had begun to receive direct services before March 15, 2020.
This reduced the list of participants to 1,174. From the remaining list of participants, a random sample of 200 participants (100 for accepted telehealth, 100 for declined telehealth) were selected who met the following inclusion criteria: (1) responded to the survey indicating they accepted or declined telehealth services, (2) were receiving direct interventions, and (3) had either the Verbal Behavior Milestones Assessment and Placement Program (VB-MAPP) or Vineland Adaptive Behavior Scales (VABS) assessment conducted within 1 year of the treatment authorization period at the start of the study.
The cumulative data set for this population was incomplete for some participants. Through the random selection process, 743 subjects were excluded from the analysis for having incompatible data for the purposes of the study. For example, some participants did not have assessments completed within the previous year or some used an alternative assessment that did not allow for subject-to-subject comparison. This lack of symmetry in assessments limited the participant pool for this study. However, the data set was still large enough to access a random sample of 100 for both accepted and rejected (Fig. 1).
Setting and Material
All participants received some level of ABA intervention from therapists in their homes before COVID-19. The research assistants obtained archival clinical and demographic records using the commercial databases myEvolv®, NPAworks software by CodeMetro Inc., as well as the organization’s participant’s data records. The data from the different databases were organized on an Excel sheet, and the IBM SPSS (v.24) statistical software was used to conduct the appropriate statistical analyses.
Design
A non-experimental retrospective design was used to compare archival records for two groups: those who accepted telehealth ABA interventions (labeled Accepted Telehealth group hereafter) and those who declined telehealth ABA interventions (labeled Declined Telehealth group hereafter).
Measurement
A minimum of two research assistants examined the listed participant’s clinical data files to obtain the information of each participant’s demographics and the dependent variables of interest. The data were entered into an Excel database. A second observer recorded data for 20% of the participants scored by the original researcher to ensure the reliability of the data entry. Point-by-point agreement was calculated by dividing the total number of data entry points that the two recorders scored the same by the total number of data points that they scored the same and scored differently. The results were multiplied by 100% to yield a percentage. The interrater reliability coefficient was 96%.
Participant data were gathered for type of insurance (Medicaid or private), gender (male, female), race or ethnicity, language spoken, single/dual parent household, and the presence of maladaptive behavior within the previous 6 months. The primary variables of interest in the analysis consisted of median zip code income (obtained through the U.S. Census Bureau),32 age of client in months at the start of the pandemic, VABS Adaptive Behavior Composite score, VB-MAPP Milestones score, VABS maladaptive behavior score, number of caretakers in the household, additional services received, and length of time receiving services from the ASD service provider.
Age and severity of symptomology of behavior excesses (e.g., aggression) were selected as target variables, as there is clinical support for earlier intervention leading to more optimal outcomes.33 The severity of autism or autism with comorbid behavioral excesses presents significant challenges for families and care providers.34,35 The number of caretakers was included to determine whether additional caregivers facilitated the acceptance or declination of telehealth services. The additional variables (length of time with their current provider and additional services received) were measured to assess whether time engaged with their provider-mediated acceptance or declination.
Analysis
Descriptive statistical analysis was used as the primary method of data analysis. For all categorical variables, the frequency of participants within the accepted telehealth and declined telehealth groups were compared. Given that each group consisted of 100 participants, the frequency measures were the same as a percentage score. For continuous variables, paired-samples t tests were conducted to compare the mean difference scores and for categorical variables, Chi-squared tests were conducted to facilitate the analysis (α = 0.05).
Results
Table 1 depicts the demographic characteristics of the participants who accepted and declined telehealth services. The Accepted Telehealth group and Declined Telehealth groups were generally similar, with slight differences across certain traits. The Declined Telehealth group had a slightly higher percentage of participants who exhibited maladaptive behaviors within the past 6 months (+12%), had private insurance (+10%), identified as male (+7%), were Asian (+7%), and were from a single parent household (+5%). In contrast, the Accepted Telehealth group had a higher percentage of Hispanic participants (+8%). None of the categorical variables were statistically significantly different.
ACCEPTED (n) | DECLINED (n) | CHI-SQUARE TEST | ||
---|---|---|---|---|
p | df | |||
Insurance type | 0.11 | 1 | ||
Medicaid insurance | 32 | 22 | ||
Private insurance | 68 | 78 | ||
Gender | 0.27 | 1 | ||
Female | 31 | 24 | ||
Male | 69 | 76 | ||
Race/ethnicity | 0.25 | 6 | ||
Asian | 10 | 17 | ||
Black | 4 | 5 | ||
Hispanic | 50 | 42 | ||
Other | 1 | 3 | ||
Multiple | 4 | 0 | ||
White | 26 | 29 | ||
Unknown | 5 | 4 | ||
Primary language spoken | 0.55 | 3 | ||
English | 94 | 93 | ||
Spanish | 5 | 6 | ||
English/Spanish | 1 | 0 | ||
Vietnamese | 0 | 1 | ||
Household count | 0.37 | 1 | ||
Single parent household | 17 | 22 | ||
Dual parent household | 83 | 78 | ||
Severe behavior reported | 0.08 | 1 | ||
Yes | 41 | 29 | ||
No | 59 | 71 |
Table 2 contains the clinical characteristics of participants in the two groups. The groups were similar in all of the variables, except the Accepted Telehealth group utilized 1.3 additional ABA hours per week (p = 0.014), 0.5 additional speech therapy hours per week (p < 0.001), and 0.8 additional occupational therapy hours per week (p < 0.001) before telehealth.
ACCEPTED | DECLINED | t TEST | ||
---|---|---|---|---|
Mean (SD) | Mean (SD) | p | df | |
Median zip income | $74K (18K) | $70K (18K) | 0.74 | 198 |
Age of child at start (months) | 70.8 (33.3) | 76.8 (37.0) | 0.23 | 198 |
VB-MAPP milestones score | 76.5 (39.9) | 79.3 (39.4) | 0.64 | 169 |
VABS standard score | ||||
ABC score | 61.2 (14.1) | 62.4 (15.5) | 0.59 | 198 |
Communication | 56.1 (20.0) | 58.1 (22.4) | 0.50 | 198 |
Socialization | 60.5 (16.5) | 62.4 (16.5) | 0.41 | 198 |
Daily living | 67.7 (14.0) | 68.5 (14.0) | 0.66 | 197 |
VABS maladaptive behavior raw score | 5.3 (4.0) | 6.0 (4.0) | ||
Internalizing | 5.8 (4.8) | 6.4 (4.7) | 0.45 | 156 |
Externalizing | 5.3 (4.0) | 6.0 (4.0) | 0.24 | 156 |
Number of caretaker in house | 2.2 (1) | 2.2 (.8) | 0.89 | 198 |
Average weekly ST hours | 1.3 (0.5) | 0.7 (0.7) | <0.001 | 163 |
Average weekly OT hours | 1.2 (0.4) | 0.4 (0.6) | <0.001 | 135 |
Total weekly ABA hours utilized | 10.5 (4.0) | 9.2 (3.1) | 0.01 | 198 |
Months receiving ABA with organization | 15.3 (6.2) | 18.9 (25.0) | 0.17 | 111 |
Discussion
The public health crisis of the COVID-19 pandemic provided an opportunity to evaluate factors that may have been associated with a family’s decision to accept or decline telehealth ABA interventions when in-person therapy was no longer available. Due to stay-at-home orders to protect the public, declination of telehealth interventions resulted in no interventions at all for children with ASD. In the face of this, many families declined telehealth interventions. When we compared the various demographic and clinical characteristics of the participants who accepted and those who declined telehealth, the two groups did not differ considerably from one another in any of the evaluated characteristics; although there were certain patterns in the data that are worth highlighting.
The only statistically significant difference was that the Accepted Telehealth group was receiving slightly more ABA, speech therapy, and occupational therapy intervention hours per week, but the group difference was not clinically meaningful.
Before the COVID-19 pandemic, the organization participating in this study provided primarily in-person interventions for ASD. Telehealth was reserved for when access to care was limited in geographically isolated areas. With the abrupt transition to telehealth, the initial barrier to providing telehealth interventions was that some families did not have the materials to receive telehealth interventions. Participant families were provided tablets enabled with cellular networks to alleviate the known barrier of access to technology.
Despite the removal of this access to technology barrier, many families initially declined telehealth interventions, which indicates the need to examine ecological barriers that may have been directly or indirectly related to the variables examined here.
Race and ethnicity comprise a known area of disparity for access to autism intervention.17,36,37 It is notable that this research cohort overrepresented race and ethnicity categories other than white. None of the assessed variables related to race/ethnicity or socioeconomic status were associated with the Accepted Telehealth or Declined Telehealth groups. When comparing the distribution of various races across the two groups, there were slightly more Hispanic families in the group that accepted telehealth and slightly more Asian families in the group that declined telehealth. It is not clear whether these results are unique to the geographic region where the study was conducted.
Under the provision of the Affordable Care Act,38 a reduction in disparities in access to health care was highlighted, which could indicate similar patterns in this study in other regions in the United States. Alternatively, our findings could be specific to California as a result of the provisions of the Medicaid plans specific to California. For example, the provision of the Affordable Healthcare Act of 2014 resulted in a reduction in disparity to health care for Latinos.39 Additional studies are warranted to evaluate the impact of federal and state-wide legislation on health care access for all groups.
We also examined two variables related to socioeconomic status, specifically the median income for the zip code a family lived in and insurance type (Medicaid vs. private). The groups were similar with regard to these variables, and there was not a consistent pattern that could be attributed to one group in particular. For example, there were slightly more participants who had Medicaid insurance in the Accepted Telehealth group than in the Declined Telehealth group. In contrast, the Accepted Telehealth group had a slightly higher median income in their respective zip code.
An additional financial barrier for telehealth is technology access but this barrier was mitigated, which may have diminished the impact of the two variables related to socioeconomic status.
Perhaps one of the more notable patterns in the results was that a higher percentage of individuals in the Accepted Telehealth group exhibited severe aberrant behaviors recently than the Declined Telehealth group. This slight difference may be because those with more significant behavioral needs might be likely to request behavioral consultation and utilize telehealth services. Behavior challenges exhibited by children with autism is a known stressor to parents.40,41 Families who experienced higher levels of severe behaviors may have been more willing to accept telehealth and behavioral support as a result.
Although the groups were similar across most of the variables that we examined, the Accepted Telehealth group received statistically significantly more intervention hours per week before the pandemic than the Declined Telehealth group. These results were pertinent to ABA, speech therapy, and occupational therapy. It is possible that the Accepted Telehealth group may have accepted the interventions’ utility and believed in their efficacy, which resulted in higher adherence to the prescribed intervention dosage than the Declined Telehealth group.
Future studies should identify whether there is a relationship between treatment acceptability and adherence to ABA interventions. The relationship between treatment satisfaction and intervention adherence has been underexplored in health care,42 and the same holds true for autism interventions.
Future Research
The pandemic has increased awareness that the system of care in the United States is fragile, particularly for vulnerable populations such as children with autism.43 Stakeholders in the autism community must identify and address systemic shortcomings and ecological barriers that prevent access to health care in case of future crises. Although the present study assessed variables that could be associated with a group of individuals who declined telehealth interventions, the study did not employ an experimental design and the conclusions are suggestive.
Additional research is warranted to examine the choice for telehealth interventions as a function of the variables studied here and other related variables experimentally. Given that the present study was conducted during a pandemic, future studies should re-evaluate these variables to control for some of the unique confounding historical variables present in this study, such as job loss, illness or death of family members, limited childcare to allow work and facilitation of therapy sessions, mental health issues induced by the pandemic, or the family’s reluctance to increase screen-time when children are home-schooled.
Conclusions
In summary, there is reason to believe that many of the disparities that prevented equal access to health care services continued to persist in the face of the COVID-19 pandemic. Our goal was to assess whether such disparities existed in a large non-for-profit organization that provided disability services and to identify what variables were correlated with declination of telehealth. Although there were subtle differences between those who accepted and those who declined telehealth, the difference was not statistically or clinically significant.
Approximately 40% of families declined telehealth when the services were initially transitioned to telehealth. This reluctance to accept telehealth was perhaps because many anticipated only a temporary disruption due to the pandemic. As the pandemic progressed, a higher percentage of consumers accepted telehealth interventions. Accordingly, the results of this study are confounded by historical variables specific to the start of the COVID-19 pandemic and additional research is warranted to better evaluate each of the variables evaluated here.
Authors’ Contributions
All authors contributed to the conception of the study design, article preparation, and data collection. All authors read and approved the final article. This statement confirms that this article has been submitted solely to this journal and is not published, in press, or submitted elsewhere.
Disclosure Statement
We wish to confirm that there are no known conflicts of interest associated with this publication and there has been no significant financial support for this work that could have influenced its outcome. We confirm that the article has been read and approved by all named authors and that there are no other people who satisfied the criteria for authorship who are not listed. We further confirm that the order of authors listed in the article has been approved by all of us. We confirm that we have given due consideration to the protection of intellectual property associated with this work and that there are no impediments to publication, including the timing of publication, with respect to intellectual property. In so doing, we confirm that we have followed the regulations of our institutions regarding intellectual property.
Funding Information
The authors have no financial conflicts of interest to disclose.
References
- 1. The hidden inequalities of COVID-19. Autism 2020;24:1309–1310. Crossref, Medline, Google Scholar .
- 2. Identification, evaluation, and management of children with autism spectrum disorder. Pediatrics 2019;145:e20193447. Crossref, Medline, Google Scholar .
- 3. Intensity and learning outcomes in the treatment of children with autism spectrum disorder. Behav Modif 2017;41:229–252. Crossref, Medline, Google Scholar
- 4. Examining the impact of COVID-19 in ethnically diverse families with young children with intellectual and developmental disabilities. J Intellect Disabil Res 2020;64:739–749. Medline, Google Scholar .
- 5. Language barriers impact access to services for children with autism spectrum disorders. J Autism Dev Disord 2018;48:333–340. Crossref, Medline, Google Scholar .
- 6. Autism spectrum disorder among us children (2002–2010): Socioeconomic, racial, and ethnic disparities. Am J Public Health 2017;107:1818–1826. Crossref, Medline, Google Scholar
- 7. Do insurance mandates affect racial disparities in outcomes for children with autism? Matern Child Health J 2017;21:351–366. Crossref, Medline, Google Scholar .
- 8. Promote social justice for students with multiple marginalized identities. Disabil Compl Higher Educ 2020;26:2. Google Scholar .
- 9. Early intensive behavioral intervention (EIBI) for young children with autism spectrum disorders (ASD). Cochrane Database Syst Rev 2012;10:CD009260. Medline, Google Scholar .
- 10. Navigating the digital divide: A systematic review of eHealth literacy in underserved populations in the United States. Inform Health Soc Care 2016;41:1–19. Crossref, Medline, Google Scholar .
- 11. Persistent digital divide in access to and use of the Internet as a resource for health information: Results from a California population-based study. Int J Med Inform 2017;103:49–54. Crossref, Medline, Google Scholar .
- 12. Single-case analysis to determine reasons for failure of behavioral treatment via telehealth. Remedial Spec Educ 2018;39:95–105. Crossref, Google Scholar
- 13. Telehealth as a model for providing behaviour analytic interventions to individuals with autism spectrum disorder: A systematic review. J Autism Dev Disord 2019;49:582–616. Crossref, Medline, Google Scholar .
- 14. Evaluating discrete trial teaching with instructive feedback delivered in a dyad arrangement via telehealth. J Appl Behav Anal 2020;53:1876–1888. Crossref, Medline, Google Scholar .
- 15. Telehealth and autism: Are telehealth language assessments reliable and feasible for children with autism?. Int J Lang Commun Disord 2019;54:281–291. Crossref, Medline, Google Scholar .
- 16. Brief report: Use of interactive television in identifying autism in young children: Methodology and preliminary data. J Autism Dev Disord 2015;45:1474–1482. Crossref, Medline, Google Scholar
- 17. Disparities in service use among children with autism: A systematic review. Pediatrics 2020;145(Suppl. 1):S35–S46. Crossref, Medline, Google Scholar .
- 18. Early identification of ASD through telemedicine: Potential value for underserved populations. J Autism Dev Disord 2018;48:2601–2610. Crossref, Medline, Google Scholar
- 19. Feasibility of parent training via telehealth for children with autism spectrum disorder and disruptive behavior: A demonstration pilot. J Autism Dev Disord 2018;48:1020–1030. Crossref, Medline, Google Scholar
- 20. Coaching parents to assess and treat self-injurious behaviour via telehealth. J Intellect Disabil Res 2018;62:1114–1123. Crossref, Medline, Google Scholar .
- 21. Compass for hope: Evaluating the effectiveness of a parent training and support program for children with ASD. J Autism Dev Disord 2017;48:404–416. Crossref, Google Scholar .
- 22. Behavioral telehealth consultation with families of children with autism spectrum disorder. Behav Intervent 2016;31:223–250. Crossref, Google Scholar
- 23. A systematic and quality review of parent-implemented language and communication interventions conducted via telepractice. J Behav Educ 2019;29:282–316. Crossref, Google Scholar .
- 24. Telehealth for expanding the reach of early autism training to parents. Autism Res Treat 2012;2012:1–12. Crossref, Google Scholar .
- 25. Increasing access to an asd imitation intervention via a telehealth parent training program. J Autism Dev Disord 2015;45:3877–3890. Crossref, Medline, Google Scholar .
- 26. Using telehealth to teach valued skills to adults with intellectual and developmental disabilities. J Appl Behav Anal 2020;53:1276–1289. Crossref, Medline, Google Scholar .
- 27. The effects of transition to technician-delivered telehealth ABA treatment during the COVID-19 crisis: A preliminary analysis. J Appl Behav Anal 2021;54:87–102. Crossref, Medline, Google Scholar .
- 28. Using teleconferencing to meet the needs of children, 0 to 3 years old, with disabilities in rural areas. Rural Spec Educ Q 2018;37:176–182. Crossref, Google Scholar .
- 29. Comparison of telemedicine to traditional face-to-face care for children with special needs: A quasiexperimental study. Telemed J E Health 2018;24:433–441. Link, Google Scholar .
- 30. A comparative study of rurality and urbanicity on access to and satisfaction with services for children with autism spectrum disorders. Rural Spec Educ Q 2012;31:3–11. Crossref, Google Scholar .
- 31. Parent-mediated intervention training delivered remotely for children with autism spectrum disorder living outside of urban areas: Systematic review. J Med Internet Res 2017;19:e198. Crossref, Medline, Google Scholar .
- 32.
QuickFacts. Census.gov . 2019. Available at https://www.census.gov/quickfacts/fact/table/losangelescitycalifornia/PST045219 (last accessedJanuary 19, 2020 ). Google Scholar - 33. Who benefits from early intervention in autism spectrum disorders? Res Autism Spectr Disord 2011;5:345–350. Crossref, Google Scholar .
- 34. Determinants of stress in parents of children with autism spectrum disorders. J Autism Dev Disord 2014;44:1609–1620. Crossref, Medline, Google Scholar .
- 35. Symptom severity, caregiver stress and intervention helpfulness assessed using ratings from parents caring for a child with autism. Autism 2018;22:585–596. Crossref, Medline, Google Scholar .
- 36. Healthcare access and services use among US children with autism spectrum disorder. Autism 2019;23:1419–1430. Crossref, Medline, Google Scholar .
- 37. Time-lag between diagnosis of autism spectrum disorder and onset of publicly-funded early intensive behavioral intervention: Do race-ethnicity and neighborhood matter?. J Autism Dev Disord 2018;48:561–571. Crossref, Medline, Google Scholar .
- 38. The affordable care act reduced socioeconomic disparities in health care access. Health Aff (Millwood) 2017; [Epub ahead of print]; DOI:
10.1377/hlthaff.2017.0083 . Crossref, Google Scholar . - 39. Access-to-care differences between Mexican-heritage and other latinos in California after the affordable care act. Health Aff (Millwood) 2018;37:1400–1408. Crossref, Medline, Google Scholar .
- 40. Transactional relations between parenting stress and child autism symptoms and behavior problems. J Autism Dev Disord 2019;49:1887–1898. Crossref, Medline, Google Scholar .
- 41. A preliminary study of activation, stress, and self-management of parents of children with autism spectrum disorder. J Child Fam Stud 2018;27:825–834. Crossref, Google Scholar .
- 42. A literature review to explore the link between treatment satisfaction and adherence, compliance, and persistence. Patient Prefer Adherence 2012;6:39–48. Crossref, Medline, Google Scholar .
- 43. COVID-19 pandemic and impact on patients with autism spectrum disorder. J Autism Dev Disord 2022;52:473–482. Crossref, Medline, Google Scholar .