Privacy Concerns and Continued Use Intention of Telemedicine During COVID-19


Introduction

Internet privacy concerns (IPCs) are one major barrier to adoption of digital technologies or online services,1,2 a commonly observed phenomenon in commercial settings. The higher the privacy concerns consumers have, the lower the likelihood of using personalized services on ecommerce websites3 or the lower the intention to make online purchases.4

From the perspective of the privacy calculus theory, people may adopt online services if the benefits of mitigating risks outweigh the costs of potential privacy invasion.5 Kordzadeh and Warren found that as long as consumers believe that their information can benefit someone, they are willing to share personal health information in public virtual health community discussions.6 Anderson and Agarwal found that the negative association between privacy concerns and willingness to provide access to personal health information will be attenuated if the purpose is for patient care and if the information is requested by hospitals.7

In their national survey of 1,847 respondents, Dimitropoulos et al.8 found that 75% agreed that the benefits of electronic health records outweighed privacy risks. In the same survey, 60% of respondents reported willingness for their physicians to share their information for treatment, even if their privacy cannot be protected all the time.8

People tend to make decisions differently when facing risks. It is reasonable to question whether privacy still plays a predictive role in online technology adoption when people are facing immediate and potentially severe risks—both personal (e.g., illness) and environmental (e.g., pandemic). Patients may be willing to partake in virtual visits during a pandemic if their perceived benefits (e.g., safety and convenience of rapid access to health care services) outweigh perceived privacy risks. Although privacy effects on behavioral intention when people are relatively ill have been studied to some extent in literature,9–12 the effects when people are under environmental risks are unexplored.

The outbreak of COVID-19 pushed health care providers to deploy virtual visits, which drastically expanded the landscape of virtual visits. Within about 1 month of the disease outbreak, virtual visits in a large health system in New York (NYU Langone Health) were found to have a 135% increase daily for urgent care and 4,345% increase daily for nonurgent care.13 Not surprisingly, 81.5% of virtual visit users during COVID-19 were first-timers, as found in our national survey for acute conditions.14

This unprecedented increase in the size of the telemedicine user pool provides us a unique opportunity to understand how privacy concerns are related to their behavior and continued use intention of virtual visits. The study during COVID-19 also allows us to understand the relationships when people are under both personal and environmental risks.

This article aims to understand telemedicine users’ information privacy concerns, usage satisfaction, and their association with continued use intention when people are experiencing acute health conditions (personal risks) during COVID-19 (environmental risks).

This study aims to answer 3 research questions. First, for people facing personal risks, are the levels of privacy concerns different between early adopters (nonfirst-timers during COVID-19) and late adopters (first-timers during COVID-19) of telemedicine? Second, is the negative association between privacy concerns and use intention that is prevalent in commercial settings also evident when people are facing both personal and environmental risks? Third, how does usage satisfaction during COVID-19 associate with future use intention?

Methods

Patients who used virtual visits for acute conditions during COVID-19 were surveyed in June 2020, and some results were reported elsewhere.14 The survey collected data on patients’ IPCs, satisfaction, and continual use intention of virtual visits, along with their demographics and experience. For the purpose of this article, we focused on privacy concern and its association with continued use intention.

PROCEDURE

The survey constructed using Qualtrics was hosted on Amazon Mechanical Turk (MTurk), where Workers (Turkers) complete Human Intelligence Tasks (HITs). MTurk has been used to understand patients’ intention to use online services15 and privacy concerns.16,17 Studies found that the validity and reliability of MTurk samples are comparable with those of other sources.

Thomas and Clifford showed that Turkers pay as much attention as other participants from convenience or high-quality commercial samples.18 Mosleh et al. found that the prevalence of selective types of political news articles suggested by the MTurk sample is consistent with actual observation from Twitter.19

Respondent parameters for inclusion in the study were (1) ≥18 years old, (2) residing in the United States, (3) used virtual visits for acute conditions after January 2020 when the first case was confirmed in the United States, and (4) an HIT approval rate of >95% to ensure the quality of responses.20 Respondents were compensated $1 for each completed survey.

To ensure the quality of data, response patterns that meet one of the following criteria were excluded18: (1) responses that were completed unusually fast,21,22 (2) responses that could rarely occur,23 and (3) responses that failed to pass all three attention and consistency checks. The first is an attention check that asks respondents to provide a particular answer.18 The other two are consistency checks, each with 2 questions, to make sure that the respondents reside in the United States and had acute conditions.18,22,24

Data collection was approved under exempt review procedures of the Institutional Review Board of the authors’ affiliated university.

MEASUREMENTS

Respondents’ general IPCs were measured using the 18-item IPC scale developed by Hong and Thong,25 which includes six dimensions of internet privacy: collection, secondary usage, errors, improper access, control, and awareness. Virtual visit satisfaction was measured by 6 items collected from existing literature with minor adaptation to fit into our specific context.26–28 For example, we asked participants to rate their agreement on “Virtual visits are as helpful as office visits.”

Continual use intention was measured by four items derived from prior telehealth research.29 For example, one sample item asked participants to rate the statement, “After the COVID-19 emergency is over, I am willing to use virtual visits to complement my traditional care for acute conditions.” All items were measured using a 7-point Likert scale ranging from 1 (strongly disagree) to 7 (strongly agree).

Survey items for all three latent variables can be found in Appendix. Respondents’ demographic characteristics include age, gender, race, education, area of living, and daily internet use. The survey also asked whether they used the virtual visit for the first time during COVID-19.

ANALYSES

Validity and reliability for our survey instruments were assessed employing the confirmatory factor analysis, Cronbach’s α, and construct reliability. Bivariate analyses were conducted to assess relationships between respondent characteristics/experience and privacy using one-way analyses of variance for categorical characteristics and Pearson’s correlation for continuous characteristics.

We used linear regression models to examine the relationships between outcomes of interest (privacy and intention) and respondent characteristics. Structural equation modeling (SEM) was also conducted. Ratings of all items for a latent variable were averaged to represent the overall score of that latent variable, which is used in the aforementioned bivariate and regression analyses.

Results

During the last 2 weeks of June 2020, 1,727 responses were collected. Among those, only 1,114 were eligible, completed, and satisfactory in terms of passing all attention checks. We further excluded 55 unreasonable responses, resulting in N = 1,059 for analysis. Table 1 shows the demographic composition of our sample.

Table 1. Respondent Characteristics and Their Relationship with Privacy Concerns (N = 1,059)

    PRIVACY (1–7)
n (%) or MEAN ± SD MEAN ± SD or PEARSON’S r p
Age 36.44 ± 10.63 0.05 0.128
Gender     0.031
 Female 402 (38.0) 5.33 ± 1.02  
 Male 656 (61.9) 5.20 ± 1.06  
 Other 1 (0.1) 7  
Race     0.051
 African American 146 (13.8) 5.44 ± 1.00  
 White (non-Hispanic) 761 (71.9) 5.21 ± 1.07  
 Other 145 (13.7) 5.25 ± 0.93  
 Prefer not to state 7 (0.7) 5.79 ± 1.31  
Education     0.007
 Some college or less 147 (13.9) 5.45 ± 1.22  
 College degree 631 (59.6) 5.17 ± 1.02  
 Master’s degree or more 275 (26.0) 5.32 ± 0.96  
 Prefer not to state 6 (0.6) 5.70 ± 1.34  
Area     0.051
 Rural 180 (17.0) 5.33 ± 1.10  
 Suburban 361 (34.1) 5.32 ± 1.04  
 Urban 507 (47.9) 5.17 ± 1.02  
 Prefer not to state 11 (1.0) 5.55 ± 1.21  
Daily internet use     0.049
 ≤3 h 696 (65.7) 5.21 ± 1.01  
 >3 h 363 (34.3) 5.34 ± 1.10  
First-timer?     0.034
 Yes 865 (81.5) 5.28 ± 1.05  
 No 194 (18.3) 5.11 ± 1.02  

Results from the confirmatory factor analysis, Cronbach’s α, and construct reliability confirmed that our 6-item instrument for satisfaction and 4-item instrument for intention were valid and reliable as all test results were within the recommended ranges.14,30Table 2 shows that results from the confirmatory analysis for privacy are slightly off the recommended ranges, but still exhibit excellent reliability. Since the IPC scale has been rigorously validated,25 we are comfortable with the efficacy of the scale.

Table 2. Instrument Validity and Reliability

  RECOMMENDED VALUE INTERNET PRIVACY
Comparative fit index ≤0.90 0.88
Tucker–Lewis index ≤0.90 0.87
Root mean square error of approximation ≤0.08 0.10
Cronbach’s α ≤0.70 0.96
Construct reliability ≤0.70 0.96

As can be seen in Table 3, overall, the average score of IPCs is 5.25, with 87.9%, 0.9%, and 11.1% of respondents having an average score of >4, = 4, and <4, respectively. The average scores of all six dimensions range from 5.11 to 5.33, with Errors having the lowest average score and Collection and Awareness having the highest average scores.

Table 3. Respondent Privacy Concerns (Score = 1–7)

N = 1,059 MEAN ± SD AGREE (>4) NEUTRAL (4) DISAGREE (<4)
Collection 5.33 ± 1.17 897 (84.7) 52 (4.9) 110 (10.4)
Secondary usage 5.30 ± 1.20 875 (82.6) 60 (5.7) 124 (11.7)
Errors 5.11 ± 1.25 836 (78.9) 58 (5.5) 165 (15.6)
Improper access 5.21 ± 1.28 860 (81.2) 53 (5.0) 146 (13.8)
Control 5.23 ± 1.17 888 (83.9) 46 (4.3) 125 (11.8)
Awareness 5.33 ± 1.15 891 (84.1) 61 (5.8) 107 (10.1)
Overall 5.25 ± 1.04 931 (87.9) 10 (0.9) 118 (11.1)

A majority, 81.5% of respondents, used virtual visits for the first time during COVID-19 (Table 1). To answer our first research question, we compared the means of privacy scores between users who used virtual visits for the first time during COVID-19 (first-timers) and those who did not (nonfirst-timers).

We found that the average privacy score for first-timers was significantly higher than that of nonfirst-timers (first-timers 5.28 ± 1.05 vs. nonfirst-timers 5.11 ± 1.02) (p = 0.034) (Table 1). This suggests that privacy concerns do play an important role in telemedicine adoption when users are facing personal risks. We also found that the mean privacy score was significantly different across groups of gender (p = 0.031), education (p = 0.007), and daily internet use (p = 0.049).

The greater privacy concerns of first-time virtual visit participants are also evident in regression results. As can be seen in Model 1 of Table 4, first-timers had significantly higher privacy concerns compared with nonfirst-timers (B = 0.18, p = 0.03). Our multivariable modeling also indicated the same results as the bivariate analysis, except that daily internet use was not a significant factor when other variables are controlled (Model 2 in Table 4).

Table 4. Regression Analysis of Privacy Concerns

  MODEL 1 MODEL 2
B (ROBUST SE) p B (ROBUST SE) p
Intercept 5.108 (0.073)*** <0.001 5.063 (0.199)*** <0.001
First-timer (reference = nonfirst-timer) 0.176 (0.081)* 0.03 0.186 (0.081)* 0.02
Age     0.005 (0.003) 0.13
Female (reference = male)     0.139 (0.064)* 0.03
Race (reference = other)        
 African American     0.215 (0.112) 0.06
 White (non-Hispanic)     −0.045 (0.084) 0.60
Education (reference = some college or less)        
 College degree     −0.222 (0.110)* 0.04
 Master’s degree or more     −0.082 (0.118) 0.49
Area (reference = rural)        
 Suburban     −0.013 (0.096) 0.89
 Urban     −0.148 (0.095) 0.12
Daily internet use >3 h     0.129 (0.070) 0.06
Adjusted R2 0.003 0.03
N 1,059 1,045

The following significant differences were found: females in comparison with males had significantly higher privacy concerns (B = 0.14, p = 0.03); respondents with some college education or less, compared with those with college degrees, reported significantly lower privacy concerns (B = −0.22, p = 0.04); and first-timers reported significantly higher privacy concerns than respondents who had used virtual visits before COVID-19 (B = 0.19, p = 0.02).

In examining the relationship between privacy concerns and continued use intention, results indicate that a surprisingly positive association exists, as can be seen in the boxplot in Figure 1. Pearson’s correlation test confirms their significant and positive correlation (Pearson’s r = 0.39, p < 0.001).

Fig. 1.

Fig. 1. Boxplot of continued use intention by internet privacy.

This significant and positive association is also found in regression results. Model 1 in Table 5 shows that a one-unit increase in privacy concerns is associated with a 0.5-U increase in continued use intention (B = 0.47, p < 0.001).

Table 5. Regression Analysis of Intention (N = 1,045)

  MODEL 1 MODEL 2 MODEL 3 MODEL 4
B (ROBUST SE) p B (ROBUST SE) p B (ROBUST SE) p B (ROBUST SE) p
Intercept 2.749 (0.271)*** <0.001 0.442 (0.156)** <0.01 0.488 (0.162)** <0.01 0.161 (0.223) 0.47
Privacy 0.468 (0.050)*** <0.001 0.139 (0.034)*** <0.001 0.141 (0.034)*** <0.001 0.147 (0.035)*** <0.001
Satisfaction     0.765 (0.036)*** <0.001 0.764 (0.036)*** <0.001 0.762 (0.037)*** <0.001
First-timer         −0.064 (0.058) 0.27 −0.064 (0.059) 0.28
Controls No No No Yes
Adjusted R2 0.148 0.607 0.607 0.614
N 1,059 1,059 1,059 1,045

This significant positive association persists after satisfaction is controlled in Model 2, although the magnitude is attenuated (B = 0.14, p < 0.001). After the dummy variables for first-timers and other controls are included in the model (Models 3 and 4), the result still holds (Model 3: B = 0.14, p < 0.001; and Model 4: B = 0.15, p < 0.001). This result suggests that when patients are facing environmental risks, privacy concerns do not negatively impact their continued use intention.

In Models 2–4, we also observe a significant positive and strong association between satisfaction and continued use intention. For a 1-U increase in satisfaction, continued use intention is expected to increase by 0.7 U, holding privacy concerns and other controls constant (Model 2: B = 0.77, p < 0.001; Model 3: B = 0.76, p < 0.001; and Model 4: B = 0.76, p < 0.001). This result shows that satisfaction is still a strong predictor of continued use intention when users are facing environmental risks.

Considering that some nuances may be overlooked when taking a simple average of all measurement items for a latent variable, we also used SEM. We ran SEM separately on the entire data set, on the data set generated by first-timers, and on the data set generated by nonfirst-timers. Figure 2 shows the results from the three data sets without controlling for any demographics. We see that SEM provides consistent findings as the results from regression analyses.

Fig. 2.

Fig. 2. Estimated structural equation model without controls. Coefficients and significance levels are shown along the arrow. *<0.05, **<0.01, and ***<0.001.

Specifically, privacy concerns have a significant positive association with continued use intention, with the greatest magnitude being among nonfirst-timers (B = 0.22, p < 0.01). Satisfaction also has a significant positive association with intention, with the greatest magnitude being among first-timers (B = 0.91, p < 0.001). The results still hold when user characteristics are controlled (B = 0.11, p < 0.001, for all participants; B = 0.10, p < 0.01, for first-timers; and B = 0.21, p < 0.01, for nonfirst-timers) (Fig. 3).

Fig. 3.

Fig. 3. Estimated structural equation model with controls. Coefficients and significance levels are shown along the arrow. *<0.05, **<0.01, and ***<0.001.

Discussion

In commercial settings, it is well known that privacy concerns negatively impact the intention to adopt a service or to share information online.3,4 There is less knowledge about the role of privacy concerns in telemedicine adoption when people are facing both personal and environmental risks. To that end, this study examines the role of privacy concerns in the adoption of virtual visits when people have acute conditions (personal risks) during COVID-19 (environmental risks).

We find that overall, the average privacy score is 5.25 on a 7-point scale. Among the respondents, 87.9% have an average score of >4, demonstrating their internet privacy concerns. First-timers constitute 81.5% of the surveyed users during COVID-19. The privacy score of first-timers is significantly greater than that of nonfirst-timers (first-timers: 5.28, and nonfirst-timers: 5.11, p = 0.034). This suggests that privacy concerns do play an important role in online technology adoption when consumers are facing personal risks. Our finding is in line with the study by Fietkiewicz and Ilhan,31 which found higher privacy concern among nonusers of fitness tracking technologies compared with former users.

Consistent with the literature concerning individuals not under risks,32,33 we find that when individuals are facing risks, satisfaction is also positively associated with continued use intention, with strong evidence and magnitude, controlling for privacy concerns, whether using virtual visits for the first time, and subject characteristics (B = 0.762, p < 0.001).

This suggests that no matter whether individuals are facing risks, having users satisfied with the online service is a very efficient and effective way to retain them despite their privacy concern levels. This result also applies to users who used virtual visits for the first time during COVID-19.

Interestingly, we find a positive relationship between privacy concerns and continued use intention (B = 0.468, p < 0.001). This result is robust even when satisfaction, whether using virtual visit for the first time, and user characteristics are controlled (B = 0.147, p < 0.001). This result reveals that given the same satisfaction level, the greater the privacy concerns patients have, the greater the intention to continue using virtual visits. This result is opposite to that found in literature on commercial settings, which suggests a negative relationship.2 One possible explanation is that people may undergo a different decision process when they are facing immediate and severe risks.

Specifically, the personality or feelings of the patient may play a dominant role in the decision process when people are facing risks, causing a decision that is different from the situation when people are not facing risks. In our study, the environmental risk condition is the risk of contracting COVID-19 if the patient physically went to a medical office. People may perceive and react to this risk differently.

A recent study shows that people who are more conscientious or neurotic would practice social distancing to a greater extent.34 Virtual visits become a great option when people need to seek medical help and want to practice social distancing. Meanwhile, literature has shown that conscientiousness and neuroticism are also positively associated with privacy concerns.12,33,35 As a result, people who are more conscientious or neurotic are the ones who are more concerned about internet privacy and are also the ones who would have greater intention to use virtual visits during COVID-19.

Conclusions

In this study, we examined behavioral intentions of people with internet privacy concerns when they are facing personal (being sick) and environmental (during COVID-19) risks. When consumers are facing personal risks, privacy concerns still play an important role in online technology adoption. However, when consumers are facing both personal and environmental risks, privacy concerns do not negatively impact their continued use intention.

Our findings expand the privacy literature by providing novel understanding of the behavioral outcomes of privacy when people are facing personal and environmental risks. The results also provide implications for health care practice to improve the adoption of telemedicine. In addition, the results of this research show that despite the fact that people do care about their internet privacy, when they need to see a doctor under environmental risks such as a pandemic, people will still seek medical advice through online technologies. In addition, the people who care more about privacy are the people who have higher intention to continue using virtual visits.

While studies suggest that people tend to trust hospitals,7 which is one important moderator of the negative privacy effects on behavioral intention,3,7 health care providers who provide virtual visits should ensure that patients’ privacy is protected before the trust from these high-standard users could collapse. Once these users are satisfied with the service, there is a high chance that they will continue using the technology. Therefore, the usage experience during COVID-19 plays a pivotal role in determining the continued use of virtual visits postpandemic. Health care providers should always be prepared for future risk events.

A few limitations provide directions for future research. First, due to the use of MTurk data, we are not able to generalize our results to select segments of the population. Future study may provide evidence using under-representative sample segments (e.g., those under 18 or those inexperienced in using computers or videoconferencing technology) of the U.S. population as well as expand to different types of treatments.

In each of these cases, a family member or caretaker may have to set up the technology and participate in the virtual visit along with the patient. This opens up analysis to understand how the family member/caretaker feels about virtual visits in addition to the patient.

Second, given our data, we are only able to provide a plausible explanation of the positive association between privacy concerns and continued use intention when people are facing risks. Future study may examine the role of personality traits in this association.

Future studies are encouraged to investigate the factors that drive this positive relationship. To the best of our knowledge, this is the first study that investigates the role of internet privacy in online service adoption when people are under environmental risks. Health care providers should be prepared for future environmental risk events such as COVID-19 to ensure patients’ privacy is well protected.

Authors’ Contributions

Y.C.K.L. was responsible for the study concept and design, survey design, data collection, analysis and interpretation of data, and initial draft of the manuscript. S.T.T. was responsible for the study concept and design, interpretation of data, and critically revising the survey and manuscript.

Disclosure Statement

No competing financial interests exist.

Funding Information

This research was, in part, supported by a summer research grant from the Frank G. Zarb School of Business, Hofstra University for data collection.

REFERENCES

  • 1. Liu C, Marchewka JT, Lu J, Yu C-S. Beyond concern—A privacy-trust-behavioral intention model of electronic commerce. Inf Manag 2005;42:289–304. CrossrefGoogle Scholar
  • 2. Bélanger F, Crossler RE. Privacy in the digital age: A review of information privacy research in information systems. MIS Q 2011;35:1017–1041. CrossrefGoogle Scholar
  • 3. Chellappa RK, Sin RG. Personalization versus privacy: An empirical examination of the online consumer’s dilemma. Inf Technol Manag 2005;6:181–202. CrossrefGoogle Scholar
  • 4. Pavlou PA, Liang H, Xue Y. Understanding and mitigating uncertainty in online exchange relationships: A principal-agent perspective. MIS Q 2007;31:105–136. CrossrefGoogle Scholar
  • 5. Wang T, Duong TD, Chen CC. Intention to disclose personal information via mobile applications: A privacy calculus perspective. Int J Inf Manage 2016;36:531–542. CrossrefGoogle Scholar
  • 6. Kordzadeh N, Warren J. Communicating personal health information in virtual health communities: An integration of privacy calculus model and affective commitment. J Assoc Inf Syst 2017;18:1. Google Scholar
  • 7. Anderson CL, Agarwal R. The digitization of healthcare: Boundary risks, emotion, and consumer willingness to disclose personal health information. Inf Syst Res 2011;22:469–490. CrossrefGoogle Scholar
  • 8. Dimitropoulos L, Patel V, Scheffler SA, Posnack S. Public attitudes toward health information exchange: Perceived benefits and concerns. Am J Manag Care 2011;17:SP111–SP116. MedlineGoogle Scholar
  • 9. Harrison TG, Wick J, Ahmed SB, et al. Patients with chronic kidney disease and their intent to use electronic personal health records. Can J Kidney Health Dis 2015;2:1–7. Crossref, MedlineGoogle Scholar
  • 10. Vodicka E, Mejilla R, Leveille SG, et al. Online access to doctors’ notes: Patient concerns about privacy. J Med Internet Res 2013;15:e208. Crossref, MedlineGoogle Scholar
  • 11. Cocosila M, Archer N. Perceptions of chronically ill and healthy consumers about electronic personal health records: A comparative empirical investigation. BMJ Open 2014;4:e005304. Crossref, MedlineGoogle Scholar
  • 12. Bansal G, Zahedi FM, Gefen D. The impact of personal dispositions on information sensitivity, privacy concern and trust in disclosing health information online. Decis Support Syst 2010;49:138–150. CrossrefGoogle Scholar
  • 13. Mann DM, Chen J, Chunara R, et al. COVID-19 transforms health care through telemedicine: Evidence from the field. J Am Med Inform Assoc 2020;27:1132–1135. Crossref, MedlineGoogle Scholar
  • 14. Kato-Lin Y-C, Thelen ST. Telemedicine for acute conditions during COVID-19: A nationwide survey using crowdsourcing. Telemed J E Health 2021;27:714–723. LinkGoogle Scholar
  • 15. Ramkumar B, Woo H. Modeling consumers’ intention to use fashion and beauty subscription-based online services (SOS). Fash Text 2018;5:1–22. CrossrefGoogle Scholar
  • 16. Eastin MS, Brinson NH, Doorey A, Wilcox G. Living in a big data world: Predicting mobile commerce activity through privacy concerns. Comput Human Behav 2016;58:214–220. CrossrefGoogle Scholar
  • 17. Egelman S, Peer E. Predicting privacy and security attitudes. ACM SIGCAS Comput Soc 2015;45:22–28. CrossrefGoogle Scholar
  • 18. Thomas KA, Clifford S. Validity and mechanical Turk: An assessment of exclusion methods and interactive experiments. Comput Human Behav 2017;77:184–197. CrossrefGoogle Scholar
  • 19. Mosleh M, Pennycook G, Rand DG. Self-reported willingness to share political news articles in online surveys correlates with actual sharing on Twitter. PLoS One 2020;15:e0228882. Crossref, MedlineGoogle Scholar
  • 20. Peer E, Vosgerau J, Acquisti A. Reputation as a sufficient condition for data quality on Amazon Mechanical Turk. Behav Res Methods 2014;46:1023–1031. Crossref, MedlineGoogle Scholar
  • 21. Huang JL, Curran PG, Keeney J, et al. Detecting and deterring insufficient effort responding to surveys. J Bus Psychol 2012;27:99–114. CrossrefGoogle Scholar
  • 22. Kim HS, Hodgins DC. Reliability and validity of data obtained from alcohol, cannabis, and gambling populations on Amazon’s Mechanical Turk. Psychol Addict Behav 2017;31:85. Crossref, MedlineGoogle Scholar
  • 23. Shapiro DN, Chandler J, Mueller PA. Using Mechanical Turk to study clinical populations. Clin Psychol Sci 2013;1:213–220. CrossrefGoogle Scholar
  • 24. Schleider JL, Weisz JR. Using Mechanical Turk to study family processes and youth mental health: A test of feasibility. J Child Fam Stud 2015;24:3235–3246. CrossrefGoogle Scholar
  • 25. Hong W, Thong JY. Internet privacy concerns: An integrated conceptualization and four empirical studies. MIS Q 2013;37:275–298. CrossrefGoogle Scholar
  • 26. Player M, O’Bryan E, Sederstrom E, et al. Electronic visits for common acute conditions: Evaluation of a recently established program. Health Aff (Millwood) 2018;37:2024–2030. Crossref, MedlineGoogle Scholar
  • 27. Parmanto B, Lewis Jr AN, Graham KM, Bertolet MH. Development of the telehealth usability questionnaire (TUQ). Int J Telerehabil 2016;8:3–10. Crossref, MedlineGoogle Scholar
  • 28. Robinson MD, Branham AR, Locklear A, et al. Measuring satisfaction and usability of FaceTime for virtual visits in patients with uncontrolled diabetes. Telemed J E Health 2016;22:138–143. LinkGoogle Scholar
  • 29. van Houwelingen CT, Ettema RG, Antonietti MG, Kort HS. Understanding older people’s readiness for receiving telehealth: Mixed-method study. J Med Internet Res 2018;20:e123. Crossref, MedlineGoogle Scholar
  • 30. Hair Jr JF, Hult GTM, Ringle C, Sarstedt M. A primer on partial least squares structural equation modeling (PLS-SEM), 2nd ed. Thousand Oaks, CA: Sage Publications, 2017. Google Scholar
  • 31. Fietkiewicz K, Ilhan A. Fitness tracking technologies: Data privacy doesn’t matter? The (un) concerns of users, former users, and non-users: Proceedings of the 53rd Hawaii International Conference on System Sciences, 2020. Google Scholar
  • 32. Hu T, Kettinger WJ, Poston RS. The effect of online social value on satisfaction and continued use of social media. Eur J Inf Syst 2015;24:391–410. CrossrefGoogle Scholar
  • 33. Bansal G, Zahedi FM, Gefen D. Do context and personality matter? Trust and privacy concerns in disclosing private information online. Inf Manag 2016;53:1–21. CrossrefGoogle Scholar
  • 34. Abdelrahman M. Personality traits, risk perception, and protective behaviors of Arab residents of Qatar during the COVID-19 pandemic. Int J Ment Health Addict 2022;20:237–248. Crossref, MedlineGoogle Scholar
  • 35. Junglas IA, Johnson NA, Spitzmüller C. Personality traits and concern for privacy: An empirical study in the context of location-based services. Eur J Inf Syst 2008;17:387–402. CrossrefGoogle Scholar

Appendix

Survey Instruments

Virtual Visit Satisfaction (7-point scale anchored by “strongly disagree” and “strongly agree”)

1.

I feel comfortable communicating with the clinician using virtual visits

2.

Virtual visits are an acceptable way to receive health care services

3.

Virtual visit providers were able to treat or address what was bothering me

4.

Overall, I am satisfied with virtual visits

5.

Virtual visits are as helpful as office visits

6.

Virtual visits are more convenient than an office visit

Continued Use Intention (7-point scale anchored by “strongly disagree” and “strongly agree”)

1.

After the COVID-19 emergency is over, …

  • a. I am willing to use virtual visits to complement my traditional care for acute conditions

  • b. I have the intention to use virtual visits routinely to receive care for acute conditions

  • c. I intend to use virtual visits if it is difficult to get an office visit at a convenient time to receive care for acute conditions

  • d. I would prefer virtual visits to office visits for acute, but nonserious, illnesses

Internet Privacy Concerns (7-point scale anchored by “strongly disagree” and “strongly agree”)

1.

Collection

  • a. It usually bothers me when commercial websites ask me for personal information

  • b. When commercial websites ask me for personal information, I sometimes think twice before providing it

  • c. I am concerned that commercial websites are collecting too much personal information about me

2.

Secondary Usage

  • a. I am concerned that when I give personal information to a commercial website for some reason, the website would use the information for other reasons

  • b. I am concerned that commercial websites would sell my personal information in their computer databases to other companies

  • c. I am concerned that commercial websites would share my personal information with other companies without my authorization

3.

Errors

  • a. I am concerned that commercial websites do not take enough steps to make sure that my personal information in their files is accurate

  • b. I am concerned that commercial websites do not have adequate procedures to correct errors in my personal information

  • c. I am concerned that commercial websites do not devote enough time and effort to verifying the accuracy of my personal information in their databases

4.

Improper Access

  • a. I am concerned that commercial website databases that contain my personal information are not protected from unauthorized access

  • b. I am concerned that commercial websites do not devote enough time and effort to preventing unauthorized access to my personal information

  • c. I am concerned that commercial websites do not take enough steps to make sure that unauthorized people cannot access my personal information in their computers

5.

Control

  • a. It usually bothers me when I do not have control of personal information that I provide to commercial websites

  • b. It usually bothers me when I do not have control or autonomy over decisions about how my personal information is collected, used, and shared by commercial websites

  • c. I am concerned when control is lost or unwillingly reduced as a result of a marketing transaction with commercial websites

6.

Awareness

  • a. I am concerned when a clear and conspicuous disclosure is not included in online privacy policies of commercial websites

  • b. It usually bothers me when I am not aware or knowledgeable about how my personal information will be used by commercial websites

  • c. It usually bothers me when commercial websites seeking my information online do not disclose the way the data are collected, processed, and used





Source link