Original Paper
Abstract
Background: The availability and use of broadband internet play an increasingly important role in health care and public health.
Objective: This study examined the associations between broadband internet availability and use with drug overdose deaths in the United States.
Methods: We linked 2019 county-level drug overdose death data in restricted-access multiple causes of death files from the National Vital Statistics System at the US Centers for Disease Control and Prevention with the 2019 county-level broadband internet rollout data from the Federal Communications Commission and the 2019 county-level broadband usage data available from Microsoft’s Airband Initiative. Cross-sectional analysis was performed with the fixed-effects regression method to assess the association of broadband internet availability and usage with opioid overdose deaths. Our model also controlled for county-level socioeconomic characteristics and county-level health policy variables.
Results: Overall, a 1% increase in broadband internet use was linked with a 1.2% increase in overall drug overdose deaths. No significant association was observed for broadband internet availability. Although similar positive associations were found for both male and female populations, the association varied across different age subgroups. The positive association on overall drug overdose deaths was the greatest among Hispanic and Non-Hispanic White populations.
Conclusions: Broadband internet use was positively associated with increased drug overdose deaths among the overall US population and some subpopulations, even after controlling for broadband availability, sociodemographic characteristics, unemployment, and median household income.
doi:10.2196/52686
Keywords
Introduction
Over 900,000 individuals have died from drug overdoses within the last 2 decades, posing a significant public health concern in the United States [
, ]. Opioids, either obtained illicitly or as a prescription, accounted for approximately 75% of the total drug overdose deaths in 2020 [ , ]. Recent numbers suggest an acceleration of both drug and opioid overdose deaths during the COVID-19 pandemic, with the United States experiencing the largest number of drug overdose deaths during this period (93,300 deaths) compared to that reported in any given year within the last 2 decades.Internet access alongside digital literacy in general have been increasingly recognized as a “super” social determinant of health [
, ]. Access to broadband internet has been identified as a crucial public health issue (including its effect on the domain of access to credible information [ ]) and a critical infrastructure for equitable access to health care, especially for underserved communities [ , ]. More specifically, the widening availability of broadband internet could potentially worsen the health inequalities in the United States, as it disproportionately impacts already marginalized groups such as racial/ethnic minorities, the older population, individuals with lower incomes, those with less education, and residents of rural areas [ ]. According to the Federal Communications Commission (FCC), approximately 19 million individuals in the United States do not have access to a reliable broadband service, often referred to as reliable high-speed internet. This issue, termed the digital divide, primarily targets rural regions but also encompasses “segments of segregated urban areas that remain disconnected” [ ]. Individuals with reduced income and less formal education are less inclined to possess a home broadband service or a mobile data plan subscription, necessitating their reliance on limited cell plan data or local public Wi-Fi hot spots [ , ].Broadband internet access has been linked with disparities in various health outcomes, ranging from health information–seeking and health communication [
] to access to care during public health emergencies requiring remote care [ ]. A recent US study demonstrated an association between lack of broadband coverage and adverse mental health outcomes [ ]. In addition, access to broadband internet could affect drug and substance use through several channels. For instance, purchase of drugs via the internet is faster, anonymous, and less risky, which makes overall access to drugs easier; accordingly, the internet has been deemed a “pipeline for narcotics” [ ]. Existing research indicates that in instances where drugs are easily accessible on the internet, there is a notable surge in the number of new and first-time users regardless of socioeconomic status [ ]. Although, theoretically, increases in knowledge and information should lead to more optimal consumer choices, substantial networking opportunities may result in peers having a significant influence over health behaviors [ ]. This raises the possibility that the marked growth in US drug abuse may have partially stemmed from the wider availability of illicit drugs on the internet [ ].The availability of telehealth through broadband internet is likely to reduce health disparities by connecting providers with individuals living in remote areas [
, , ]. Telehealth brings specialized health care to communities where it was previously unavailable [ , ]. Thus, having access to and the ability to use broadband internet services can affect major public health outcomes such as drug overdose deaths.Furthermore, access and usage data sets are critically important in building a full and accurate broadband internet map. Access data show current and future plans, while usage data help to understand how access translates into consumption. The aim of our study was to explore how broadband access and usage intersect with drug abuse by using access and usage data to elucidate the association of broadband internet with drug overdose mortality rates. In addition, given that in this time and age almost all counties have internet/mobile data plans in place, our study aimed to explore whether the emphasis should shift from broadband availability to actual usage, which is potentially the more relevant metric from a public health perspective.
Methods
Data Sources
Primary data for the study were obtained from three main sources: (1) 2019 county-level drug overdose death data from restricted-access multiple causes of death files available from the National Vital Statistics System (NVSS) at the US Centers for Disease Control and Prevention (CDC); (2) 2019 county-level broadband internet rollout data from the FCC; and (3) 2019 county-level broadband usage data available from Microsoft’s Airband Initiative. In addition, county-level socioeconomic and demographic characteristics were gathered from the US Census Bureau and US Bureau of Labor Statistics.
All drug overdose deaths were measured per 10,000 persons per year by county. Following the CDC and NVSS guidelines, we used the Tenth Revision of the International Classification of Diseases Clinical Modification codes X40-X44 (unintentional), X60-X64 (intentional), X85 (homicide), and Y10-Y14 (undetermined) to identify all drug overdose deaths.
Ethical Considerations
As this was a secondary data analysis, there was no requirement of approval from an institutional review board.
Statistical Analysis
Data analysis was performed using descriptive analysis and a cross-sectional regression analysis. In addition to examining the effects of broadband availability and usage on drug overdose deaths, we investigated how these effects vary based on different subpopulations and location characteristics.
The one-way fixed-effects regression equation used for this analysis was:
Yj = α0 + ∂BBj + βXj + δs + εs
where Yj is the outcome variable for county j. The BBj vector indicates the broadband internet availability and usage in a given county during 2019. Internet availability was measured as the percentage of people per county with access to fixed terrestrial broadband at minimum speeds of 25 Mbps/3 Mbps. Internet usage was measured as the percentage of people per county that use the internet at broadband speeds based on the methodology provided by Microsoft.
Microsoft estimates broadband usage by combining data from multiple Microsoft services. These data are combined with the number of households per county and zip code. While Microsoft suppresses any location with less than 20 devices in zip code–level data, this is not an issue for the county-level data used in our study. Every time a device receives an update or connects to a Microsoft service, Microsoft estimates the throughput speed of a machine. To calculate the broadband speed, they use the size of the package sent to the computer and the total time of the download. They determine the zip code–level location data via the reverse IP. Therefore, they can count the number of devices that have connected to the internet at broadband speed for each zip code based on the FCC’s definition of broadband, which is 25 Mbps per download. The zip code–level data were then aggregated to the county level. Microsoft’s data might be more representative in regions where its products are more widely used and less representative in regions where its products have lower penetration rates. Since Microsoft’s data primarily come from devices running Windows operating systems and services such as Bing, Edge browser, and Xbox, this might skew the data toward certain types of devices and services and may not capture the full spectrum of internet-connected devices or platforms.
The coefficient on these variables (∂) captures the direct effect of broadband availability and usage on the outcome. Xj is a vector of observed socioeconomic and demographic characteristics of county j and εs is the error term. State fixed effects eliminate the omitted variable bias that may result from the time-invariant differences between states. The analysis was performed using robust Huber-White standard errors to capture arbitrary within-county heteroscedasticity.
Results
The descriptive statistics showed that 1.71 drug overdose deaths occurred per 10,000 county population in 2019 in the United States. Although approximately 76.6% of people in a given county had access to broadband internet in 2019, only approximately 28% of people were using the internet at broadband speeds (
).Variable | Counties, n | Mean (SD) | |||
Outcome variables | |||||
Drug overdose deathsa | 3104 | 1.71 (1.48) | |||
Internet availability (% of county population with access to broadband internet) | 3104 | 76.627 (23.88) | |||
Internet usage (% of county population using internet at broadband speeds) | 3104 | 28.133 (19.027) | |||
Kidney deathsa | 3103 | 2.179 (1.721) | |||
Non-Hispanic White deathsa | 3104 | 1.917 (1.739) | |||
Non-Hispanic Black deathsa | 3093 | 2.718 (45.691) | |||
Non-Hispanic other deathsa | 3104 | 8.354 (35.53) | |||
Hispanic deathsa | 3104 | 0.844 (3.17) | |||
Deaths for those with less than high school educationa | 3104 | 2.889 (4.101) | |||
Deaths for those with some college educationa | 3104 | 4.173 (4.033) | |||
Deaths for those with college education or highera | 3103 | 0.486 (1.446) | |||
Male deathsa | 3104 | 2.165 (2.138) | |||
Female deathsa | 3104 | 1.264 (1.446) | |||
Deaths among those aged ≤19 yearsa | 3103 | 0.1 (0.447) | |||
Deaths among those aged 20-29 yearsa | 3103 | 2.205 (3.554) | |||
Deaths among those aged 30-39 yearsa | 3104 | 3.796 (5.117) | |||
Deaths among those age 40-49 yearsa | 3104 | 3.244 (4.866) | |||
Deaths among those aged 50-64 yearsa | 3104 | 2.39 (3.048) | |||
Deaths among those aged ≥65 yearsa | 3104 | 3.108 (12.245) | |||
Control variables | |||||
Percent county poverty | 3103 | 14.429 (5.772) | |||
Percent population with no health insurance | 3103 | 11.903 (5.108) | |||
Net migration (the number of immigrants minus the number of emigrants in the county) | 3104 | 192.543 (2937.949) | |||
Percent of county population with a college degree or higher | 3104 | 22.018 (9.566) | |||
Median household income (US $) | 3103 | 55,707.34 (14,456.62) | |||
Percent of county population that is unemployed | 3103 | 3.977 (1.41) | |||
Share of population aged 20-34 years | 3104 | 0.18 (0.037) | |||
Share of population aged 35-49 years | 3104 | 0.175 (0.019) | |||
Share of population aged 50-64 years | 3104 | 0.203 (0.024) | |||
Share of population aged ≥65 years | 3104 | 0.198 (0.047) | |||
Share of the female population | 3104 | 0.499 (0.022) | |||
Share of the Black population | 3104 | 0.094 (0.144) | |||
Share of the Hispanic population | 3104 | 0.097 (0.138) | |||
Share of the Asian population | 3104 | 0.015 (0.028) | |||
Counties with population of ≥50,000 (dummy variable) | 3104 | 0.319 (0.466) | |||
Metro counties (dummy variable) | 3104 | 0.374 (0.484) | |||
Adjacent to an urban area (dummy variable) | 3104 | 0.424 (0.494) | |||
Rural county (dummy variable) | 3104 | 0.201 (0.401) |
aMeasured per 10,000 of the total or specific subpopulation indicated.
The regression analysis results in
show that a 1% increase in broadband internet usage is significantly associated with a 1.2% increase in overall drug overdose deaths among the general population.Variables | Drug overdose (full sample) | Drug overdose in counties with a population over 50,000 | Drug overdose in counties with a population less than 50,000 | Kidney disease–related deaths (full sample) |
Internet usage, coefficient (robust SE) | 0.012 (0.002)b | 0.008 (0.004)c | 0.008 (0.003)d | 0.004 (0.003)e |
Internet availability | Yesf | Yes | Yes | Yes |
Socioeconomic variables | Yes | Yes | Yes | Yes |
Demographic variables | Yes | Yes | Yes | Yes |
State controls | Yes | Yes | Yes | Yes |
Robust standard errors | Yes | Yes | Yes | Yes |
Number of observations | 3103 | 990 | 2113 | 3103 |
Adjusted R2 | 0.296 | 0.456 | 0.232 | 0.214 |
aThe regression analysis includes the set of full control variables shown in
.bP<.001.
cP=.05.
dP=.007.
eP=.18.
fIndicates inclusion of the variable as a control in the regression model; coefficients for subpopulations and the full set of controls are provided in
.Splitting the sample into counties with a population more and less than 50,000 showed that the association result was primarily driven by the relationship between these variables in the less populated counties.
This association could result from the fact that the internet encourages greater consumption of drugs by making illegal drugs more accessible. Internet purchasing is more convenient and less risky because of anonymity. Furthermore, online drug sales could also be less risky for suppliers than offline sales. Thus, it is reasonable to expect broadband internet usage to improve market liquidity and spur both the demand and supply of illicit drugs. If this is the case, we would expect no significant association between broadband internet and mortality rates from chronic conditions. To test our assumption, we considered mortality rates associated with kidney disease, which is a chronic condition and should not be associated with internet availability. There was no association between internet availability/usage rates and kidney disease–related mortality rates (
).Further analysis revealed that different subpopulations are disproportionately affected by the associations between internet usage and drug-related deaths (see
). More specifically, shows that a 1% increase in internet usage is associated with a 1.1% increase in drug overdose deaths among the non-Hispanic White population, a 1.2% increase among the Hispanic population, a 1.4% increase among the male population, and a 1% increase among the female population. There appears to be no statistically significant association for the Non-Hispanic Black population, although the coefficient’s SE is wide for this population because of the small sample size. Additionally, a 1% increase in broadband internet usage was significantly associated with a 1.7% increase in drug overdose deaths among those aged 20-29 years, a 2.2% increase among those aged 30-39 years, a 2% increase among those aged 40-49 years, a 1.9% increase among those aged 50-64 years, and a 4.3% increase among those 65 years and older compared with those 19 years and younger.Discussion
Principal Findings
The findings of this study show that increased usage of broadband internet is positively and significantly associated with increased drug overdose deaths in the general US population as well as in several subpopulation categories, with the largest increase observed among the population 65 years and older compared with those 19 years and younger.
Our approach is novel in carefully distinguishing two different existing definitions of “broadband internet access” that are critical for studying its equity and potential impact on individual and community health outcomes: (1) its physical availability to individuals and communities (broadband availability) and (2) its adoption and effective use by those individuals and communities (broadband usage) [
, , ]. Although no previous studies have examined the link between broadband internet usage and drug overdose deaths to our knowledge, there have been a few studies examining the link between drug abuse and the internet using the rollout of Craigslist [ ], broadband internet subscription rates and opioid prescribing via telemedicine during COVID-19 [ ], broadband internet and youth mental health [ ], and broadband internet access and treatment admissions to substance use programs [ ].Specifically, one of the earliest studies examining the link between broadband internet access and drug abuse found that every 10% increase in the number of residential high-speed internet lines per capita at the state level was associated with a 1% increase in admissions to treatment programs for substance abuse [
]. Another study, using the phased rollout of Craigslist, a major web-based platform, found that Craigslist’s entry was associated with a 14.9% increase in drug abuse treatment admissions, a 5.7% increase in drug abuse violations, and a 6.0% increase in drug overdose deaths in the United States [ ]. Although different in magnitude, these previous findings are in line with the results of this study, especially in terms of the direction of the effects of the internet on the health outcomes examined. Other researchers examining the link between broadband internet and youth mental health found similar directional effects of internet access. In particular, access to high-speed internet resulted in an increase in diagnoses of depression, anxiety, drug abuse, and personality disorders for the younger cohorts of both males and females but not for the older cohort [ ]. In contrast, Oyler et al [ ] found that broadband subscription rates (low and high) did not affect opioid prescriptions dispensed in Kentucky counties during the time period of Executive Order 2020-243 issued by the state’s governor on March 22, 2020, which limited nonurgent medical procedures in Kentucky to conserve personal protective equipment and medical supplies for patients with COVID-19. These findings suggest that access to broadband internet may not affect legal prescriptions of opioids. Despite the heterogeneity, if taken together with previous research, our findings suggest that broadband internet usage may be contributing to the drug epidemic in the United States.Strengths and Limitations
We should acknowledge that our measure of broadband internet availability does not include internet access via mobile phones. Unfortunately, these data are currently not available; thus, our estimation of the effect of broadband availability would be an underestimation. To obtain information on internet access via mobile use, we downloaded the American Community Survey (ACS) census data for 2021 and 2022, which were the two most recent years (along with 2016) with data available on two relevant questions. The first question was whether or not someone in the household uses or connects to the internet, regardless of whether or not they pay for the service. The second was whether or not anyone in the household has a data plan for a smartphone or other mobile device. Since the ACS does not provide the county Federal Information Processing Standard (FIPS) code for all observations, we could only identify the county FIPS codes for a subset of the respondents and only data for 2022 included FIPS codes for rural counties. Using the Economic Research Service–US Department of Agriculture rural-urban continuum codes [
] to classify rural counties, we found that 94.30% (n=21,733) of households in rural counties and 95.37% (n=1,897,961) in metro and urban counties had a household member with a data plan. Using the same sample and definition of rural, we also found that 97.22% (n=22,657) of households in rural counties and 96.71% (n=1,999,196) of households in metro and urban counties had a household member that uses or connects to the internet. Thus, the use of data plans and internet connection in rural areas is very similar to those in metro and urban areas. Another limitation is that we do not have data for a longitudinal study that could provide opportunities for examining causal relationships.These limitations notwithstanding, the findings of this study underscore the importance of curbing illegal drug sales via web-based pharmacies and social networks. In addition, it is important for the Food and Drug Administration to monitor the shipping of medications to the United States from other countries. The results of this study emphasize the importance of tracking prescription drug use and sales on web-based platforms to better understand the amount and the types of transactions of prescription drugs taking place on these platforms and the role these platforms play in prescription drug abuse in the United States.
Finally, we have included controls in the regression model that mediate the association between internet connectivity and overdose rates, such as the percentage of uninsured population in a county, which, as expected, was negatively associated with overdose rates although not significantly. Even though determining the mediating effects of such variables was not within the scope of this study, research on the mediating effects of insurance availability, distance from medical resources, and other factors may be an important area for future research.
Conclusions
Broadband internet usage is positively associated with increased drug overdose deaths among the overall US population and some subpopulations, even after controlling for broadband availability, sociodemographic characteristics, unemployment, and median household income. These findings merit further investigation and can assist in policy shaping and thoughtful resource allocation to susceptible populations, especially in areas with recently improved broadband internet access.
Authors' Contributions
GK and VZH had full access to all the data in the study. These authors take full responsibility for the accuracy and integrity of the data and the analysis. IK and KT contributed substantially in writing the manuscript and interpreting the findings. All authors contributed to study concept and design; acquisition, analysis, or interpretation of data; and drafting of the manuscript. IK and KT critically reviewed the manuscript for important intellectual content. GK and VZH performed the statistical analysis.
Conflicts of Interest
None declared.
Table S1: Associations between broadband internet usage and drug and overdose deaths; Table S2: Associations between broadband internet usage and drug and overdose deaths with coefficients for the full set of controls; Table S3: Associations between broadband internet usage and drug overdose deaths for different subpopulations with coefficients for the full set of controls.
DOCX File , 34 KBReferences
- Ahmad F, Rossen LP. Provisional drug overdose death counts. Centers for Disease Control and Prevention. National Center for Health Statistics. URL: https://www.cdc.gov/nchs/nvss/vsrr/drug-overdose-data.htm [accessed 2021-10-06]
- Drug overdose death rates. National Institute on Drug Abuse. URL: https://www.drugabuse.gov/drug-topics/trends-statistics/overdose-death-rates [accessed 2021-09-09]
- Hanebutt R, Mohyuddin H. The digital domain: a "super" social determinant of health. Prim Care. Dec 2023;50(4):657-670. [CrossRef] [Medline]
- Turcios Y. Digital access: a super determinant of health. Substance Abuse and Mental Health Services Administration. Mar 22, 2023. URL: https://www.samhsa.gov/blog/digital-access-super-determinant-health#1 [accessed 2024-06-07]
- Benda NC, Veinot TC, Sieck CJ, Ancker JS. Broadband internet access is a social determinant of health! Am J Public Health. Aug 2020;110(8):1123-1125. [CrossRef] [Medline]
- Bauerly BC, McCord RF, Hulkower R, Pepin D. Broadband access as a public health issue: the role of law in expanding broadband access and connecting underserved communities for better health outcomes. J Law Med Ethics. Jun 2019;47(2_suppl):39-42. [FREE Full text] [CrossRef] [Medline]
- Katz M. Equitable access to healthcare starts with affordable broadband for all. Forbes. 2021. URL: https://www.forbes.com/sites/tmobile/2021/03/30/equitable-access-to-healthcare-starts-with-affordable-broadband-for-all/?sh=72e4c14c66c3 [accessed 2021-10-06]
- Sieck CJ, Sheon A, Ancker JS, Castek J, Callahan B, Siefer A. Digital inclusion as a social determinant of health. NPJ Digit Med. Mar 17, 2021;4(1):52. [CrossRef] [Medline]
- Internet, broadband fact sheet. Pew Research Center. URL: https://www.pewresearch.org/internet/fact-sheet/internet-broadband/#who-has-home-broadband [accessed 2024-06-07]
- Kim H, Mahmood A, Goldsmith JV, Chang H, Kedia S, Chang CF. Access to broadband internet and its utilization for health information seeking and health communication among informal caregivers in the United States. J Med Syst. Jan 15, 2021;45(2):24. [CrossRef] [Medline]
- O'Shea AMJ, Howren MB, Mulligan K, Haraldsson B, Shahnazi A, Kaboli PJ. Quantifying the digital divide: associations of broadband internet with tele-mental health access before and during the COVID-19 pandemic. J Gen Intern Med. Jul 2023;38(Suppl 3):832-840. [FREE Full text] [CrossRef] [Medline]
- Ramesh T, McBain RK, Cantor JH, Stein BD, Yu H. Mental health outcomes among patients living in US counties lacking broadband access and psychiatrists. JAMA Netw Open. Sep 05, 2023;6(9):e2333781. [FREE Full text] [CrossRef] [Medline]
- Doris Á. Exploring the direct link between drug abuse and the internet. Emory Business. 2020. URL: https://www.emorybusiness.com/2020/11/06/exploring-the-direct-link-between-drug-abuse-and-the-internet/ [accessed 2024-06-07]
- DiNardi M, Guldi M, Simon D. Body weight and internet access: evidence from the rollout of broadband providers. J Popul Econ. Jun 27, 2018;32(3):877-913. [CrossRef]
- Liu J, Bharadwaj A. Drug abuse and the internet: evidence from Craigslist. Manage Sci. May 2020;66(5):2040-2049. [CrossRef]
- Kaushal M, Patel K, Darling M, Samuels K, McClellan M. Closing the rural health connectivity gap: how broadband funding can better improve care. Health Affairs. 2015. URL: https://www.healthaffairs.org/do/10.1377/hblog20150401.045856/full/ [accessed 2021-10-06]
- Huffman A. Broadband: the critical infrastructure for delivery of today's health care. N C Med J. 2018;79(6):383-384. [CrossRef] [Medline]
- Hser Y, Mooney LJ. Integrating telemedicine for medication treatment for opioid use disorder in rural primary care: beyond the COVID pandemic. J Rural Health. Jan 2021;37(1):246-248. [FREE Full text] [CrossRef] [Medline]
- Fourteenth Broadband Deployment Report. Federal Communications Commission. URL: https://docs.fcc.gov/public/attachments/FCC-21-18A1.pdf [accessed 2021-10-09]
- Kajan J. It's time for a new approach for mapping broadband data to better serve Americans. Microsoft on the Issues. 2019. URL: https://blogs.microsoft.com/on-the-issues/2019/04/08/its-time-for-a-new-approach-for-mapping-broadband-data-to-better-serve-americans/ [accessed 2021-10-09]
- Oyler DR, Slavova S, Freeman PR, Huang Z, Talbert J, Walsh SL, et al. Broadband internet subscription rates and opioid prescribing via telemedicine during the COVID-19 pandemic. J Rural Health. Sep 2022;38(4):900-907. [FREE Full text] [CrossRef] [Medline]
- Donati D, Durante R, Sobbrio F, Zejcirovic D. Lost in the net? Broadband internet and youth mental health. IZA DP No. 15202. IZA Institute of Labor and Economics. Mar 2022. URL: https://www.iza.org/publications/dp/15202/lost-in-the-net-broadband-internet-and-youth-mental-health [accessed 2024-06-07]
- Jena AB, Goldman DP. Growing internet use may help explain the rise in prescription drug abuse in the United States. Health Aff. Jun 2011;30(6):1192-1199. [FREE Full text] [CrossRef] [Medline]
- Rural-Urban Continuum Codes. Economic Research Service-US Department of Agriculture. URL: https://www.ers.usda.gov/data-products/rural-urban-continuum-codes/ [accessed 2024-06-07]
Abbreviations
ACS: American Community Survey |
CDC: Centers for Disease Control and Prevention |
FCC: Federal Communications Commission |
FIPS: Federal Information Processing Standard |
NVSS: National Vital Statistics System |
Edited by E Mensah; submitted 12.09.23; peer-reviewed by N Cesare, C Baxter; comments to author 10.02.24; revised version received 27.04.24; accepted 23.05.24; published 26.06.24.
Copyright©Ioannis Karakis, Genti Kostandini, Konstantinos Tsamakis, Velma Zahirovic-Herbert. Originally published in the Online Journal of Public Health Informatics (https://ojphi.jmir.org/), 26.06.2024.
This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in the Online Journal of Public Health Informatics, is properly cited. The complete bibliographic information, a link to the original publication on https://ojphi.jmir.org/, as well as this copyright and license information must be included.