Skip to main content
  • Research Article
  • Open access
  • Published:

Vaccination as an alternative to non-drug interventions to prevent local resurgence of COVID-19

Abstract

Background

While a COVID-19 vaccine protects people from serious illness and death, it remains a concern when and how to lift the high-cost and strict non-pharmaceutical interventions (NPIs). This study examined the joint effect of vaccine coverage and NPIs on the control of local and sporadic resurgence of COVID-19 cases.

Methods

Between July 2021 and January 2022, we collected the large-scale testing information and case number of imported COVID-19 patients from the website of the National Health Commission of China. A compartment model was developed to identify the level of vaccine coverage that would allow safe relaxation of NPIs, and vaccination strategies that can best achieve this level of coverage. We applied Monte Carlo simulation 50 000 times to remove random fluctuation effects and obtain fitted/predicted epidemic curve based on various parameters with 95% confidence interval at each time point.

Results

We found that a vaccination coverage of 50.4% was needed for the safe relaxation of NPIs, if the vaccine effectiveness was 79.3%. The total number of incidence cases under the key groups firstly strategy was 103 times higher than that of accelerated vaccination strategy. It needed 35 months to fully relax NPIs if the key groups firstly strategy was implemented, and 27 months were needed with the accelerated vaccination strategy. If combined the two strategies, only 8 months are needed to achieve the vaccine coverage threshold for the fully relaxation of NPIs. Sensitivity analyses results shown that the higher the transmission rate of the virus and the lower annual vaccine supply, the more difficult the epidemic could be under control. When the transmission rate increased 25% or the vaccination effectiveness rate decreased 20%, 33 months were needed to reduce the number of total incidence cases below 1000.

Conclusions

As vaccine coverage improves, the NPIs can be gradually relaxed. Until that threshold is reached, however, strict NPIs are still needed to control the epidemic. The more transmissible SARS-CoV-2 variant led to higher resurgence probability, which indicates the importance of accelerated vaccination and achieving the vaccine coverage earlier.

Graphical Abstract

Background

On March 11, 2020, the World Health Organization (WHO) characterized Coronavirus disease 2019 (COVID-19) as a pandemic [1]. As of 25 February 2022, 228 countries/regions have reported at least one case of COVID-19 infection [2]. Due to the lack of effective drugs and vaccines at that time, non-pharmaceutical interventions (NPIs) played a significant early role in control of the COVID-19 outbreak in China and other countries [3,4,5,6]. However, long-term and strict NPIs can lead to significant economic and social costs, and new infections could emerge if they are relaxed too early [7,8,9].

COVID-19 was under control in China at the end of March 2020, but China faced a new challenge of re-contamination due to close contact with foreign visitors because of increased travel to China [10, 11]. The National Health Commission of China recommended that foreign personnel should be subject to nucleic acid testing and centralized quarantine or household quarantine for 14 days upon entry. They also recommended that foreigners with confirmed or suspected COVID-19 identified in local customs quarantine should receive treatment in designated hospitals [12]. However, from the end of March 2020 there were some sporadic and local outbreaks in the regions of Suifenhe, Harbin [13], Shulan [14], Beijing [15], Urumqi [16], Dalian [16], Qingdao [17], Kashgar, Chengdu [18], and Shanghai [19]. Some of these outbreaks were related to imported cases [20, 21] and others to cold-chain foods [22, 23]. Quarantine, treatment of confirmed cases, comprehensive close contact tracking, large-scale nucleic acid detection, and community lockdown are NPIs that have greatly prevented COVID-19 transmission and helped to control local outbreaks [24,25,26,27,28]. Although these measures are effective, they are also costly and disruptive [29].

An effective vaccine is considered the key for preventing further morbidity and mortality from COVID-19 [30]. As of May 28, 2021, there were 184 vaccine candidates in pre-clinical development, and 102 candidate vaccines currently undergoing clinical trials worldwide [31]. By the end of 2021, the total global production capacity of the 12 currently approved COVID-19 vaccines was estimated to reach about 10 billion doses [32]. As of December 31, 2020, 14 COVID-19 vaccines developed in China were undergoing clinical trials, including 5 in phase III trials. The National Medical Products Administration granted conditional approval for first COVID-19 vaccine in China on December 30, 2020 [33]. China now provides COVID-19 vaccines free-of-charge to all populations [34]. The vaccination strategy of China gives priority to those with high risk (including doctors and individuals engaged in the import of cold chain foods, public transportation, etc.), followed by eligible members of the general population [35]. China had a production capacity of 610 million doses in 2020 and was projected to produce at least one billion doses by the end of 2021 [36]. However, China’s large and heterogeneous population has made it difficult to achieve herd immunity in a short time. Thus, NPIs are still important for the prevention and control of imported COVID-19 cases and local outbreaks.

There were several studies that analyzed the joint effects of vaccines and NPIs in controlling the pandemic [37,38,39,40]. Before sufficient effective vaccine coverage reached, relaxation of NPIs would cause a new wave of infections. However, most of the current studies focused on the scenario that there had been a COVID-19 outbreak or epidemic, and none have assessed the impact of vaccination and NPIs in avoiding a resurgence in a city or country. In addition, few studies have considered the impact of variants due to increased transmissibility and attenuated effectiveness of vaccine in models [37, 39].

In this study, we developed a compartment model to determine the role of vaccination and NPIs on avoiding COVID-19 resurgence at the city level. We focused on the relationship of vaccine coverage with the timing and conditions of the relaxation of different NPIs.

Methods

A model of SARS-CoV-2 transmission, with the population of a city stratified into six compartments, was developed (Fig. 1). The model city had a population size similar to Beijing and demographics similar to the general population of China, although the results are generalizable to other populations. The model assumed that vaccine-induced immunity lasted at least 2 years (model time horizon).

Fig. 1
figure 1

The BSIQDRS model. We extended the classic SIRS model to include six compartments: susceptible (S), adverse reactions (B), infectious (I), quarantined cases (Q), removed (R), and deaths due to COVID-19 (D). Each compartment attached an equation in the model

Data collection

Non-pharmaceutical interventions (NPIs) refer specifically to government interventions to control the spread of COVID-19 that do not use drugs, such as school closures, masks and large-scale nucleic acid testing [41]. Large-scale test data were from the website of the National Health Commission (http://www.nhc.gov.cn/), which had data on sporadic cases in Beijing [42], Dalian [43], Qingdao [17], Chengdu [18], and Shanghai [19]. These data were averaged as the estimation of sporadic cases in the model.

The compartmental model

The model analyzed a population stratified into six compartments by extension of the classic SIRS model [44] to a BSIQDRS model (Fig. 1). The BSIQDRS model is an abbreviation for each compartment in the model, and each letter in the name of BSIQDRS model represents the corresponding compartment. This model incorporates three additional compartments to account for individuals with adverse reactions (B), quarantined cases (Q) and deaths due to COVID-19(D) (where S: susceptible people, I: infected people, R: recovered people, and N: total population (S + I + Q + R)). Dynamics of these compartments across time t was described in Fig. 1. The differential equations of dynamic model as following.

$$\frac{dS}{dt}=-\frac{\beta SI}{N}-eV+\sigma R$$
$$\frac{dI}{dt}=\frac{\beta SI}{N}-hI-{\gamma }_{1}I-{d}_{1}I+C\frac{dA}{dt}$$
$$\frac{dQ}{dt}=hI-{\gamma }_{2}Q-{d}_{2}Q$$
$$\frac{dR}{dt}={\gamma }_{1}I+{\gamma }_{2}Q+eV-\sigma R$$
$$\frac{dB}{dt}=bV$$
$$\frac{dD}{dt}={d}_{1}I+{d}_{2}Q$$

In addition, a represented a Poisson process to simulate sporadic non-local COVID-19 arrival time with a parameter C (number of patients selected randomly from a discrete uniform distribution for each time). Furthermore, β was the transmission rate of COVID-19 cases, defined as the average number of individuals that a case can infect per day [11], V was the daily vaccination number, e was the vaccine effectiveness, \({\upsigma }^{-1}\) was the immunity duration, h was the rate of an infectious cases to isolated cases (\({h}^{-1}\): actual infectious period), \({\gamma }_{1}^{-1}\) and \({\gamma }_{2}^{-1}\) were the rates of patients recovered, d1 and d2 were case fatality rates, and b was the adverse reaction rate. Additionally, β was a time-varying coefficient which was simulated as the quotient of randomly selected basic reproduction number and mean infectious period without quarantine. Parameters e, V, σ, h, γ1, γ2, d1, d2 and b were time-varying coefficients (fixed constant with 10% perturbation).

Monte Carlo simulations

In this study, we made efforts to do numerical analysis on infectious disease stochastic modelling. In addition, since stochastic process were included in the model and most of parameters were time-varying and time-dependent, we applied Monte Carlo simulations 50 000 times to remove random fluctuation effects and obtain fitted/predicted epidemic curve based on various parameters with 95% confidence interval (95% CI) at each time point.

Parameter settings and initial states

Parameter settings for the main analysis were summarized in Additional file 1: Table S1. The BSIQDRS infectious disease stochastic model was used to simulate three-year results in this study. We set β = R0/τ according to [45, 46], where R0 was basic reproduction number which varied around 2.5 [47, 48]. τ was mean infectious time, with an estimated 9 days according to previous papers reported [49, 50]. We set vaccine effectiveness e = 0.7934 according to the results of phase III clinical trials of the vaccine in China [51, 52]. The transmission rate of the population reduced to 0 as they effectively protected by vaccination. β (or R0) was still the initial value, for those who were not vaccinated or who were vaccinated but not effectively protected. We set up two vaccination scenarios. In addition, this study assumed that 10% of the people in the city were the key population (held higher chance to contact foreign imported patients and had higher transmission rate). We compared simulation results based on key group vaccinated firstly with slow situations in this article. We assumed that vaccine-induced immunity last for around two years (our time horizon), thus the σ equal to 1/730. h was the rate for an infectious cases becoming isolation (mean detection time, MDT), which refers to both pharmacological and NPIs, including but not limited to large-scale nucleic acid testing, which can reduce the detection time of patients. We used h to represent intensity of the NPIs. The average incubation period of COVID-19 is around 5.18 days [53] Since COVID-19 can hardly be detected in the first several days until onset [48], we assumed that the most stringent NPIs were detected on day 5, with a mean detection time, \({h}^{-1}\) of 5 days. Additionally, the average duration from symptom onset to isolation was 4.1 ± 3.7 days [54], and thus, the largest mean detection time, h, should be around 10 days. We assumed that infected cases in this city would recover 14 days after infections, and \({\gamma }_{1}^{-1}\) and \({\gamma }_{2}^{-1}\) were 14. We assumed the infectious cases and the quarantined cases shared the same case fatality rate in this city, and we set d1 and d2 = 0.005/21, which were similar to the city like Shanghai [19], Beijing [42] and Qingdao [17]. A was represented as a Poisson process to simulate sporadic foreign imported COVID-19 arrival times with a parameter C, which is the number of patients selected randomly from a discrete uniform distribution (1–7 patients) each time. We assumed the frequency of sporadic cases in this city is similar to that in Beijing, China, which was around 5 times from September to December, 2020 in 120 days.

Estimated scenarios in which vaccines can replace current NPIs

The stochastic simulations described above were used to estimate the daily number of infected cases, death rate, and probability of resurgence under different scenarios. First, vaccine coverage was assumed to range from 0 to 60% of the total population in 5% increments (the proportion in compartment R). In this analysis, b represented the daily vaccination rate, assuming that after a certain vaccination coverage is reached, the rate of vaccination is consistent with the rate of vaccine failure. Second, to model different levels of nucleic acid detection, we used mean detection time (h−1) to represent the intensity of nucleic acid detection, and defined h−1 as the actual infectious period. It was assumed that h−1 varied from 5 to 10 days in 0.5 day increments; an h−1 of 5 days meant that the person was identified and isolated on the first day of symptom onset [48]. An individual is infectious during the four days before symptom onset, but nucleic acid testing is insufficiently sensitive during this time due to the low viral titer, and it represents the NPIs were not rigorous when h−1 was 10 days. There were 143 combinations of parameters and each combination runs Monte Carlo simulation for 50 000 times.

Predicting the risk of resurgence after cessation of NPIs

The risks of halting NPIs on the probability of resurgence, daily number of infections, and the number of deaths were determined. This included relaxing all NPIs at t days after the first day of vaccination. Time to resurgence was defined as the number of days from lifting controls to when the number of active cases above seven patients in some day (detailed sensitivity analysis for resurgence threshold can be seen in Additional file 1: Fig. S1). It was assumed necessary to consider NPIs and vaccination rates when the resurgence probability exceeded 20%.

We performed Monte Carlo simulations for 50 000 times with different parameter combinations. The probability of resurgence was the proportion of simulations in which a resurgence occurred, and we simulated the following three years from the day of vaccination. Several vaccination scenarios were considered. First, it was assumed that 5 million doses of vaccines were available every year, and the city could choose to vaccinate high-risk individuals or to vaccinate everyone (no priorities). Second, it was assumed the government could provide 16 million vaccine doses in the first year and 2 million doses in each subsequent year, and the city could choose to vaccinate high-risk individuals or to vaccinate everyone (no priorities). Then, these two plans were combined to create four different vaccination scenarios. The slow vaccination plan was that the city had an annual supply of 5 million vaccine doses and the city chose to vaccinate everyone (no priorities). High-risk individuals were workers may be exposed to dangerous occupation of COVID-19, such as workers in the Centers for Disease Control and Prevention (CDC), hospital workers, delivery workers, cold food chain workers, and so on. This study assumed high-risk individuals accounted for 10% of the total population of the city.

Sensitivity analyses for the real data

We designed five sensitivity analyses to test the robustness of our results from real data. For each of the sensitivity analyses, we fixed parameters and initial states to be the same as the main analysis except for those mentioned below. According to COVID-19 Weekly Epidemiological Update Reports Edition 43, published 8 June 2021 of World Health Organization (WHO) [55], some variants of SARS-CoV-2 have resulted in changes in transmissibility, for instance, Alpha (B.1.1.7) variant first detected in United Kingdom may increase 45–71% transmissibility, Beta (B.1.351) variant first detected in South Africa may increase 50% transmissibility, and the transmissibility of Gamma (P.1) variant which first detected in Brazil may be 1.4–2.2 times as the original transmissibility of SARS-CoV-2. Therefore, for analysis (S1), we set different scenarios of transmission rate of SARS-CoV-2 under the slow vaccination strategy. The different cases of transmission rate settings are assumed to be how many times the transmission rate is increased from the original basis, respectively 0, 25, 50, 75 and 100%. For analysis (S2), we set the different total number of vaccinations scenarios per year: 3 million, 4 million, 5 million, 6 million, 7 million. For analysis (S3), effective vaccine rate was assumed to range from 60 to 100% of the total population in 10% increments. For analysis (S4), we set different vaccination effectiveness times scenarios: 1 year, 1.5, 2, 2.5, 3 years (2 years was our baseline scenario in the main analysis). For analysis (S5), we assume this city have 30, 60, 90, 120, 150 sporadic foreign imported COVID-19 cases per year (60 sporadic foreign imported COVID-19 cases per year was our baseline scenario in the main analysis).

Results

Scenarios in which vaccines can lead to relaxation of NPIs

We assumed the mean detection time was 5 days and the vaccination rate was 0% (strictest NPIs without vaccination) as a basic scenario because of the low probability of an outbreak (resurgence probability: 51%, Fig. 2a). This meant that when the vaccine introduced in this scenario, we can relax the NPIs gradually. If the vaccination rate was 10% (vaccine coverage: 12.6%), prolonging the detection time to 5.5 days led to the same outcome. The same outcome also occurred if the vaccination rate was 20% (vaccine coverage: 25.2%) and the detection time was more than 6.5 days; if the vaccination rate was 30% (vaccine coverage: 37.8%) and the detection time was more than 8 days; and if the vaccination rate was 40% (vaccine coverage: 50.4%) and the detection time was more than 10 days. Thus, when vaccine coverage reaches 50.4%, no matter whether the large-scale detection was strict or not, we can obtain the same effect of basis scenario (because we can prolong the detection time to longest 10 days), which means we can fully lift the NPIs.

Fig. 2
figure 2

Joint effects of NPIs and vaccination on resurgence probability (a), daily infections (b), and total deaths (c). For each plot, each row represents a different NPIs intensity (mean detection time) and each column represents effective vaccination coverage (percentage of the total population to be vaccinated multiply vaccine effective rate). Colors represent the probability of resurgence / maximum daily infected number / total death number, ranging from 0 (white) to 100%/106/105 (blue)

During the two-year simulation period, nder the same intervention intensity, the probability of resurgence declined as vaccine coverage increased. When effective vaccination coverage was 40–60%, the probability of resurgence was low regardless of the extent of detection. When effective vaccination coverage was 40%, NPIs could be relaxed (i.e., mean time interval from infection to isolation was longer), and the resurgence probability was the same as when there were strict NPIs without vaccination (resurgence probability: 51%). Strict NPIs were still needed when the vaccine coverage was 10–30%. If there was no vaccine, there was a high probability of resurgence if NPIs were relaxed. We observed the same trends in terms of maximum daily infected cases and deaths (Fig. 2b, c). In particular, when effective vaccine coverage was less than 40%, the daily number of infected cases and deaths increased exponentially as the NPIs were relaxed; when 40% of the population was vaccinated (vaccine coverage: 50.4%), NPIs may be safely relaxed.

Predicting the risk of resurgence after relaxation of NPIs

We assessed the effect of relaxing NPIs under no prior vaccination strategy (Fig. 3a) and high-risk population first vaccination strategy (Fig. 3b) on resurgence probability, daily infections, and the total number of deaths when there were 5 million vaccine doses per year. Under these scenarios, with the most relaxed NPIs (MDT = 10) and regardless of vaccination strategy, there was a high initial probability of resurgence and this continued over time. For the vaccination strategy with no prioritized individuals, a continuing relaxation of NPIs, and a continuous increase of vaccination, the probability of resurgence was still high. Only after 27 months, when vaccination coverage reached 26.1%, was there a decline in the probability of resurgence (Fig. 3a). When high-risk individuals had priority for vaccination, this time could be shorter, and the effect of the vaccine was evident after 21 months when the NPIs were most relaxed (Fig. 3b). If NPIs were in place (MDT = 5/7/8) at the time of vaccination, the probability of resurgence, the number of infections, and the number of deaths decreased in the early stage. Moreover, stricter interventions led to a sharper decline. After the third year of vaccination, the most relaxed NPIs (MDT = 10) was also associated with a probability of resurgence that was less than 20%.

Fig. 3
figure 3

Effect of relaxing NPIs under no priority vaccination strategy a and high-risk population first vaccination strategy b on resurgence probability, daily infections, and total deaths when there were 5 million vaccine doses per year. Colors represent different NPIs intensity (mean detection time), ranging from 5 (purple, “baseline”) to 10 (red). For each plot, each row represents the date to lift NPIs (months, from the day of vaccination) and each column represents resurgence probability, daily infections, and total deaths. The line represents resurgence probability, daily infections, and total deaths when lifting NPIs, the shaded area represents averaged results of MC simulations with 95% confidence interval

We also assessed the effect of relaxing NPIs under ‘no priority vaccination strategy (Fig. 4a) and high-risk population first vaccination strategy (Fig. 4b) on resurgence probability, daily infections, and total deaths when there were 16 million vaccine doses in the first year and 2 million doses in the following two years. In these cases, even if when the MDT was 10 days, the probability of resurgence gradually declined, and the effect of vaccination appeared during the first month (Fig. 4a, b). In addition, for the same intervention intensity, the risk of resurgence is lower for the high-risk population first vaccination strategy than for the no priority vaccination strategy. With sufficient vaccine supply, high-risk population first vaccination strategy was more effective to reduce the resurgence probability at the early stage, even with the greatest relaxation of NPIs. For high-risk population first vaccination strategy, after 9 months, the risk of resurgence was less than 20% (Fig. 4b). If slightly intensified NPIs were implemented at this time, the epidemic was controlled (Fig. 4b).

Fig. 4
figure 4

Effect of relaxing NPIs under no priority vaccination strategy a and high-risk population first vaccination strategy b on resurgence probability, daily infections, and total deaths when there were 16 million vaccine doses during the first year. Colors represent different NPIs intensity (mean detection time), ranging from 5 (purple, “baseline”) to 10 (red). For each plot, each row represents the date to lift NPIs (months, from the day of vaccination) and each column represents resurgence probability, daily infections, and total deaths. The line represents resurgence probability, daily infections, and total deaths when lifting NPIs, the shaded area represents averaged results of MC simulations with 95% confidence interval

We then compared the effects of multiple strategies (Fig. 5). During the first 21 months, there were far fewer COVID-19 cases in the accelerated vaccination scenario than the slow vaccination scenario, the decline percentage were nearly 100% (Fig. 5a). This indicated that the impact of rapid mass vaccination was very significant. We also determined the effect of prioritizing vaccines for high-risk individuals when 5 million doses were available (Fig. 5b), the number of COVID-19 cases was reduced by about 60% over three years These results indicated that, the targeting of COVID-19 vaccinations provides an important benefit. Finally, prioritizing COVID-19 vaccinations for high-risk individuals and accelerating vaccination led to a very dramatic decline in total incidence (Fig. 5c). We then assessed that how long can we lift all NPIs (Fig. 5.d). We estimated that 8 months are needed to achieve the vaccine coverage threshold for the full relaxation of NPIs in the combination strategy of accelerated vaccination and key groups firstly. However, if we conduct a slow vaccination strategy, NPIs would not be fully liberalized in three years (Fig. 5.d).

Fig. 5
figure 5

Comparison of different vaccination strategies. For each plot, each row represents the date to lift NPIs (months, from the day of vaccination) and each column represents total incidence number ac, and different NPIs intensity (d). Colors represent different vaccination strategies. The dashed line in a, b and c represents the decline percentage (%) between two strategies

Sensitivity analyses

We performed a series of sensitivity analyses to test the robustness of our results by varying the transmission rate, the number of vaccinations per year, the vaccination effectiveness rate, the lengths of vaccination effective time and the imported patients per year. Sensitivity analyses results shown that the total incidence number were negatively correlated with the vaccination number per year, vaccination effectiveness rate, the specified vaccination effective time, while the total incidence number were positively correlated with the number of imported patients per year, and transmission rate (Fig. 6.). If the transmission rate of the virus increased by 25%, the total number of the incidence cases was 750 times than that of the baseline transmission rate, and it would take an additional 30 months to reduce the incidence cases less than 1000 (Fig. 6a). When the vaccine supply reaches 7 million doses per year, the total incidence number is significantly less than that when the vaccine supply is 3 million doses per year, and 32.9% patients can be reduced in three years in that scenario (Fig. 6b). In addition, we found that vaccination effectiveness rate and vaccine duration had less impact on the total number of cases compared to the number of vaccinations (Fig. 6c, d). Imported patients had few influences on the total number of patients (Fig. 6e). With the increasing of vaccination number per year, effective vaccination rate and the vaccination effectiveness time, the resurgence probability decreased (Additional file 1: Fig. S2).

Fig. 6
figure 6

Sensitivity analyses on transmission rate (a), vaccination number per year (b), vaccination effectiveness rate (c), vaccination effectiveness time d and imported patients per year (e). For each plot, each row represents the date to lift NPIs (months, from the day of vaccination) and each column represents total incidence number. Colors represent different scenarios of every parameter. Horizontal dotted line in each plot represents the threshold of total incidence number (1000 cases)

Discussion

The major result of this modeling study is that gradual relaxation of NPIs, such as large-scale detection and quarantine, would be safe as vaccine coverage increased. In particular, for the transmission of wild strain in a city with a population of 20 million, NPIs can be relaxed when vaccine coverage reaches 50.42%. The outcomes will be improved if the vaccination strategy was accelerated or high-risk groups were given priority.

Consistent with previous studies [37, 38, 40], our results suggested that the relaxation of NPIs before establishment of sufficient immunity increased the probability of COVID-19 resurgence (maximum daily infected cases and the number of deaths). In particular, our model indicated that if vaccine effectiveness was 79.3%, vaccine coverage must be 50.4% before NPIs can be fully relaxed, and when coverage reached 75.6%, resurgence was very unlikely. The vaccination coverage threshold 50.4% was estimated based on the transmissibility of the wild strain and the vaccine efficacy against wild strain infection. The presence of many mutations in the SARS-CoV-2 spike (S) protein region of the Omicron (B.1.1.529) variant has led to a high rate of transmission and decreased disease severity after the Alpha (B.1.1.7), Beta (B.1.351), Gamma (P.1), and Delta (B.1.617), the protection from existed COVID-19 vaccines seems to be attenuated against the disease [55]. As our results suggested that with the increasing of transmissibility of variants and the possible decreasing of vaccine effectiveness, the vaccine coverage threshold for safely relaxing NPIs would be higher. In the presence of highly transmissible variants, strict NPIs were also needed to avoid resurgence before reaching a sufficient vaccine coverage [37, 39]. The more transmissible the new variants would be, the faster speed of vaccination are needed.

A localized COVID-19 outbreak occurred in Guangzhou on May 21, 2021 and on May 31, 2021, there were 34 symptomatic cases and 8 asymptomatic infections [56]. According to public data, we estimated that vaccine coverage was 40% (effective vaccinated population: 31.74%) in Guangzhou on May 23, 2021. If Guangzhou implemented moderate NPIs, in particular if the MDT was 7 to 8 days, the probability of resurgence was 30% to 60%. This suggested that NPIs, such as the social distancing, large-scale nucleic acid testing, close contact tracking, and centralized isolation, still played a significant role in reducing the probability of resurgence and controlling local resurgences before the vaccine coverage threshold was attained. On 29 May 2021, there were 12 COVID-19 asymptomatic infections in Guangzhou [56], which had met the criteria of resurgence. However, even if Guangzhou lifted all NPIs, the resurgence probability was estimated by 90%. Those facts suggested that the virus might be more infectious, or the efficiency of vaccines may be not high enough for the variants. As vaccine coverage increased, the NPIs can be gradually relaxed without increasing the risk of a resurgence.

We estimated that 8 months are needed to achieve the effective vaccine coverage threshold (50.4%) for the fully relaxation of NPIs in the combination of accelerated vaccination strategy and high risk groups first strategy. However, if a slow vaccination strategy was conducted, NPIs would not be fully liberalized in three years. These results suggested that acceleration of vaccination and targeting high-risk groups could reduce the probability of COVID-19 resurgence, especially when implemented early during the vaccination program [37, 38, 57]. Accelerating vaccination is also necessary to prevent the transmission and spread of more contagious SARS-CoV-2 variants [57]. Compared with no vaccination, introducing vaccination had high cost-effectiveness [58].

Vaccine hesitancy is a complex public health issue, and obviously hinders vaccination programs. At the end of March 2020, when the first wave of the COVID-19 outbreak was controlled in China, 67.1% to 91.3% of people were willing to accept the available COVID-19 vaccine [59, 60]. However, in May 2020, 83.5% of people said they had the intent intended to get vaccinated in China, and only 28.7% reported they definitely intended to get vaccinated [61]. Because of the successful control of COVID-19 outbreaks and the low incidence rate of COVID-19 in China, many people believed that vaccination was unnecessary [59]. Our results suggested that there is a high probability of resurgence if the NPIs are relaxed before the target vaccine coverage is achieved. Therefore, to reduce vaccine hesitancy, it is necessary to educate the general public about the safety, benefits, and importance of vaccination [59, 60]. There were evidences that individuals at high-risk have greater acceptance of the vaccine [59]. Our results indicated it is essential to improve vaccine coverage for these high-risk individuals as soon as possible to prevent a resurgence.

There are some limitations of the current study. Our model did not consider the characteristics of the population, such as age, sex, and occupation. A heterogeneous population might influence vaccine coverage. Thus, a more sophisticated model, such as an agent-based model, is more suited for addressing the issue of population heterogeneity.

Conclusions

Our study estimated that vaccine coverage of 50.4% was needed before NPIs can be fully relaxed. As vaccine coverage increases, the NPIs can be gradually relaxed. Until that threshold is reached, however, strict NPIs are still needed to contain the epidemic. An accelerated vaccination strategy was the most effective measure for preventing a resurgence, followed by providing vaccination to high-risk groups. Targeting of high-risk groups for vaccination may be the best approach if there are insufficient vaccine doses. The more transmissible SARS-CoV-2 variant led to higher resurgence probability, which indicates the importance of accelerated vaccination and achieving the vaccine coverage earlier.

Availability of data and materials

The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

COVID-19:

Coronavirus disease 2019

SARS-CoV-2:

Severe acute respiratory syndrome coronavirus 2

NPIs:

Non-pharmaceutical interventions

SIRS:

Susceptible Infectious Recovered Susceptible

MC simulation:

Monte Carlo simulation

95% CI :

95% Confidence interval

MDT:

Mean detection time

CDC:

Centers for Disease Control and Prevention

WHO:

World Health Organization

References

  1. WHO. WHO Director-General's opening remarks at the media briefing on COVID-19 - 11 March 2020. (2020). https://www.who.int/dg/speeches/detail/who-director-general-s-opening-remarks-at-the-media-briefing-on-covid-19---11-march-2020. Accessed 14 Jan 2021.

  2. WHO. WHO Coronavirus (COVID-19) Dashboard. (2021). https://covid19.who.int/. Accessed 11 Dec 2021.

  3. Flaxman S, Mishra S, Gandy A, Unwin HJT, Mellan TA, Coupland H, et al. Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe. Nature. 2020;584(7820):257–61. https://doi.org/10.1038/s41586-020-2405-7.

    Article  CAS  PubMed  Google Scholar 

  4. Lai S, Ruktanonchai NW, Zhou L, Prosper O, Luo W, Floyd JR, et al. Effect of non-pharmaceutical interventions to contain COVID-19 in China. Nature. 2020;585(7825):410–3. https://doi.org/10.1038/s41586-020-2293-x.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Yao Y, Pan J, Liu Z, Meng X, Wang W, Kan H, et al. No association of COVID-19 transmission with temperature or UV radiation in Chinese cities. Eur Respir J. 2020. https://doi.org/10.1183/13993003.00517-2020.

    Article  PubMed  PubMed Central  Google Scholar 

  6. Hsiang S, Allen D, Annan-Phan S, Bell K, Bolliger I, Chong T, et al. The effect of large-scale anti-contagion policies on the COVID-19 pandemic. Nature. 2020;584(7820):262–7. https://doi.org/10.1038/s41586-020-2404-8.

    Article  CAS  PubMed  Google Scholar 

  7. Looi MK. Covid-19: Is a second wave hitting Europe? BMJ. 2020;371: m4113. https://doi.org/10.1136/bmj.m4113.

    Article  PubMed  Google Scholar 

  8. Iacobucci G. Covid-19: Prepare for a third wave, warns England’s chief medical officer. BMJ. 2021;373: n1577. https://doi.org/10.1136/bmj.n1577.

    Article  PubMed  Google Scholar 

  9. Sharma M, Mindermann S, Rogers-Smith C, Leech G, Snodin B, Ahuja J, et al. Understanding the effectiveness of government interventions against the resurgence of COVID-19 in Europe. Nat Commun. 2021;12(1):5820. https://doi.org/10.1038/s41467-021-26013-4.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  10. Chen L, Cai J, Lin Q, Xiang B, Ren T. Imported COVID-19 cases pose new challenges for China. J Infect. 2020;80(6):e43–4. https://doi.org/10.1016/j.jinf.2020.03.048.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Pan J, Tian J, Xiong H, Liu Z, Yao Y, Wang Y, et al. Risk assessment and evaluation of China’s policy to prevent COVID-19 cases imported by plane. PLoS Negl Trop Dis. 2020;14(12): e0008908. https://doi.org/10.1371/journal.pntd.0008908.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. National Health Commission. Protocol on Prevention and Control of Novel Coronavirus Pneumonia (Edition 7). 2020.

  13. Jun X, Yong Z, Xiang Z, Dayan W, Weiping D, Guangyu J, et al. A Reemergent Case of COVID-19—Harbin City, Heilongjiang Province, China, April 9, 2020. China CDC Weekly. 2020;2(25):460–2. https://doi.org/10.46234/ccdcw2020.127.

    Article  Google Scholar 

  14. Cao C, Xiang Z, Dayan W, Juan L, Ao W, Donglin W, et al. The Initial Case of COVID-19—Shulan City, Jilin Province, China, May 8, 2020. China CDC Weekly. 2020;2(25):458–9. https://doi.org/10.46234/ccdcw2020.115.

    Article  Google Scholar 

  15. Wenjie T, Peihua N, Xiang Z, Yang P, Yong Z, Lijuan C, et al. Reemergent Cases of COVID-19—Xinfadi Wholesales Market, Beijing Municipality, China, June 11, 2020. China CDC Weekly. 2020;2(27):502–4. https://doi.org/10.46234/ccdcw2020.132.

    Article  Google Scholar 

  16. Cao C, Hemuti M, Zhiyuan J, Xiang Z, Dayan W, Jun Z, et al. Reemergent Cases of COVID-19—Xinjiang Uygur Autonomous Region, China, July 16, 2020. China CDC Weekly. 2020;2(39):761–3. https://doi.org/10.46234/ccdcw2020.206.

    Article  Google Scholar 

  17. Qingdao Municipal Health Commission. (2021). http://wsjkw.qingdao.gov.cn/n28356065/index.html. Accessed 15 Apr 2021.

  18. Chengdu Municipal Health Commission. (2021). http://cdwjw.chengdu.gov.cn/. Accessed 15 Apr 2021.

  19. Shanghai Municipal Health Commission. (2021). https://wsjkw.sh.gov.cn/. Accessed 15 Apr 2021.

  20. Chengdu Municipal Health Commission. All risk areas in Chengdu cleared. (2020). http://cdwjw.chengdu.gov.cn/cdwjw/gzdt/2020-12/31/content_002ff2ec42d24c19bf860f11f8936356.shtml. Accessed 5 Apr 2021.

  21. The State Council Information Office of the People's Republic of China. Heilongjiang COVID-19 epidemic prevention and control work conference (44th session). (2020). http://www.scio.gov.cn/xwfbh/gssxwfbh/xwfbh/heilongjiang/Document/1677545/1677545.htm. Accessed 5 Apr 2021.

  22. Pang X, Ren L, Wu S, Ma W, Yang J, Di L, et al. Cold-chain food contamination as the possible origin of COVID-19 resurgence in Beijing. Natl Sci Rev. 2020;7(12):1861–4. https://doi.org/10.1093/nsr/nwaa264.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  23. Liu P, Yang M, Zhao X, Guo Y, Wang L, Zhang J, et al. Cold-chain transportation in the frozen food industry may have caused a recurrence of COVID-19 cases in destination: successful isolation of SARS-CoV-2 virus from the imported frozen cod package surface. Biosaf Health. 2020;2(4):199–201. https://doi.org/10.1016/j.bsheal.2020.11.003.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Qingdao Municipal Health Commission. Notification of test status. (2020). http://wsjkw.qingdao.gov.cn/n28356065/n32563060/n32563061/201016073950064260.html. Accessed 5 Apr 2021.

  25. The People's Government of Beijing Municipality. Novel Coronavirus nucleic acid testing situation of relevant staff in the whole city and Xinfadi Wholesales Market. (2020). http://www.beijing.gov.cn/ywdt/gzdt/202006/t20200615_1924858.html. Accessed 5 Apr 2021.

  26. Health Commission of Sichuan Province. From 18:00 on December 10 to 18:00 on December 11, 2 newly diagnosed cases were reported in Chengdu, and free nucleic acid testing was carried out in Pidu district. (2020). http://wsjkw.sc.gov.cn/scwsjkw/gzbd06/2020/12/12/eb27bc85ca304a16b8afe623f0752fc4.shtml. Accessed 5 Apr 2021.

  27. Shanghai Municipal Health Commission. The investigation of local cases confirmed on the evening of the 23rd was announced: the nucleic acid test results of 2,286 relevant screeners were all negative. (2020). http://wsjkw.sh.gov.cn/xwfb/20201125/d2e89fc247f84af7af093d21f5bc3706.html. Accessed 5 Apr 2021.

  28. Shanghai Municipal Health Commission. News! The nucleic acid test results of 8,717 related personnel of confirmed cases yesterday were all negative. (2020). http://wsjkw.sh.gov.cn/xwfb/20201110/048c7936508242c180ceee34db9877f0.html. Accessed 5 Apr 2021.

  29. Bonaccorsi G, Pierri F, Cinelli M, Flori A, Galeazzi A, Porcelli F, et al. Economic and social consequences of human mobility restrictions under COVID-19. Proc Natl Acad Sci U S A. 2020;117(27):15530–5. https://doi.org/10.1073/pnas.2007658117.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  30. Hodgson SH, Mansatta K, Mallett G, Harris V, Emary KRW, Pollard AJ. What defines an efficacious COVID-19 vaccine? A review of the challenges assessing the clinical efficacy of vaccines against SARS-CoV-2. Lancet Infect Dis. 2020. https://doi.org/10.1016/S1473-3099(20)30773-8.

    Article  PubMed  PubMed Central  Google Scholar 

  31. WHO. DRAFT landscape of COVID-19 candidate vaccines, 29 November, 2020. (2020). https://www.who.int/publications/m/item/draft-landscape-of-covid-19-candidate-vaccines. Accessed 5 Apr 2021.

  32. Wang W, Wu Q, Yang J, Dong K, Chen X, Bai X, et al. Global, regional, and national estimates of target population sizes for covid-19 vaccination: descriptive study. BMJ. 2020;371: m4704. https://doi.org/10.1136/bmj.m4704.

    Article  PubMed  Google Scholar 

  33. National Medical Products Administration. China grants conditional approval for first COVID vaccine. (2020). http://english.nmpa.gov.cn/2020-12/31/c_579192.htm. Accessed 5 Apr 2021.

  34. The State Council, The People's Republic of China. Chinese COVID-19 vaccines free to all its citizens: official. (2020). http://english.www.gov.cn/statecouncil/ministries/202012/31/content_WS5fed9059c6d0f72576942e9e.html. Accessed 6 Apr 2021.

  35. The State Council, The People's republic of China. Who can vaccinate? Where to vaccinate? 11 authoritative answers about the new COVID-19 vaccine! (2020). http://www.gov.cn/fuwu/2020-12/19/content_5571152.htm. Accessed 6 Apr 2021.

  36. So AD, Woo J. Reserving coronavirus disease 2019 vaccines for global access: cross sectional analysis. BMJ. 2020;371: m4750. https://doi.org/10.1136/bmj.m4750.

    Article  PubMed  Google Scholar 

  37. Giordano G, Colaneri M, Di Filippo A, Blanchini F, Bolzern P, De Nicolao G, et al. Modeling vaccination rollouts, SARS-CoV-2 variants and the requirement for non-pharmaceutical interventions in Italy. Nat Med. 2021. https://doi.org/10.1038/s41591-021-01334-5.

    Article  PubMed  PubMed Central  Google Scholar 

  38. Moore S, Hill EM, Tildesley MJ, Dyson L, Keeling MJ. Vaccination and non-pharmaceutical interventions for COVID-19: a mathematical modelling study. Lancet Infect Dis. 2021. https://doi.org/10.1016/S1473-3099(21)00143-2.

    Article  PubMed  PubMed Central  Google Scholar 

  39. Sonabend R, Whittles LK, Imai N, Perez-Guzman PN, Knock ES, Rawson T, et al. Non-pharmaceutical interventions, vaccination, and the SARS-CoV-2 delta variant in England: a mathematical modelling study. Lancet. 2021;398(10313):1825–35. https://doi.org/10.1016/S0140-6736(21)02276-5.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Leung K, Wu JT, Leung GM. Effects of adjusting public health, travel, and social measures during the roll-out of COVID-19 vaccination: a modelling study. Lancet Public Health. 2021;6(9):e674–82. https://doi.org/10.1016/S2468-2667(21)00167-5.

    Article  PubMed  PubMed Central  Google Scholar 

  41. Melnick ER, Ioannidis JPA. Should governments continue lockdown to slow the spread of covid-19? BMJ. 2020;369: m1924. https://doi.org/10.1136/bmj.m1924.

    Article  PubMed  Google Scholar 

  42. Beijing Municipal Health Commission. (2021). http://wjw.beijing.gov.cn/. Accessed 15 Apr 2021.

  43. Health Commission of Dalian. (2021). http://hcod.dl.gov.cn/. Accessed 15 Apr 2021.

  44. Elgazzar AS. Simple mathematical models for controlling COVID-19 transmission through social distancing and community awareness. Z Naturforsch C J Biosci. 2021. https://doi.org/10.1515/znc-2021-0004.

    Article  PubMed  Google Scholar 

  45. Anderson RM, May RM. Population biology of infectious diseases: Part I. Nature. 1979;280(5721):361–7. https://doi.org/10.1038/280361a0.

    Article  CAS  PubMed  Google Scholar 

  46. May RM, Anderson RM. Population biology of infectious diseases: Part II. Nature. 1979;280(5722):455–61. https://doi.org/10.1038/280455a0.

    Article  CAS  PubMed  Google Scholar 

  47. Shi A, Gaynor SM, Quick C, Lin X. Multi-resolution characterization of the COVID-19 pandemic: a unified framework and open-source tool. MedRxiv. 2021. https://doi.org/10.1101/2021.03.12.21253496.

    Article  PubMed  PubMed Central  Google Scholar 

  48. Kretzschmar ME, Rozhnova G, Bootsma MCJ, van Boven M, van de Wijgert J, Bonten MJM. Impact of delays on effectiveness of contact tracing strategies for COVID-19: a modelling study. Lancet Public Health. 2020;5(8):e452–9. https://doi.org/10.1016/S2468-2667(20)30157-2.

    Article  PubMed  PubMed Central  Google Scholar 

  49. Huang Y, Cai X, Zhang B, Zhu G, Liu T, Guo P, et al. Spatiotemporal heterogeneity of social contact patterns related to infectious diseases in the Guangdong Province, China. Sci Rep. 2020;10(1):6119. https://doi.org/10.1038/s41598-020-63383-z.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  50. Donnelly CA, Ghani AC, Leung GM, Hedley AJ, Fraser C, Riley S, et al. Epidemiological determinants of spread of causal agent of severe acute respiratory syndrome in Hong Kong. Lancet. 2003;361(9371):1761–6. https://doi.org/10.1016/S0140-6736(03)13410-1.

    Article  PubMed  PubMed Central  Google Scholar 

  51. Al Kaabi N, Zhang Y, Xia S, Yang Y, Al Qahtani MM, Abdulrazzaq N, et al. Effect of 2 inactivated SARS-CoV-2 vaccines on symptomatic COVID-19 infection in adults: a randomized clinical trial. JAMA. 2021. https://doi.org/10.1001/jama.2021.8565.

    Article  PubMed  PubMed Central  Google Scholar 

  52. Ahram online. China's Sinopharm says vaccine 79% effective against Covid-19. (2021). https://english.ahram.org.eg/NewsContent/2/9/397815/World/International/Chinas-Sinopharm-says-vaccine--effective-against-C.aspx. Accessed 28 May 2021.

  53. Zhang J, Litvinova M, Wang W, Wang Y, Deng X, Chen X, et al. Evolving epidemiology and transmission dynamics of coronavirus disease 2019 outside Hubei province, China: a descriptive and modelling study. Lancet Infect Dis. 2020;20(7):793–802. https://doi.org/10.1016/S1473-3099(20)30230-9.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  54. Tian S, Chang Z, Wang Y, Wu M, Zhang W, Zhou G, et al. Clinical characteristics and reasons for differences in duration from symptom onset to release from quarantine among patients with COVID-19 in Liaocheng, China. Front Med (Lausanne). 2020;7:210. https://doi.org/10.3389/fmed.2020.00210.

    Article  Google Scholar 

  55. WHO. Weekly epidemiological update on COVID-19—11 January 2022. (2022). https://www.who.int/publications/m/item/weekly-epidemiological-update-on-covid-19---11-january-2022. Accessed 14 Jan 2022.

  56. Health Commission of Guangdong Province. (2021). http://wsjkw.gd.gov.cn/. Accessed 15 Apr 2021.

  57. Sah P, Vilches TN, Moghadas SM, Fitzpatrick MC, Singer BH, Hotez PJ, et al. Accelerated vaccine rollout is imperative to mitigate highly transmissible COVID-19 variants. EClinicalMedicine. 2021;35: 100865. https://doi.org/10.1016/j.eclinm.2021.100865.

    Article  PubMed  PubMed Central  Google Scholar 

  58. Sandmann FG, Davies NG, Vassall A, Edmunds WJ, Jit M, Centre for the Mathematical Modelling of Infectious Diseases C-wg. The potential health and economic value of SARS-CoV-2 vaccination alongside physical distancing in the UK: a transmission model-based future scenario analysis and economic evaluation. Lancet Infect Dis. 2021. https://doi.org/10.1016/S1473-3099(21)00079-7.

    Article  PubMed  PubMed Central  Google Scholar 

  59. Wang C, Han B, Zhao T, Liu H, Liu B, Chen L, et al. Vaccination willingness, vaccine hesitancy, and estimated coverage at the first round of COVID-19 vaccination in China: a national cross-sectional study. Vaccine. 2021;39(21):2833–42. https://doi.org/10.1016/j.vaccine.2021.04.020.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  60. Wang J, Jing R, Lai X, Zhang H, Lyu Y, Knoll MD, et al. Acceptance of COVID-19 Vaccination during the COVID-19 Pandemic in China. Vaccines (Basel). 2020. https://doi.org/10.3390/vaccines8030482.

    Article  PubMed  PubMed Central  Google Scholar 

  61. Lin Y, Hu Z, Zhao Q, Alias H, Danaee M, Wong LP. Understanding COVID-19 vaccine demand and hesitancy: a nationwide online survey in China. PLoS Negl Trop Dis. 2020;14(12): e0008961. https://doi.org/10.1371/journal.pntd.0008961.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We gratefully acknowledge our funders.

Funding

This study was granted by: Science and Technology Commission of Shanghai Municipality, Grant No. 20dz1200600 (YY); Bill & Melinda Gates Foundation, Seattle, WA, Grant No. INV-006277 (WBW); National Natural Science Foundation of China, Grant No. 82073612 (WBW); Shanghai New Three-year Action Plan for Public Health, Grant No. GWV-10.1-XK16 (WBW).

Author information

Authors and Affiliations

Authors

Contributions

JHP, WLZ, YY, and WBW designed and conceived the study. JHP, YY, and WBW developed the model and conducted the analysis. WLZ, JT, ZXL, and AX collected the data. JHP and WLZ drafted the manuscript, with all authors contributing to interpretation and critical revision of the work and approving the final manuscript. YY and WBW act as the guarantors. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to Ye Yao or Weibing Wang.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

Authors declare that they have no competing interests.

Supplementary Information

Additional file 1: Fig S1.

Sensitivity analyses on resurgence threshold. Fig. S2. Sensitivity analyses on transmission rate (a), vaccination number per year (b), vaccination effectiveness rate (c), vaccination effectiveness time (d) and imported patients per year (e). For each plot, each row represents the date to lift NPIs (months, from the day of vaccination) and each column represents resurgence probability. Colors represent different scenarios of every parameter. Horizontal dotted line in each plot represents the threshold of resurgence probability (20%). Table S1. Parameter settings for the main analysis.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Pan, J., Zhu, W., Tian, J. et al. Vaccination as an alternative to non-drug interventions to prevent local resurgence of COVID-19. Infect Dis Poverty 11, 36 (2022). https://doi.org/10.1186/s40249-022-00960-6

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40249-022-00960-6

Keywords