Impact factor (WEB OF SCIENCE - Clarivate)

2 year: 7.664 | 5 year: 7.127

Articles

Non-restrictive open vial policy combined with the home visit vaccinations for improving BCG coverage in a high-incidence outreach region: A model-based cost-effectiveness analysis for Indonesia

Afifah Machlaurin1,2, Jos Luttjeboer3, Didik Setiawan4, Tjipke Sytse van der Werf5, Maarten J. Postma1,3,6,7,8

1 Department of Health Sciences, University Medical Center Groningen, University of Groningen, Netherlands
2 Department of Clinical and Community Pharmacy, Universitas Jember, Indonesia
3 Asc Academics, Groningen, Netherlands
4 Faculty of Pharmacy, Universitas Muhammadiyah Purwokerto, Indonesia
5 Department of Pulmonary Diseases & Tuberculosis, University Medical Center Groningen, Netherlands
6 Department of Economics, Econometrics & Finance, Faculty of Economics & Business, University of Groningen, Netherlands
7 Department of Pharmacology & Therapy, Universitas Airlangga, Indonesia
8 Center of Excellence in Higher Education for Pharmaceutical Care Innovation, Universitas Padjadjaran, Indonesia
† Joint senior authorship.

DOI: 10.7189/jogh.13.04049

Share:

Facebook
Twitter
LinkedIn
Abstract

Background

Bacillus Calmette-Guérin (BCG) vaccination is recommended at birth or in the first week of life to achieve the most beneficial effects in protecting against the most severe type of tuberculosis (TB) disease in children. However, delayed vaccination is commonly reported, especially in outreach or rural areas. We assessed the cost-effectiveness of combining non-restrictive open vial and home visit vaccination strategies in order to increase timely BCG vaccination in a high-incidence outreach setting.

Methods

We applied a simplified Markov model for the Papua setting, which resembled a high-incidence outreach setting in Indonesia, to assess the cost-effectiveness of these strategies from a health care and a societal perspective. A moderate increase (75% wastage rate and 25% home vaccination) and a large increase (95% wastage rate and 75% home vaccination) scenario were assessed in the analysis. We calculated incremental cost-effectiveness ratios (ICER) based on the incremental costs and quality-adjusted life years (QALYs) gained by comparing the two strategies to the base case scenario (35% wastage rate and no home vaccination).

Results

The costs per vaccinated child were US$10.25 in the base case scenario, increasing slightly in the moderate (US$10.54) and large increase scenarios (US$12.38). The moderate increase scenario was predicted to prevent 5783 TB-related deaths and 790 TB cases while the large increase scenario predicted the prevention of 9865 TB-related deaths and 1348 TB cases for the entire lifespan of our cohort. From a health care perspective, the ICERs were predicted to be US$288/QALY and US$487/QALY, respectively, for the moderate and large increase scenarios. Using Indonesia’s gross domestic product (GDP) per person as a threshold, both strategies were considered to be cost-effective.

Conclusions

We found that the allocation of resources for timely BCG vaccination based on combining home vaccination and a less restrictive open vial strategy could substantially reduce childhood TB cases and TB-related mortality. Although outreach activities are more expensive than vaccination at a health care facility only, these activities proved to be cost-effective. These strategies might also be beneficial in other high-incidence outreach settings.

Print Friendly, PDF & Email

The Bacille Calmette–Guérin (BCG) vaccine was introduced decades ago and remains the only available tuberculosis (TB) vaccine on the market. The World Health Organization (WHO) recommends a universal vaccination strategy by vaccinating all infants in high TB incidence countries [1] at birth or in their first week of life, as this prevents infants from contracting the most severe type of TB [2]. Timely vaccination at birth is reported to have the most beneficial effects on reducing TB-related death in children compared to a later schedule, eg, six weeks after birth or at the recommended age of the first dose of diphtheria, tetanus, and pertussis (DTP) vaccination [3]. In fact, delayed BCG vaccination is commonly reported in low-middle income countries (LMICs), where administration may be delayed by up to 10 weeks [4].

In Indonesia, BCG vaccination has been included in the national immunisation programme since 1956 [5]; in 2017, its coverage was high, at an average of 87% [6]. Despite this high vaccination coverage, Indonesia’s TB incidence remains the third-highest globally [7]. This can be partly explained by the substantially lower vaccination coverage among within first two months of life, at almost half compared to the national coverage [4,8,9]. Furthermore, coverage differs between regions, from 69.8% in Papua to 98.9% in Yogyakarta [6]. There are several context-specific reasons why the coverage is very low in some settings, especially in outreach or rural areas such as Papua. Children who live in urban areas or near a health care facility are less likely to miss their BCG vaccination as adherence to BCG vaccination is influenced by the children’s area of residence, rather than the mother’s education and knowledge [10,11]. Mothers who have more frequent health care visits show a higher BCG vaccination uptake for their infants. Children born at home are at an increased risk of being vaccinated later than recommended or of not being vaccinated at all [11]. To minimise the wastage of 20-dose BCG vaccines, the vaccine may be delivered less frequently in the outreach region. The health care worker tends to wait for enough infants to be vaccinated to decrease costs, which might reduce vaccination uptake.

As BCG vaccination is one of the cornerstones of the TB prevention programme, efforts to increase the BCG vaccination coverage are important, especially in high-incidence rural and remote areas. The measles vaccination case showed that encouraging health care workers to open a vial regardless of the number of children to be vaccinated and promoting home visits in rural areas improved vaccination coverage [12]. Following WHO guidelines to open multidose vials despite any wastage of unused vaccine [1], these strategies might be warranted in outreach areas to reduce missed BCG vaccination at birth.

To achieve and maintain high vaccination coverage in rural, remote areas, additional investments in the national immunisation programme are needed, since current funds and efforts are not sufficient to provide all children in Indonesia with a BCG vaccine. Given its potentials to enhance health gains in Indonesia, we considered the implementation of a non-restrictive open vial policy combined with pro-active home visits by health care workers for improving the vaccination coverage. We aimed to evaluate the cost-effectiveness of the combined strategy in different scenarios, by calculating the costs required and the health impacts in high-incidence outreach settings such as Papua.

METHODS

Cost-effectiveness analysis

This study is a model-based cost-effectiveness analysis, performed from both a health care and a societal perspective. We calculated the costs required for the implementation of a non-restrictive open vial use strategy, combined with performing home visit vaccinations. We calculated the health impacts of the improved vaccination coverage on the number of tuberculosis cases and deaths, as well as the quality-adjusted life-years (QALYs) gained over a lifespan with an average life expectancy of 70 years. We calculated both direct medical costs and lost-productivity costs incurred by TB patients during the treatment and disease stages. We evaluated the incremental cost-effectiveness ratio (ICER) based on the incremental costs per incremental QALY for context-specific vaccination coverages (moderate increase scenario and large increase scenario) compared to the base of current coverage (Table 1). We applied once gross domestic product (GDP) per person in 2020 (US$3871 per year) as the willingness-to-pay threshold. A scenario is considered cost-effective if the ICER is below this threshold. We ran the calculation and model simulation in the Microsoft Excel 2016. An annual timestep and a 3% discount rate for both the costs and the outcomes were applied in the model [23].

Table 1.  Input parameters and assumptions with respective distributions for probabilistic sensitivity analysis

TB – tuberculosis, RR – relative risk, DSTB – drug-susceptible tuberculosis, MDR/RRTB – multidrug-resistance/rifampicin-resistance TB, SD – standard deviation

*Interval reflected as the lower and upper values; we used 95% CIs where applicable or SD = 25% to the point of estimate in the base case. We applied specific distributions to the central estimates in the probabilistic sensitivity analysis.

Model setting

We followed a published simplified Markov model [24] to assess the costs and health impacts of increasing the BCG vaccine coverage in outreach area settings by allowing moderate to non-restrictive open vial strategies and promoting home visit vaccination (Figure 1). The model simulates one birth cohort that comprises susceptible healthy new-borns. Following infection, newborns can develop TB directly (active TB compartment) or enter a latency phase (latent TB compartment). In the active TB compartment, individuals are divided into a treated and an untreated group. The treated group is further subdivided into a drug-susceptible TB (DSTB) group and a rifampicin and/or multidrug resistant TB (RRTB and/or MDRTB) group, both of which encounter specified treatment costs and outcomes. The untreated group comprises patients with active TB who have not yet been diagnosed. Untreated patients may recover without treatment, but do not necessarily clear the infection and are assumed to move to the latent TB compartment. Individuals with latent TB are at a reduced risk of developing active TB, with a relative risk (RR) of 21% (95% confidence interval (CI) = 14%-30%)) [13] compared to healthy unvaccinated individuals. There are four treatment outcomes; success, failure, death, and lost to follow-up. Successful treatment outcome brings patients into the healthy group, since these individuals have cleared their infection. Failed treatment results in patients remaining in the group with active TB, as if untreated. Each group was assigned a specific mortality rate (Table 1), which was age-stratified for the healthy population and fixed for others.

Figure 1.  Natural course of tuberculosis (TB). The model was based on age-stratified incidence and implicitly included mortality rate in each group. A = infection, B = fast progression to active TB, C = slow progression to active TB, D = treatment failure, E = successful treatment, F = self-healing. Red line is affected by vaccine effectiveness.

Data and model assumption

Population setting

We engaged with the Indonesian national TB programme and applied the model to one of its provinces, Papua, which reflects a high-incidence outreach setting in Indonesia. We retrieved the birth cohort size of Papua from the Indonesian Basic Health Surveillance data (RISKESDAS, 2018 data) [25] and used it as the initial population of the model. We simulated the cohort over a lifespan with an average life expectancy of 70 years (Indeks pembangunan manusia 2018, BPS) [21]. In 2018, the reported BCG vaccination coverage for Papua was 69.8% and this was used as a base case coverage [25]. We applied the 2018 TB incidence in Papua (0.6%) and assumed that the incidence was the same for all ages [25].

Vaccine characteristics

We derived BCG vaccine effectiveness from a meta-analysis study, which included 14 studies worldwide, to be 27% (RR = 0.73, 95% CI = 0.61-0.87) and 71% (RR = 0.29, 95% CI = 0.15-0.58) against infection and active TB, respectively. Additionally, the vaccine was expected to provide protection against progression from infection to active disease at 58% (RR = 0.42, 95% CI = 0.23-0.77) [18]. Regarding the waning effect of the BCG vaccine, we assumed protection up to 10 years, as the study showed that the most significant vaccine effectiveness of BCG happen from zero to nine years [26]. We applied 87% vaccine coverage for the base case.

Costs of vaccination

Since the vaccine delivery costs for rural and urban areas are uncertain, we defined a composite of vaccination costs per infant that includes vaccine costs, wastage, freight and supply, administration, immunization support, and programme-related costs. We assumed that the costs for BCG vaccination per child in rural areas, which we considered remote areas, required greater vaccine vial, syringe, and safety box supplies. Additionally, the health care staff would spend extra time on vaccination and transportation to reach the areas to actively vaccinate new-borns at home.

The cost components of vaccination are described in Table 2. We derived the vaccine costs from the 2020 UNICEF price for a 20-dose BCG vial at US$2.10 [27]. We used the 2020 UNICEF negotiated price of US$0.057 per syringe and US$0.54 for one safety box, assuming one safety box per 100 children vaccinated. The WHO estimates freight costs, including insurance, at 6% of the vaccine price and 15% of the supplies costs [28]. However, for remote areas, we assumed a 10% higher cost for vaccines and 20% for supplies. For the extra health care workload, we estimated the cost at US$10 (range US$8-12) per infant vaccinated based on the price list of average BCG vaccination services at private clinics in urban areas in Indonesia. Extra transportation costs were applied when the health care staff needed to vaccinate the infants at home.

Table 2.  Cost components of BCG vaccination

SD – standard deviation

*Interval reflected as the lower and upper values; we used 95% CIs where applicable or SD = 25% to the point of estimate in the base case. We applied specific distributions to the central estimates in the probabilistic sensitivity analysis.

Scenarios

Base case

The base case resembles the current practice in Papua. We applied a 70% vaccination coverage based on the current situation of BCG vaccination in Papua [6]. We assumed a 35% wastage rate for a vaccine vial containing 20 doses, since there are no country-specific data for BCG vaccination wastage in rural areas. This estimate was based on several studies: a study in the national hospital setting in Guinea-Bissau showed that the median wastage rate for BCG was 35% [29]; a study found that the wastage rate in the Gambia was 18.5%-79.0% [30], while another found it to be 35.1% and 37.1% in two districts in India [31]; in Bangladesh, higher wastage rates were reported for the BCG vaccine (55%-93%) [32]. Vaccine wastage was calculated by the following formula: (vaccine doses supplied − vaccine doses used)/vaccine doses supplied. In the base case scenario, we assumed all vaccinations were administered at a health care centre.

Two scenarios proposed

Two scenarios are analysed in this study. First, the large increase scenario was considered as a high vaccination coverage up to 99% by allowing even a 95% vaccine wastage rate and 75% home visit vaccinations. This wastage rate corresponds to a situation in which the health care worker could open a 20-dose BCG vial for one eligible infant. Second, the moderate increase scenario assumed a moderate vaccination coverage up to the national level of coverage at 87%, allowing 75% vaccine wastage and implementing 25% home visit vaccinations (Table 3). The assumption for the large increase scenario was motivated by a study of measles vaccination, which showed that home visits after delivery and removing the wastage restriction could increase the vaccination coverage to up to 97% [33]. The moderate increase scenario lay between the status quo and the large increase scenario which resembled as the national vaccination coverage. The wastage rates for the two scenarios were based on the WHO tool for estimating the wastage of BCG vaccination for Indonesia, where the predicted BCG wastage in 2020 was 83% [34]. For these strategies, the wastage rate was assumed around the range between 75% and 95% for the moderate and the large increase scenario, respectively. The large increase scenario has a higher wastage rate since the number of home visits is higher than in the moderate increase scenario, meaning more vials will be opened regardless of the number of newborns requiring vaccination.

Table 3.  Summary of the scenarios explored in the model

Sensitivity analysis

We performed a univariate sensitivity analysis to investigate the key drivers of the cost-effectiveness analysis by varying the base case values with lower and upper values of each parameter. The likely range of the parameters was based on the CIs, and a standard deviation (SD) = 25% was used when there was no CI or other plausible range available.

To account for uncertainty in the deterministic outcomes of the model, we performed a probabilistic sensitivity analysis (PSA). The parameters’ ranges were used to assign a distribution to most parameters (Table 1). The costs per vaccinated child were uniformly distributed with a range of SD = 25% of the point estimate. We conducted a Monte Carlo simulation by running the model over 1000 iterations, each iteration using random parameter values drawn from the respective parameter distribution. We used the same ranges to assign distributions to the parameters. The PSA results were presented in a cost-effectiveness acceptability curve (CEAC), using the threshold to predict the probability of the strategy being cost-effective.

RESULTS

Based on our vaccination costs calculation, in the base case scenario, the costs per vaccinated child were US$10.25, in line with the current vaccination price in Indonesia. Targeting a 75% wastage rate and 25% home visit vaccinations for a moderate increase scenario, the costs per vaccinated child were slightly increased at US$10.54. In the large increase scenario, which used a conservative wastage rate of 95% and assumed to reach 75% of children who did not have access to a health care facility, the costs per vaccinated child were increased to US$12.38. Regarding costs, the large increase scenario requires more costs compared to the moderate increase scenario due to the higher home visit costs and the wastage of BCG vaccine. The incremental vaccination costs were estimated to be US$540 818 for the moderate and US$1 266 576 for the large scenario (Table 4). Expectedly, the ICER in the large increase scenario was higher than in the moderate increase scenario. The ICERs from the health care perspective were predicted to be US$288/QALY for the moderate and US$487/QALY for the large increase scenario. From a societal perspective, when productivity losses are incorporated in the estimations, the ICERs for the two scenarios were slightly improved, at US$278/QALY and US$477/QALY, respectively. Although the ICER for the large increase scenario was almost twice that of the moderate increase scenario, if the decision-maker sets a willingness-to-pay of once GDP per capita (US$3871 per year in 2020), both strategies are considered cost-effective and justified to be applied in high-incidence outreach areas.

Table 4.  BCG vaccination cost components based on the BCG vaccination scenarios

*Costs were presented in 2020 exchange rates for US$.

The vaccination strategies were estimated to have more impact on preventing TB cases in childhood compared to later age (Table 5). The moderate increase scenario could prevent 790 TB cases, while the large increase scenario could prevent 1348 cases. Compared to the base case scenario, the moderate increase scenario was predicted to prevent 569 childhood TB-related deaths during the first 15 years, while the large increase scenario was predicted to prevent almost twice that number at 971 TB-related deaths. Over the entire lifespan of the cohort, the vaccination strategies were predicted to prevent 5783 and 9865 TB-related deaths in the moderate and large increase scenarios, respectively.

Table 5.  Estimated costs and outcomes per birth cohort according to the BCG vaccination scenarios

QALY – quality adjusted life year, LYG – life year gained, ICER – incremental cost-effectiveness ratio, TB – tuberculosis

*Costs were presented in 2020 in US$.

The one-way sensitivity analysis from a societal perspective is presented in the tornado diagram in Figure 2. The top three key drivers of the analysis of both scenarios were vaccine effectiveness against TB disease, incidence, and mortality in untreated patients. The fourth most influential parameter varied between moderate and large increase scenario; administration costs for the moderate increase scenario and transportation costs for the large increase scenario.

Figure 2.  Univariate sensitivity analysis from a societal perspective. Panel A. Moderate increase scenario. Panel B. Large increase scenario.

The PSA showed that using one GDP per person (US$3871 per year in 2020) as the willingness-to-pay threshold, both moderate and large increase scenarios are cost-effective. The corresponding scatter plot and cost-effectiveness acceptability curves are presented in Figure 3. The cost-effectiveness acceptability curves suggest that applying lower willingness-to-pay, corresponding to a monthly salary in Indonesia of US$500/QALY, the probability of the moderate increase scenario being cost-effective was predicted to be 97%, while the probability for the large increase scenario was predicted to be only around 50%.

Figure 3.  Probabilistic sensitivity analysis: a) cost-effectiveness plane and b) cost-effectiveness acceptability curve (1000 iterations).

DISCUSSION

Main findings

In rural, remote areas such as the Papua setting, we estimated that increasing the coverage of BCG vaccination was beneficial in reducing TB cases (especially in childhood) and overall TB-related mortality. In our moderate increase scenario, increasing local coverage in Papua (69%) up to the national level (87%) by allowing higher vaccine wastage to 75% (compared to the base case scenario of 35%) and reaching 25% of children who have no access to a health care facility through home vaccination (rather than only vaccinating children at the health care centre as is the current situation) would prevent 790 TB cases during the first 15 years in one birth cohort. More substantial health benefits could be achieved by implementing the large increase scenario, which allows a more active vaccination strategy by combining 75% home vaccination and a non-restrictive open vial strategy. Compared to the moderate increase scenario, the large increase scenario was predicted to prevent almost twice the number of TB cases in childhood and TB-related mortality. The WHO has recently paid more attention to childhood TB burden to better understand the impact of BCG vaccination. Additionally, TB-related deaths remain a significant concern, with 1.2 million TB-related deaths in human immunodeficiency virus (HIV) negative individuals in 2018. Reflecting on the WHO 2020 milestone of a 20% reduction in TB incidence and a 35% reduction in TB-related deaths, Indonesia was still off target. Increased coverage may indeed emerge especially in rural or hard to reach areas. This could be achieved by lifting the open vial restriction and reaching children who have no access to a health care centre through home visit vaccinations. We showed that in rural settings such as Papua, these two cost-effective policy adjustments may substantially reduce the number of childhood TB cases and TB-related deaths.

Besides a lack of visits to a health care facility, parental attitudes and a lack of knowledge might hinder BCG vaccine coverage of newborns in rural areas [8]. Home visits may help with overcoming these barriers by providing BCG vaccines on time and increasing awareness among parents by informing them about the benefits of vaccination. Home visit vaccinations might require some investments from the government, especially for transportation and administration. However, this visit can be combined with other health care programmes, such as other newborn vaccination programmes or the postnatal check-up.

Although home vaccination and a less restrictive open vial strategy produce a higher ICER compared to the current vaccination strategy in rural area settings with a high incidence of TB, these strategies are considered very cost-effective.

Strengths and limitations

This study has several strengths. To our knowledge, it is the first to explore the cost-effectiveness of combining the implementation of home visit vaccinations and less restrictive multidose open vial strategies in the BCG vaccination programme in rural areas. These strategies were determined to increase the coverage of timely BCG vaccination, preferably at birth, to reduce TB cases and TB-related deaths. Second, we applied extensive sensitivity analyses to assess the impact of uncertainty in the input parameters on the outcome and further explored the key variables that influence the results. Our PSA showed that, even at a lower threshold of US$500/QALY, the probability of both strategies being cost-effective was 97%. Beyond clinical efficacy inputs, the one-way sensitivity analysis identified the costs of administration and transportation as important drivers. Therefore, the government could optimize these cost variables to achieve optimum beneficial impacts regarding investments. Third, our model could be used for any data setup, so our results could be updated and validated when more robust evidence emerges; for example, concerning the effectiveness of home visit vaccination and the implementation of a non-restrictive open vial strategy to increase vaccine coverage, or the effectiveness of the BCG vaccine in high incidence areas.

As in any model-based analysis, our study is subject to limitations, especially regarding the uncertainties of the input parameters and assumptions. First, there is the absence of age-stratified incidence data in Papua. We applied a uniform incidence retrieved from the local surveillance data for all ages. As disease incidence was the second key driver of the analysis, under- or over-estimation of this variable might influence the results and, in a worst-case scenario, even change the recommendation. However, in a high incidence country such as Indonesia, the incidence is likely to be underreported [35], which makes our analysis conservative.

CONCLUSIONS

Using a modelling approach, we showed that allocation of resources for timely home vaccination of children without or with poor access to a health care facility combined with a less restrictive open vial strategy could substantially reduce childhood TB cases and TB-related mortality. Although outreach activities are more costly than vaccination at a health care facility only, these activities proved to be cost-effective. The cost-effectiveness profile might become even more favourable when home BCG vaccination is combined with other vaccinations or a postnatal check-up.

[1] Funding: AM received scholarship from the Directorate General of Higher Education (DIKTI), Ministry of Research, Technology and Higher Education of the Republic of Indonesia, and Islamic Development Bank for 4in1 Project. The grant number is D1.1/PR/4in1/X/2017. AM also received supports from University of Groningen and University of Medical Center Groningen.

[2] Authorship contributions: All authors contributed to the study conception and design. Material preparation, data collection, and analysis were performed by AM and re-checked by JL and DS. The works were supervised and critically reviewed by TSW and MJP. The first draft was written by AM. and all authors commented on previous versions of the manuscript. All authors have read and agreed to the final version of the manuscript.

[3] Disclosure of interest: The authors completed the ICMJE Disclosure of Interest Form (available upon request from the corresponding author) and disclose no relevant interests.

references

[1] . BCG vaccine: WHO position paper, February 2018 – Recommendations. Vaccine. 2018;36:3408-10. DOI: 10.1016/j.vaccine.2018.03.009. [PMID:29609965]

[2] P Mangtani, I Abubakar, C Ariti, R Beynon, L Pimpin, and PE Fine. Protection by BCG vaccine against tuberculosis: a systematic review of randomized controlled trials. Clin Infect Dis. 2014;58:470-80. DOI: 10.1093/cid/cit790. [PMID:24336911]

[3] Roy PS, White RG, Harris RC. Mathematical modelling to estimate the impact of age of BCG vaccination on global paediatric TB mortality. London: London School of Hygiene & Tropical Medicine; 2019.

[4] A Clark and C Sanderson. Timing of children’s vaccinations in 45 low-income and middle-income countries: an analysis of survey data. Lancet. 2009;373:1543-9. DOI: 10.1016/S0140-6736(09)60317-2. [PMID:19303633]

[5] HN Barnum, D Tarantola, and IF Setiady. Cost-effectiveness of an immunization programme in Indonisia. Bull World Health Organ. 1980;58:499-503. [PMID:6774826]

[6] Kesehatan K, Penelitian B, Kesehatan P. [Results of Basic Health Researches in Indonesia at 2018] [in Indian]. 2018. Available: https://kesmas.kemkes.go.id/assets/upload/dir_519d41d8cd98f00/files/Hasil-riskesdas-2018_1274.pdf. Accessed: 17 May 2023.

[7] World Health Organization. Global tuberculosis report 2018. Geneva: World Health Organization; 2018.

[8] K Kusnanto, H Arifin, and Y Kurniawati. Determinant of BCG vaccine coverage among Indonesian children aged 0-2 months. Child Youth Serv Rev. 2020;116:105238. DOI: 10.1016/j.childyouth.2020.105238

[9] P Roy, J Vekemans, A Clark, C Sanderson, RC Harris, and RG White. Potential effect of age of BCG vaccination on global paediatric tuberculosis mortality: a modelling study. Lancet Glob Health. 2019;7:e1655-63. DOI: 10.1016/S2214-109X(19)30444-9. [PMID:31708146]

[10] A Schoeps, N Ouédraogo, M Kagoné, A Sié, O Müller, and H Becher. Socio-demographic determinants of timely adherence to BCG, Penta3, measles, and complete vaccination schedule in Burkina Faso. Vaccine. 2013;32:96-102. DOI: 10.1016/j.vaccine.2013.10.063. [PMID:24183978]

[11] AK Tsehay, GT Worku, and YM Alemu. Determinants of BCG vaccination coverage in Ethiopia: a cross-sectional survey. BMJ Open. 2019;9:e023634. DOI: 10.1136/bmjopen-2018-023634. [PMID:30796120]

[12] S Byberg, AB Fisker, SM Thysen, A Rodrigues, U Enemark, and P Aaby. Cost-effectiveness of providing measles vaccination to all children in Guinea-Bissau. Glob Health Action. 2017;10:1329968. DOI: 10.1080/16549716.2017.1329968. [PMID:28580855]

[13] JR Andrews, F Noubary, RP Walensky, R Cerda, E Losina, and CR Horsburgh. Risk of progression to active tuberculosis following reinfection with Mycobacterium tuberculosis. Clin Infect Dis. 2012;54:784-91. DOI: 10.1093/cid/cir951. [PMID:22267721]

[14] World Health Organization. WHO TB burden estimates. 2018. Available: https://www.who.int/tb/country/data/download/en/. Accessed: 9 April 2019.

[15] The World Bank. Mortality rate, infant (per 1000 live births) – Bangladesh. 2017. Available: https://data.worldbank.org/indicator/SP.DYN.IMRT.IN?locations=BD. Accessed: 9 April 2019.

[16] TL Miller, FA Wilson, JW Pang, S Beavers, S Hoger, and S Sharnprapai. Mortality hazard and survival after tuberculosis treatment. Am J Public Health. 2015;105:930-7. DOI: 10.2105/AJPH.2014.302431. [PMID:25790407]

[17] EW Tiemersma, MJ van der Werf, MW Borgdorff, BG Williams, and NJ Nagelkerke. Natural history of tuberculosis: duration and fatality of untreated pulmonary tuberculosis in HIV negative patients: a systematic review. PLoS One. 2011;6:e17601. DOI: 10.1371/journal.pone.0017601. [PMID:21483732]

[18] A Roy, M Eisenhut, RJ Harris, LC Rodrigues, S Sridhar, and S Habermann. Effect of BCG vaccination against Mycobacterium tuberculosis infection in children: systematic review and meta-analysis. BMJ. 2014;349:g4643 DOI: 10.1136/bmj.g4643. [PMID:25097193]

[19] World Health Organization. TB Expenditure and Utilization and health services in fiscal year 2017. Available: https://extranet.who.int/tme/generateCSV.asp?ds=expenditure_utilisation. Accessed: 2 January 2020.

[20] D Collins, F Hafidz, and D Mustikawati. The economic burden of tuberculosis in Indonesia. Int J Tuberc Lung Dis. 2017;21:1041-8. DOI: 10.5588/ijtld.16.0898. [PMID:28826455]

[21] Statistik BP. [Statistics of Incomes per February 2018]. 2018. Available: https://www.bps.go.id/publication/2018/06/04/769946b424c9a22b0732c3e5/statistik-pendapatan-februari-2018.html. Accessed: 24 June 2020.

[22] N Guo, CA Marra, F Marra, S Moadebi, RK Elwood, and JM Fitzgerald. Health state utilities in latent and active tuberculosis. Value Health. 2008;11:1154-61. DOI: 10.1111/j.1524-4733.2008.00355.x. [PMID:18489493]

[23] DG Walker, R Hutubessy, and P Beutels. WHO Guide for standardisation of economic evaluations of immunization programmes. Vaccine. 2010;28:2356-9. DOI: 10.1016/j.vaccine.2009.06.035. [PMID:19567247]

[24] A Machlaurin, FCK Dolk, D Setiawan, TS van der Werf, and MJ Postma. Cost-Effectiveness Analysis of BCG Vaccination against Tuberculosis in Indonesia: A Model-Based Study. Vaccines (Basel). 2020;8:707 DOI: 10.3390/vaccines8040707. [PMID:33256143]

[25] Indonesian Health Research and Development. National report of Indonesian Basic Health Research. Jakarta: Lembaga Penerbit Bandan Penelitian dan Pengembangan Kesehatan; 2019.

[26] P Nguipdop-Djomo, E Heldal, LC Rodrigues, I Abubakar, and P Mangtani. Duration of BCG protection against tuberculosis and change in effectiveness with time since vaccination in Norway: a retrospective population-based cohort study. Lancet Infect Dis. 2016;16:219-26. DOI: 10.1016/S1473-3099(15)00400-4. [PMID:26603173]

[27] UNICEF Supply Division. Bacillus Calmette–Guérin (BCG) vaccine price data. 2020. Available: https://www.unicef.org/supply/reports/bacillus-calmetteguérin-bcg-vaccine-price-data. Accessed: 20 August 2020.

[28] World Health Organization. Immunization, Vaccines and Biologicals. 2023. Available https://www.who.int/teams/immunization-vaccines-and-biologicals/vaccine-access/planning-and-financing/immunization-financing-indicators. Accessed: 11 August 2020.

[29] F Schaltz-Buchholzer, HN Frankel, and CS Benn. The real-life number of neonatal doses of Bacille Calmette-Guérin vaccine in a 20-dose vial. Glob Health Action. 2017;10:1-4. DOI: 10.1080/16549716.2017.1267964. [PMID:28169606]

[30] E Usuf, G Mackenzie, L Ceesay, D Sowe, B Kampmann, and A Roca. Vaccine wastage in The Gambia: a prospective observational study. BMC Public Health. 2018;18:864 DOI: 10.1186/s12889-018-5762-5. [PMID:29996802]

[31] MK Das, M Sood, MP Tambe, TD Sharma, MAG Parande, and JB Surwade. Documentation of vaccine wastage in two different geographic contexts under the universal immunization program in India. BMC Public Health. 2020;20:556 DOI: 10.1186/s12889-020-08637-1. [PMID:32334554]

[32] S Guichard, K Hymbaugh, B Burkholder, S Diorditsa, C Navarro, and S Ahmed. Vaccine wastage in Bangladesh. Vaccine. 2010;28:858-63. DOI: 10.1016/j.vaccine.2009.08.035. [PMID:19716458]

[33] S Byberg, AB Fisker, SM Thysen, A Rodrigues, U Enemark, and P Aaby. Cost-effectiveness of providing measles vaccination to all children in Guinea-Bissau. Glob Health Action. 2017;10:1329968. DOI: 10.1080/16549716.2017.1329968. [PMID:28580855]

[34] World Health Organization. Essential Programme on Immunization. 2023. Available: https://www.who.int/teams/immunization-vaccines-and-biologicals/essential-programme-on-immunization/supply-chain/supply-chain-tools. Accessed: 19 August 2020.

[35] World Health Organization. Global Tuberculosis Report 2017. Geneva: World Health Organization;2017.

Correspondence to:
Afifah Machlaurin
University of Jember
Kalimantan I no. 2 Jember
Indonesia
[email protected]