Table 2

Quality assessment of studies of PC conjugate vaccines on pneumonia related outcomes

PC vaccinesQuality assessment
Directness
No of events
No of studies (ref.)DesignLimitationsaConsistencybGeneralizability to population of interestcGeneralizability to intervention of interestdInterventionControlRR (95% CI)
LRTI specific mortalitye: Very low outcome specific quality of evidencef
1 (HIV- children from Klugman et al.18)RCTNot designed to look at effect on mortalityn/aOnly 1 study9-valent pneumococcal conjugate CRM-19718220.82 (0.44, 1.52)
All cause mortalitye: Very low outcome specific quality of evidence
2 (HIV- children from Cutts FT et al.17 and Klugman KP et al.18)RCTNot designed to look at effect on mortality and for 1 study per protocol analysisBoth studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1973664250.85 (0.74, 0.98)g
Radiologically confirmed pneumoniae: Moderate outcome specific quality of evidence
2 (HIV- children from Cutts FT et al.17 and Klugman KP et al.18)RCTNo majorHeterogeneity from meta-analysis (P = 0.09); both studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1975578020.71 (0.58, 0.87)h
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur1191410.84 (0.66, 1.07)
3 (Cuts et al.17, HIV- children from Klugman et al.18, Lucero et al.19)RCTSee aboveHeterogeneity from meta-analysis (P = 0.09); all studies show benefitAfrica, AsiaAll valent6769430.74 (0.63, 0.88)
Clinical severe pneumoniae: Moderate outcome specific quality of evidence
2 (HIV-children from Cutts et al.17 and Klugman et al.18)RCTNo major, for one study per protocol analysisBoth studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1977638540.89 (0.81, 0.98)
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur3973831.03 (0.90, 1.19)
3 (HIV-children from Cutts et al.17 and Klugman et al.18, Lucero et al.19)RCTSee above2 of 3 studies show benefitAfrica, AsiaAll valent116012370.93 (0.86, 1.01)
Clinical pneumoniae: Moderate outcome specific quality of evidence
2 (HIV-children from Cutts et al.17 and Klugman et al.18)RCTNo major, for one study per protocol analysisHeterogeneity from meta-analysis (P = 0.08); both studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-197273829650.89 (0.80, 0.99)
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur109310801.08 (0.93, 1.10)
3 (Cutts et al.17, HIV- children from Klugman et al.18, Lucero et al.19)RCTSee aboveHeterogeneity from meta-analysis (P = 0.03); 2 of 3 studies show benefitAfrica, AsiaAll valent383140450.93 (0.85, 1.02)
PC vaccinesQuality assessment
Directness
No of events
No of studies (ref.)DesignLimitationsaConsistencybGeneralizability to population of interestcGeneralizability to intervention of interestdInterventionControlRR (95% CI)
LRTI specific mortalitye: Very low outcome specific quality of evidencef
1 (HIV- children from Klugman et al.18)RCTNot designed to look at effect on mortalityn/aOnly 1 study9-valent pneumococcal conjugate CRM-19718220.82 (0.44, 1.52)
All cause mortalitye: Very low outcome specific quality of evidence
2 (HIV- children from Cutts FT et al.17 and Klugman KP et al.18)RCTNot designed to look at effect on mortality and for 1 study per protocol analysisBoth studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1973664250.85 (0.74, 0.98)g
Radiologically confirmed pneumoniae: Moderate outcome specific quality of evidence
2 (HIV- children from Cutts FT et al.17 and Klugman KP et al.18)RCTNo majorHeterogeneity from meta-analysis (P = 0.09); both studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1975578020.71 (0.58, 0.87)h
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur1191410.84 (0.66, 1.07)
3 (Cuts et al.17, HIV- children from Klugman et al.18, Lucero et al.19)RCTSee aboveHeterogeneity from meta-analysis (P = 0.09); all studies show benefitAfrica, AsiaAll valent6769430.74 (0.63, 0.88)
Clinical severe pneumoniae: Moderate outcome specific quality of evidence
2 (HIV-children from Cutts et al.17 and Klugman et al.18)RCTNo major, for one study per protocol analysisBoth studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1977638540.89 (0.81, 0.98)
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur3973831.03 (0.90, 1.19)
3 (HIV-children from Cutts et al.17 and Klugman et al.18, Lucero et al.19)RCTSee above2 of 3 studies show benefitAfrica, AsiaAll valent116012370.93 (0.86, 1.01)
Clinical pneumoniae: Moderate outcome specific quality of evidence
2 (HIV-children from Cutts et al.17 and Klugman et al.18)RCTNo major, for one study per protocol analysisHeterogeneity from meta-analysis (P = 0.08); both studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-197273829650.89 (0.80, 0.99)
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur109310801.08 (0.93, 1.10)
3 (Cutts et al.17, HIV- children from Klugman et al.18, Lucero et al.19)RCTSee aboveHeterogeneity from meta-analysis (P = 0.03); 2 of 3 studies show benefitAfrica, AsiaAll valent383140450.93 (0.85, 1.02)

aLimitations include comments on such aspects as blinding, placebo, how valid is the measure (i.e. self reported incidence vs. active case detection) for each study included.

bConsistency is a summary measure of the heterogeneity of the meta-analysis and a short description applying judgment based on the overall directionality of the effect.

cGeneralizability to population of interest examines the age of the children and the regions the studies were conducted in for each meta-analysis.

dGeneralizability to intervention of interest examines how direct the intervention is measured.

eOutcome definition for each study described in Supplementary Table 2b.

fMore information about the quality grades is presented in Supplementary Table b.

gMantel-Haenszel pooled RR, fixed effect meta-analysis.

hDerSimonian-Laird pooled RR, random effect meta-analysis. The bold value indicates the fact that this outcome was used to infer the effect of Hib vaccines on pneumonia mortality.

Table 2

Quality assessment of studies of PC conjugate vaccines on pneumonia related outcomes

PC vaccinesQuality assessment
Directness
No of events
No of studies (ref.)DesignLimitationsaConsistencybGeneralizability to population of interestcGeneralizability to intervention of interestdInterventionControlRR (95% CI)
LRTI specific mortalitye: Very low outcome specific quality of evidencef
1 (HIV- children from Klugman et al.18)RCTNot designed to look at effect on mortalityn/aOnly 1 study9-valent pneumococcal conjugate CRM-19718220.82 (0.44, 1.52)
All cause mortalitye: Very low outcome specific quality of evidence
2 (HIV- children from Cutts FT et al.17 and Klugman KP et al.18)RCTNot designed to look at effect on mortality and for 1 study per protocol analysisBoth studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1973664250.85 (0.74, 0.98)g
Radiologically confirmed pneumoniae: Moderate outcome specific quality of evidence
2 (HIV- children from Cutts FT et al.17 and Klugman KP et al.18)RCTNo majorHeterogeneity from meta-analysis (P = 0.09); both studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1975578020.71 (0.58, 0.87)h
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur1191410.84 (0.66, 1.07)
3 (Cuts et al.17, HIV- children from Klugman et al.18, Lucero et al.19)RCTSee aboveHeterogeneity from meta-analysis (P = 0.09); all studies show benefitAfrica, AsiaAll valent6769430.74 (0.63, 0.88)
Clinical severe pneumoniae: Moderate outcome specific quality of evidence
2 (HIV-children from Cutts et al.17 and Klugman et al.18)RCTNo major, for one study per protocol analysisBoth studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1977638540.89 (0.81, 0.98)
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur3973831.03 (0.90, 1.19)
3 (HIV-children from Cutts et al.17 and Klugman et al.18, Lucero et al.19)RCTSee above2 of 3 studies show benefitAfrica, AsiaAll valent116012370.93 (0.86, 1.01)
Clinical pneumoniae: Moderate outcome specific quality of evidence
2 (HIV-children from Cutts et al.17 and Klugman et al.18)RCTNo major, for one study per protocol analysisHeterogeneity from meta-analysis (P = 0.08); both studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-197273829650.89 (0.80, 0.99)
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur109310801.08 (0.93, 1.10)
3 (Cutts et al.17, HIV- children from Klugman et al.18, Lucero et al.19)RCTSee aboveHeterogeneity from meta-analysis (P = 0.03); 2 of 3 studies show benefitAfrica, AsiaAll valent383140450.93 (0.85, 1.02)
PC vaccinesQuality assessment
Directness
No of events
No of studies (ref.)DesignLimitationsaConsistencybGeneralizability to population of interestcGeneralizability to intervention of interestdInterventionControlRR (95% CI)
LRTI specific mortalitye: Very low outcome specific quality of evidencef
1 (HIV- children from Klugman et al.18)RCTNot designed to look at effect on mortalityn/aOnly 1 study9-valent pneumococcal conjugate CRM-19718220.82 (0.44, 1.52)
All cause mortalitye: Very low outcome specific quality of evidence
2 (HIV- children from Cutts FT et al.17 and Klugman KP et al.18)RCTNot designed to look at effect on mortality and for 1 study per protocol analysisBoth studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1973664250.85 (0.74, 0.98)g
Radiologically confirmed pneumoniae: Moderate outcome specific quality of evidence
2 (HIV- children from Cutts FT et al.17 and Klugman KP et al.18)RCTNo majorHeterogeneity from meta-analysis (P = 0.09); both studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1975578020.71 (0.58, 0.87)h
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur1191410.84 (0.66, 1.07)
3 (Cuts et al.17, HIV- children from Klugman et al.18, Lucero et al.19)RCTSee aboveHeterogeneity from meta-analysis (P = 0.09); all studies show benefitAfrica, AsiaAll valent6769430.74 (0.63, 0.88)
Clinical severe pneumoniae: Moderate outcome specific quality of evidence
2 (HIV-children from Cutts et al.17 and Klugman et al.18)RCTNo major, for one study per protocol analysisBoth studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-1977638540.89 (0.81, 0.98)
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur3973831.03 (0.90, 1.19)
3 (HIV-children from Cutts et al.17 and Klugman et al.18, Lucero et al.19)RCTSee above2 of 3 studies show benefitAfrica, AsiaAll valent116012370.93 (0.86, 1.01)
Clinical pneumoniae: Moderate outcome specific quality of evidence
2 (HIV-children from Cutts et al.17 and Klugman et al.18)RCTNo major, for one study per protocol analysisHeterogeneity from meta-analysis (P = 0.08); both studies show benefitOnly Africa9-valent pneumococcal conjugate CRM-197273829650.89 (0.80, 0.99)
1(19)RCTNo majorn/aOnly 1 study11-valent pneumococcal sanofi pasteur109310801.08 (0.93, 1.10)
3 (Cutts et al.17, HIV- children from Klugman et al.18, Lucero et al.19)RCTSee aboveHeterogeneity from meta-analysis (P = 0.03); 2 of 3 studies show benefitAfrica, AsiaAll valent383140450.93 (0.85, 1.02)

aLimitations include comments on such aspects as blinding, placebo, how valid is the measure (i.e. self reported incidence vs. active case detection) for each study included.

bConsistency is a summary measure of the heterogeneity of the meta-analysis and a short description applying judgment based on the overall directionality of the effect.

cGeneralizability to population of interest examines the age of the children and the regions the studies were conducted in for each meta-analysis.

dGeneralizability to intervention of interest examines how direct the intervention is measured.

eOutcome definition for each study described in Supplementary Table 2b.

fMore information about the quality grades is presented in Supplementary Table b.

gMantel-Haenszel pooled RR, fixed effect meta-analysis.

hDerSimonian-Laird pooled RR, random effect meta-analysis. The bold value indicates the fact that this outcome was used to infer the effect of Hib vaccines on pneumonia mortality.

Close
This Feature Is Available To Subscribers Only

Sign In or Create an Account

Close

This PDF is available to Subscribers Only

View Article Abstract & Purchase Options

For full access to this pdf, sign in to an existing account, or purchase an annual subscription.

Close