A Review of Meta-Analyses in Education: Methodological Strengths and Weaknesses
Source: Review of Educational Research, 82(4), December 2012, p. 436-476.
This review addresses the validity of published meta-analyses in education that determines the credibility and generalizability of study findings.
The authors' objectives were to evaluate the current meta-analytic practices in education, identify methodological strengths and weaknesses, and provide recommendations for improvements in order to generate a more valid and credible knowledge base of what works in practice.
They used a total of 56 meta-analyses published in education in the 2000s.
The review was found that 56 meta-analyses followed general recommendations fairly well in problem formulation and data collection, but much improvement is needed in data evaluation and analysis.
Particularly, lack of information reported as well as little transparency in the use of statistical methods are concerns for generating credible and generalizable meta-analytic findings that can be transformed to educational practices.