Evidence Menu

As part of your FLN journey, you can explore evidence-based interventions to improve FLN outcomes. The Education Evidence Menu draws on J-PAL's body of rigorous research, a series of recent academic studies and reviews, as well as an effort by the World Bank, FCDO, and the Building Evidence in Education (BE2) group, which UNICEF is a core part of, to invest in "Smart Buys" to improve foundational learning.  

Synthesising evidence for the menu involved both quantitative data as well as expert judgement capturing qualitative insights, the importance of context, scale, and equity.

The contents of this menu will likely be most useful after you have already conducted a local diagnostic and prioritisation to identify top barriers to FLN in your context. One approach to identify your FLN barriers is through an analysis using UNICEF's 10 determinant framework. For detailed guidance on how to conduct such an analysis, please see here. The four domains of this determinant framework (enabling environment [EE]; supply [S]; demand [D]; and quality [Q]) are used to frame the barriers in the Evidence Menu.


Another resource to help users get acquainted with the magnitude of FLN challenges in their own countries and across countries is this UNICEF Education Pathway Analysis dashboard. It provides a visual understanding of whether children are getting adequate access to primary education, analyzes progression, and to what extent the transition from primary to secondary education is happening. This data (global and country-level) can help users better understand children's educational trajectory and reveal the FLN challenges that may be at the root of inequalities of educational attainment.

This in turn can inform the diagnostic of FLN barriers for your context. After you have reviewed the evidence in this menu to identify both ineffective and effective FLN approaches to address a given barrier, next steps include determining how to take action, e.g. invest in a proof of concept in your context, scale-up an approach, generate additional research, etc.

This resource was produced by the Abdul Latif Jameel Povery Action Lab (J-PAL) under the Unicef FLN Initiative in close collaboration with Noam Angrist (University of Oxford; Young 1ove). We thank the Foreign, Commonwealth, and Development Office for inputs and useful discussions.

Criteria and Factors Considered

Equity

Dropdown
© UNICEF/UN0482321
The menu includes interventions that improve education outcomes for the most marginalized students and for students at scale, which means schooling and learning for all.

Outcomes

Dropdown
© UNICEF/UN0518452/Bidel
The menu focuses on identifying the evidence-based approaches that are cost-effective in improving learning in basic education, measured in terms of core cognitive skills (typically literacy and numeracy). In cases where impacts on cognitive skills are often not measured, such as early childhood development, we have relied on proxies such as effects on school readiness.
 

Scale

Dropdown
© UNICEF/UN0474123/Panjeta
Given the scale of the learning crisis, and UNICEF's in-depth collaboration with governments around the world, we prioritize approaches that have been tested at a large scale, and/or have the potential to scale.

System reform

Dropdown
© UNICEF/UN0521681/Mawa
To address the learning crisis, a suite of reforms will be needed to achieve long-term system strengthening. The approaches outlined in this menu are only a part of this system-wide reform, rather than any one approach being a silver bullet. Many of these approaches can be combined to achieve greater impacts and have complementarities.

Of note, while long-term reform is the ultimate goal, individual approaches can still close substantial learning gaps on their own, and in the process, catalyze long-term systems change.

Shifting current spending versus allocating new spending

Dropdown
© UNICEF/UN0517426/Panjwani
Even small changes to "business as usual" approaches in education can be more cost-effective than adopting entirely new approaches. Many education systems have large line-items and expenditures on approaches reviewed in this evidence menu. Rather than allocating new funding, simply shifting current spending towards more evidence-based approaches could achieve substantial learning progress.

State of the Evidence

Dropdown
© UNICEF/UN0506771/Ijazah
This menu reflects the current state of the evidence reviewed across multiple disciplines, though largely draws on education and economics. Over time, as more studies become available, the evidence may evolve.

Explore the Evidence Menu

To use the Evidence Menu, first select from the drop-down "Barrier" menu the barrier to learning you hope to overcome with a programme.

You may also add other filters (domain focus, cost effectiveness, evidence strength, action takeaway).  After selecting an option from a drop-down, if you wish to explore another option you must unselect the original option and then click on the other option.

Click on "Terms and Definitions" below to find out more about the filter categories.

If you prefer using an offline version of the Evidence Menu, please click on this link, which has instructions on how to use the document offline or without internet access.
Terms and definitions

Evidence strength: The menu includes the following categories to capture effectiveness and level of evidence: "Strong evidence of effectiveness" indicates a lot of evidence exists and the approach is typically effective; "Promising evidence but some uncertainty" indicates there is high potential, with perhaps a few studies showing strong effects, but other studies showing minimal effects, hence there is uncertainty, either since the intervention is highly contextual or varies due to difficulty in implementation, among other factors; "Strong evidence of ineffectiveness" indicates there is a lot of evidence and the approach is typically ineffective; and "More evidence is needed" indicates an important topic which is of central importance or a core component of many education systems, yet there is minimal evidence or mixed evidence to date.

Cost-effectiveness: This dimension combines effectiveness information with cost data, either directly from a given set of studies or estimated due to the nature of the intervention. For example, information interventions are known to be typically very cheap. We include multiple categories: "high" which indicates a program that is highly effective and relatively cheap, such as "teaching at the right level", or moderately effective but very cheap, such as information interventions; "medium" indicates a program that is highly effective but expensive or somewhat effective and cheap, or may indicate high variation in cost-effectiveness among the programs included in the category; "low" indicates a program that is somewhat effective and expensive; "unknown" indicates a category with few costed impact evaluations to date.

Evidence to action takeaway: The evidence to action takeaway categories include: (a) pilot/scale (b) test/research. Approaches that have evidence of high and consistent effectiveness are recommended for direct action through pilots to demonstrate local proof of concept and generate momentum in-country; scale-up is recommended especially if an existing country effort is operational and ready for scale. For approaches with limited evidence, mixed evidence, or high variation in effectiveness in the literature, more evidence generation is recommended to close evidence gaps. These takeaways are meant to only be a guide rather than a definitive recommendation. In some cases, even effective and well-studied interventions might benefit from further research, for example, to test scale pathways or to optimise programs for cost-effectiveness.

Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Providing information to parents or students about education

Programs that make education-related information available to parents or students have increased learning outcomes at low cost.

[D] Parents and communities do not have information on the best ways to encourage learning, [D] Student motivation is low
Parent
High
Strong evidence of effectiveness
Pilot/Scale
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Targeting instruction by learning level rather than age or grade

Research from many different contexts have shown that programs that target instruction to students’ current learning level rather than their age or grade can increase learning outcomes.

[Q] Teachers are not equipped to provide quality FLN instruction, [Q] Children's differential needs are not being met in the classroom, [EE] Education systems aren't providing access to inclusive and equitable education
Leaders, Learners, Teachers
High
Strong evidence of effectiveness
Pilot/Scale
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Structured pedagogy

This includes four broad elements: (1) student materials; (2) lesson plans for teachers; (3) teacher training; and (4) ongoing support to teachers.

[Q] Teachers are not equipped to provide quality FLN instruction
Leaders, Teachers, Learners
High
Strong evidence of effectiveness
Pilot/Scale
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Merit-based scholarships to low-income youth

There are two pathways through which financial resources may affect motivation and ultimately learning outcomes: merit-based aid and directly motivating student effort.

[S] Children do not have universal access to education, [D] Student motivation is low
Learner
Medium
Strong evidence of effectiveness
Pilot/Scale
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Early childhood education

Early childhood education can be delivered through public preschools and kindergartens, encouraged by supporting parents to engage with their child’s education, or both.

[S] Children do not have high-quality early learning opportunities
Leaders
Medium
Strong evidence of effectiveness
Pilot/Scale
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
School-based health interventions

Child health programs may improve learning outcomes, and schools are an especially important, convenient, and cost-effective venue to deliver these interventions.

[Q] Children's differential needs are not being met in the classroom
Leaders, Parents, Learners
Medium
Promising evidence but some uncertainties
Pilot/Scale
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Early childhood stimulation

Evidence shows that encouraging caregivers to play and interact with children improves cognitive development.

[S] Children do not have high-quality early learning opportunities, [D] Parents and communities do not have information on the best ways to encourage learning
Learners
Medium
Promising evidence but some uncertainties
Pilot/Scale
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Reduce travel times to schools

Reducing the travel time of attending school can increase both school participation and learning outcomes.

[S] Children do not have universal access to education, [EE] Education systems aren't providing access to inclusive and equitable education
Leaders, Learners
Medium
Promising evidence but some uncertainties
Test/Research
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Mother tongue instruction

Experimental and non-experimental evidence from a variety of contexts indicates instruction in a child’s L1 (mother tongue) has a positive effect on learning.

[Q] Children's differential needs are not being met in the classroom, [EE] Education systems aren't providing access to inclusive and equitable education
Leaders, Teachers, Learners
Unknown
Promising evidence but some uncertainties
Test/Research
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Teacher accountability and incentives

Financial rewards for teachers conditional on either increased effort or improved results may be effective for improving student learning in contexts where teacher effort is particularly low.

[Q] Teachers are not equipped to provide quality FLN instruction
Leaders, Teachers
Medium
Promising evidence but some uncertainties
Test/Research
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Community involvement in school management

When community programmes have been effective, they often improved both learning and participation; when they were not effective, they usually improved neither.

[D] Parents and communities do not have information on the best ways to encourage learning
Parents
Medium
Promising evidence but some uncertainties
Test/Research
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Education technology

Evidence of programs that leverage education technology closely follow existing lessons about increasing learning outcomes from non-technology interventions.

[Q] Teachers are not equipped to provide quality FLN instruction, [Q] Children's differential needs are not being met in the classroom, [D] Parents and communities do not have information on the best ways to encourage learning
Leaders, Learners
Medium
Promising evidence but some uncertainties
Test/Research
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Additional inputs alone without accompanying changes in pedagogy or governance

Adding inputs into a classroom to support business-as-usual modes of schooling without changing anything else has not been effective at increasing learning outcomes.

Leaders, Teachers
Low
Strong evidence of ineffectiveness
Augment
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Teacher training

This brief describes the state of the evidence, contextual and equity considerations when designing teacher training programs, and suggestions for applying the information in practice.

[Q] Teachers are not equipped to provide quality FLN instruction
Leaders, Teachers
Low
More evidence needed
Test/Research
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Selection and allocation of teachers

Based on the current evidence, researchers suggest a policy of selective tenure.

[Q] Teachers are not equipped to provide quality FLN instruction
Leaders, Teachers
Unknown
More evidence needed
Test/Research
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Differentiating support by gender

This brief describes the state of the evidence, contextual and equity considerations when designing programs for girls, and suggestions for applying the information in practice.

[Q] Children's differential needs are not being met in the classroom, [EE] Education systems aren't providing access to inclusive and equitable education
Leaders, Learners
Unknown
More evidence needed
Test/Research
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Targeted support for children living with disabilities

There are a variety of inclusive education programs that may be effective at increasing access to education and learning outcomes for children with disabilities.

[Q] Teachers are not equipped to provide quality FLN instruction, [Q] Children's differential needs are not being met in the classroom, [EE] Education systems aren't providing access to inclusive and equitable education
Leaders, Learners
Unknown
More evidence needed
Test/Research
Doc 1Doc 2GoLinkLinkTool 2ToolDownloadDownload 2Quizquiz 2
Safeguarding children from violence at school

There is broad agreement on the importance of safeguarding children though there is limited experimental research on the most effective approaches to best protect children from violence in school.

[EE] Children are not protected from violence in school
Leaders, Teachers, Learners
Unknown
More evidence needed
Test/Research