Apply concepts learned to date to explain and critique an educational evaluation funded by the World Bank.
Please read carefully Blimpo and Evans (2011), “School-Based Management and Educational Outcomes:
Lessons from a Randomized Field Experiment,” World Bank. Focus in particular on the evaluation logic and design and the substance of the reported findings rather than the specific statistical analyses conducted to derive the findings.
Answer the following questions to explain the logic of the experiment and consider potential validity threats.
Some of the terms are underlined.
As part of your answer, briefly define the underlined terms in your own words (not quoting from the textbook or other readings), and explain why this concept or technique is important in evaluation.
1. The article does not elaborate a logic model, but there is a design logic underlying the intervention and short- and longer-term impact measures.
Outline a logic model for the program, with attention to inputs, processes, outputs, and outcomes..
2. Identify two researchable questions that were addressed in this evaluation.
3. Describe the specific experimental design used in this study, and use RXO notation to illustrate the design.
4. From a standpoint of internal validity, explain why this design is superior to the following.
For each of the following, also define the design and illustrate it using XO notation:
a. Single-group interrupted time-series design.
b. Unequal comparison group post-test-only design.
c. Unequal comparison pre-post test design.
5. The authors state: “The schools were clustered in groups of 2 or 3 schools on the basis of geographic proximity to limit contamination while allowing useful exchange and cooperation between nearby schools.”
The clustering of schools is illustrated in Figure 6.
a. What threats to internal validity might arise from clustering schools in this fashion?
b. Discuss potential tensions between validity and experimental ethics in the context of this case.
6. Discuss how the authors use site-based observation of school practices to assess internal validity with respect to the experimental treatment.
7. Discuss the findings regarding the impact of Whole School Development on educational outcomes.
How do the authors explain these findings?
8. From a standpoint of external validity, what might be some limitations on generalizability of these findings to other contexts?
9. If you were a World Bank grantor, what would you conclude about future policy based on the outcome of this particular field experiment?
How confident would you be in the findings, and why?
This material may consist of step-by-step explanations on how to solve a problem or examples of proper writing, including the use of citations, references, bibliographies, and formatting. This material is made available for the sole purpose of studying and learning - misuse is strictly forbidden.1. The article does not elaborate a logic model, but there is a design logic underlying the intervention and short- and longer-term impact measures. Outline a logic model for the program, with attention to inputs, processes, outputs, and outcomes. The design logic in this process was about effectively building the capacity of the locals to implement the administrative processes necessary to run and operate an effective learning community based in research based results and practices. From the beginning to the end of this endeavor all stakeholders were involved in the processes. Data collection was cemented on an annual basis....