Please see attached document and below is the instruction:  1. Complete calculations and provide answers for scenario 1 and scenario 2. 2. Write a short narrative (1-3 paragraphs) about the advice tha

Worksheet: Managing expectations about how much detail can be obtained from the evaluation?

Purpose:

Understand the tension between providing coverage estimates for small disaggregated administrative levels and time and budget constraints.

Be able to provide advice to implementers

Tasks

  1. Complete calculations and provide answers for scenario 1 and scenario 2.

  2. Write a short narrative (1-3 paragraphs) about the advice that you would give to implementers about how to handle the tension between providing coverage estimates that are useful for decision making while taking into consideration time and budget constraints. The aim is to make sure that implementers understand what to expect from the evaluation before it is undertaken.


The situation (based on Yemen):

Project Objective: By end of project, DPT3 coverage among 12-23-month children will have increased by 20 percentage points.

The project area probably has low coverage at baseline (i.e. 50%)

The project will be implemented in 3 governorates and 3 districts in each governorate for a total of 9 districts. Each district has 270 communities. The project area of each governorate has 810 communities

As part of the evaluation you are designing a household survey.

Assume that:

  • You will only interview mothers of children 12-23 months

  • You will use a 30x10 cluster design, so you only visit 1 community for every 10 mothers interviewed

  • To significantly demonstrate a 20-percentage point change you need a sample size of 300 at baseline and 300 at final

  • The unit cost of reaching a community is $80

  • It costs $2 to process one interview

Remember: You Can only significantly demonstrate a 20-percentage point increase in a given area by 300 interviews at baseline and 300 at final

Scenario 1: Calculate total survey cost if want to see change in coverage at the district level

Calculate for baseline:

Sample size needed for each district ________________________

Number of communities to be visited in each district ________________________

Cost of reaching communities in each district ________________________

Cost of processing interviews for each district ________________________

Total cost/ district ________________________

Total cost of survey of entire project area ________________________

Calculate total cost of survey for both baseline and final (district level estimates) ________________

Scenario 2: Calculate total survey cost if want to see change in coverage at the governorate level

Sample size needed for each governorate ________________________

Number of communities to be visited in each governorate ________________________

Cost of reaching communities in each governorate ________________________

Cost of processing interviews for each governorate ________________________

Total cost/ governorate ________________________

Total cost of survey of entire project area ________________________

Calculate total cost of survey for both baseline and final (governorate level estimates) ____________

Write a narrative about advice that you would give implementers