Mid- term evaluation of Save the Children in Uganda’s Strategic plan 2006-2009

Background
In line with SCN recommendation a mid-term review of the programme/strategy was conducted, focusing on both internal organizational issues and program progress in order to assess the extent to which SCiU has implemented the country 4-year programme plan and strategy. Particular attention was to be given to the logical coherence of the strategic plan; the results expected for children; the results achieved for children (and data on associated indicators), and progress towards sustainability in the form of ability to hand over programmes to partners.

Purpose/objective
Assess the progress of implementation of the country 4-year programme plan and strategy 2006-2009 and provide learning to make necessary adjustments for the second half of the strategy period and serve as reference for the preparation for the next strategy period.
 
Methodology
The review used a number of methods: Desk review of key project documents; programme visits and critical enquiry with SCiU staff and partners

Key findings
Progress and impact on children
Education: 147,515 children are enrolled in the operational areas (74,435 boys, 73,080 girls), of which SC is responsible for 11.3%. 1,890 deaf children have been enrolled in one project in the West. And 52,863 children are enrolled in non-formal education, together with 467 in vocational education and 9,902 in early childhood development. There is no systematic measurement of children’s academic performance, which makes it hard to know what the impact is. However, some data is presented which shows mixed impact. In non-formal education, one project (ABEK) conversion rate to formal education shows that only 12% successfully entered formal education.

Child Protection; 66 Child Protection Committees have been established with 1,208 members trained and 4,045 children counseled. The evaluation of the Child Resilience Project in Northern Uganda does suggest that the programme probably made a change in children’s psycho-social well being and recovery from the effects of the conflict. Unaccompanied children and street children have been reunited with their families. Though a significant number of street children, where follow-up is available, have returned to the streets. Some of the marginalized children have been provided with vocational training or income generation support. In the one case where the outcome has been measured, 57 out of 521 were able to successfully make a living. In this
programme too, children’s groups have been formed. Children’s issues have been recognized in peace protocols dealing with reconstruction and development in the North.

HIV and AIDS: 1,242 children living with HIV in Gulu are receiving free child-friendly services from four out of five health facilities, either prophylaxis against opportunistic infections or anti-retrovirals. This is 10.4% of the target population. Through innovative community-based support to drug adherence, clinical outcomes for these children have been dramatically improved. From 2005 until 2008, hospital admissions have been reduced from 10-15 a month to 5, and deaths from 2-3 to 6 a month with 6.5 times as many children in the programme. Psychosocial outcomes are also significant, as measured by indicators like children attending school and progressing, and the fact that 289 children chose to disclose their status after counselling. In Gulu, 428 mothers are accessing PTMCT, 19.55% of the target group and an over-achievement of the 15% of target. 128 children born to HIV+ mothers were tested and 114 (89%) were negative. The programme is achieving a high level of success. However, considered within the context of the strategy as a whole it is harder to track the impact of the HIV programme as a supporting programme.

Health and nutrition: The global malnutrition rate has been reduced to 3.2% (below the emergency threshold). The programme is now concentrating on developmental support. 17,310 children in 5,770 households are reached with seeds, agricultural inputs and training. A pervious phase of the programme supported 408 vulnerable households with implements and trainings. Over 80% of the beneficiaries registered a 50% increase in food production. Seventy five children are being supported in vocational education, though there is no information yet as to the outcomes of the training.

Partnership: There was considerable consistency in the way partners described and evaluated the relationship. Without distinction between public or civil society partners, the partnership was described as close, with joint problem solving, and shared vision, without SCiU “imposing”. At national level, the parliamentary forum for children described the relationship in broadly similar terms to the first group. The Children’s Commission of the Ministry of Gender Labour and Social Development assessed the partnership as broadly supportive and positive. However there are signs of problems in the working relationship. Asked about proposed changes in SCiU’s stance, some partners expressed the hope that SCiU would broker relationships with other funders for them. One partner suggested it would be helpful to get multi-year funding from SCiU, though on closer inspection this did not appear to be helpful or necessary.

Contribution to government strategy: SCiU’s advocacy work has been highly effective, contributing to national policy change in education and child protection. There is convincing evidence for Save the Children’s contribution to these changes. SCiU’s work has contributed 11.3% of the 147,515 children enrolled in school in its operational areas. It is suggested that future work concentrate more on educational quality. The success in lobbying for the revised education bill is significant, not only in the establishment of the principle of free universal primary education, but also in the recognition of the value of non-formal education. The amended defilement law is a major contribution to child protection, speeding up justice as well as allowing for diversion for children who are themselves guilty of defilement. SC has been instrumental in achieving the incorporation of children’s issues into the northern peace process. Most courageously SCiU braved government displeasure in publicizing human rights violations in the Karamoja disarmament process and has succeeded in achieving human rights training and procedures in UPDF operations.

Conclusions and recommendations
Results based management: Implement results-based management and use and routinely measure the impact indicators; Disaggregate all data by relevant dimensions of marginalization, specifically gender, disability, socio-economic status, HIV status, and children affected by conflict. Make efforts to ensure that the interventions are accessible to all children.

Education: Assess ways in which the gender gap in educational access and performance in the north can be closed; investigate the reasons for an apparent lack of impact on educational performance of SCiU interventions in schools in Kasese compared with Gulu ; measure educational outcomes in the non-formal education programmes and if necessary take steps to improve quality; analyse the level of conversion of vocational training into sustainable livelihoods and assess the cost-benefit; assess whether revised teaching methods work equally well fordisadvantaged children; Measure the outcomes of early childhood development for child development and track subsequent educational performance in schools by ECD graduates in order to assess whether there is a boost to school performance. Use this evidence to advocate for investment in pre-schooling

Child Protection: Develop operational measures of successful outcomes for children of the operations of the community-based protection networks; find out what children want from community based protection structures and what they think of the present ones; track outcomes for children in the justice system in terms of diversion rates and protection, and measure recidivism rate to test the success of diversion; probe whether cases of decline in the recorded incidence of child sexual abuse such as Katwe Kabatoro, are indeed true, and if so investigate why. Investigate in particular whether abusers have now become more clandestine and are terrorizing their victims into silence; clarify the number of children reached by the child protection programme and reassess the cost per child of programme delivery

HIV and Aids: Ensure the integration of HIV into other programmes by monitoring access for children living with HIV in education and protection programmes; ensure removal of fear-based messaging about AIDS in other programmes; ensure that young people have safe and confidential access to all means of protecting themselves including condoms

Partnerships: Develop criteria to measure the effectiveness of different types of partnership and compare them with the cost-effectiveness of self-implemented projects.

General: Develop a twin-track strategy for the north, simultaneously continuing support for young camp and urban dwellers, while also supporting extension of services