Midterm Project Evaluation (MTE)

Background

AFU is a Non-Governmental Organisation implementing a 10 year project (2010-2019) partly funded by Norwegian Aid (NORAD) through AFN. The review focuses on the project titled, ”Continued Quality Services to Children with physical Disability in Lira and Alebtong Districts” run at Lira Rehabilitation Centre. Secondary it is an evaluation of the organization as AFU runs only this project and is as old as the project.

Purpose/objective

The purpose of this MTE is to assess the project performance and progress to establish the distance travelled and direction taken in implementing the project; the extent to which the project is achieving its goals and objectives and producing expected outcomes/impacts on target beneficiaries.

Methodology

The methodology included a combination of quantitative and qualitative evaluation design.  Primary data collection was undertaken in four of the five AFN and NORAD supported sub counties. Quantitative data was obtained from children who have received direct services from AFU.  Qualitative data was obtained from project documents, child beneficiaries, members of parent support groups, local government officials, teachers and AFU staff and board members.

Key findings

Relevance of the project: The project is innovative and fit for purpose- it can enable AFU achieve its goals. In northern Uganda the rehabilitation of Children with Disability (CWD) by the responsible statutory institutions rarely go beyond giving out a few wheelchairs and where poverty limits access to private fee paying rehabilitation services, any rehabilitation project that includes physiotherapy, surgery and the provision of assistive devices would be relevant. AFU’s approach goes further to address the livelihood of the CWD once returned to his/her family, the skills of teachers and the accessibility of schools; in essence extending its intervention into the communities where the CWD live and significantly increasing the impact of the project. There is also a verifiable linkage between the objectives and outcomes of this project and Uganda’s development priorities as espoused in its child and disability related policies and plans. However, the implementation of Formely Abducted Children (FAC) component in the project is no longer relevant.

Project effectiveness (implementation, monitoring and evaluation)

The synergy resulting from the implementation of IR and CBR means that the CWD’s right to good health, food, shelter, education are addressed. It also builds the capacity of community actors to understand the causes of disability and to treat CWD without discrimination. However, in some cases, poor care at CBR stage reduces the effectiveness of the project. The implementation of activities as planned are robust and carried out with good intentions. Weaknesses in the staff capacity, lack of systematic monitoring and annual reviews are some of the gaps in the implementation process.

Sustainability

AFUs attempt towards financial sustainability through serving paying adult physiotherapy outpatients has not been as successful so far.

Stakeholder collaboration

AFU is good at winning the support of elected representatives and civil servants.  It has also increased their capacity to address disability in their respective areas of work. Collaboration with Plan appears to be working well, but could be more effective.  Other than CPU, the relationship between AFU and schools, vocational institutions and NUDIPU is fruitful.

Recommendations

1.  Review the relevance of FAC as a beneficiary group. End collaboration with CPU.
2. Improve activity planning by drawing up an annual plan of activities and conducting annual review and planning retreats.
3. Strengthen monitoring and follow-up by designing and utilising systemic data collection instruments and review the implementation of follow up of CBR activities.
4. Improve the quality of IR at LRC by drawing up and implementing a policy on occupancy and child protection, and instituting a casework approach which includes case conferences, having a single case file per CWD and a named caseworker for each CWD.
5. Make the physiotherapy services for paying outpatients better known to the public.
6. Consider undertaking commercial activities in the rehabilitation industry 
7. Review collaboration with Plan with the intention of improving the terms of the agreement.

Comments from the organisation

AFN and AFU has discussed and taken into consideration the recommendations in the report. We are pleased to be on the right track, and have started adjusting where there is room for improvements according to the MTE. We value also the fruitful dialogue we have had with Mr. Augustine Omara from AJP.