Scope of Work
For AN EXTERNAL CONSULTANT FOR FINAL EVALUATION
For CRS Timor-Leste Laletek (Bridge) Project
Purpose
Catholic Relief Services Timor-Leste Program (CRS/TL) is looking for an external consultant to conduct a final evaluation for a USAID and CRS-funded Laletek (Bridge) project. The evaluator will be required to conduct a participatory evaluation in 6 targeted aldeias and neighboring aldeias in six sukus – Becora, Bidau Santa Ana, Camea, Comoro, Fatuhada and Mascarenhas - in Dili in February 2012. This evaluation is important to record project results, lessons learned, good practices and challenges after a two-year implementation period towards realizing its goal to help opposing groups reduce violent conflict against each other.
Background
CRS began working in Timor-Leste 1979-1983, providing famine relief and agriculture support. In 1999, it reopened its program in response to violence following the referendum, and focuses on achieving its agency-wide goal of achieving a just society, based on the right relationships that enable people to reach their full potential. CRS’ current program areas include livelihood, emergency preparedness, health, peacebuilding and governance.
In peace and reconciliation, CRS worked with civil society and government bodies in Timor-Leste in preparation for the referendum in 1999 and during the early transition period (2001-2002). CRS built a network of peace partners, strengthening their capacities in conflict resolution, communication and dialogue skills to bridge gaps and reach out to opposing groups that played critical roles in facilitating peacebuilding. The Frontier Youth Peace and Solidarity in Action (FYPSA) project in the border districts of Bobonaro and Covalima helped local youth groups to contribute positively to their community (2006-2009). CRS/TL has worked in conflict mitigation through the IDP Camp Support and Facilitating IDP Returns and Reintegration program, funded by USAID’s Office of Foreign Disaster Assistance (OFDA) in Dili and Baucau (2006-2009). Through UNDP-funded Return and Continued Support (RACS) Project (2008-2010), CRS worked to support local communities to create conditions for families to return to their homes and live in peace with their neighbors.
The Laletek Project is a two-year project (March 15, 2010 – March 14, 2012) funded by USAID’s Office of Conflict Management and Mitigation and CRS, implemented in six sucos in the capital district, Dili, by CRS local partner, the Diocesan Justice and Peace Commission of Dili (DJPC). The Laletek Project aims at addressing local level conflict through people-to-people approaches to achieve the goal that opposing groups in targeted aldeias reduce violent conflict with each other, which will be achieved through its two strategic objectives:
SO1: Opposing groups in targeted aldeias develop healthy relationships with each other
SO2: Opposing groups in targeted aldeias collaborate non-violently to manage and maintain existing, new, or renovated local infrastructure.
The project uses three theories of change, which correspond to those found in the “Healthy Relationships” (third) family of theories of change in support of achieving this overall goal:
• If opposing groups learn more about one other’s experiences, then they will be more willing to see each other as human beings rather than as enemies to be vilified.
• If opposing groups see each other as fellow human beings, then they will be more willing to focus on what connects rather than what divides them.
• If opposing groups are willing to connect and work constructively together on issues of collective interest, then they will be less likely to engage in acts of violence against one other.
Objectives of the Final Evaluation
The final evaluation has the following objectives:
1. To evaluate the performance of Laletek Project based on standard evaluation criteria, i.e. – its overall effectiveness and efficiency, its relevance and appropriateness re current context, impacts (the changes at personal, relational, structural and cultural dimensions), and sustainability of the interventions beyond 2012.
2. To contribute towards organizational learning through the documentation of best practices and lessons learned, and provide recommendations for future peacebuilding projects for CRS, DJPC, USAID and other stakeholders.
Methodology
• All relevant project documents and materials will be made available by CRS Laletek Project Staff for the evaluator prior to the evaluation, including project proposal, baseline report, mid-term evaluation report, six-monthly reports to donor, bulletins, comic book, DVDs, etc.
• Participatory tools such as Focus Group Discussions (FGD) and Key Informant Interviews (KII) with project beneficiary and non-beneficiary will be used for data collection in the selected project locations, where project activities were implemented from March 2010 up to January 2012.
• The target interviewees consisting of individuals with most significant change and those that contribute most to the project to be evaluated have been identified by Laletek project team, the consultant is expected to provide advice on this
• Staff reflection and interviews will be conducted with identified CRS staff and partner staff (DJPC).
• During the evaluation, CRS Laletek Project staff will be assigned to support the evaluator in community organization and logistical arrangements.
• Presentation of preliminary findings will be done after field work by the evaluation team to relevant stakeholders, including but not limited to CRS, USAID representatives, the Diocesan Justice and Peace Commission of Dili (DJPC), and other relevant stakeholders.
• Feedback and recommendation from the presentation will be incorporated into the Final Report by the evaluator.
The report will be presented based on CRS evaluation criteria, i.e., relevance, effectiveness, efficiency, impact and sustainability, along with recommendations for future projects.
Moreover, CRS/TL expects the evaluator to use the “Reflective Peacebuilding – A Planning, Monitoring, and Learning Tool Kit” as reference in the design and the evaluation process to measure changes at the personal, relational, structural and cultural dimensions from the interventions of the project. Both quantitative and qualitative data collection methods should be used appropriately to complement findings.
While paying attention to the above points, the evaluator is expected to propose evaluation design that will be able to achieve the objectives of this consultancy using participatory methods.
Deliverables
The evaluators are expected to complete these following deliverables:
1) Review project proposal, baseline report, mid-term evaluation project, bi-annual reports, and samples of training reports, field visit reports and meeting notes, and monitoring data, prior to data fieldwork.
2) Review the project materials produced like Active Non-Violence Training Manual, bulletins, suku profile, comic book, dahur competition and street theatre DVDs, and others prior to the evaluation.
3) In consultation with project team, select the 6 targeted aldeias for evaluation using best and worst case sampling for data collection activities from project beneficiaries and additional aldeias for non-project beneficiaries. Non-beneficiaries are people living at neighboring aldeias who have had conflicts with project beneficiaries in targeted aldeias.
4) Develop and propose data collection tools and analysis methodologies for both beneficiary and non-beneficiary, based on final evaluation information needs to allow comparison with baseline data, covering quantitative and qualitative information needs, and project indicators. Note: baseline data included information from 192 respondents from 6 sukus. Project team will be assigned tasks to review tool design, participate in analysis and interpretation sessions, and also provide relevant information and documents to the evaluator.
5) Field-test and finalize all data collection tools and analysis components after consultations with respondents and other stakeholders.
6) Lead data collection activities directly at the selected respondents and locations, as well as from other stakeholders, and CRS and partner staff.
7) Lead a 2-day participatory analysis workshop and facilitation of a session to identify lessons learned with project team and CRS senior management
8) Present preliminary findings and recommendations to CRS, partners and stakeholders - including donor (USAID) and representatives from government offices.
9) Incorporate feedback and comments from CRS, USAID, partners and key stakeholders on the preliminary findings into the draft evaluation report.
10) Circulate draft evaluation report to CRS, DJPC and USAID for review and feedback
11) Submit the final evaluation report presenting an executive summary, background of the evaluation, methodology of the evaluation, findings under each evaluation criteria with reference to personal, relational, structural and cultural dimensions, followed by lists of lessons learned and best practices and also recommendations, in English to CRS no later than 14 days after the presentation.
Time frame
The proposed time frame for the consultancy in the country is as follows:
Date Total # of days Activity
30 Jan 2012 1 day Meeting with CRS & DJPC
31 Jan 2012 1 day Finalize evaluation tools and analysis methodologies
1 & 2 Jan 2012 2 days Orientation/Training of the evaluation team members
3 – 13 Feb 2012 11 days (incl. Sat & Sun) Data collection activities: FGDs, KIIs and Staff Reflection
14 – 15 Feb 2012 2 days Analysis Workshop & Lessons Learned Sessions with Evaluation Team, Project team and CRS senior management
16 Feb 2012 1 day Day off (to prepare for presentation)
17 Feb 2012 Half a day Presentation of Preliminary Findings to stakeholders
24 Feb 2012 Draft Report due to CRS
2 Mar 2012 Comments of the report provided by CRS, JDPC & USAID
8 Mar 2012 Final evaluation report and invoice DUE to CRS
Qualifications
A consultant will be required to lead and support implementation of the final evaluation of Laletek (Bridge) Project. The successful candidate will have a minimum of 5 years experience, preferably in Timor-Leste or South East Asia, in leading complex evaluations, good knowledge in peace building theory and practice, experience and the ability to facilitate focus group discussions and consultation processes, significant experience in implementing social surveys and research activities, experience in survey sampling, design, data compilation, analysis and presenting findings through the use of data analysis tools, computer literate with working knowledge of Word and Excel, excellent report writing skills and analytical skills. Experience in using the “Reflective Peacebuilding – A Planning, Monitoring, and Learning Tool Kit” and Most Significant Change Methodology will be crucial. Tetum or Bahasa Indonesia language skill is an advantage.
The consultant will have overall responsibility for evaluation process design in consultation with CRS staff, implementing the social impact evaluation and integrating findings to present a final report on the overall progress of CRS interventions under the final project’s Results.
Vacancies Contact
Interested expert should submit a cost and technical proposal including CV and two references, preferably former clients, and proposed curriculum and evaluation methodology to Catharina Maria at catharina.maria@crs.org with copy to Risza Lopes da Cruz at risza.lopesdacruz@crs.org, before 30 November 2011.
No comments: