Individual Consultant: Evaluation of a project on Gender-Based Violence and Reproductive Health

Background

The United Nations Population Fund (UNFPA) is one several United Nations organizations with a mandate to operate in humanitarian and emergency situations to combat gender-based violence (GBV) and mitigate its consequences and to provide life-saving reproductive health (RH) interventions, especially ensuring that women have access to safe pregnancy and deliver safely in often difficult conditions.

The conflict in Syria, since 2011, lead to the displacement of millions of persons from Syria to the neighboring countries. In Lebanon, the number of currently registered Syrian refugees with UNHCR amounts, to date, to a total of 942,565 individuals, living in 217,751 households (4.3 individuals per household). Refugees from Syria in Lebanon are considered to be the largest proportion of refugees in the world in a country, if compared to the size of Lebanon’s population.

As a result of the prolonged displacement, Syrian population in Lebanon is suffering from poor living conditions aggravated by insufficient privacy in overcrowded settlements. Their drastic situation raises serious protection concerns associated with Gender-Based Violence (GBV) in general, and early marriage/ domestic violence in particular, among others. Furthermore, both the Lebanese host communities and Syrian Refugees are suffering from a poor access to GBV and Sexual and Reproductive Health (SRH) services and information leading sometimes to devastating consequences on survivor’s health, including mental health and emotional well-being, among others.

In addition, and in 2020, the COVID-19 pandemic that constituted the largest global public health crisis in a century has already severely disrupted access to life-saving SRH services which will lead to higher maternal mortality and morbidity. In Lebanon, like elsewhere around the world, the combination of economic and social stresses brought on by the pandemic as well as the deteriorating economic situation, as well as restrictions on movement, have increased the numbers of women and girls facing GBV. More so, the pandemic situations puts health systems under stress and confronts them with multiple challenges, such as the confrontation of the pandemic while maintaining the supply and continuity of other health care. Given current pressures, health systems are unable to meet all health needs for the entire population.

Furthermore, the massive explosion that hit the port in Beirut on August 4, 2020 caused massive human and financial losses. With the explosion, the number of persons in need for healthcare services increased including for SRH, GBV, first aid and psychological support as well for mental health services. Moreover, the explosion has added to the toll of the economic crisis and effect of the COVID-19 outbreak.

UNFPA in Lebanon has been considerably supporting nationwide health and protection related interventions particularly around enhancing access SRH and preventing/responding to GBV with due attention to the Syrian refugees, Lebanese in hosting communities as well as those affected by the Beirut Port explosion.Those interventions translated mainly into reinforcing national systems and structures, enhancing quality of care, strengthening capacity and institutional development, and reaching out to the most vulnerable groups and communities by meeting their urgent SRH and GBV needs ensuring integration of mental health and psycho-social support (MHPSS) across the various lifesaving interventions. UNFPA Lebanon has been responding to the crisis by working closely with affected populations, community based organizations, local government structures (i.e. municipalities), local and international NGOs, relevant government institutions and UN agencies to ensure that the RH needs are met and systems and capacities are in place to prevent and respond to GBV.

Rationale

In the context of the Syria crisis, and with the generous contribution from the Government of Norway, UNFPA in partnership with the Ministry of Social Affairs (MoSA) including the Social Development Centers (SDCs) of Chaat, Baalback and Ras Baalback and in collaboration with its partners ABAAD, Al Mithaq organization and Amel association implemented a the project that was initially a one year project but extended to 2 years due to delays (Between 2019-2020) targeting Baalback governorate specifically the towns of Baalback, Chaat and Ras Baalback. The project outcome aimed at “Strengthening Protection and Empowerment of Women and Girls through access to comprehensive community-based Gender Based Violence Prevention and Response (GBV) and Reproductive Health (RH) Services in Lebanon” and which constituted of 2 outputs.

• OUTPUT 1: Women and adolescent girls affected by or at risk of GBV have access to critical response and prevention services through safe spaces including RH.
• OUTPUT 2: Local government and non-government institutions’ capacities reinforced to integrate, enhance and sustain quality integrated RH/FP and GBV prevention services.

The three implementing partners (IPs) executed specific activities that were discussed and agreed upon with the donor and MoSA. Amel Association and Al Mithaq implemented the same activities (GBV and SRH sensitization and awareness raising) but in different municipalities and MOSA/SDCs whereas ABAAD implemented the GBV related activities/services such as GBV risk assessment, focused psychosocial support, case management, referral to specialized services and GBV training in the three selected areas Chaat, Baalback and Ras Baalback. On the other hand, the Lebanese Society of Obstetrics and Gynecology acted as the technical arm in this project by developing the capacities of health care providers of MoSA SDCs in Baalback governorates on the National RH Service Delivery Guidelines.

In response to COVID-19 and Beirut port explosion, UNFPA revised the activities under this project in 2020. The revised interventions were discussed and approved locally by the donor and MoSA and focused on 1) provision of SRH services and GBV prevention and response services to women and girls remotely and/or in person; 2) Adoption of physical and/or online approach for capacity development and awareness sessions while reducing the number of participants in each sessions, maintaining social distancing and taking into consideration all infection prevention control measures. 3) Procurement and distribution of dignity kits to beneficiaries; and 4) Ensuring continuity of Lifesaving SRH and MHPSS services for Lebanese and Syrians women, girls, men and boys displaced/ affected by the Beirut Port explosion through the provision of medical consultations, follow up exams and mental health services. UNFPA used a consistent mechanism to communicate about prevention and control measures with beneficiaries in light of COVID-19 pandemic by distributing brochures, leaflets and adding a session on COVID-19 in each training/ awareness sessions. Moreover, UNFPA implemented national risk communication and community engagement plans for COVID-19 by minimizing the number of beneficiaries in each session/ training, maintaining social distancing and distributing PPEs to all participants.

This one year project has reached more than 21,000 beneficiaries (men, women and adolescents) through several interventions that are fully aligned with the priorities set in the 2017-2020 Lebanon Crisis Response Plan.  In addition, UNFPA and its IPs adopted several approaches to increase interventions effectiveness namely peer to peer.  Capacity development component on the peer to peer was delivered by UNFPA to the peer educators identified by the IPs to ensure harmonization of approaches, knowledge and tools. Continuous monitoring was ensured throughout all the project phases to ensure achievements as well as address bottlenecks. It is worth noting that the project faced many challenges that affected timely implementation and resulted in extending the project for one additional year at no cost.

Based on the above, UNFPA is seeking to undertake an external evaluation of this one year project aiming at scaling up national  response and mitigate GBV protection risks for Syrian refugee women and girls and reinforce quality and timely access to integrated GBV and SRH services and based on the project’s effectiveness, efficiency, relevance, coverage, coherence and connectedness

Purpose

The main purpose of the evaluation revolves around three main axes as follows:  

1. Demonstrate accountability to stakeholders on achieving results;
2. Support evidence-based decision making for tailoring/scaling up/expanding interventions;
3. Appraise sustainability of approaches 

Objectives

While the overall goal  of the evaluation is to produce an independent and useful report, with a view to informing similar projects, the evaluation will address selected aspects of the effectiveness, efficiency, relevance, coverage, coherence and connectedness criteria either through specific tasks under this evaluation and/or tapping on existing reports generated during the project implementation period.  

 The specific objectives of the evaluation are detailed below:

• Assess the efficiency and effectiveness of the approaches used to achieve the project outcome
• Identify challenges, constraints and changes encountered during the project’s implementation and assess variances/mitigation measures adopted to address the challenges and changes.
• Retrieve lessons learned and good practices.
• Document key results the project achieved within thematic areas of interventions as stated by the project’s outputs and related indicators.
• Identify positive and negative effects produced, intended or unintended, directly (target groups) and indirectly (lager society).
• Determine elements for sustainability of interventions beyond the lifespan of the project taking into consideration building ownership of local actors including MoSA SDCs
• Document actions taken by IPs and MoSA SDCs and stockholders involved in the project which demonstrate compliance and adherence to Ethical standards related to matters such as confidentiality of informants, cross-cutting issues such as gender, Do No Harm, Human rights and Code of conduct.
• Provide analysis about the added value of UNFPA,IP’s and local stockholders involved in the project (i.e municipalities, local NGOs, police …) for the implementation of key activities and achievement of outcome ’’Strengthening Protection and Empowerment of Women and Girls through access to comprehensive community-based Gender Based Violence Prevention and Response (GBV) and Reproductive Health (RH) Services in Lebanon’’ and draw key lessons related to the partnerships and coordination  with local stakeholders established within the project
• Propose recommendations and concrete actions for scaling up the interventions

Scope of the Evaluation

It is anticipated that the evaluation will look into outcomes and deliverables at various levels i.e. through implementing partners and MOSA SDCs. As such, the evaluation will adopt a three staged process namely 1) Key informant’s interview with representatives from MoSA/SDCs, IPs; UNFPA and the donor; 2) Focus group discussions with selected beneficiaries, peer educators, social workers and community leaders; and 3) review of various reports and documents generated within the frame of the project.  The evaluation will take place over a period of 5 weeks. The consultant will be asked to account for diversity in this exercise – selecting interventions that have had more or less success achieving targets and end results.

The evaluation will cover key activities implemented during the project life cycle and in the frame of the two outputs.

The final evaluation report will entail to i) developing a matrix summarizing 1-2 findings for each of the following 6 criteria: effectiveness, efficiency, relevance, coverage, coherence and connectedness .ii) Highlight variances in the implementation, strengths, changes and challenges, iii) identify sustainability factors and iv) provide a concise set of practical and feasible recommendations for scaling up   future similar projects. v) Document adherence to Ethical standards and Code of conduct.

Process and Methodology

Preparation and Inception

• Preliminary communication to clarify terms of evaluation between the individual consultant and UNFPA.
• Delivery of brief 3 – 5 page inception report detailing the individual consultant understanding of the required tasks and the proposed approach to work, analysis approaches, and timeframes for product delivery..

Desk Review

• Desk review of documents including project documents, reports, annual review meetings reports, resource material produced in the frame of the project.

Consultations / Focus Group with beneficiaries

• The consultant will design an evaluation methodology (including data collection tools, evaluation questions, and evaluation matrix with associated assumptions to be assessed) using mostly qualitative data
• The consultant will hold meetings with UNFPA, IPs, MoSA/ SDCs and donor representatives including relevant experts involved in the project.
• The consultant will meet/hold FGD with selected beneficiaries and community members to get their input on specific areas. The beneficiaries will be identified by the IPs based on selection criteria developed by the consultant
• It is expected that the consultation process will consist of 8 to 10 interviews/meetings, and 4 to 5 FGDs

Synthesis phase

• During this phase, the consultant will proceed with the analytical work based on the desk review and consultation process. A preliminary report will be shared with UNFPA for review and input.
• All findings and conclusions must be backed by reference to evidence (source) and their magnitude/representativeness commented

Final report

• The consultant will incorporate comments received from UNFPA into final report
• The consultant will highlight methodological challenges and limitations in findings and conclusions.
• The consultant will submit (a) a complete, copy-edited and cleanly formatted English analytical report (20-25 pages excluding annexes) with references as a Word document (template to be discussed and agreed upon), (b) an executive English and Arabic summary (3-4 pages each language) with the key findings and recommendations, and (c) a power point presentation in English/Arabic language (with 15-20 slides each language) summarizing key outcomes and findings of the evaluation exercise.

Support to be provided by UNFPA

• Clarify consultancy TORs and expectation
• Avail all documentations
• Be available for meetings with the consultant when need be
• Facilitate organization of meetings and interviews with its implementing partners
• Provide additional and immediate advice and information when need be
• Review draft report and provide input

Indicative time frame for the consultancy

Skills and experience required

The time period for the evaluation is limited therefore a consultant requested to fulfill this task whereby evaluation activities need to be implemented simultaneously and a team must be readily available, fully dedicated to this exercise and equipped to undertake requested multiple tasks.  

The consultant must have relevant experience in evaluations, experience in development and/or humanitarian settings, knowledge of evaluation methodology, and experience and in-depth knowledge of the Lebanese context and Syria crisis.

Qualifications

The consultant must offer the following demonstrated expertise, and qualifications:

• A university degree in research methodology, sociology/anthropology, social sciences or other relevant specialty
• At least 5 years of extensive experiences in carrying out similar evaluations;
• Working with international organizations/ UN agencies/ donors is an asset.
• Experience in humanitarian /emergency contexts including familiarity with humanitarian related resources and material is an asset
• Extensive experience and knowledge in the field of SRH and GBV programmes
• Extensive knowledge in the Lebanese context including  in institutional development and public policies;

Individual consultant that meet the required qualifications set forth in the TORs may apply on line by sending a cover letter expressing interest, curriculum vitae and price schedule form (Annex VII). All documents must be sent to the following email: bids_lbn@unfpa.org    by no later than February 12^th, 2021.