Consultancy: Evaluability Assessment of UNICEF ESARO’s Private Partnerships, Nairobi, Kenya

UNICEF works in some of the world’s toughest places, to reach the world’s most disadvantaged children. To save their lives. To defend their rights. To help them fulfill their potential.

Across 190 countries and territories, we work for every child, everywhere, every day, to build a better world for everyone.

And we never give up.

TERMS OF REFERENCE FOR INDIVIDUAL CONTRACTORS/CONSULTANTS

PART I

Title of Assignment

Evaluability Assessment of UNICEF ESARO’s Private Partnerships

Section

Evaluation

Location

Home-based. Travel required to Nairobi, Kenya – once during inception phase and once during validation phase.

Duration

30 Days

Start date

From: 01/02/2020

From: 31/05/2020

Background and Justification

An Evaluability Assessment (EA) is being led by UNICEF Eastern and Southern Africa Regional Office (ESARO)’s Evaluation Section, in support of UNICEF ESARO’s Public and Private Partnership (PPP) Team to assess the extent to which their Business for Results (B4R) and other private sector engagement activities and approaches can be evaluated in a meaningful, credible and reliable way[1]. The regional PPP Team aims to develop regional private sector engagement/partnerships as well as support country offices, in building and managing private sector engagement/partnerships that generate meaningful impact and results for child rights. Such partnerships have financial and non-financial components and are developed in close coordination with country offices, regional sections and relevant headquarters (HQ) teams. In order to achieve high impact and high return-on-investment partnerships, the regional PPP Team provides capacity strengthening to country offices and holds a light oversight role. The regional PPP Team is particularly interested in increasing the evaluability to answer the following question: what is the non-financial value of private partnerships, and how do we measure their contributions to achieving results in child rights?

The regional PPP Team’s work is guided by the UNICEF Private Sector IMPACT Plan 2018-2021 (the IMPACT Plan), as well as the newly developed Business for Results (B4R) approach. The IMPACT Plan was developed in support of UNICEF Strategic Plan 2018-2021 and in recognition that the private sector plays a crucial role in UNICEF’s ability to deliver results for children (in raising revenue and making progress on child rights agenda)[2]. The IMPACT Plan is led by the Division of Private Fundraising and Partnerships (PFP) at UNICEF Headquarters (HQ) and lays out a vision and key strategies for private sector fundraising and partnerships across UNICEF. In parallel, support for the Strategic Plan and the IMPACT Plan, UNICEF developed a key corporate approach Business for Results (B4R) in 2018 that recognizes the business sector’s growing role in impact on children and families and in achievement of outcomes for children and the SDGs. B4R looks to go beyond engagement and partnership with private sector for resource mobilization and procurement – it seeks for systematic and strategic engagement of businesses to maximize their power and potential in accelerating programmatic progress and to bring a new dimension of expertise, innovation and impact at scale[3].

B4R and related private sector engagement approaches will be at the centre of this EA. The regional PPP team’s role in B4R is to support country offices (COs) in determining how to engage with business programmatically and promote business respect and support for child rights for the larger purpose of enhancing programme effectiveness and achieving positive outcomes for children[4]. Through this Evaluability Assessment and following evaluations, the regional PPP Team hopes to explicitly identify and gather data on non-financial value-add of private partnerships (i.e. beyond their monetary contributions); and use the information gathered to strategically engage the private sector and strengthen the role and contribution of private sector engagement in promoting child rights and making progress on UNICEF’s agendas and programmes.

The B4R approach is in its early stages of operationalization and it is an opportune time to conduct an EA. The intention of this EA is to strategically embed evaluative thinking in B4R’s planning and implementation, to strengthen its results-based management and promote evidence-driven decision-making. Findings from the EA can be used to support planning and enable the regional PPP Team to establish systems and mechanisms to collect meaningful data from early stages. Furthermore, EA findings can support the PPP Team in developing a consistent and harmonious approach when guiding the COs on how to be more strategic in engaging private sector and how to integrate private partnerships from planning stages to the end of programme cycles.

Onboarding a consultant to conduct this EA in line with an upcoming training on private sector engagement in February 2020 being held for the staff of ESARO and Kenya CO can also strengthen UNICEF ESARO’s thinking on evaluability. Introducing evaluation during this training can provide attendees with a foundation to integrate evaluation in their private sector engagement from early stages, further increasing coherence and streamlining of evaluation activities and key indicators across the region.

Most importantly, the EA will allow the regional PPP Team to adjust the operationalization of B4R as needed to ensure availability of relevant data and build capacity to establish evaluations to systematically determine the non-financial value of private partnerships and assess how private sector engagement contributes to child rights.

Scope of Work

  • Goal and Objective:
  • The purpose of this EA is to assess, and provide recommendations on, the extent to which the B4R initiative and related private sector engagement approaches can be readily and reliably measured, monitored and evaluated, particularly in relation to their non-financial value and contribution in achieving UNICEF’s programmatic results and promoting child rights.

    The findings from this EA will be used to make clear and strengthen the UNICEF ESARO’s PPP Team’s monitoring and evaluation goals and agendas in relation to the B4R and related private sector engagement approaches and increase evaluation readiness by identifying necessary conditions required to collect quality and meaningful evaluation data to inform future programming and decision-making.

    The UNICEF ESARO’s PPP Team is the primary users of the EA findings; however, the EA findings will also be of benefit to the Regional Management Team (RMT) and CO PPP staff in ESAR. In addition, the findings and lessons learned from this EA and future evaluations can be shared at the global (e.g. the PFP Division in HQ) and regional (e.g. PPP teams in other regions) levels to inform their evaluations and evidence generating activities.

    Objective 1: Assess the clarity, relevance and coherence of the B4R initiative and related private sector engagement approaches, including its Theory of Change (ToC) and its alignment to the ESAR context and UNICEF Strategic Plan.

  • Is there a clear theory of change (ToC) for B4R and related private sector engagement approaches? Is there a clear identification of risks and assumptions?
  • Is the results framework coherently articulated and aligned with the goals and outcomes of IMPACT Plan and the Strategic Plan? What are some gaps?
  • To what extent have the B4R and related private sector engagement approaches already been operationalized in practice? Do the outputs, outcomes and goals of the approaches follow results chain logic? Are adjustments needed in ToC and/or results framework?
  • What are the data needs of the regional PPP Team beyond private partnerships’ non-financial value and contribution to making progress on child rights, from both the perspective of UNICEF and private partners/other external stakeholders?
  • Objective 2: Assess the availability, adequacy and validity of the indicators, tools and systems for monitoring, measuring and verifying results.

  • What credible, reliable and innovative indicators and tools are currently available, in literature and in use, both external and internal to UNICEF, to measure the non-financial value of private partnerships and their contribution in achieving results for child rights?
  • Are baselines and targets in place for the indicators at the regional level, or in those countries where a B4R approach is being operationalized?
  • What are the currently available or collectible data related to the key indicators? What are significant foreseeable data gaps?
  • Are there systems in place for data verification and quality assurance?
  • Objective 3: Assess the conduciveness of context and adequacy of resources and capacity, including but not limited to human and financial resources, to meet the expected results.

  • Is there a Monitoring and Evaluation (M&E) Plan in place for the B4R and related private sector engagement approaches?
  • Are M&E responsibilities and lines of accountability clearly outlined? Are involved stakeholders (PPP, Programme and Supply Teams at the regional and country levels; private partners; HQ; etc.) aware of their roles within these lines of accountability?
  • Are there modalities for M&E collaborations between agencies/partners?
  • What are the likely resources and capacities required for necessary evaluation planning, data collection, analysis and reporting/sharing? Are these resources accounted for in the budget?
  • Are there any successful cases or standardized indicators to measure non-financial value and contribution of private partnerships in achieving results for child rights that UNICEF ESARO’s PPP Team can model and refer to?
  • Objective 4: Provide guidance and recommendations on tools and approaches to support the evaluation of the B4R and related private sector engagement approaches with a view to measure results for children.

  • How can the ToC, risks and assumptions for B4R and related private sector engagement approaches be sharpened? If none exists, develop – in close coordination with relevant ESARO staff – a possible ToC and engagement options.
  • What are the essential steps to be taken by the regional PPP Team to ensure that their B4R and related private sector engagement approaches can be monitored and evaluated in the future, with a focus to determine the non-financial value of private partnerships and their contributions to achieving results in child rights, and in consideration of relevant human rights and gender equality aspects of private sector engagement?
  • Provide details/reference to AWP areas covered: Explain briefly how this assignment links to the AWP/IR number.
  • Outcome: Programme Effectiveness – ESAR Country Office programmes are results-oriented, affordable, fit for purpose and represent value for money by 2021
  • Output: Evaluation – Timely and rigorous evaluations yield findings and recommendations that are used by UNICEF, governments, civil societies and development partners to strengthen programmes and support advocacy for children
  • Activity 1: Oversight and quality assurance of ESARO evaluations
  • Activities, Deliverables and Payment Schedule:
  • The EA will focus on the evaluability of B4R (as the primary private sector engagement approach). However, the EA will also explore any precursors of B4R as well as other private sector engagement approaches similar to B4R used by external agencies (e.g. other UN agencies, international NGOs, etc.), in consultation with the regional PPP Team.

    The EA will take a regional scope of covering the Eastern and Southern Africa Region with an understanding that a number of COs (to be determined by the regional PPP Team) may be consulted or involved to get an understanding of how COs have integrated the B4R and related approaches in their programmes, as well as to get a direction on how best the regional PPP Team can support COs in operationalizing B4R and in increasing evaluability at the country level.

    Lastly, the EA will assess how key cross-sectoral priorities, sustainability, equity, innovation, gender equality and humanitarian action, can be integrated into the B4R and related private sector engagement approaches and their future evaluations.

    The evaluability assessment will be managed by the Evaluation Section of UNICEF EASARO and will be conducted in close collaboration with the regional PPP Team. This approach has the objective to actively promote (i) ownership, (ii) instill evaluative thinking in planning and implementation, and (iii) accountability for results in relation to the evaluations of B4R and related private sector engagement approaches.

    The evaluability assessment will involve discussions with key internal and external stakeholders including RMT, CO PPP staff and PFP Division at HQ and other development agencies, as well as an extensive desk review of key documents. This review will cover Theory of change, results frameworks and other sources of information. This review will culminate into drawing of conclusions and making recommendations.

    The EA will be conducted over the course of 30 days, between February and May 2020. The assignment will require travel to Nairobi on two occasions, once during the inception phase (5 days in Kenya) and once during the validation phase (3 days in Kenya).

    Activities and Duration

    Deliverables and Deadline

    Payment Schedule

    Inception Phase (10 Days):

    The inception phase will involve an initial desk review to analyze the B4R and any other related private sector engagement approaches along with key documents (results framework, regional PPP Team’s work plan, B4R Programme Guidance, B4R Overview, UNICEF Private Sector IMPACT Plan 2018-2021 (the IMPACT Plan), UNICEF Strategic Plan 2018-2021, etc.). An in-person briefing with the UNICEF ESARO’s Evaluation Section and PPP Team will also take place during this phase, during which a draft ToC will be developed, or current ToC will be strengthened, in consultation with the PPP Team.

    The EA consultant will produce a 20-page approach paper during this phase that presents the options and details of the EA. This report should refine the EA’s objectives, scope and key questions to be answered by the evaluability exercise, and present the methods that will be used to develop a work plan and the final report.

    By the end of inception phase (tentatively mid-March 2020), deliver:

  • A draft Theory of Change for B4R, if none exists
  • An inception report, following an initial desk review
  • Upon satisfactory completion of the inception report: 30%

    Assessment Phase (15 Days):

    The second phase of the EA will involve an extensive desk review and analysis, including a literature review of indicators and tools (e.g. WFP’s Value Assessment Tool) and all available documents shared by the UNICEF ESARO’s PPP Team. In-depth discussions with the regional PPP Team, as well as key stakeholders identified by the PPP Team (e.g. CO PPP representative, ESARO RMT representative, PFP Division representative) will be held to identify constraints, opportunities, contextual and substantive issues related to the implementation of the B4R and related private sector engagement approaches. Key informant interviews with private sector partners may also take place to identify shared indicators and areas of collaborations related to evaluation and data collection/needs. EA consultant will submit a draft EA report during this phase that includes findings, conclusions and recommendations.

  • Validation Phase (5 Days):

    In this last phase, a workshop will be held with UNICEF ESARO’s PPP Team, Evaluation Section, RMT and any other important stakeholders identified by the PPP Team (e.g. a number of private partner representatives and CO PPP staff) to validate the major findings of the draft EA report and formulate and validate recommendations. In this phase, the reference group will conduct a final review of the EA report.

    By the end of validation phase (tentatively mid-April 2020), deliver:

  • A final EA report that reflects the comments and feedback of UNICEF ESARO’s PPP Team and Evaluation Section, as well as other key stakeholders identified by the PPP Team, during the validation phase
  • A summary product (e.g. a PowerPoint presentation – to be determined in consultation with the PPP Team) that outlines the summary of key EA findings, conclusions and recommendations prepared towards the end of the EA and submitted before the stakeholder validation workshop
  • A guidance note that outlines recommendations for COs on B4R and related private sector engagement approaches, both in term of programmatic aspects (e.g. approaches on how to embed and integrate programmatic thinking when engaging with the private sector and building private partnerships) as well as monitoring and evaluation (M&E) aspects (e.g. how to conceptualize success/results; key indicators on non-financial value add of private partnerships; how to set up a monitoring system to track progress)
  • Upon satisfactory completion of all deliverables: 70%

  • Work relationships:
  • Under the supervision of the Regional Adviser Evaluation, the EA will be managed by Mona Lee, Evaluation Specialist. The consultant will work closely with the regional PPP Team and engage with key stakeholders and partners identified by the regional PPP Team (e.g. potentially those mentioned in the inception, assessment and validation phases above).

    Desired competencies, technical background and experience

    The EA will be carried out by an individual consultant. Minimum qualifications required are:

  • At least 10 years of experience conducting or managing evaluations. Preference will be given to candidates with experience conducting evaluability assessments and experience conducting evaluations related to private partnerships/private sector engagement.
  • Experience working with the United Nations, particularly UNICEF. Preference will be given to candidates with a strong understanding of UNICEF policies and programming.
  • Master’s degree or equivalent in Development Studies, Economics, Social Sciences, International Development or other related field.
  • Proven skills in data collection and analysis, both for quantitative and qualitative data.
  • Excellent report writing skills.
  • Excellent command of written and spoken English.
  • Administrative issues

    The focal point for this EA at the ESARO Evaluation Section will be the Evaluation and Knowledge Management Specialist. She will be the main point of contact throughout the contract duration, available via email and phone (to be shared once consultant is secured and contract is signed).

    Conditions

    The consultant must provide their own equipment (e.g. laptop, office space) required to conduct this EA. All travel to Nairobi will be by most economical fare and reimbursement will be provided as per UNICEF policy.

    As per UNICEF DFAM policy, payment is made against approved deliverables. No advance payment is allowed unless in exceptional circumstances against bank guarantee, subject to a maximum of 30 per cent of the total contract value in cases where advance purchases, for example for supplies or travel, may be necessary.

    The candidate selected will be governed by and subject to UNICEF’s General Terms and Conditions for individual contracts.

    How to Apply

    The application must include qualifications, availability and fee/rate to undertake the terms of reference. Applications submitted without a fee/rate will not be considered.

    [1] Evaluability Assessment https://www.betterevaluation.org/en/themes/evaluability_assessment#eval_…

    [2] UNICEF Private Sector IMPACT Plan 2018-2021

    [3] Special Focus Session on Business for Results https://www.unicef.org/about/execboard/files/2019_SRS-SFS-Business_secto…

    [4] Engagement with Business: Programme Guidance for Country Offices

    Incoming search terms:

    Sharing is Caring!
    Click Here to Leave a Comment Below 0 comments