Jordan

‘REFORMING EDUCATION TO ASSIST DISADVANTAGED YOUTH (READY)’ FINAL EVALUATION STUDY

Organization
Posted
Closing date

Palestinian refugee children, particularly those at risk of dropout, achieve better in school and have improved attendance.

CONSULTANT TERMS OF REFERENCE:

‘REFORMING EDUCATION TO ASSIST DISADVANTAGED YOUTH (READY)’ FINAL EVALUATION STUDY

1. RIGHT TO PLAY

Established in 2000, Right To Play is an international non-governmental organization committed to improving the lives of children and youth affected by conflict, disease, and poverty. Headquartered in Toronto, Canada, Right To Play is active in 15 countries across Africa, Asia, and the Middle East, and has fundraising offices in six European and north American countries. Pioneering its innovative child-centered, play-based learning methodology, Right To Play works across the five key outcome areas of quality education, peaceful communities, health and well-being, gender equality, and child protection.

Right To Play has been active in the education and sports for development sectors in Jordan since 2006, training teachers in UNRWA and Ministry of Education schools as well as coaches in local communities to provide engaging interactive sessions that utilize games and sports for psychosocial wellbeing, education and gender equality. Vulnerable Jordanian, Palestinian, and Syrian children who take part in Right To Play play days and tournaments are more engaged in school and have vastly improved life skills. In turn, the youth with whom Right To Play works achieve higher grades, experience greater levels of cooperation and cohesion, and are empowered to overcome trauma, adversity, and cultural stigmas to fulfil their dreams.

All RTP projects are gender-responsive, placing particular emphasis on female empowerment. They are also usually supported by a sustainable rehabilitation component whereby school classrooms and play spaces are renovated, football pitches are constructed within underserved communities, or students lead maintenance initiatives within their schools. In 2019 RTP reached a total of 102848 Jordanian, Palestinian, and Syrian children and youth in schools across Amman, Irbid, Zarqa, Mafraq, and Aqaba. In addition, the organization currently has 2904 active teachers and coaches, having trained 766 this year.

2. ‘REFORMING EDUCATION TO ASSIST DISADVANTAGED YOUTH (READY)’**

The ‘READY’ project, funded by the Latter Day Saints, aims to improve access to quality education in safe, positive learning environments for 2400 Palestinian refugee children in Marka’s Hitten Camp while increasing their enthusiasm for, and commitment to, learning. RTP is working in eight UNRWA schools with the highest dropout rates in Hitten Camp, training 30 to 40 teachers and eight headteachers in its play-based learning methodology and conducting trainings of trainers to enable further dissemination of the RTP approach. Four teachers will deliver remedial maths and Arabic classes after school for underperforming students, while RTP trains 120 youth leaders to organize youth-led initiatives encouraging students to remain active in school life. Community engagement sessions will be held to cultivate support for the education of children at high risk of dropout among 200 parents and community members, and a parallel component will be undertaken in at least two schools whereby solar panels will be installed, with money saved on electricity reinvested in school maintenance and/or infrastructural repairs. The ultimate objective of this project is for Palestinian refugee children to achieve better in school and have improved attendance.

IMPACT

Palestinian refugee children, particularly those at risk of dropout, achieve better in school and have improved attendance.

OUTCOMES

Palestinian refugee children, particularly those at risk of dropout, have improved access to quality education in safe, positive learning environments and increased enthusiasm for, and commitment to, learning.

Target Geographies

Hitten Camp, Marka, Jordan

Target Beneficiaries

  • Children and youth: 2400 across six to eight schools

  • Teachers: 30-40 plus eight headteachers

  • Parents and community members: 200

Full Project Timeline

12 months (February 2021 to February 2022)

Final Evaluation Study Timeline

Approximately three weeks, beginning ASAP after selection.

1. PROJECT GOAL AND OUTCOMES

Ultimate Objective: Palestinian refugee children, particularly those at risk of dropout, achieve better in school and have improved attendance.

Outcome 1: Palestinian refugee children, particularly those at risk of dropout, have improved access to quality education in safe, positive learning environments and increased enthusiasm for, and commitment to, learning.

All project activities will fall under one outcome. To foster children’s learning and enthusiasm for school, RTP will conduct play-based learning teacher trainings, trainings of teachers, play days and sports tournaments for students, and remedial maths and Arabic classes for regularly absent and/or underperforming students. To cultivate support for these students, RTP will also hold community awareness sessions, and to encourage them to remain active within, and to cultivate a greater sense of ownership of, their schools, and thereby to foster improved attendance, RTP will also support these students to undertake youth-led initiatives. At the same time, RTP will install solar panels in selected schools, the money saved on electricity in the ensuing years being put towards school maintenance and infrastructure improvement.

4. FINAL EVALUATION CONSULTANCY OBJECTIVE AND SCOPE OF WORK

The objective of the final evaluation consultancy is to assess project effectiveness and assess project results against its objectives and baseline benchmarks. The final evaluation will be crucial for measuring change during the lifetime of the project, the project’s contribution to achieving this change, and generating new knowledge on key strategic areas for Right To Play in Jordan.

The final evaluation consultant will be expected to:

  • Perform a comprehensive review of existing project materials, M&E plan, baseline report and measurement tools, proposing any adjustments necessary for ensuring conceptual validity and robustness of the final evaluation, taking into account limitations expected and safety measures to be adopted as a result of the COVID-19 crisis.

  • Design and plan a final evaluation study that may be implemented in-country, partly online, or fully online and that complies with Right To Play and governmental regulations concerning the COVID-19 crisis in collaboration with Right To Play staff, holding responsibility for the overall approach and methodology. An inception report must be submitted prior to the start of the study, providing a detailed evaluation plan that gives:

An outline of the study approach/methodology and COVID-19 safety measures to be undertaken

The timeline of activities

Sampling requirements and framework

The methodology of collecting, triangulating, and summarizing qualitative and quantitative primary and secondary data (if needed, data quality protocols should be developed to guide data collection/entry for Right To Play field staff, including spot checking protocols) and COVID-19 safety measures to be undertaken

Fieldwork logistics and schedule

Fieldwork manual including data collectors’ training guide

  • Design and/or revise existing data collection methodology and tools to be used during the final evaluation, as well as for routine monitoring until the final evaluation, outlining COVID-19 safety measures to be undertaken

· Provide training for data collectors and submit the following:

Data collectors’ training agenda

Data collectors’ training report

  • Provide recommendations and plans for integrating data collection tools and/or other required data sets necessary for monitoring and evaluating the project, considering the possibility of an extended COVID-19 crisis.

· Provide a comprehensive final evaluation report (both a draft and final version) measuring achievements against outcome and output indicators and changes from baseline values. Values for all outcome and output indicators must be produced.

5. FINAL EVALUATION METHODOLOGY

The final evaluation study may be conducted in-country, partly online, or fully online, subject to the Jordanian government’s COVID-19 restrictions at the time of implementation. It should employ a variety of tools, including, for example, surveys, focus group discussions, and key informant interviews, to collect both qualitative and quantitative data, ensuring in-depth analysis of the project starting points and providing baseline indicator values. A review of project and organizational documents, as well as Right To Play’s current data collection tools must be undertaken, and all data collection practices must be in line with child safeguarding principles and both Right To Play and governmental COVID-19 safety regulations. Proposals must include three separate methodologies and fees (to account for the possibilities of conducting the study in-country, partly online, or fully online), and given the limitations of online studies, creative approaches to data collection will be welcomed.

The final evaluation will be conducted with the communities where the project is being implemented. Right To Play will support the consultant in making any logistical arrangements for data collection and meetings with key stakeholders.

Right To Play will review the consultant’s submitted inception report prior to data collection and will provide guidance for the final evaluation report. All raw data must be submitted to Right To Play prior to submission of the final report.

6. ROLE DURATION

The final evaluation study should begin ASAP after selection, with implementation lasting approximately three weeks.

7. DELIVERABLES

Deliverables are illustrated in the table below; the specifics and timeframe should be negotiated with Right To Play upon confirmation of the consultancy.

DELIVERABLE

Right To Play consultations

DETAILS

An initial online kick-off meeting will be held with RTP to finalize plans for the study.

DELIVERABLE

Submission of Inception Report with evaluation and fieldwork plan

DETAILS

· Evaluation plan:

  • An outline of the study approach/methodology and COVID-19 safety measures to be undertaken

  • The timeline of activities

  • Sampling requirements and framework

  • The methodology for collecting, triangulating, and summarizing qualitative and quantitative primary and secondary data (if needed, data quality protocols should be developed to guide data collection/entry for Right To Play field staff, including spot checking protocols) and COVID-19 safety measures to be undertaken

· Fieldwork plan:

  • Fieldwork logistics and schedule

  • Fieldwork manual including data collectors’ training guide **

DELIVERABLE

Training of data collectors and submission of report

DETAILS

  • Data collectors’ training agenda

  • Data collectors’ training report

DELIVERABLE

Data collection

DETAILS

Ensure that both quantitative and qualitative data is collected in-person, or, if not possible, online.

DELIVERABLE

Data submission

DETAILS

Cleaned, raw data in two formats: Excel and a statistical analysis software format (e.g. SPSS or STATA) if possible.

DELIVERABLE

Validation Workshop

DETAILS

Online consultation with key stakeholders for revision and validation of findings.

DELIVERABLE

First Draft Final Evaluation Report

DETAILS

· Revised data analysis framework document

· Excel spreadsheets, or SPSS/Stata scripts with clear, easy to understand notes

· Ensure that all values for outcome and output indicators are provided (filled in on the PMF) and decide on final target values in collaboration with RTP.

. Draft final evaluation report.

DELIVERABLE

Revised data analysis framework document

DETAILS

· PowerPoint presentation with summary findings for formal presentation to key stakeholders.

· Copies of original and cleaned data sets including any field notes, as well as annexes of processed results tables (with all levels of disaggregation, including geographical areas breakdown).

. Revised version of final evaluation report

DELIVERABLE

De-briefing meeting with RTP

DETAILS

N/A

8. QUALIFICATIONS

· A consultant/consultancy firm/group with at least 3-5 years of experience in the research and/or evaluation field, including experience in quantitative and qualitative data collection, analyzing quantitative and qualitative data, and reporting.

· Extensive experience managing and designing evaluation studies in diverse contexts relevant to Right To Play’s work (e.g. Middle East context, with children and young people, with refugee communities, in urban settings, etc.).

· Extensive experience creating measurement frameworks, refining indicators, and creating measurement tools for education-focused programs.

· Experience in education.

· Experience in Positive Youth Development (PYD), life skills measurement and behavioral change measurement, and youth psycho-social wellbeing.

· Experience using participatory methodologies and following OECD-DAC principles for evaluation and measurement.

· A relevant degree in social sciences, international development, statistical sciences, or another related field.**

· Excellent skills in, and experience with, data analysis using statistical computing tools (Excel, SPSS, STATA, NVIVO).**

· Proficiency in Arabic and in English.

· Experience conducting online studies is desirable, though not required.

How to apply

PROPOSAL APPLICATION SUBMISSION

Interested organizations should submit proposals with the following documents:

· Cover letter including the consultant’s/firm’s suitability for the assignment and current contact information.

· CV including contact details of two references. If the lead consultant is planning to recruit enumerators in Jordan to support the data collection, data entry, and dataset development, please state this in your application and if possible provide details (cost, expertise, expected role of each consultant, etc.).

· Include one or two samples of previous evaluation work.

· A detailed response to the ToRs, including a technical proposal addressing the purpose and objectives of the assignment, in-country, partly online, and fully online methodologies, and key selection criteria (max. two pages)

· Financial proposal with a detailed budget breakdowns for each methodology based on expected daily rates and an initial work plan.

· Initial drafts of the proposed work plans for each methodology in the form of a Gantt chart.

Both the financial and technical proposals must be submitted to Logistics Coordinator Fakhri Al Syouri at fsyouri@righttoplay.com no later than the 12thof February 2022. Please also copy Isabella Di Paolo, Global Monitoring, Evaluation, and Learning Manager, at idipaolo@righttoplay.com. .

All offers should be valid until at least 30th April 2021. If you are applying as an international organization, please ensure that you include all travel costs in your financial offer. All enumerator and training costs must also be included.

The selected candidate must adhere to both Right To Play and governmental standards regarding health and safety in light of the COVID-19 crisis, including all required social distancing measures.

Right To Play is a child-centered organization. Our recruitment and selection procedures reflect our commitment to the safety and protection of children in our programs.**