World Vision Baseline Study Consultant Tender Announcement
World Vision International Insani Yardim Kuruluşu Turkiye – Gaziantep
İHALE ÇAĞRISI
WORLD VISION INTERNATIONAL IS LOOKING FOR AN EXTERNAL CONSULTANT FOR THE BASELINE STUDY FOR ECHO TURKEY
ALL PROPOSALS SHOULD BE SUBMITTED TO: Gaziantep_Procurement@wvi.org BY THE 7TH of SEPTEMBER,2017.
ALL RELATED QUESTIONS SHOULD BE SENT TO :Kubra_Ozel@wvi.org
PLEASE INDICATE ‘PR 990 BASELINE STUDY FOR ECHO TURKEY’’AS THE SUBJECT OF YOUR EMAILS.
Baseline Evaluation Terms of Reference
For: “Providing Information and Protection Assistance to Vulnerable Refugees in Turkey, and Linking Them to Protection Services”
Implemented by: World Vision International in Turkey and partners
Funded through: European Union Humanitarian Aid
Glossary
ADH | Aktion Deutschland Hilft e.V. – Action Germany Helps, fund-raising coalition of German non-governmental organizations |
BMZ | Bundesministerium für wirtschaftliche Zusammenarbeit und Entwicklung – German Federal Ministry for Economic Cooperation and Development |
CV | Curriculum vitae |
DGMM | Republic of Turkey, Ministry of Interior, Directorate General of Migration Management, responsible for refugees |
ECHO / DG ECHO | European Commission Directorate-General for Humanitarian Aid and Civil Protection, providing funding for the project |
ESSN | Emergency Social Safety Net, cash assistance for about 1 million refugees funded by the European Union and implemented in cooperation between the World Food Program and the Turkish Red Crescent |
EU | European Union |
FGD | Focus group discussion |
HH | Household |
IEC | Information, education and communication materials |
IP | International Protection, legal regime governing the status of non-Syrian refugees in Turkey |
IPA | Individualized Protection Assistance, one-off cash support to alleviate immediate protection needs among refugees |
KII | Key informant interview |
M&E | Monitoring and evaluation |
MHPSS | Mental health and psychosocial support |
SGBV | Sexual and gender-based violence |
SOPs | Standard operating procedures |
ToR | Terms of reference |
TP | Temporary Protection, legal regime governing the status of Syrian refugees in Turkey |
UNHCR | United Nations High Commissioner for Refugees |
WV | World Vision |
WVI-T | World Vision International in Turkey |
- Evaluation Summary
World Vision is seeking an external consultant to undertake a baseline evaluation for the Action titled “Providing Information and Protection Assistance to Vulnerable Refugees in Turkey, and Linking Them to Protection Services” implemented between April 2017 and March 2018 in cooperation with local partners in Istanbul, Ankara, Mersin, Bursa, Konya and Mardin and funded by the European Union. The project is part of World Vision´s and the local partners´ response to the needs of Syrians suffering from the ongoing crisis in Syria but also aims to reach other refugees living in Turkey. The main objective of the baseline is to establish baseline values and validate anticipated target figures for the indicators established to measure the results and specific objective of the Action, as well as to provide assessment data for Mardin.
Program / project | Action entitled “Providing Information and Protection Assistance to Vulnerable Refugees in Turkey, and Linking Them to Protection Services”, grant agreement number ECHO/TUR/BUD/2016/91019, PBAS 208054 |
Program phase | 01.04.2017 – 31.03.2018 (12 months) |
Evaluation type | Baseline evaluation |
Evaluation purpose | · Collection of baseline data for project indicators· Assessment for Mardin
· Identify leads for marginalized or excluded groups based on guidance on vulnerable or at risk groups from the Protection Working Group |
Primary methodologies | Quantitative |
Evaluation start and end dates | 21st August – 6th October 2017 |
Anticipated evaluation report release date | 6th October 2017 |
- Description of Program or Project Being Evaluated
Since the beginning of the crisis in Syria in March 2011, more than 5 million Syrians are officially estimated to have fled their country, out of whom 2,9 million are being hosted by Turkey.[1] Turkey also hosts significant refugee populations from other countries in the region, such as 130.000 Iraqis and 118.000 Afghanis, as well as smaller populations from Africa.[2]The majority of the Syrian refugees live outside of the Government-supported camps in urban or semi-urban areas. Needs assessments have shown that up to one third of the Syrian refugees remain unregistered with the authorities, which means that their ability to access the protection offered by the legal regimes that govern the status of refugees in Turkey is compromised. This includes legal rights as well as access to public services such as healthcare and education, the labor market and social safety nets. Indeed, livelihoods and income are ranked as top priority concern by refugees in assessments and have an impact on many other areas where they are found to be at higher risk, such as school drop-out, child labor and early marriage, health problems left unattended, and basic needs such as shelter and food compromised. The often traumatic experience of the civil war in Syria, the disruption of families and social networks, and living in displacement, including language barriers, differences in culture, tensions etc., furthermore impact on refugees´ well-being and ability to cope.[3]
World Vision International in Turkey (WVI-T)[4] has been scaling up programming to support Syrian refugees in Turkey since late 2015, made possible notably with funding from the European Union (ECHO)[5] but also the German Federal Ministry for Economic Cooperation and Development (BMZ) and Aktion Deutschland Hilft e.V. (ADH). The local partners who will implement the proposed Action have been providing assistance to Syrian and other refugees in Turkey for several years and have extensive experience in the provision of community-based protection services.
World Vision Baseline Under the proposed Action, World Vision and its local partners aim to facilitate access to existing protection solutions for vulnerable refugees in Ankara, Bursa, Istanbul, Konya, Mardin and Mersin by supporting their registration under the temporary and international protection regimes and their integration into public service provision. This is expected to contribute to improved protection from harm and improved living conditions and well-being for refugees. It is to be achieved through the dissemination of information on refugee rights and available services; a case management approach for vulnerable cases identified through a screening process, including legal assistance, mental health and psychosocial support (MHPSS), and individualized protection assistance (IPA); and advocacy with government duty bearers on refugee protection issues. An estimated 71.885 refugees (mainly Syrians but also other nationalities) are expected to be reached overall, with approx. 9.377 households benefiting from a protection screening process and members of approx. 15-20% of these households from case management. The table below provides a more detailed overview of the proposed Action´s objectives, results, activities and indicators.
World Vision Baseline Action logical framework
Intervention hierarchy | Description | Indicator |
Principle objective | Ensure that vulnerable refugees in Turkey are protected from harm, until lasting solutions are modelled and integrated into government systems – resulting in sustainable and equitable access to services for refugees | |
Specific objective | Vulnerable refugees and their specific needs are identified, and are linked with the right information to regularize their status to access social services and to improve their living conditions and well-being | 1 – % of unregistered refugees identified that are now formally registered with the Government of Turkey under a valid legal status |
Result 1 | Refugees are aware of their rights and obligations | 1-1 – % of refugees benefiting from protection services aware of their rights and obligations (disaggregated by gender, age, location, nationality)1-2 – Standardized and harmonized materials exist and are used for outreach and to facilitate registration and access to services (both social and legal)
1-3 – Number of people reached through awareness raising sessions (disaggregated by gender, age, location, nationality) |
Result 2 | The most vulnerable refugees identified are able to access quality services in accordance with Turkish law and regulation (temporary protection – TP and international protection – IP) | 2-1 – % of refugees identified who access specialized protection services provided through the hubs (disaggregated by type of specialized vulnerabilities, gender, age, location, nationality)2-2 – Service mapping and referral pathways in place and delivering services
2-3 – % of registered refugees who are integrated into the provision of national social and legal services |
Result 3 | Protection situations are locally monitored and advocacy with key stakeholders is enhanced | 3-1 – Number of local level protection monitoring reports identifying protection concerns disseminated to relevant stakeholders3-2 – % of recipients of protection monitoring reports and advocacy initiatives reporting concrete examples of how the information is / will be used in their programming / policy / advocacy work
3-2 – Number of marginalized or excluded groups identified |
Activities | 1.1 Develop tailor-made information dissemination materials1.2 Community Protection Volunteers carry out protection screening and information dissemination to most vulnerable households via house-to-house visits
1.3 Production of an awareness raising video to be spread on social media 1.4 Execute SMS campaigns covering updated protection service information 1.5 Protection awareness raising session provided in the hubs 1.6 Provision of legal awareness raising sessions
2.1 Updated mapping of available services 2.2 Operating an Information and Referral Call Center, linked to the accountability hotline 2.3 Development of a Case Management Standard Operating Procedure and supportive database software that enables follow-up and monitoring of the 6 steps of case management 2.4 Provision of 1:1 legal counselling and assistance for identified protection cases 2.5 Psychosocial awareness raising through group sessions 2.6 Provision of psychosocial support through dialogue-based group counselling 2.7 Provision of mental health support through 1:1 counselling by a clinical psychologist 2.8 Provision of Individual Protection Assistance and monthly follow-up
3.1 Conduct structured and scheduled protection monitoring activities 3.2 Develop periodic hub-specific protection monitoring bulletins 3.3 Regular engagement with neighborhood mukhtars and municipality officials (mukhtars / mayors), (metropolitan) district municipality officials, and with province authorities on issues and progress related to refugee protection |
World Vision Baseline Project direct beneficiaries
The project will be implemented in Ankara, Bursa, Istanbul (2 locations), Konya, Mardin and Mersin. Areas that were identified in the needs assessments as having high percentages of vulnerable refugees will be served by the Action. Vulnerability of areas were determined by high numbers of refugees and host communities living in overcrowded informal housing and shanty houses, facing income constraints and barriers to accessing basic goods and services. The table below shows available information on the distribution of host communities and Syrian refugees for the targeted areas.
Province | Districts the project is estimated to serve | Est. host community population in those districts | Est. Syrian refugee population in those districts |
Ankara | Altındağ, Keçiören, Mamak, Çubuk, Kazan | 2.800.000 | 125.000 |
Bursa | Yıldırım, Osmangazi, İnegöl, Nilüfer | 2.200.000 | 140.000 |
Istanbul | Esenyurt, Bağcılar, Avcılar, Başakşehir, Küçükçekmece, Esenler | 2.800.000 | 270.000 |
Istanbul | Sancaktepe | 354.882 | ? |
Konya | Karatay, Meram | 77.372 | |
Mardin | Kızıltepe, Midyat, Artuklu, Nusaybin, Yeşilli | 630.000 | 110.000 |
Mersin | Akdeniz, Toroslar, Mezitli, Yenişehir, Tarsus, Erdemli | 1.500.000 | 168.500 |
Source: Information from project partners provided during the project design.
While the majority of refugees reached by the project will be of Syrian nationality, the project also targets refugees of other origins. The table below provides an overview of refugees in Turkey by nationality. Information on the distribution by the locations served by the project is not available.
Refugees in Turkey by nationality | Est. number | % of all refugees in Turkey |
Syrian | 3 million | 90,9% |
Afghani | 135.000 | 4,1% |
Iraqi | 134.000 | 4,1% |
Iranian | 32.000 | 1,0% |
Somali | 4.000 | 0,1% |
Other | 9.000 | 0,3% |
Total persons of concern | 3.3 million | 100% |
Source: UNHCR Turkey: “Key Facts and Figures”, May 2017, http://reliefweb.int/sites/reliefweb.int/files/resources/UNHCRTurkey-KeyFactsandFigures-May2017.pdf (22/06/2017).
The sex and age distribution of Syrian refugees is estimated to be as follows (no information available for refugees of other nationality):
Est. % of target group | % female | % male | |
0-59 months | 12% | 52% | 48% |
5-18 years | 33% | 52% | 48% |
19-49 years | 46% | 55% | 45% |
≥50 years | 8% | 50% | 50% |
Source: DGMM, http://www.goc.gov.tr/icerik6/temporary-protection_915_1024_4748_icerik(22/06/2017). Note that the percentages presented here deviate slightly from those in the Action proposal but are more up-to-date and based on official figures.
The estimated total number of beneficiaries targeted by the Action as calculated during the proposal design phase is 71.885, with information dissemination including through a call center, SMS campaigns, the publication of videos on social media, the distribution of IEC materials and awareness raising sessions reaching the highest number of persons.
Based on the anticipated capacity of each of the protection hubs grounded in experience from the previous phase of the project, the Action will target 9.377 households for protection screening (based on an average HH size of 4,7, this corresponds to approximately 44.071 individuals). Out of the overall number of households, it is estimated that between 15-20% will go into full case management (1.406 – 1.875 cases, with a case principally defined as an individual person rather than the entire household unless the entire household benefits). As needed, case management may include individual legal counselling and referrals, MHPSS group or individual counselling, and IPA assistance. It is expected that these activities will overlap, as many vulnerable families require multiple types of assistance and the project aims for a holistic approach.
Cases will be selected in line with the Standard Operating Procedures (SOPs) for Case Management and Individualized Protection Assistance formulated for this project based on Case Management Working Group guidance. The following vulnerability criteria shall be taken into account: Persons with disabilities, injuries, victims of torture, women at risk (including female-headed households, pregnant and lactating women with no means of support, and survivors of sexual and gender-based violence), children at risk (including unaccompanied minors, child-headed households and children with disabilities), elderly at risk (unaccompanied elderly persons, elderly persons with disabilities), single male-headed households with children with disabilities, large households (including extended families living together and nuclear families with numbers of children higher than average), families hosting another family where number of individuals in one space exceeds 14 people.
In addition, some of the services offered at the hubs such as awareness raising and individual legal assistance will be open to drop-in cases who are not under a full case management approach.
Finally, 105 government officials will be targeted for protection advocacy.
The number of beneficiaries targeted by key activities under the project is as follows:
Key activities | Beneficiaries targeted |
Information dissemination | 71.885 individuals |
Protection screening | 9.377 HH @ 4,7 individuals = 44.071 individuals |
Awareness raising sessions | 4.800 individuals |
Legal assistance | 2.814 individuals |
MHPSS group and individual counselling | 2.012 individuals |
IPA | 1.820 individuals |
Protection advocacy | 105 individuals |
- Baseline Evaluation Target Audiences (i.e., for whom the evaluation is intended?)
The targeted audiences for this evaluation are:
- Project management of World Vision and local partners
- World Vision BaselineBaseline Study Type
Formative evaluation.
- World Vision Baseline Baseline Study Purpose and Objectives
Purpose: To provide an information base against the project objective and result indicators to further assess the progress within the project final evaluation. The baseline survey will be designed to allow measurement of the degree and quality of change as a result of the project implementation.
World Vision Baseline Objectives:
- To set up benchmarks against the project indicators. Note that, in line with donor requirements, as much as possible, indicators related to the targeted refugee populations shall be disaggregated by location, sex, age (children <18 years / men and women 18-49 years / elderly ≥50 years), nationality, disability, and vulnerability as defined in the Case Management and IPA SOPs.
- To identify protection threats and vulnerabilities for the main non-Syrian refugee groups and key known vulnerable groups targeted by the project, as well as possible leads for other marginalized or excluded groups in the different locations as informed by the guidance on protection threats and at risk populations in the Case Management and IPA SOPs.
- To validate the percentage of Syrian refugees that are not registered under the temporary protection regime in Turkey in the targeted areas, provide information on the legal status of non-Syrian refugees, and provide recommendations for adjusting the anticipated target figures for indicator 2-3, “% of refugees to be integrated into provision of national social and legal services”.
- In line with the rapid assessments undertaken in other locations prior to proposal submission, to identify protection threats, prevalence of vulnerability factors, registration status, level of access to services, and level of awareness of rights and services among refugees, as well as to identify existing service providers, in Mardin, to inform detailed intervention planning.
- World Vision Baseline Baseline Study Methodology
The methodology for implementing the baseline shall aim to triangulate information to the extent reasonable and possible to ensure a good degree of validity of the findings. It shall notably comprise:
- Collection of primary data through a HH survey and FGDs with members of the targeted populations in all targeted locations;
- Collection of primary data through KIIs with staff from implementing partners and stakeholders such as the Protection Working Group, covering all targeted locations;
- Review of project documentation and relevant secondary sources.
The proposed methodological approach and the tools will be developed in close cooperation between World Vision and the consultant and include field testing with a sample set of the targeted population.
Specifically with regards to the Action´s indicators, the following information shall be collected and methodological approach is foreseen:
Indicator | Definition | Information to be collected during the baseline | Informants | Methods | Sample | Tools |
1 – % of unregistered refugees identified that are now formally registered with the Government of Turkey under a valid legal status | % of refugees identified in the course of the project through screening who do not have valid documents under the temporary or international protection regime, who have a valid legal status under either one of those regimes by project end as a result of support provided to them by the implementing partners | · % of the targeted population in the targeted areas who have a valid legal status under TP or IP· % who have TP or IP that requires changes
· % who have applied for TP or IP · % who have no TP or IP and who have also not applied for it |
Syrian and non-Syrian refugees;adult household member
|
Survey for Syrian refugees, FGDs for non-Syrian refugees | 292 HH, 4-8 FGDs | Structured survey questionnaire, semi-structured FGD guide |
1-1 – % of refugees benefiting from protection services aware of their rights and obligations (disaggregated by gender, age, location, nationality) | % change in refugees who are aware of their rights and obligations and of the public services they can access under the TP and IP schemes compared from project beginning to project end after having received information from the project partners in the form of house-to-house visits, legal and protection group awareness raising sessions at the project offices, and information, education and communication (IEC) materials | % of the targeted population in the targeted areas who are aware of their rights, obligations, and of the public services they can access (TP and IP registration, healthcare, education, labour market, social safety net, complaints procedure) | Syrian and non-Syrian refugees;adult household member
|
Survey for Syrian refugees, FGDs for non-Syrian refugees | 292 HH, 4-8 FGDs | Structured survey questionnaire, semi-structured FGD guide |
1-2 – Standardized and harmonized materials exist and are used for outreach and to facilitate registration and access to services (both social and legal) | Number of standardized and harmonized information materials on refugee rights and obligations and on public services available to refugees under the TP and IP scheme developed and used by project partners for information dissemination and for outreach activities | Mapping of IEC materials currently used by the project partners, disaggregated by location, topic and language | Project partners´ staff | Key informant interviews, desk review | 4 existing project centers, 2 head offices | Mapping tool |
1-3 – Number of people reached through awareness raising sessions (disaggregated by gender, age, location, nationality) | Number of people who attend group awareness raising sessions on legal or protection topics provided by the project partners at the project offices | % of the targeted population in the targeted areas who report to have accessed information provision services on legal or protection topics in the 3 months prior to the survey by any service provider, disaggregated bybroad topic, type of information service provider | Syrian and non-Syrian refugees;adult household member
|
Survey for Syrian refugees, FGDs for non-Syrian refugees | 292 HH, 4-8 FGDs | Structured survey questionnaire, semi-structured FGD guide questionnaire |
2-1 – % of refugees identified who access specialized protection services provided through the hubs (disaggregated by type of specialized vulnerabilities, gender, age, location, nationality) | % of refugees identified in the course of the project through screening who receive legal counselling / assistance, psychosocial awareness raising, dialogue-based group counselling, 1:1 counselling, and / or individualized protection assistance from the project partners
Vulnerability as defined in the Case Management and IPA SOPs |
% of the targeted population in the targeted areas in need of legal (registration, complaints procedure), MHPSS, basic needs (shelter, food, NFIs, cash), healthcare and / or education assistance | Syrian and non-Syrian refugees;adult household member
|
Survey for Syrian refugees, FGDs for non-Syrian refugees | 292 HH, 4-8 FGDs | Structured survey questionnaire, semi-structured FGD guide questionnaire |
2-2 – Service mapping and referral pathways in place and delivering services | · Number of service mappings completed· Number of referral pathways developed
· % of people referred to project-external services who access the services they were referred to, disaggregated by reason for referral and type of service provider referred to |
Mapping of service mappings and referral pathways already in place for the project partners, disaggregated by location, sector, type of service provider | Project partners´ staff | Key informant interviews, desk review | 4 existing project centers, 2 head offices | Mapping tool |
2-3 – % of registered refugees who are integrated into the provision of national social and legal services | % of refugees identified in the course of the project through screening who access registration, healthcare, education, labour market, Emergency Social Safety Net (ESSN), social services and / or complaints procedures offered by the Government of Turkey to refugees under the TP and IP regime as a result of the project intervention | % of the targeted population in the targeted areas who have (not) accessed TP and IP registration, (public) healthcare, (public) education, (public) labour market services, ESSN, social services, and / or complaints procedure in the 3 months prior to the survey, disaggregated by sector and type of service provider | Syrian and non-Syrian refugees;adult household member
|
Survey for Syrian refugees, FGDs for non-Syrian refugees | 292 HH, 4-8 FGDs | Structured survey questionnaire, semi-structured FGD guide questionnaire |
3-1 – Number of local level protection monitoring reports identifying protection concerns disseminated to relevant stakeholders | Number of location-specific protection monitoring reports disseminated to stakeholders involved in registration and / or service provision for refugees under TP and IP, covering community and individual-level protection issues, risks and needs of the most vulnerable groups, and giving action-oriented recommendations | Mapping of protection monitoring and / or advocacy initiatives with stakeholders involved in registration and / or service provisions for refugees under TP and IP in the targeted locations, disaggregated by location and issue | Protection Working Group lead, potentially others | Key informant interview | Tbd | Semi-structured questionnaire |
3-2 – % of recipients of protection monitoring reports and advocacy initiatives reporting concrete examples of how the information is / will be used in their programming / policy / advocacy work | % of government officials who received protection monitoring reports who report concrete examples of how they use or plan to use the information provided on protection issues and on risks and needs of the most vulnerable groups in their work | This indicator will only be measured during the end-of-project evaluation. | n/a | n/a | n/a | n/a |
3-2 – Number of marginalized or excluded groups identified | Number of groups particularly vulnerable to protection threats identified and profiled by the project partners in each of the 7 project locations | · Identification of groups who are reported by refugees taking part in the study as particularly vulnerable to protection threats· Outline of the specific protection threats and vulnerabilities of the groups known to be at greater protection risk and selected for FGDs | Syrian and non-Syrian refugees;adult household member
|
Survey for Syrian refugees, FGDs for non-Syrian refugees | 292 HH, 4-8 FGDs | Structured survey questionnaire, semi-structured FGD guide |
World Vision Baseline Primary data collection
Primary data collection is expected to comply with recognized ethical principles. Data are expected to be collected on smartphones or tablets, using ODK, Kobo, SMAP or similar applications, and processed electronically. The consultant will provide the cleaned primary data set in Excel to World Vision and grants World Vision rights of storage and further usage. The consultant is expected to:
- Provide a time schedule, a breakdown by location and a breakdown of resources needed for primary data collection in the 7 locations covered under the Action;
- Hire, train and supervise enumerators, which must include both men and women, and care for their provisions and security;
- Obtain the necessary permissions for gathering primary data from the relevant authorities.
The consultant must confirm in writing in the application package that he / she or their sub-contracted party has permission to operate and collect primary data in Turkey for research purposes.
World Vision Baseline Sampling
- Household survey
A cross-sectional household survey focused mainly on protection threats, vulnerability factors, registration status, level of access to services, and level of awareness of rights and services will be carried out in the form of a structured interview with adult household members to assess baseline values for the Action´s indicators, validate the percentage of refugees that do not have a valid legal status, and provide assessment information for Mardin.
The sampling aims to achieve results representative by hub, hence the survey will be conducted among the randomly selected target population living in the neighborhoods expected to be served by the hubs. As the hub capacities are set up in a similar way, it is assumed that each hub will reach approximately the same number of beneficiaries over the course of the project, hence the sample size will be the same for all locations.
As the distribution of non-Syrian refugees by location is not known, only Syrian refugees will be purposefully sampled for the survey, while information on non-Syrian refugees will be gathered through qualitative instruments. In line with known national-level statistics, it is assumed that 90,9% of the refugee population to be served will be of Syrian nationality.
The reference activity chosen for calculating the sample size is protection screening, which is the activity carried out by the hubs that is expected to have the largest reach and serve as an entry point to all other activities offered at the hubs.
A balanced number of male and female adult household members will be chosen to participate in a structured interview and in case of deviation in the resulting sample, the weighting method will be applied at the analysis stage.
World Vision Baseline This translates into:
- 377 HH reached by protection screening across hubs = approx. 1.340 HH per hub
- 524 out of the 9.377 HH are expected to be of Syrian nationality = approx. 1.206 HH per hub
- Based on a margin of error of 5%, a confidence level of 95%, and a response distribution of 50%, the sample size per hub will be 292 HH x 7 locations = 2.044 HH across locations.
- Focus group discussions
Focus group discussions will be used to gather qualitative information on protection threats, risk factors, registration status, access to services, and awareness of rights and services among main non-Syrian refugee groups as well as to assess protection threats in more detail among key known vulnerable groups.
For non-Syrian refugees, the consultant shall strive to hold FGDs with each Afghanis, Iraqis, Iranians and Somalis as the largest non-Syrian refugee groups in Turkey in all locations. Enquiries shall be made locally as to the presence of non-Syrian refugees and to identify potential participants, including through channels such as DGMM, the United Nations High Commissioner for Refugees (UNHCR), the municipality and non-governmental actors working with non-Syrian refugee populations. The maximum number of FGDs would be 4 per location or 4 x 7 = 28 across locations. It is anticipated that FGDs with all nationalities are unlikely to be held in all locations.
For known vulnerable groups, the consultant shall strive to hold FGDs with each women at risk, children at risk, elderly at risk, and persons with severe medical conditions as defined in the Case Management and IPA SOPs in all locations. Potential participants shall be identified through the household survey as well as by making enquiries with social services and non-governmental organizations working with the targeted groups. The anticipated number of FGDs is 4 per location or 4 x 7 = 28 in total.
- Key informant interviews
Key informant interviews shall be undertaken with staff from the project partners, both from the 4 already existing centers and from headquarters, and, at a minimum, the lead of the Protection Working Group. World Vision and the partners will facilitate setting up interviews.
Province | Districts the hubs are estimated to serve | Syrian refugee population targeted through protection screening | Sample size for HH survey | FGDs with non-Syrian refugees and vulnerable groups | KIIs with partner staff |
Ankara | Altındağ, Keçiören, Mamak, Çubuk, Kazan | 1.206 HH | 292 HH | 4-8 FGDs | 2 staff (hub + HQ) |
Bursa | Yıldırım, Osmangazi, İnegöl, Nilüfer | 1.206 HH | 292 HH | 4-8 FGDs | 1 staff (hub) |
Istanbul | Esenyurt, Bağcılar, Avcılar, Başakşehir, Küçükçekmece, Esenler + Sancaktepe | 1.206 HH | 292 HH | 4-8 FGDs | 1 staff (hub) |
Istanbul | Sancaktepe | 1.206 HH | 292 HH | 4-8 FGDs | 1 staff (HQ) |
Konya | (Karatay, Meram) | 1.206 HH | 292 HH | 4-8 FGDs | – |
Mardin | Kızıltepe, Midyat, Artuklu, Nusaybin, Yeşilli | 1.206 HH | 292 HH | 4-8 FGDs | – |
Mersin | Akdeniz, Toroslar, Mezitli, Yenişehir, Tarsus, Erdemli | 1.206 HH | 292 HH | 4-8 FGDs | 1 staff |
Total | 8.448 HH | 2.044 HH | 28—56 FGDs | 6 staff+ min 1 KII with Protection WG lead |
Secondary data
WVI-T and partners will provide the consultant with access to project documents relevant for the baseline, including documentation from the previous phase of the project and assessments on the protection situation of refugees in Turkey undertaken by other agencies. The consultant is expected to research and include additional secondary sources on the situation of refugees in Turkey in the analysis as needed.
- World Vision Baseline Limitations
- The study aims to yield generalizable, representative findings for Syrian refugees expected to be serviced by the hubs in the different locations. Data shall furthermore be disaggregated by sex, age and vulnerability as they are found among the populations interviewed.
- Information on non-Syrian refugees and specific vulnerable groups will be qualitative, as they cannot be purposefully sampled given lack of information on their prevalence in the targeted locations as well as access challenges. Even with a qualitative approach, it might not be possible to find non-Syrian refugees and refugees at risk willing to participate in FGDs in all locations.
- The consultant should expect that the data collection process might face challenges due to changes in the operating environment, including regarding obtaining the necessary government permissions for data collection.
- Expected Outputs and Deliverables
- Inception meetings to finalize scope of work, expectations, process / work plan, and brief on logistics and technical aspects.
- Evaluation design document, including detailed description of the methodology to answer the evaluation questions, proposed sources of information, data collection procedures, work plan, activities to be implemented, deliverables, roles and responsibilities of each member of the evaluation team.
- Piloted and adapted baseline tools, including HH survey, FGD guide, KII questionnaire and mapping tool.
- Training of enumerators, obtain government permissions to implement primary data collection.
- Raw data (all data sets in excel and / or SPSS, notes from KIIs and FGDs) and data analysis as per analysis framework.
- Draft & final baseline report and summary fact sheet. The consultant will produce a draft report to be submitted to WVI-T on the agreed date for review. A final report (MS Word, Excel files, PDF), including feedback from WVI-T reflected in, will then be submitted to WVI-T. The report needs to follow the provided template / guidance.
World Vision Baseline Guidance for the final report:
- Executive summary
- Context and intervention description
- Baseline purpose and objectives
- Baseline methodology
- Findings on the Action´s indicators
- Including validation of anticipated target figures for indicator 2-3
- Including validation of the % of refugees that are not registered under temporary or international protection
- Assessment findings for Mardin
- Leads for marginalized or excluded groups identified in the different locations and their protection risks and needs
- Conclusions and recommendations
- Annexes (research design, final version of the tools used, list of people interviewed, bibliography)
All deliverables (except for the evaluation report) need to be provided in English and Arabic as well as other languages where appropriate. The evaluation report needs to be provided only in English.
- World Vision Baseline Authority and Responsibility
Phase | Person responsible | Timeline | Tasks |
Planning | WVT M&E Coordinator | April 2017 | ü Develop the baseline evaluation ToRü Adapt and contextualize the evaluation baseline measurement tools in cooperation with consultant
ü Develop target population sampling method to make sure the quality of data is acceptable and analysis results are credible in cooperation with consultant |
WV Syria Response MEAL Manager,WVT Grant Manager,
local implementing partners, World Vision Regional Evidence and Knowledge Management Director |
ü Provide feedback and approval on the final version of the baseline evaluation ToR, sampling method and tools | ||
Implementation: Data collection and analysis | Consultant | August 21st – September 22nd 2017 | ü Develop the detailed Evaluation Design Document in cooperation with WVT M&E Coordinatorü Develop primary data collection tools, field test, revise in cooperation with WVT M&E Coordinator and provide final version
ü Select, contract enumerators and arrange and provide training for them to ensure quality of the baseline data, with training supported by WVT M&E Coordinator ü Develop data collection schedule and define roles and responsibility ü Obtain government permissions for primary data collection ü Arrange logistics (including transport, payment, devices for data collection, setting up of interview dates with key informants) ü Oversee the data collection process and monitor the data received on a daily basis ü Process, analyze and present the collected data in the developed analysis format for each instrument |
WV M&E Coordinator, WVT Protection Coordinator, local implementing partners | ü Review and provide feedback on the detailed Evaluation Design Document and the primary data collection toolsü Support enumerator training
ü Facilitate the set-up of meetings for KIIs with project partners and Protection Working Group lead ü Provide analysis plan to consultant |
||
Reporting and follow-up | Consultant | September 25th – October 6th | ü Analyze the primary data results across instruments and with reference to relevant secondary sourcesü Prepare the draft Baseline Evaluation Report with respective recommendations
ü Share the report with WVT M&E Coordinator, WV Syria Response MEAL Manager, WVT Grant Manager and local implementing partners for review ü Incorporate feedbacks into the report and share the final version with WV Syria Response Program Development & Quality Assurance Director for final review and feedback ü Finalize the Baseline Evaluation Report.
|
WV M&E Coordinator, WVT Protection Coordinator, local implementing partners | ü Provide feedback on the draft report. | ||
WVT Grant Manager | Post October 6th 2017 | ü Present the report to stakeholders. |
- World Vision Baseline Timeline
- August 21st – 25th: Finalization of Evaluation Design Document, including methodological approach, sampling aspects, primary data collection tools
- August 28th – September 15th: Primary data collection, including obtaining government permissions and training enumerators
- September 18th – 22nd: Data cleaning, primary data analysis and presentation
- September 25th – 29th: Report writing
- October 2nd – 6th: Report review, feedback and finalization
- World Vision Baseline Profile of the Baseline Study Team
The consultant (team) must have proven expertise and experience in social research, protection in protracted displacement responses, and be able to implement the research in Turkey following the required procedures and in the required languages.
World Vision Baseline Proof of these is to be provided by submitting, together with the application:
- An overview of relevant works
- Work samples
- Contact details for references
- The proposed research team´s CVs.
World Vision Baseline Requirements in detail:
- Have expertise and experience in social science research, including mixed methods and notably quantitative and qualitative primary data collection methods.
- Have expertise and experience in research, assessments, monitoring and evaluation in humanitarian emergency response contexts, preferably related to the Syria crisis and Turkey, as well as related technical standards with a particular focus on protection in protracted displacement contexts.
- Have a good understanding of the Syria crisis and the situation of Syrian refugees in Turkey.
- Have permission to work, travel and undertake primary data collection in the project target locations and be able to do so in the language of the primary target groups and the project teams (Arabic, Turkish, English).
- Have proven experience in conducting participatory qualitative and quantitative evaluation studies with superior analytical skills.
- Have a good knowledge of data collection software (such as Kobo, SMAP) and statistical packages (such as SPSS).
- Have excellent report writing skills.
- Have excellent written and spoken English and Arabic.
- Have excellent team leading skills, with the ability to work with a varied team.
- Hold a minimum educational qualification equivalent to a master´s degree in a relevant field.
- World Vision Baseline Application
The consultant should submit a proposal comprising the following:
- A technical proposal which indicates how the consultant is going to undertake the activities highlighted in the ToR, with initial indication of the enumerators and timeframe required.
- A capacity statement detailing the consultant´s ability to deliver a quality evaluation report within the given timeframe, including an overview of relevant work and technical experience.
- If not registered in Turkey themselves, a statement with whom the consultant team will be cooperating to collect data in Turkey, information on the cooperating partner´s registration in Turkey and on their experience in collecting data in Turkey for similar research projects.
- At least 2 samples of previous relevant works undertaken, including at least 1 baseline report that was 100% led by the lead consultant.
- Contact details for 2 references for similar assignments done not more than 3 years ago.
- CVs of the key personnel on the research team.
- A financial budget with explanations about the line items that is split in 2 parts: 1) Primary data collection, 2) development of research framework, tools, data analysis, report writing.
- An indication of how the consultant team will cover multiple languages amongst them, namely English, Turkish and Arabic.
- Any appendices the consultant sees as relevant to the application.
Note that World Vision reserves the right to split the contract into an analytical and a data collection part. The applicants should take this into account when presenting their budget and split the cost in a clearly visible way between data collection and analysis on the one hand and designing the research framework and report writing on the other.
Applications should be submitted electronically to:
- WVI-T Procurement, Gaziantep_Procurement@wvi.org
by September 7th, 2017.
All related questions should be sent to Kubra_Ozel@wvi.org
- Child Protection & Data Confidentiality
The external consultant, along with all enumerators, will be required to sign and follow World Vision International´s child protection standards and protocols of behavior, which will be provided to the research team selected.
All primary data collected by this evaluation process is to remain confidential and is not to be shared with third parties.
[1] Syria Regional Refugee Response, Inter-agency Information Sharing Portal, http://data.unhcr.org/syrianrefugees/regional.php (21/06/2017).
[2] UNHCR, “Key Facts and Figures – Turkey”, http://reliefweb.int/report/turkey/unhcr-turkey-key-facts-and-figures-december-2016.
[3] See UDA Consulting, Baseline Study for “Providing Life-Improving Protection Support to Vulnerable Refugees and Host Families in Turkey”, September / October 2016; Support to Life, “Vulnerability Assessment of Syrian Refugees in Istanbul”, April 2016;
[4] For more information on World Vision and the organization´s work in response to the Syria crisis, see http://www.wvi.org/ and http://www.wvi.org/syria-crisis.
[5] For more information on ECHO, see http://ec.europa.eu/echo/.