Request for Proposals (RFP) to Conduct Endline Evaluation of PMC-Zambia USAID Community Radio Program

Consultancy

Population Media Center- Zambia (PMC-Z), a US-based non-profit organization is seeking technical and financial proposals from qualified firms to conduct an endline evaluation for the Kwishilya and Sinalamba Radio Serial Drama (RSDs). PMC-Z has been implementing the Community Radio Program (CRP), a USAID funded project, that includes the production of one Bemba-language (Kwishilya) and one Lozi-language (Sinalamba) RSDs. Each 156-episode RSD is broadcast on strategically selected community and commercial radio stations in Muchinga, Luapula, Northern and Central provinces for the Bemba drama, and Western province for the Lozi drama. Over the course of 156 episodes, the RSDs addresses the following themes:
Core themes

Family Planning (FP): tied to reproductive and maternal health
Nutrition: tied to maternal, newborn and child health and development and early childhood development
Gender Based Violence (GBV): including ending child marriage and adolescent pregnancy
HIV: with a focus on adolescents, Test and Start and Adherence to treatment

Supporting themes

Malaria Prevention and Treatment
Education, including keeping girls in school
Civic Engagement with a focus on adolescents
Covid 19

Crosscutting Issue:

Gender Equality

The purpose of the endline evaluation is to gauge the impact of the RSDs immediately after the broadcast ends. This is done through a household survey which allows PMC-Z to classify survey respondents as Kwishilya/ Sinalamba listeners or non-listeners. PMC-Z will then use statistical analysis to look for meaningful differences between listeners and non-listeners in each of the themes: FP, Nutrition, GBV, HIV , Malaria and Education.
Application Details:

The bidder should submit their technical and financial proposals (see following sections for details) with relevant supportive documents through the email addresses mentioned below on or before August 26, 2022.
In addition to the proposals, all firms should submit letter of commitments that indicate the assigned task will be completed within 40 days from the date the contract is offered and signing of the agreement.
The selected firm is expected to notify PMC-Z office in 48 hours its willingness to accept the offer and start the work the soonest possible to meet the deadline.
Interested and eligible firms should submit technical and financial proposals to [email protected] and copy to [email protected]ulationmedia.org, [email protected], [email protected].
PMC-Z reserves the right to accept or reject any or all bids.

 
 

Background of the Assignment

Population Media Center- Zambia (PMC-Z) in partnership with USAID Zambia has been broadcasting the Kwishilya (Bemba language) and Sinalamba (Lozi language) Radio Serial Dramas on strategically selected community and commercial radio stations in Muchinga, Luapula, Northern and Central provinces for the Bemba drama, and Western province for the Lozi drama (see the annex). The 156-episode RSDs began its broadcast in April 2021 and will conclude on September 30, 2022. The purpose of the RFP is to locate research firms within Zambia that can complete a household survey that will enable PMC-Z to assess the impact of RSDs. The survey will use a cross-sectional design and must be conducted on a representative sample of households within the broadcast area.
The primary target audiences are women and adolescents ages 15-49. The secondary audience includes men ages 15-59.
This document outlines the terms for the endline evaluation. Data collection should begin immediately after the broadcast has concluded in late September 2022. Data collection, cleaning, and submission to PMC-Z should occur by early November 2022, accompanied by a research report that explains survey progress, technical issues, and high-level results.
 

Objective of the Assignment

 
The purpose of the endline evaluation is to gauge the impact of the RSD immediately after the broadcast ends. This is done through a household survey that begins with an informed consent script. For households which give consent, enumerators will then collect location data and household demographics. The fourth section of the survey collects listenership data to allow PMC-Z to classify survey respondents as Kwishilya/Sinalamba listeners or non-listeners. PMC-Z will then use statistical analysis to look for meaningful differences between listeners and non-listeners in each of the four themes: FP, Nutrition, GBV, HIV, Malaria and Education.
The final sections of the survey include questions to collect data relevant to PMC’s global mission, feedback on how RSDs like Kwishilya and Sinalamba might be improved in the future, and questions about how Kwishilya/Sinalamba may have influenced listeners’ knowledge, attitudes, and behaviors.

Methods and Sampling Techniques

 
The endline evaluation will be a quantitative assessment (20 to 25 minutes per respondent). PMC-Z will use mobile data collection software and will set up and manage the mobile account for the selected firm.
The selected firm must collect data using a statistically representative sample of the target audience in the broadcast regions. Sampled areas must include both rural and urban areas of selected districts. Further, the firm is expected to train enumerators to collect data from roughly 50% female and 50% male respondents. Applicants should consider a design effect of 2 into their sample size calculations. Section 8 of this RFP lists all broadcast stations for Kwishilya/Sinalamba and includes specific districts that applicants should plan to include in sampling plans. Please note that not all districts need to be included in sampling plans—firms may suggest however many districts they feel are necessary to complete the endline evaluation with a survey sample size that is representative, includes rural and urban data, and attempts to include equal numbers of men and women. Firms must explain why they believe their choice of sampled districts is a sound research design.

Tasks of the Firm

Review the endline evaluation survey in consultation with PMC-Z staff and PMC-HQ to ensure the intent and answer choices for all questions are clear.
Submit a brief inception report to detail final plans for data collection
Translate the endline evaluation survey into appropriate language (Bemba and Lozi) using a template provided by PMC.
Have an adequate number of Android phones or tablets to collect survey data using KoBoCollect. Note that phones generally collect GPS data by default, but most tablets are not GPS enabled. Firms must use equipment that accurately collects GPS data.
Create a training manual, supervisor guide, and enumerator guide for review by PMC-Z and PMC-HQ, and document training progress (i.e., number of enumerators successfully trained).

PMC-Z will work with the selected contractor on Human Subjects Protection requirements and ethical approval to conduct the endline evaluation in selected regions/districts and wards.

Lead training for enumerators with PMC-Z and PMC-HQ staff supporting.
Pre-test the survey tool in one community and if changes are needed consult with PMC-Z and PMC-HQ.
Collect data and ensure digital forms are submitted each evening during the collection period. Supervisors must submit weekly progress reports during data collection to detail where they are, how many interviews their team attempted, how many interviews their team completed, etc.
Conduct five (5) interviews per district visited. These interviews should be conducted with two (2) male and two (2) female listeners who strongly enjoyed Kwishilya/Sinalamba, as well as with one (1) district official (from health services, social services, or another relevant stakeholder). Note that the total number of interviews depends on number of districts selected in the sampling plan.
Develop and submit draft technical research report to document fieldwork, survey completion rates (as compared to original sampling plan), and any concerns/lessons learned.
Organize a workshop with relevant PMC-Z, PMC-HQ, and other stakeholders to share results from endline data collection and the technical research report.
Incorporate feedback and requests for clarification into a) a final technical report, and b) final clean dataset.

 

Deliverables

The firm will provide the following deliverables (which are repeated in Section 6):

An inception report with detailed work plan, appropriate methodology, sampling, timing, roles, and responsibilities of research firm. This should be no longer than five pages.
Bemba and Lozi version of the survey tool based on the English language survey provided by PMC-Z.
Training reports which show number of enumerators and supervisors trained, as well as training manual used during training and any reference guides for supervisors and enumerators to use during field work.
A copy of ethical clearance approval from the appropriate local government authorities.
Pre-test results that show any changes that are required to questions or answers in the survey. These must be made in both English and Amharic in the official survey template used by PMC-Z.
Weekly progress reports from supervisors to document survey progress. These should be no longer than one page.
Daily submissions of survey data should be completed at the end of the day for review by PMC-Z and PMC-HQ; any serious issues or mistakes in submitted forms must be corrected within 24-48 hours.
Interview transcripts and photos. All interviews (five per ward, as noted above) should include a photo, photo release, and transcript of the interview.
Draft technical report (using PMC template) to document all aspects of the survey field work. This will largely be a compilation of weekly progress reports and will also include a section on any lessons learned, another section on challenges with data collection, and other relevant information that impacts data analysis.
Workshop with PMC-Z, PMC-HQ, and other stakeholders to share results of the endline evaluation. This meeting is meant to share information about the process, lessons learned, and challenges. Firms do not need to complete data analysis for this deliverable.
Final technical report which includes responses to any PMC-Z or PMC-HQ questions or requests for clarification.

 

Duration of the Assignment

The endline evaluation will proceed as described in the table and timelines below:

Sequence
Deliverables (see numbered list above)
Estimated Working Days (5-day week)
Deadline
Fee Paid

Contract Signing
None
1
Monday, Sept 5, 2022
40%

Planning
1-5
20
Wednesday, Oct 5, 2022

Data Collection
6-8
12
Friday, Oct 21, 2022

Draft Report
9
10
Friday, November 4, 2022
40%

Final Report and Presentation
10-11
3
Tuesday, November 15, 2022
20%

 

Instructions

Interested individual firms which are legally registered in the Country’s rule of Law are invited to submit an Expression of Interest (EOI) for delivery of the assignment. The EOI should include both Technical and Financial proposals, as described below:
Technical proposal—may not exceed ten pages. The technical proposal must include:

A cover letter outlining the suitability of consultant for the assignment, motivation and summarizing relevant experience (Maximum 2 pages);
Proposed sampling frame. Must include specific details and assumptions of sample size calculation. Must include details on the use of design weights (survey weights) if required by sampling approach (Maximum 3 pages);
Clear work plan which addresses all tasks in Section 4 above and deliverables in Section 5 above (Maximum 4 pages);
Contact details from at least two independent referees with in-depth and proven knowledge of the applicant’s expertise and relevant work experience (1 page)

Financial proposal—submitted in in Microsoft Excel or Google Sheet format may include:

A detailed budget containing total costs as per person per day rates, and any other costs anticipated in completing the assignment (i.e., travel to field sites, equipment);
Costs for conducting the endline evaluation.
A budget narrative (no more than one page) to justify costs

Additional Materials:

Two samples of relevant studies previously produced.
CVs of the consultant/firm with full description of the profile and experience

PMC- Z will provide the necessary orientation for the firm to abide by the existing rules and regulations.
 

Kwishilya and Sinalamba Broadcast Locations

 
The tables below includes complete broadcast locations for Kwishilya and Sinalamba. Please refer to the final column of the table for which districts should be included in endline evaluation sampling plans.
It is up to the applicant to decide which districts must be visited for the endline evaluation. It is not necessary to collect data from all districts which say “yes” in the final column. Applicants must explain their district selection in their proposal.
Annex Table 1. Kwishilya/ Sinalamba  Broadcasters

Broadcaster
Region
District
Date of Final Broadcast
RSD Name
Districts to include in Endline Survey

Serenje Radio Station FM 89.5
Central Province
Serenje,Mkushi,Mpika,Samfya
30/09/22
Kwishilya
TBD

Mpika Radio Station FM 89.5
Muchinga Province
Mpika, Kanchibiya,Luvushi manda
30/09/22
Kwishilya
TBD

Mkushi Radio Station FM 92.7
Central Province
Mkushi,Kapiri, Masaiti, Luano
30/09/22
Kwishilya
TBD

KNC Radio FM 90.3
Central province
Kabwe,Chibombo, Chisamba, Kapiri, Serenje, Luano, Mkushi
30/09/22
Kwishilya
TBD

Radio Luswepo FM  89.5
Northern Province
Mbala, Mpulungu
30/09/22
Kwishilya
TBD

Oblate Liseli Radio FM 105.3
Western Province
Mongu, senanga, Kalanbo, Kaoma, Lukulu
30/09/22
Sinalamba
TBD

Bangwela Radio FM 89.5
Luapula Province
Samfya Chienge, Mwansabombwe, Kawambwa
30/09/22
Kwishilya
TBD

Luapula Radio Station FM 93.7
Luapula Province
Nchelenge
30/09/22
Kwishilya
TBD

Lwansanse Radio FM 88.9
Northern Province
Luwingu, lupososhi,lunte, chifunabuli, chilubi,
30/09/22
Kwishilya
TBD

Radio Yangeni
FM 98.7
Luapula Province
Mansa, Samfya
30/09/22
Kwishilya
TBD

Isoka Radio
FM 93.5
Muchinga Province
Isoka, Mansa
30/09/22
Kwishilya
TBD

Radio Lyambai
FM 101.3
Western Province
Mongu, Senenga, nalolo, limulunga, kalabo
30/09/22
Sinalamba
TBD

Tuta  Radio
FM 90.7
Luapula Province
Mansa, Samfya, Luwingu, Chipili, Chembe, Chifunabulu
30/09/22
Kwishilya
TBD

Chete Radio Station FM 89.9
Muchinga Province
Nakonde
30/09/22
Kwishilya
TBD

Radio Mano
FM 89.3
Northern Province
Kasama, Mungwi, Mbala, Mporokoso
30/09/22
Kwishilya
TBD

Muchinga Radio
FM 88.1
Muchinga Province
Chinsali, shiwangandu,
30/09/22
Kwishilya
TBD

Lukulu Radio
FM 89.7
Western Province
Lukulu, Mitete, Zambezi
30/09/22
Sinalamba
TBD