Terms of Reference
Baseline Statistical Analysis Review
ToR Title Statistical Analysis Consultant (Review of Lafaek Learning Media Baseline Report)
Duration 4 days
Location Dili (or homebased)
Reports to Shoaib Danish, Program Coordinator (Education)
Start date February 2016
CARE is an international organization working to end poverty and social injustice and bring about lasting, sustainable change in communities. CARE works in over 80 countries around the world to help overcome poverty by supporting development projects and providing emergency relief. A non-religious and non-political organization, we know that achieving gender equality, increasing inclusive governance and strengthening community resilience are critical in achieving sustainable outcomes.
In Timor Leste, CARE’s goal is to improve the wellbeing and voice of women and girls in rural disadvantaged areas as we know they are the most disadvantaged members of society. We do this through our thematic priority areas of sexual reproductive and maternal health and rights, education, women’s economic empowerment and women’s voice. CARE uses a number of approaches including the Gender Equality Framework, engaging men and boys, working in partnership, robust monitoring evaluation learning and impact and a commitment to accountability and inclusion.
Lafaek Learning Media
The Lafaek Learning Media Program is a five year program implemented by CARE International in Timor-Leste with support from New Zealand Aid Program. The main goal is to contribute to improved learning outcomes for children and low literate adults, and supporting family wellbeing. The program marks a new phase of the Lafaek magazines series, initially started in 2001. The current Lafaek Learning Media is comprised of three magazines that are produced and distributed three times a year: Lafaek Ki’ik, a publication for pre-school to Grade 2 students; Lafaek Community Magazine to promote literacy and provide news to families and child caregivers and; Lafaek for Teachers to support teachers’ classroom management skills and provide a professional educators’ network.
CARE International in Timor Leste (CITL) has recently undertaken a thorough baseline study for this project, aimed to describe the relevant demographic and other characteristics of the sample, and to identify the current state of knowledge, attitude, practice and skills in a range of key areas relevant to the magazines’ content and intended audiences. In particular data has been collected to allow estimation of key metrics related to relevant knowledge, attitudes, practices and literacy and numeracy skill levels, and to test
associations of interest between key variables. The baseline will provide valuable formative information for developing the project interventions. The data will be compared with endline administrations of similar survey instruments to evaluate the changes that have occurred during the course of the program and assess the impact of the project. The baseline can be used by a wider audience to understand many aspects of the current state of education and development in Timor-Leste. Knowledge, literacy and numeracy results have also identified particularly weak areas for focus of future magazine editions. Information from the surveys allows program staff to have immediate feeback on the initial magazines from the main users to inform future content and improve distribution. Teachers in particular provided many useful suggestions for how editions of Lafaek could be useful to them in the classoom.
Six surveys were conducted during the baseline from June to September 2015 in all 13 municipalities:
- Community Household Survey to assess community members’ adult literacy and numeracy, and knowledge of community development and education issues (749 respondents)
- Teacher Survey to assess teachers’ knowledge and practice of teaching (262 teachers)
- Student Survey to assess students attitudes to school and home environment (823 students)
- Pre-School Survey to examine pre-schools students pre-literacy and pre-numeracy and school readiness (1,073 students)
- Early Grade Mathematics Assessment (EGMA) to assess Grade 1 and 2 students’ numeracy (829 students)
- Early Grade Reading Assessment (EGRA) to assess Grade 1 and 2 students’ literacy (823 students)
- Objectives/Purpose/Key Responsibilities
Given the quantity and complexity of data gathered for this baseline, and the importance of being able to present robust findings for both internal and external purposes, CITL seeks a consultant to review the overall relevance, accuracy and appropriateness of the statistical analysis used within the baseline. The consultant will be expected to review the baseline materials in detail and identify any issues, putting forward recommendations for improvements where necessary and making the revisions as agreed with CITL to ensure the best possible quality of the end product. The review is expected to consider:
- That the most relevant, appropriate and accurate statistical analysis, tests, descriptions and presentations of results are used throughout the current report which is over 100-pages long
- That the survey provides the most effective statistical description and presentation of demographics and other characteristics of the survey samples
- That key measurements especially relating to relevant knowledge, attitudes, practice and literacy and numeracy skills are effectively calculated and clearly shown with appropriate confidence intervals, so that changes over time can be found through a later survey
- To ensure that the relevant associations of interest between key variables are effectively tested, and results presented and clearly explained
- To determine and explain any relevant anomalies
- To identify and comment on any key weakness of the survey methodology or other aspects, against which the results should be considered
- To ensure that the results of the statistical description and analysis are accurately reflected in the report narrative especially in the key findings of the survey and the recommendations for action
- Expected Results or Outputs
- Using the above key points (1-7) as guidance, the consultant will produce a tracked revision of the draft baseline report incorporating any necessary changes to the existing data tables, graphs, figures, and accompanying narrative explanation, including key findings and recommendations.
- The consultant will produce a short accompanying report to explain the recommended changes and annexing all relevant analysis of data.
- After review and discussion with CITL, the consultant will implement the agreed changes in a final draft of the full report.
- Management and Reporting Arrangements
The consultant will report Shoaib Danish.
- Schedule and Dates
The consultancy will take place in February 2016 over 4 days based on a timeline as agreed with the successful candidate.
- Payment Schedule
The Consultant shall receive the following payments upon completion of the outputs as specified above and listed below:
|Acceptance by CARE of the Final Baseline Survey Report||Submission within 4 days of signing the contract||100 per cent of the total fee payable to the Consultant|
The consultant will require the following skills, qualifications and competencies:
- Master’s degree in statistics or related field required
- Extensive experience in applied statistical analysis for baseline and evaluations, ideally in education or related development sector
- Strong technical knowledge of data analysis, statistical tests and relevant tools
- Excellent analysis and writing skills
- Written and oral fluency in English.
- Candidates should provide the following:
- An updated CV
- Proposed timeline
- Financial Proposal in USD
- Indication of availability
The consultant will be expected to sign and adhere to CARE’s Code of Conduct and Child Protection policy. Interested applicants should respond to this ToR with a letter outlining their interest, availability and daily rate and a recent CV to (Shoaib Danish, Shoaib.Danish@careint.org) by February 10, 2016.