CLOSE

SIGN UP TO OUR NEWSLETTER

Sign up here to receive our updates on the fight to end modern slavery.

What would you like to receive emails about
(select at least 1 option)

Monitoring & Evaluation

Integral to the mission of the Freedom Fund is the commitment and investment to know and understand what works. We therefore place emphasis on research and aim to conduct rigorous monitoring and evaluation. This allows us to constantly improve our programs, as well as those of other anti-slavery organisations, contribute to sector learning about what is effective and provide clear accountability to both our donors and program participants.

Monitoring metrics of partner programs
Our work begins with local partners by ensuring that they have a clear change strategy, articulating how the program is designed to achieve its aims. As part of the approved grant proposal, each partner must also have a clear data collection plan and report into a common set of metrics. This data is used to both monitor performance at a local level – and can be aggregated to provide a global picture of results. The metrics cover a number of common areas, including who we are reaching, the outputs we produce and project cost:

  • Reach: How many people are our partners reaching directly?
  • Outputs: This covers the goods and services that our partners provide to program participants over a wide range of areas including information provided about slavery, individuals assisted with legal cases and individuals graduating from vocational courses.
  • Outcomes: This is designed to monitor the effect of the goods and services (outputs) provided by our partners. The range extends from the individual to the systems level and includes slavery victims liberated, changes in public policy, number of individuals gaining new access to government services as well as the number of perpetrators convicted. We also ensure that the work of the Freedom Fund can be clearly linked to each outcome.
  • Cost per person to each project: This allows us to compare costs across projects. We also aim combine this data with measures of program effectiveness to assess value for money.

Monitoring data is largely collected by the partners themselves although ensuring the quality of monitoring data is the responsibility of the Freedom Fund. We work with partners as part of our capacity building program to ensure accurate data collection.

Qualitative research to assess local partners’ performance
Monitoring data is only one part of the picture and we want to work with our partners to understand how they are performing across a range of areas. We believe there is no substitute for going and talking to people and we spend time talking to our partners and community members to form qualitative assessments. Our qualitative research is designed to be supportive rather than burdensome whilst also providing key insights and learning from the field that can be used and shared.

Organisational capacity assessments
A primary objective of all our hotspot programs is to build the capacity of our local partners. We believe this is the best way to ensure that change on the ground is sustainable. We regularly work with our partners to assess their overall development against a set of indicators. These fall into the broad themes of governance, people, operations and program quality. This in-house assessment is designed to be light-touch and facilitate conversation, allowing both us and the partner to identify priority areas for training and improvement and track progress over time.

Strategic evaluations of our partner interventions
The Freedom Fund regularly works with external academic partners to provide independent and rigorous evaluation of the work of our partners within a particular hotspot. Evaluations are carried out when an intervention delivered by a partner has particular strategic importance due to size or learning potential, and also to advance understanding of some of the most common anti-slavery interventions. This is particularly important when considering model replication, or in relation to scaling up a particular intervention. Evaluations fall broadly into two areas:

  • Evaluations that seek to assess the relevance and success of our partner programs against intermediate outcomes such as increased community awareness of trafficking risks or increased economic resilience.
  • Prevalence research. Studies will seek to measure the prevalence of slavery within a given area, and whether there has been a reduction in slavery in areas in which our partners are working. Prevalence research is challenging and for practical reasons studies may involve participatory as well as statistical methods. We will share learning about innovative approaches to measuring prevalence within this context.

Evaluation of our hotspots
It is important to understand not only whether particular interventions are effective, but whether the overall hotspot is successful at achieving its key aims. We commission independent external research agencies, and carry out our own research, to help us explore questions around the efficacy of the hotspot model in general, facilitate exploration of where we may be able to replicate and scale-up successful models and provide important learning to the anti-slavery sector. Evaluations are complex and use mixed methods but typically include:

  • an assessment of the relevance and effectiveness of interventions
  • an understanding of the prevalence of slavery in the area
  • an understanding of external factors relevant to the success and contribution of our programmes.

Where appropriate, evaluations will also examine the extent to which we have strengthened civil society and supported wider systems level efforts including the private sector and advocacy to governments.

In addition, research will provide support to our local partners to develop and refine their change strategies and improve data collection processes.

We have commissioned the London School of Hygiene and Tropical Medicine to carry out an evaluation of our hotspot in Ethiopia.

The Institute of Development Studies at the University of Sussex is currently carrying out an evaluation of our hotspot in northern India and will commence an additional evaluation in south-eastern Nepal shortly.

We have been working with Harvard University’s FXB Center for Health and Human Rights on research examining the socio-economic benefits of eradication of slavery in Uttar Pradesh, India. Further details on the project can be found here and the results are expected later this year.

Each year we will publish highlights of our impact in the Annual Impact Report together with key insights and learning from across all of our hotspots. A copy of the 2014 Annual Impact report can be found here.

Global and movement-building initiatives

Global and movement-building initiatives will be monitored and evaluated on a case by case basis.

We are currently working with the Helen Bamber Foundation to understand the literature on mental health and modern slavery. This includes understanding current knowledge on the scope, nature and impact of modern slavery on mental health and the resulting approaches to treatment. Gaps in the literature will be identified and the report will be available later this year with recommendations for future research. Further details can be found here.

The Freedom Fund is partnering with a team of researchers led by Dr Cathy Zimmerman of the London School of Hygiene and Tropical Medicine to outline the major evidence gaps in the field of ‘safe migration’. The findings of the formative work will serve as the basis for a convening of experts later this year to discuss priorities for new research. Further details can be found here.

Research on the Socio-Economic Benefits of Eradication of Slavery, Uttar Pradesh, India
Harvard University FXB Center for Health and Human Rights

Evaluation of Northern India Hotspot Program
Institute for Development Studies, University of Sussex

Evaluation of Southern India Hotspot Program
Institute for Development Studies, University of Sussex

Participatory Evaluation of the South Eastern Nepal hotspot
Institute for Development Studies, University of Sussex

Formative Research and Prospective Program Evaluation of the Ethiopia hotspot
London School of Hygiene and Tropical Medicine