BU Research Blog

October 10, 2024

Evaluating complex interventions

international, Publishing, writing Edwin van Teijlingen

There are several different methods or approaches to help researchers when evaluating of complex public health interventions or programmes. Our recent paper ‘Most Significant Change Approach: A Guide to Assess the Programmatic Effects’ [1] describes the Most Significant Change (MSC) participatory technique to monitor and evaluate programmatic effects. The MSC is a form of monitoring because it occurs throughout the programme’s lifecycle and provides information to manage it. Unfortunately, MSC as a participatory evaluation technique using qualitative methods is not widely used nor known.

We hope to convince relevant funders and evaluators of the value of the MSC technique and application. Our paper offers step-by-step guidelines on how to use the MSC technique when evaluating a large-scale intervention covering perspectives of different beneficiaries within a limited period. The MSC process involves purposively selecting the beneficiaries, collecting the Most Significant (MS) stories, which are then systematically analysed by designated stakeholders and or implemented partners, selected through internal vetting, and external process by involving beneficiaries and stakeholders.

The central question focuses on changes in the form of stories such as ‘Who did what?’; ‘When did the change occur?’; and ‘What was the process?’ Additionally, it seeks feedback to explain why particular a story was selected as MS and how the selection process was organised. The MSC technique further attempts to verify the validity, significant, relevant, sustainability of the change, and impact on marginalized or Gender Equality and Social Inclusion (GESI) groups brought by the programme. Furthermore, the technique seeks verification of the MS story by triangulating comprehensive notes and recordings.

Prof. Edwin van Teijlingen

Centre fro Midwifery & Women’s Health

Reference:

Sharma, M. K., Khanal, S. P., & van Teijlingen, E. (2024). Most Significant Change Approach: A Guide to Assess the Programmatic Effects. International Journal of Qualitative Methods, 23. https://doi.org/10.1177/16094069241272143

January 9, 2023

RKEDF Evaluation Workshops: Monday 20 and Tuesday 21 February

Knowledge Exchange, Public engagement, Training ballen

The Public Engagement with Research Team are running two workshops in February: Evaluation of Engagement and Advanced Evaluation.

These sessions will be delivered by Dr Jamie Gallagher, one of the most experienced engagement trainers in the UK. Jamie is a dynamic and engaging trainer who makes these sessions enjoyable as well as useful.

It is recommended that both sessions are attended to gain the full benefit. The sessions will build skills from the basic principles of evaluation, through to being able to develop evaluation plans for even the most complex topics, exploring data capture, analysis and reporting. You’ll also learn how to write evaluation reports for funders or for the REF (Research Excellence Framework).

While both sessions are recommended, attending just the first session may be appropriate for your needs. It is advised against only attending the second session.

Evaluation of Engagement: Monday 20 February, 9am-12:30pm, Talbot Campus

This workshop will highlight what you need to ask yourself, and the public, to ensure you can demonstrate the success of your intervention and capture the long term impact of it.

Successful public engagement can benefit research, researchers and the public – but how do you go about demonstrating this change? This workshop will guide you through the best evaluation processes showing you when, why and crucially how to use evaluation to give you reliable and clear data. It will highlight how to demonstrate success to funders, record impact for the REF, help to improve your processes, and give you a better understanding of the people you are connecting with.

At the end of the workshop, you will be able to:

Understand the purposes, uses and limitations of evaluation
Apply event-appropriate evaluation methods in multiple scenarios
Prepare useful, answerable and relevant evaluation questions
Devise and deliver your own evaluation plan
Interpret and report evaluation data.

To book a place on this workshop please complete the booking form.

Advanced Evaluation: Tuesday 21 February 9am – 12:30pm, Talbot Campus

Taking an in-depth look at evaluation, participants will explore data capture, analysis and reporting. From surveys to focus groups, you will learn how to format powerful questions and report meaningful data. Discover how to develop evaluation plans for even the most complex topics. You will also learn how to write evaluation reports for funders or for the REF.

This workshop requires good base knowledge of evaluation, ideally from attending the previous Evaluation of engagement workshop.

To book a place on this workshop please complete the booking form.

For any queries regarding either of these sessions please contact the Public Engagement team: publicengagement@bournemouth.ac.uk.

March 30, 2022

RKEDF Session – Evaluation: Developing your approach. Tuesday 12 April 2-4:30pm.

Knowledge Exchange, Public engagement, Training ballen

Evaluation: Developing your approach – Why is evaluation important in public engagement? And how do you do it effectively?

We are delighted to have teamed up with the National Coordinating Centre for Public Engagement (NCCPE), who will deliver this bespoke session for BU researchers.

This interactive course will encourage participants to think about why evaluation is important, look at ways to get started, explore different techniques they can use, and consider what findings can tell the participant and their organisation or funder. With an emphasis on how to conduct evaluation, participating in practical activities and discussion as together the workshop facilitators and attendees will demystify evaluation and find the fun in revealing and identifying participants’ effectiveness.

These sessions are aimed at people with experience of public engagement with research; however, the session will be open to all experience levels.

Learning objectives:

To develop an awareness of the value and importance of evaluating public engagement.
To gain familiarity with the process of evaluation and the usefulness of planning.
To consider the uses of evaluation including improving activities; sharing good practice and reporting.
To begin to explore the issues and challenges of evaluating public engagement.

By the end of this session, you will:

Have a greater understanding and awareness of the importance of evaluating public engagement
Understand the processes of evaluation and how to plan for it.

It is a condition of booking that the attendee agrees that their contact email will be shared with the NCCPE for the purposes of programme administration.

Workshop	Date	Time	Location
Evaluation: Developing your approach	Tuesday 12th April 2022	14:00-16:30	Online

To book a place on this workshop please complete the booking form.

For any queries, please contact Organisational Development .

January 12, 2022

Free Impact Event with Mark Reed

Training alazar

Professor Mark Reed from Fast Track Impact is running a free online impact event:

Monitoring and Evaluating Impact, with invited guest case study and discussion (with Mark Reed, Poppy Townsend (UKRI) and Rachel Blanche (QMU)): 09.30-11.00 UK time, 28th February 2022.

Evidencing impact from research remains a huge challenge. This workshop will build on Mark Reed’s paper, “Evaluating impact from research: A methodological framework” (recommended reading prior to the workshop) to consider methods for evidencing impact in three particularly challenging areas: capacity building, policy and cultural impacts. Three speakers will provide case studies, methods and tips from their own experience of evaluating impact. Rachel Blanche (Queen Margaret University, Edinburgh) will outline methods from the arts and humanities that have been used to evaluate the cultural impacts of professional practice in the arts. Poppy Townsend (UKRI) will consider how to evaluate capacity building impact from data services. Mark Reed will discuss the evaluation of policy impacts. The session includes significant time for group interaction, and participants are encouraged to bring their own evaluation challenges to the group for discussion.

You can Book your place here.

Tagged / Evaluating impact

RKEDF Evaluation Workshops: Monday 20 and Tuesday 21 February

Evaluation of Engagement: Monday 20 February, 9am-12:30pm, Talbot Campus

Advanced Evaluation: Tuesday 21 February 9am – 12:30pm, Talbot Campus

RKEDF Session – Evaluation: Developing your approach. Tuesday 12 April 2-4:30pm.

Free Impact Event with Mark Reed

Other services

Don’t miss a post!

Recent posts

Search by Category

Research Information Network

UKRI

Tagged / Evaluating impact

Other services

Don’t miss a post!

Recent posts

Search by Category

Search by popular post topics