Category / Research assessment

Working towards research impact in Nepal

BU’s Centre for Midwifery, Maternal & Perinatal Health has a long history of working Nepal.  Last month (January 7th) BU’s partner Green Tara Nepal led the dissemination of the findings of our evaluation of key health promotion initiatives in Nepal. The evaluation was conducted in collaboration with the Government of Nepal, Green Tara Trust, a UK-based charity, several national and international non-governmental organisations and three UK universities, namely Liverpool John Moores University, Bournemouth University and the University of Sheffield. The evaluation identified key government, bilateral, UN agencies national and international non-governmental organisations working in health promotion in Nepal. Their health promotion activities and approaches were documented and gaps were identified.

As a follow up to both the evaluation and dissemination event we were asked by the journal Public Health Perspectives to write an editorial on our work.1  Our editorial ‘Health Promotion: A review of policies and practices in Nepal’ highlights the research we conducted and the state of health promotion we uncovered.  We also used our editorial to explain the UK notion of impact as formalised in the 2014 Research Excellence Framework (REF).  To explain to our non-academic readers the REF is a nation-wide system to assess the quality academic research in all academic disciplines. 2-4  One key part of the REF is measuring the ‘impact’ that a UK university has on society and/or the economy.  This REF requires UK universities to write and submit a number of case studies that show societal impact.5   The dissemination of the health promotion research in Nepal is the beginning of a REF impact case study for Bournemouth University and our UK partner Liverpool John Moores University.  The editorial is a further stepping stone in the dissemination especially since it was co-authored between UK academics, health promotion practitioners as well as a member of the Constitutional Assembly (the Nepali equivalent of Parliament).   Working with policy-makers at an early stage increases the chances of our research being incorporated in national policy-making in Nepal.

Prof. Edwin van Teijlingen

CMMPH

 

References:

  1. Sharma, A, Tuladhar, G., Dhungel, A., Padmadharini, van Teijlingen, E., Simkhada, P. (2015) Health Promotion: A review of policies and practices in Nepal, Public Health Perpective 5(2): http://phpnepal.org/index.php?listId=941#.VO4Qvn9tXkd
  2. Parker, J., van Teijlingen, E. (2012) The Research Excellence Framework (REF): Assessing the impact of Social Work research on society, Practice: Social Work in Action 24(1): 41-52.  http://eprints.bournemouth.ac.uk/20511/2/REF%20paper%20JPEvT.pdf
  3. van Teijlingen, E., Ryan, K., Alexander, J., Marchant, S. (2011) The Research Excellence Framework (REF): new developments to assess research in higher education institutions and its impact on society. MIDIRS 21 (3): 298-301.
  4. Hartwell, H., van Teijlingen, E., Parker, J. (2013) Nutrition; Effects of the Research Excellence Framework (REF) Nutrition & Food Science 43 (1): 74-77.
  5. Research Councils UK (2015)  RCUK Review of Pathways to Impact: Summary http://www.rcuk.ac.uk/RCUK-prod/assets/documents/documents/PtoIExecSummary.pdf

 

Leading Sociologist to Present Workshop on Achieving and Demonstrating Research Impact!

Professor John Scott, a leading figure in British Sociology, is visiting the University to present a workshop on ‘Achieving and Demonstrating Research Impact’ 9am to midday on 26th March in S202, Studland House, Lansdowne Campus.  The workshop will consider both the achievement and demonstration of impact and will comprise three linked sessions:

 

  1. What is ‘impact’ and how can it be achieved?
  2. How can impact be demonstrated?
  3. The future of the REF

 

Hope you can make it as this will be of cross-University interest!

In metrics we trust?

Back in May HEFCE launched a Call for Evidence on the role of metrics in research assessment. The Independent review chaired by by Professor James Wilsdon,  University of Sussex and supported by an independent steering group, is tasked with building on the previous 2008/9 pilot exercise to explore the current use of metrics for research assessment, consider the robustness of metrics across different disciplines, and assess their potential contribution to the development of research excellence and impact.

HEFCE received 153 responses (44% from HEIs, 27% individuals, 18% learned societies, 7% providers, 2% mission groups, 2% other). With the majority – 57% – of those who responded expressed overall scepticism about the further introduction of metrics into research assessment.

As part of the review three stakeholder workshops have been held/scheduled on key areas of interest and debate:

To date, all have been well attended and very lively. I was able to attend the I workshop in Sussex with some 150 odd other delegates including members of the metrics review panel, metrics developers and providers, researchers, university managers, and a range of stakeholders from across the research and HE community.

The day contained many thoughtful contributions from a range of speakers including: Dr Philip Campbell, Editor-in-Chief, Nature; Professor Stephen Curry, Department of Life Sciences, Imperial College; and Dr Steven Hill, Head of Research Policy, HEFCE. There was lively discussion about the value, potential role, and unintended consequences of metrics in research evaluation. If you are interested in the future role of metrics in research assessment, I would particularly recommend reviewing the presentations from David Colquhoun, Emeritus Professor of Pharmacology at UCL and Dorothy Bishop, Professor of Developmental Neuropsychology, the University of Oxford.

For further insight you could also check out the Twitter discussion, which has over 1000 tweets tagged with #HEFCEmetrics, Impact story have also helpfully encapsulated much of the story/discussion via Storify.

The results of the review will be announced at the end of March and published in the summer. The report will make recommendation againsts three time horizons:

(1) What can HEIs do to improve research management now;

(2) Suggestions for the next REF;

(3) The longer term, including identification of programmes for further work.

The REF results are in! BU’s research recognised as world leading

REF logoAfter many years of preparation, numerous mock exercises and thirteen long months of waiting, the REF results are finally published today! And the news for BU is excellent!

62% of BU’s research has been recognised as internationally excellent, with 18% rated as world-leading. This is a significant uplift on our RAE 2008 scores and has been achieved whilst also submitting considerably more staff to REF 2014 (161.8 FTE, an increase of 45.5%). This highlights the growing research volume and quality at BU and is testament to the significant investment that has been put into research over the past decade. The assessment recognised BU as a leading university in both the UK and south west region.

Key achievements for BU overall include:

  • BU was in the top half of all institutions that submitted to the REF (69th out of 154) based on the proportion of research rated of international standard
  • BU was 11th out of the 69 post-1992 universities based on the proportion of world-leading research
  • BU was fourth in the south west based on the proportion of world-leading research, behind Bristol, Bath and Exeter
  • 30% of BU’s research impact was rated world-leading
  • 58% of BU’s research outputs were rated internationally excellent or world-leading
  • 63% of BU’s research environment was rated internationally excellent or world-leading
  • The THE has ranked BU 69th overall, an increase from 75th in 2008, and 69th for impact – http://www.timeshighereducation.co.uk/news/ref-2014-results-table-of-excellence/2017590.article

Key achievements for our research areas include:

  • Tourism (UOA 26) was rated as joint-first in the UK (out of 51 institutions) based on its internationally-recognised research
  • Art and design (UOA 34) is in the top quartile in the UK for its world-leading research, and is ranked first in the south west (out of 7 institutions)
  • Communication, Cultural and Media Studies (UOA 36) is in the top third of institutions in the UK (17th out of 67) for its world-leading research, and 7th in the UK for its world-leading impact
  • Psychology’s (UOA 4) outputs scored particularly well with 73% rated as internationally excellent or world-leading, placing BU 27th out of 82 institutions in the UK
  • Research impact was rated highly in General Engineering (UOA 15) which scored 73% internationally excellent, placing it fourth out of 29 post-1992 institutions.
  • BU submitted considerably more staff to Allied Health Professional, Dentistry, Nursing and Pharmacy (UOA 3) than in the last assessment exercise (9.2fte in 2008 and 21.4fte in 2014) and achieved a significant uplift in the proportion of its research that was rated internationally excellent and world-leading (40% to 54%).
  • Geography, Environmental Studies and Archaeology (UOA 17) is in the top quartile in the UK (joint-17th out of 74 institutions) based on the proportion of research rated of international standing, making it also 1st out of 20 post-1992 universities
  • Business and Management Studies (UOA 19) scored particularly well in terms of impact, resulting in it ranking 9th in the UK (out of 101 institutions) for its world-leading impact

HEFCE, on behalf of the four funding councils, publish the results of the REF today. You can browse the results here: www.ref.ac.uk.

Congratulations to all – this is a milestone achievement 🙂

HEFCE are looking for views on a potential international REF in future…

HEFCE has published a survey inviting views on an internationalised system of research assessment.

This survey forms part of a project exploring the benefits and challenges of expanding the UK’s research assessment system, the Research Excellence Framework (REF), on an international basis. At the broadest level, this means an extension of the assessment to incorporate submissions from universities overseas.

This follows an invitation earlier this year from the then Minister of State for Universities and Science, David Willetts, for HEFCE to provide an opinion on the feasibility of an international REF. The project belongs in a wider context of international interest in the exercise, on which HEFCE frequently provides information and advice to higher education policymakers and university senior management from overseas.

The THE ran a story about this in April 2014: HEFCE looks at overseas links for research excellence 

Responses are invited from any organisation or individual with an interest in higher education research or its assessment. The survey will be open until Wednesday 12 November 2014.

The survey only has four questions –

1. What do you think the key benefits would be of expanding the REF internationally?

2. What do you think the key challenges would be in expanding the REF internationally?

3. In view of the potential benefits and challenges overall, how supportive would you be of further work to explore the issues in more depth?

4. Have you got any further comments relating to internationalisation of REF?

To complete the survey visit: https://www.surveymonkey.com/r/refinternationalisation

REF 2020 update

In approximately 7 weeks we will know the outcome of the REF 2014 exercise. It is hard to believe that it is almost a year since we submitted to the exercise and that the results are round the corner. Whilst the expert panels have been assessing the submissions this past year, HEFCE have been working hard to design and shape the post-2014 REF, currently being referred to as REF 2020. They are currently midway through a review of the role of metrics in research assessment to ascertain the extent to which metrics could be used in the assessment and management of research. They have commissioned RAND Europe to undertake an assessment of the impact element of REF 2014, part of which will include recommendations to the assessment of impact in future REF exercises. They are currently consulting on whether an international REF exercise, rather than a national one, is the way forward. And, arguably the most important announcement to date, they have confirmed their open access policy for the next REF which stipulates that in order to be eligible for submission to the next REF from April 2016 all journal papers and conference proceedings have to be made freely available in an institutional and/or subject repository at the time of acceptance. Outputs not made freely available in a repository at the time of acceptance after April 2016 will be exempt from inclusion.

The Research Blog’s REF pages have recently been updated and you can read more of what we know about REF 2020 here: http://blogs.bournemouth.ac.uk/research/ref/

As soon as we know more we will post it on the Blog. Until then we wait with anticipation for the REF 2014 results!

Impact, outcome and research methods – HSC PhD student on LSE Impact Blog

With working at a university and the rise of the REF, you would have almost certainly come across the terms ‘impact’ and ‘outcomes’. Whilst there might be a great deal of similarity and overlap in the use of these terms, it is important to discuss the sometime subtle differences between ‘impact’ and ‘outcome’. What consequences might this have for the design of social research?

The health and social care literature uses these terms in a rather haphazard manner. The differences are rarely discussed and it can be suggested that many use the wrong terminology. In this blog post on the LSE Impact of Social Sciences Blog, relating to the field of information and advice on welfare issues, I briefly discuss and propose that there are fundamental differences between what an impact refers to and what an outcome refers to. Furthermore, I suggest that these differences are significant and profound enough to align each to opposing research methodologies.

These thoughts relate to the key areas of my PhD project with Elderly Accommodation Counsel (EAC) in London. EAC coordinates the FirstStop service which provides information and advice to older people (and other stakeholders) on housing and care issues. My research is focused on how older people use information and advice on housing and the wider impact that this has.

If anyone has an interest in this area, do get in touch!

 

Money available for you to publish your articles Open Access! – International Open Access Week

Back in April 2011 we launched the BU Open Access Publication Fund. This is a dedicated central budget that has been launched in response to, and in support of, developments in research communication and publication trends. The fund is also to support research in complying with some of the major funding bodies who have introduced open access publishing requirements as a condition of their grants.

The fund is available for use by any BU author ready to submit a completed article for publication who wishes to make their output freely and openly accessible.

If you are interested in applying to the fund then you need to email Pengpeng Hatch in RKEO with the following information:

  • Name of the open access publication
  • Confirmation this will be a peer reviewed paper
  • A short justification (1 paragraph) of why it is beneficial for your research article to be published open access
  • The cost of the open access publication
  • Likely publication date
  • Likely REF Unit of Assessment (UOA)
  • A copy of the paper

If you have any questions about the Fund then please direct them to Pengpeng via email.

Further information: BU Open Access Fund policy

HEFCE are looking for views on a potential international REF in future…

HEFCE has published a survey inviting views on an internationalised system of research assessment.

This survey forms part of a project exploring the benefits and challenges of expanding the UK’s research assessment system, the Research Excellence Framework (REF), on an international basis. At the broadest level, this means an extension of the assessment to incorporate submissions from universities overseas.

This follows an invitation earlier this year from the then Minister of State for Universities and Science, David Willetts, for HEFCE to provide an opinion on the feasibility of an international REF. The project belongs in a wider context of international interest in the exercise, on which HEFCE frequently provides information and advice to higher education policymakers and university senior management from overseas.

The THE ran a story about this in April 2014: HEFCE looks at overseas links for research excellence 

Responses are invited from any organisation or individual with an interest in higher education research or its assessment. The survey will be open until Wednesday 12 November 2014.

The survey only has four questions –

1. What do you think the key benefits would be of expanding the REF internationally?

2. What do you think the key challenges would be in expanding the REF internationally?

3. In view of the potential benefits and challenges overall, how supportive would you be of further work to explore the issues in more depth?

4. Have you got any further comments relating to internationalisation of REF?

To complete the survey visit: https://www.surveymonkey.com/r/refinternationalisation

Have you been involved with an event designed for the external community?

Then we want to hear from you! 🙂

The University is currently compiling the data for the annual Higher Education – Business & Community Interaction survey (HE-BCI) due to be submitted to HESA in early December.

We are asked to submit details of social, cultural and community events designed for the external community (to include both free and chargeable events) which took place between 1 August 2013 and 31 July 2014.

Event types that should be returned include, but are not limited to:

  • public lectures
  • performance arts (dance, drama, music, etc)
  • exhibitions
  • museum education
  • events for schools and community groups
  • business breakfasts

We cannot return events such as open days, Student Union activity, commercial conferences, etc.

All events that we ran as part of the Festival of Learning, ESRC Festival of Social Science and Cafe Scientifique series are likely to be eligible for inclusion and we will collate this information on your behalf centrally.

If you have been involved with any other event which could be returned, please could you let your contact (see below) know the event name and date, whether it was free or chargeable, the estimated number of attendees, and an estimate of how much academic time was spent preparing for (but not delivering) the event:

  • SciTech – Norman Stock
  • BS – Corrina Lailla Osborne
  • HSC – Andy Scott
  • MS – Mark Borcklehurst
  • ST – Rob Hydon
  • Professional Service – please contact Julie Northam in RKEO

The data returned is used by HEFCE to allocate the HEIF funding so it is important that we return as accurate a picture as possible.

Open Access Salons! – Phil Ward

In June Research Professional reported that Prof Adam Tickell, successor to Dame Janet Finch, will be holding a series of salons to discuss Open Access.

Open Access salons! What a great idea.

A hairdressing salon. A row of women sit under hard hat dryers along the back wall, flicking through out of date copies of Grazia magazine. At the front a stylist fusses around a client in front of a large mirror.The bell on the door tinkles as a woman enters. Everyone turns to look at her.

STYLIST: Can I help you, love?
WOMAN (nervously): Yes, I was wanting a quick trim..?
STYLIST: Open Access, is it?
WOMAN: Pardon?
STYLIST: Do you want your haircut to be Open Access?
WOMAN: I don’t really understand…
STYLIST: Do you want your hair to be freely viewed by members of the public? Or do you want to wear this over your head?

She holds up a paper bag.

You’ll only be allowed to take it off if people pay to view it, or have bought a general subscription to my salon. Could get quite complicated.
WOMAN: But that’s crazy!
STYLIST: I’m just allowing others to benefit from this salon whilst protecting my business. It’s a tough world out there. It’s not as easy to make money out of hairdressing these days, you know.
WOMAN (patting her hair, and looking at the women at the back): Well, I guess I don’t really have a choice, do I? If I want others to see my hair.
STYLIST: You’ve made the right choice, love. Right then: if you want it to be Open Access, you’ll have to pay me a Hair Processing Charge, in addition to any other money I might get from you.
WOMAN: How much is that?
STYLIST: It varies. Averages about a thousand pounds.
WOMAN: A thousand pounds! But that’s outrageous!
STYLIST: It’s actually very good value. There’s a huge amount of unseen work involved in haircutting. Of course, we do offer a discount for pre-payment. If you buy 10 haircuts up front, we’ll give you a 20% reduction.
WOMAN: But still that’s £800!
STYLIST: Take it or leave it. You could go for the green option, of course.
WOMAN: What’s that?
STYLIST: You submit your hair to your local wig shop. However, it can’t be the final version. It might include bits I’ve missed, and won’t include any final changes we might make.
WOMAN: So my option is to have an incomplete haircut and put it on display in a wig shop, or pay a grand so that other people can look at it?
STYLIST: Essentially yes. Alternatively you could opt not to go Open Access. But then you will have to wear the paper bag.
WOMAN: But…but…
STYLIST: Look, love, it’s for your benefit! We need to protect your reputation and uphold the esteem and profile of this salon. And think what Open Access hair will do for you: More people will see your hairstyle, and will mention it to others. And people from the poor parts of town will be able to freely look at your hair.
WOMAN: And…and what if the people who see my hair decide they don’t like it? What if they disagree with my choices?
STYLIST: Well, if they make a good case we might have to retract it.
WOMAN: Retract it?
STYLIST: Yes. We might say we no longer agree with the hair and the underlying decisions which informed it. We might even decide to glue back any hair we’ve removed to restore the cut to its previous state. And I’ll put an apology note in the window.
WOMAN: This is ridiculous! I’ve changed my mind. I don’t want a trim any more.

She storms out of the salon.

STYLIST: I don’t know. No pleasing some people. (She returns to the client in the chair). So what style do you want, my love? A David Sweeney, you say? Right you are.

Written by Phil Ward, Deputy Director, Research Services, University of Kent.

Congratulations to Dawn Morley

Congratulations to Dawn Morley, senior lecturer in HSC, who is taking on leadership of the Post Graduate Certificate in Education Practice with immediate effect from Linda Byles, as she is leaving BU shortly. Many of you will know that Dawn is currently CEL theme leader for innovation, entrepreneurship and creativity and is looking forward to this new role, which will be for semester one at this point. I’m sure you will all look forward to working with Dawn in this new capacity.

Thanks.

Gail

Professor B. Gail Thomas

Dean of Health and Social Care & Director of the Centre for Excellence in Learning

Bournemouth University