Category / Research assessment

Emerald Literati Network 2012 Awards for Excellence

Professor Jonathan Parker

Professor Jonathan Parker, Deputy Dean for Research in the School of Health and Social Care has been chosen as an Outstanding Reviewer at the Emerald Literati Network Awards for Excellence 2012. Each year Emerald names and rewards the Outstanding Reviewers who contribute to the success of the journals.  Each journal’s Editor has nominated the Reviewer they believe has been that title’s most Outstanding Reviewer.

The most Outstanding Reviewers are chosen following consultation amongst the journal’s Editors, whom are eminent academics or managers. Professor Parker was selected for the very impressive and significant contribution he made as a Reviewer to The Journal of Adult Protection throughout 2011.

BU REF Code of Practice available now!

As I mentioned in my previous post about the forthcoming outputs mock REF exercise, we have recently submitted our final draft REF Code of Practice document to the REF Team for their approval. We produced this document to help inform staff about the policies and processes around submitting to the REF in November 2013, as well as to meet the four UK higher education funding bodies’ request that each institution making a submission to the REF must develop and apply such a code when selecting staff to include in their submission.

The BU REF Code of Practice is the culmination of months of drafting and approval, and sets out the approach that will be, and has already been, taken by BU in preparing its REF2014 submission. It therefore includes important information about the schedule of mock REF exercises that you are able to take part in (Chapter 3), and about declaring any circumstances that may have affected your ability to produce the four outputs required (Chapter 5), along with other equality and diversity aspects. Staff eligibility and selection are also covered.

Throughout the document there are references to the relevant paragraphs within the key publications published by the REF Team, which are: Assessment Framework and Guidance on Submissions and Panel Criteria and Working Methods.

Because this document is still subject to the approval of the REF Team’s Equality and Diversity Advisory Panel (EDAP), the Code is currently available to BU staff via the new Staff Intranet under ‘Policies, Forms and Procedures/Research’. We will make it fully available here on the Blog once we’ve received the EDAP feedback, so watch this space!

Limber up for the next BU mock REF exercise

Just as the Olympic athletes are getting set for the 2012 games, so are we gearing up to launch the summer 2012 mock REF exercise for BU academic staff, this time looking at research outputs. This follows on from our previous light-touch review exercise, which was open to all academic staff and took place over the winter of 2010/2011.

This latest exercise will be the fourth in a series of different preparation exercises that have been held or are due to take place at BU ahead of the REF2014 submission deadline on 29 November 2013. Just as the athletes will have taken part in warm-up events and qualifiers to test their fitness and shine before selectors, so the mock REF exercises are a useful ‘dry run’ to give you a feel for what’s going to be required for the real thing. Equally, you’ll get valuable feedback on your outputs from external reviewers and your UOA Leader, and it will enable us to test out our data collection processes.

As in the light touch review, the outputs mock will be open to all academic staff. The relevant form will be distributed via your UOA leader in due course so it would be a good time to start thinking about which outputs you’re likely to put forward. Although REF2014 requires a maximum of four outputs, we’re giving you the opportunity to get feedback from the reviewers on up to six outputs, so make the most of this chance to really shape your outputs submission.

Also under starter’s orders – the BU REF Code of Practice will shortly be circulated to all staff, which outlines the timetable of REF preparation exercises and includes a host of other useful information related to how BU is preparing for REF2014. The final draft of this document has just been submitted to the REF Team for formal approval so watch this space for more information about this.

If you need any more information about the REF, have a look at all the previous blog posts that we’ve included here, or visit the new-look REF website. Alternatively, you can contact myself or Julie Northam in the Research Development Unit, or leave a comment below.

REF Panel Criteria summaries by UOA

The final REF Panel Criteria and Working Methods documentation was released by the REF Team (based at HEFCE) at the end of January.

As a handy guide to the information the RDU has summarised the headline information for the UOA in the documents listed below:

Allied Health Professions, Dentistry, Nursing and Pharmacy – UOA 3 panel criteria summary

Psychology, Psychiatry and Neuroscience – UOA 4 panel criteria summary

Earth Systems and Environmental Sciences – UOA 7 panel criteria summary

Computer Science and Informatics – UOA 11 panel criteria summary

General Engineering – UOA 15 panel criteria summary

Geography, Environmental Studies and Archaeology – UOA 17 panel criteria summary

Business and Management Studies – UOA 19 panel criteria summary

Law – UOA 20 panel criteria summary

Social Work and Social Policy – UOA 22 panel criteria summary

Sports and Exerise Sciences, Leisure and Tourism – UOA 26 panel criteria summary

Art and Design – UOA 34 panel criteria summary

Communication, Cultural and Media Studies – UOA 36 panel criteria summary

Happy reading! If you have any questions about the REF then please do let me know.

The second brilliant external REF event at BU!

On Wednesday this week BU hosted a REF Team-supported event for universities in the south of England explaining the content of the recently released REF Panel Working Methods and Criteria documentation. This was the second REF event that has been hosted at BU in the past 12 months. The first event was held in May 2011 and you can read about it here: http://blogs.bournemouth.ac.uk/research/2011/05/25/the-excellent-hefce-ref-event-at-bu/

The event, attended by over 150 delegates from 32 institutions, outlined the similarities between how the four Main Panels will review submissions, as well as focusing on the differences between the panels particularly in how they will define and assess impact in the context of the REF.

Chris Taylor, Deputy REF Manager, spoke about the technical aspects of the REF, e.g. the timetable, element weightings, and institutional REF codes of practice, and then looked at each of the three elements of the REF in depth – impact, outputs and environment.

Prof Stephen Holgate, Chair of Main Panel A, then delivered a very interesting presentation on the similarities between the four Main Panels which have been vastly improved since the sector-wide consultation on the Panel Working Methods documentation last autumn. The Panels have put in a significant amount of work to ensuring their working methods will be as simple, transparent and similar as possible which is excellent news.

After break there were four concurrent sessions, each focusing on one of the Main Panels. Event attendees could choose to attend one session. The session were led by:

  • Main Panel A – Prof Stephen Holgate (Chair of Main Panel A)
  • Main Panel B – Prof Philip Nelson (Chair of the General Engineering sub-panel)
  • Main Panel C – Prof John Scott (Chair of the Sociology sub-panel)
  • Main Panel D – Prof Bruce Brown (Chair of Main Panel D)

After the concurrent sessions, all presenters took part in a Q&A session back in Kimmeridge House.

One of the key messages of the day was that the sub-panels will not make use of journal impact factors, journal ranking lists, or other journal scoring information to inform the review of outputs. Citation data will be provided by the REF Team to sub-panels:

  • Main Panel A: Sub-panels 1-6
  • Main Panel B: Sub-panels 7-11
  • Main Panel C: Sub-panel 18

Research collaboration (e.g. links with other institutions, business and industry, international collaboration, etc) was also highlighted at numerous points throughout the event as being of particular importance in the environment element of the assessment.

Regarding impact, Prof Holgate stressed that the assessment of impact was not necessarily linked to the size of the population affected but to the reach and significance of the impact – for example, a 4* impact case study could be for a drug that cured three people or 3 billion people.

Also interesting was the focus on 4* research being that which is transformative research and that this could be the synthesis of knowledge and the identification of a new way of doing things. A review paper could therefore be assessed as 4* if it meets this definition. Prof Holgate remarked: “we are in an era of transformation. We want game changing outputs to be submitted to the REF”.

The event was closed by Prof Matthew Bennett at 1pm after which point event attendees networked over lunch. Feedback from attendees so far has been very positive!

If you attended the session then we’d love to know what you thought! Let us know by adding a comment to this post.

The slides will be available shortly via the Blog.

REF draft code of practice – BU academic staff comments invited

Over the past 18-24 months we have been working on a code of practice to set out the approach that is being taken at BU in preparing our REF submission. The document has largely been authored by Anita Somner, Judith Wilson, Dr James Palfreman-Kay and myself with input from Prof Kate Galvin, and has been approved by the REF Academic Steering Group and REF Academic Leadership Team. It is a requirement for all institutions submitting to the REF to have a code of practice in place which has been approved by the REF Equality and Diversity Advisory Panel (EDAP), and the initial deadline for submitting draft codes to the EDAP is midday on 27 April 2012.

We are now inviting all academic staff to comment on this version of the BU REF code of practice. Comments received will help to refine the document in advance of the final version being sent by the VC to the EDAP at the end of April. A feedback form is available for completion by academic staff wishing to comment on the draft document.

The draft code of practice and the feedback form are available from the I-drive: I:\CRKT\Public\RDU\REF\COP feedback

Responses should be emailed to Anita Somner by 5pm on Friday 16 March 2012.

I am happy to discuss the document with colleagues and/or to meet as appropriate. If you have any queries, please do let me know.

Thanks

Julie

Involving undergraduates in research: the Psychology Research Apprenticeship Scheme

Following on from Sally Gates’ recent blog about involving undergraduates in research, we thought it would be good to share with the blog readership our experience of the Research Apprenticeship Scheme that we have been running in the Psychology Research Centre for the past three years.

Undergraduate students in their second year are offered the chance to work alongside staff and help them with their research.  These positions enable 2nd year students to work directly alongside staff and help them with their research.  Students get the chance to work together with researchers, gathering and analysing data, and working out what experimental findings might mean.  The students often get a chance to work with specialist equipment that they might not have been able to otherwise and gain in-depth knowledge of what research really involves. And of course it looks great on their CVs. This experience engenders the research bug in the students – two were intrigued enough to apply for and win funding from the Nuffield Foundation for summer work in the Psychology Research Centre – and those students and others from the scheme are busy applying for PhD positions this year.   The scheme also provides the students with invaluable experience for their own research project in their final year of study.

Of course, the scheme also helps staff.  We really appreciate the help and support the ‘apprentices’ provide.  The scheme has really grown and this year we were able to offer 25 research apprenticeship positions to 2nd year students.  We hope the scheme will go from strength to strength and that in future years we may be able to offer one or two paid summer placements to our best undergraduate apprentice researchers.

Southern Universities REF event at BU – 22 February 2012 – book your place NOW!

REF logo
BU is hosting a 1/2 day REF event on Wednesday 22 February 2012. All staff are invited to attend.
 
The final panel working methods and criteria documents are due to be published in January 2012. This event will provide an update on the current developments with the REF and the confirmed REF panel documentation, focusing specifically on the assessment of impact within each of the four Main Panels.
 
Each of the REF Main Panels will be represented. If you have any questions about the REF, how research will be assessed and graded, or how impact will be assessed then you should attend this event! 😀
 
The event is open to BU staff and external delegates. There are already 130 delegates registered to attend, representing 32 different universities.

The event is free to attend but booking is essential.

For further information (including the programme) and to register, visit HERE.

Latest developments with the REF now available from the REF Highlight Report #11

REF logoThe latest REF Highlight Report is now available from the Research Blog.

Key points include updates on:

  • progress towards the Winter 2011 REF preparation exercise
  • funding identified for case study development
  • update of the draft BU REF code of practice
  • latest documents released from the REF team at HEFCE (including an updated external timetable and a set of FAQs)

You can access the full document from the I-drive in the following folder: CRKT\Public\RDU\REF\REF preparations\REF highlight reports\#11

REF Highlight Report #10

REF logoThe latest REF Highlight Report is now available from the Research Blog.

Key points include updates on:

  • progress towards the Winter 2011 REF preparation exercise
  • publication of the final REF guidance on submissions in July 2011
  • the consultation on the panel working methods and criteria
  • the appointment of Sally Gates as the REF Communications Manager
  • the RASG and RALT meetings held between May and October

You can access the full document from the I-drive via this link: REF Highlight Report #10

If you are accessing the report from off-campus then you will need to locate the following folder on the I-drive: CRKT\Public\RDU\REF\REF preparations\REF highlight reports\#10

Southern Universities REF event at BU – 22 February 2012 – book your place NOW!

BU will be hosting a half day Research Excellence Framework (REF) event, supported by the REF team, on 22 February 2012 to which all staff are invited to attend.

Book your place now by completing the online registration form 

This event follows hot on the heels of the first REF event held at BU on 19 May 2011, to which over 150 delegates from 39 institutions attended (see our previous blog post – The excellent REF event at BU!).

The sector-wide consultation on the proposed REF panel criteria closed earlier this month and the final documents are due to be published in January 2012. This event will provide an update on the current developments with the REF and the confirmed REF panel documentation, focusing specifically on the assessment of impact within each of the four Main Panels.

The event will be open to BU staff and external delegates and the provisional programme is shown below.

Time Activity
09:30 – 10:00 Coffee and registration
10:00 – 10:30  REF Team overview of the assessment framework
Chris Taylor, Deputy REF Project Manager, REF Team
10:30 – 11:00 Similarities between the four Main Panel working methods and criteria
Professor Stephen Holgate, Chair of Main Panel A
11:00 – 11:30 Morning break
11:30 – 12:15 Panel specifics, differences and impact assessment
There will be concurrent sessions, one for each of the four Main Panels. Attendees choose which one to attend.

  • Main Panel A:   Professor Stephen Holgate, Chair of Main Panel A
  • Main Panel B:   Professor Philip Nelson, Chair of sub-panel 15 (General Engineering)
  • Main Panel C:   Professor John Scott, Chair of sub-panel 23 (Sociology)
  • Main Panel D:   Professor Bruce Brown, Chair of Main Panel D
12:15 – 13:00 Panel Q&A session with all participants
13:00 – 14:00 Lunch, networking and close

The event is free to attend but booking is essential.

Book your place now by completing the online registration form 

REF week on the Blog! REF Frequently Asked Questions

This week is REF Week on the Blog! Each day we will be explaining a different element of the Research Excellence Framework (REF) as a quick reference guide to help you prepare for the forthcoming REF exercise – REF2014.

Today’s post covers the frequently asked questions Matthew, Anita and I are asked about the REF.

If you have a question which isn’t covered in this list, add it as a comment or email it to me and I will add it to the FAQs!

open access logo, Public Library of ScienceI need an extra publication and all the normal journals I submit to have very long waiting lists. What can I do? – You could consider open access publishing as a route to getting your work published and in the public domain. Open access publishing typically has much shorted publication times, often only 2-3 months between submission and publication. Open access journals are eligible output types for the REF and are usually peer-reviewed to the same level of quality and scrutiny as traditional subscription journals. Open access publishing also has the addition benefit of sharing your research with the whole world, rather than only those who have access via paid subscriptions. This increases the visability and potentially the impact of your research. BU has a dedicated central budget to support open access publishing – read more here – Launch of the BU Open Access Publication Fund.

How can I increase the visibility of my published work and maybe increase the number of citations? – As above, one of the best ways of increasing the visibility of your work is to make it freely available, either by publishing in open access outlets or adding a full-text copy of your publication to our institutional repository, BURO. You can use the Sherpa RoMEO database to check whether your publisher supports open access archiving in repositories – the majority of them do! Don’t worry too much about the copyright as this will be checked for your by the BURO team prior to your output being added to the live repository. You can also blog about your research findings and outputs on this Research Blog! The blog is visable externally and well optimised to be picked up by search engines, such as Google. We always want to hear about the excellent research you’re doing, and anyone at BU can have access to add their own posts. Just email Susan Dowdle and she’ll get you blogging in no time 🙂

I need to win some research grant funding to strengthen our REF submission. How can I increase my chances? – My main advice here would be to choose your potential funder wisely; research proposals take considerable time and effort to put together and there is little point spending your time writing a proposal which a funder is unlikely to fund, e.g. if your research idea doesn’t fit the funder’s strategic aims. Make use of our internal peer review scheme, the RPRS, to ensure your research proposal is submitted to the most appropriate funder and to strengthen and add value to your proposal prior to submission. We can also advise you of which funders have shorter turnaround times so you can get started quickly and bring in some funding during the REF period.

I am unlikely to have four outputs to submit to the REF. Can I still be entered? – Possibly. The REF team acknowledge there are a number of reasons as to why a researcher may not be able to produce four outputs during the REF period. Clearly defined circumstances include qualifying as an early career researcher, part-time working, maternity, paternity or adoption leave, and secondments or career breaks outside of the HE sector. The REF team also recognise that there are a number complex circumstances which may result in a researcher not being able to produce four outputs – these include disability, ill-health or injury, mental health conditions, constraints relating to pregnancy o maternity, childcare or other caring responsibilities, gender reassignment, etc. Further details on how BU will be dealing with circumstances such as these will be released in the BU REF Code of Practice. In the meantime if you would like to discuss your personal circumstances with someone, you should contact your REF UOA Leader, Anita Somner or myself, or Judith Wilson in HR. All queries will be dealt with on a confidential basis.

I work at the University on a part-time basis. Can I still be submitted to the REF? – As above, the REF recognises part-time working as a clearly defined circumstance which can result in a researcher being unable to produce four outputs during the REF assessment period. It is likely this will be dealt with on a pro-rata basis, e.g. a researcher who has been on a 0.5 FTE contract throughout the REF period is likely to be required to submit 2 outputs. Further details will be included in the BU REF Code of Practice.

I’m not sure which of my outputs to submit to the REF. Will there be an opportunity for them to be reviewed externally before the submission? – Yes! We will be holding at least two more mock exercises reviewing outputs, one in spring 2012 and the other in spring 2013. Further details will be communicated via the blog in due course.

Remember – if you have a question which isn’t covered in this list, please add it as a comment or email it to me and I will add it to the FAQs!

Check out the posts appearing on the Blog every day this week as part of REF Week!

REF week on the Blog! Mock exercises prior to submission

This week is REF Week on the Blog! Each day we will be explaining a different element of the Research Excellence Framework (REF) as a quick reference guide to help you prepare for the forthcoming REF exercise – REF2014.

BU will undertake a series of mock exercises as part of the internal preparations for the REF

The Light-Touch Review – BU’s first REF preparation exercise was the Light-Touch Review which took place during autumn/winter 2010-11. All academic staff were invited to submit up to four outputs (published since 1 January 2008) and an impact summary to a panel of external expert reviewers. In addition, REF UOA Leaders provided the external reviewers with a summary of the unit of assessment (UOA) as a whole.

This first exercise was considered to be a ‘light touch’ review as the external reviewers were not asked to look in detail at each output but to provide general comments about an individual’s research profile and an overview assessment of the UOA as a whole.

Mini-mock for two UOAs – in spring/summer 2011 BU undertook an external review exercise for two UOAs to help further define and shape the submissions, especially around the notion of disciplinary fit.

Winter mock 2011 – the preparation for the winter mock exercise is currently taking place. This will not be a mock exercise of outputs but of narratives. The UOA Leaders are currently drafting impact case studies, impact statements and environment statements which will be submitted to a panel of external expert reviewers in early December.

Future mock exercises – we are planning to hold a second outputs mock (open to all eligible staff) in spring/summer 2012, and a final mock exercise in spring/summer 2013 focusing on all assessment elements (outputs, impact and environment).

Details of all upcoming mock exercises will be made available via the Blog in due course.

You can access the latest presentation about the REF, written by the REF team, here: REF slide pack Sep 2011

Check out the posts appearing on the Blog every day this week as part of REF Week!

REF week on the blog! A Ramble about REF

It’s REF week on the Research Blog and I also have to give a talk to the BU Board on Thursday about progress with our REF preparations, but I am sitting here wondering what to write?  Does this often happen to you?  I often put these things off and turn my hand to something else, like the paper I am currently struggling to complete, or keeping up with my email correspondence rather than tackle the task in hand.  But you see, here am I avoiding starting on the piece again, so I had better get started before it gets any later.

For the Board presentation I am taking a historical view of REF and its ancestors.  It started out in 1985 as the Research Selectivity Exercise, before progressing in its third iteration to the Research Assessment Exercise (RAE) in 1992 which was the first time research funds (QR – Quality Research Income) was distributed as a consequence of the outcome.  In some ways it was only in 1997 that universities had really got their act together and begun to take the RAE seriously, and by 2001 it was a major focus of energy in higher education and was beginning to result in a progressive concentration of research funding in a few key institutions.  BU’s greatest success to date was in 2008 when we were the fourth most improved university in the country, and for the first time BU started to receive significant QR income as a result. 

Apart from dominating the lives of many researchers, you may well ask what it has done for UK research.  Well, the answer is actually a huge ton!  In the 1970s, research in UK universities was funded via a government block grant and the UK was a middle-ranking research power, complacent, inefficient and underperforming.  According to the recent BIS survey with the catchy title International Comparative Performance of the UK Research Base – 2011 the UK is now a leading research nation in the world, second only to the US.  The much quoted headlines run something like: 1% of the world’s population, 3% of R&D spend, 4% of researchers, but 6% of articles, 10% of citations, 14% of the most cited articles.  According to HEFCE, for every pound spent on research in the UK you get between four and seven pounds back.  When seen in this context, the RAE has done its job extremely well by introducing competition into the sector.  There are parallels here with the current move to introduce competition around student numbers.

Since RAE2008, goal posts have changed again as the name has changed to the Research Excellence Framework (REF) with the introduction of ‘Impact’ as an element of the assessment.  In 2014, it will contribute 20% of the overall profile that a Unit of Assessment (UOA) will receive.  At its simplest, impact is about justifying research spending from the public purse by demonstrating the societal benefit – economic, environmental, social, or cultural – from research.  It is a great concept and speaks to the heart of societal relevance which we are placing at the centre of BU’s future research strategy.  It will be assessed as part of REF via a series of case studies and each case study has to be based on a piece or body of research undertaken in the last 15 years, with an evidenced impact since 2008.  The basic idea is that impact often takes time to come to fruition, but for a youthful institution like our own this is challenging since the research belongs to the university where it was done, not to the researcher. In the last 5 years there has been a steady influx of talented researchers to BU, but in many cases their impact belongs to another university!  

The need to evidence societal benefit is also important – it’s not enough just to have changed government policy for example; one needs to demonstrate the benefit of that change to ordinary people.  The example we often use is that of seatbelts.  Professor X does some research into seat belts and convinces government to legislate with respect to their introduction.  This only counts, however, as interim impact – to complete the case study, one would have to demonstrate how that legislation has reduced road traffic accidents.  So evidencing one’s claim is critical.  I have used this example on several occasions but was somewhat challenged when an individual in the audience pointed out that this could also be construed in a negative way since seatbelts have reduced the number of organ donors!  You will no doubt be able to guess at this point that I was talking to staff in HSC at the time. 

The point is that it is all about the narrative you build from a piece of research and how you evidence that claim.  There are some challenges for us around the issue of impact, but it also offers great opportunity.  So I think it is time for me to finish here and go back to working on my Board presentation.

REF week on the Blog! BU REF preparation and governance

This week is REF Week on the Blog! Each day we will be explaining a different element of the Research Excellence Framework (REF) as a quick reference guide to help you prepare for the forthcoming REF exercise – REF2014.

Internal preparations for the BU submission to the REF have already started and you can keep up to date by reading the BU REF Highlight Reports. These are published regularly and detail all of the recent developments (internal and external) with the REF (see the link to the I-drive at the end of the post).

Two internal groups have been established to oversee preparations for the REF:

RASG – The REF Academic Steering Group (RASG) has been established as the primary decision-making body for the BU REF preparations. It first met on 14 June 2010 and normally meets on a monthly basis. The RASG Terms of Reference (including a list of members) can be accessed via the I-drive.

RALT – The REF Academic Leadership Team (RALT). RALT met for the first time on 27 September 2010 and will meet when required (currently this is on a monthly basis). Members of RALT include all of the RASG members plus the REF UOA Leaders. The list of REF UOA Leaders and the RALT Terms of Reference can be access on the I-drive.

BU is currently working on a REF Code of Practice and some FAQs around REF preparation, staff eligibility, staff selection, etc., which will be available from the BU Research Blog in due course.

The Research Development Unit (RDU) are managing and administering the internal REF process. If you have any questions then please do ask Anita Somner or Julie Northam.

You can access all of this information regarding the BU preparations for the REF via the I-drive: I:\CRKT\Public\RDU\REF

You can access the latest presentation about the REF, written by the REF team, here: REF slide pack Sep 2011

Check out the posts appearing on the Blog every day next week as part of REF Week!