Tagged / teaching excellence

Policy Update w/e 1 June 2018

Research Collaboration

Research/Horizon Europe

The Guardian draws on a leaked document to report that the UK will only have limited access to Horizon Europe through a costly ‘third countries’ deal, despite the PM’s intentions for full participation.

Theresa May’s appeal for a special Brexit deal on science and research collaboration, worth billions to the British economy, is being stonewalled by Brussels as it prepares to offer an arrangement less privileged and more expensive than that given to non-EU states such as Israel… the UK is set to join Canada and South Korea in the category of countries that will have to pay a higher price for the privilege of collaborating, while being barred from a particular raft of programmes designed to encourage innovation.

According to the draft paper, so-called “third countries” will not have a seat on the new European Innovation Council, which sets priorities, and their companies will not have the opportunity to apply for “fast, flexible grants and co-investments” designed to “bridge the ‘valley of death’ between research, commercialisation and the scaling-up of companies”.

The Guardian reports that Thomas Jørgensen, the senior policy coordinator at the European University Association (EUA) working on Brexit-related issues, stated: the commission was acting to protect its interests in the face of the emergence of the UK as a rival economic power. He said: “It is entirely understandable that you would want to help small countries in your neighbourhood, but why would you do that for small and medium-size enterprises in South Korea or other third countries such as the UK?”

The Guardian also report that on Wednesday the EU confirmed the UK could take part in Erasmus (for a fee) but would not allow the UK to influence programme’s design. More detail is provided in the Times Higher: In its proposal for the Erasmus+ programme for the period 2021-27, published on 30 May, the European Commission said that countries outside the EU and the European Economic Area would be able to participate fully as long as they do not have a “decisional power” on the programme and agree to a “fair balance” of contributions and benefits.

Research Professional also cover the EU’s decision to open Erasmus to other countries, and the requested significant boost to the Horizon budget (€20 billion).

Earlier this week Sam Gyimah discussed how international collaboration strengthens research excellence: The UK values international cooperation. That is why we will remain a leading power in science and innovation, and why our Industrial Strategy has a target that 2.4% of our GDP will go to R&D funding by 2027. We are committed to ensuring that this investment leads to real results for everyone.

We are also committed to remaining a place for scientists. Our success is built in part on the contribution of researchers and innovators who come to the UK from across the world to study, to research and to do business. Over half of the UK’s researchers come from outside the UK. And, as the Prime Minister said, we will ensure that this does not change.

Although we are leaving the EU, it’s important to remember that science is an international enterprise and discoveries know no borders. We are all strengthened by our collaborative links.

On the European research access Sam stated:

Full association would mean a particular amount – of course it’s too early in our discussions to put a figure on what this would be but based on existing precedents it would be billions of euros. Anything less than full association and we would need to consider whether this was a fair ask. I am accountable to the UK Parliament and would need to demonstrate that the amount contributed actually is fair.

Latest News

The latest news on our regularly featured topics.

 

OfS

  • OfS Board Member Carl Lygo has resigned (moving to new role in Germany).
  • OfS have a new blog: The ‘value’ of a degree is academic and vocational.
  • Just in case you missed it previously OfS released information showing an increase in masters’ student numbers since the introduction of the postgraduate loans.
  • The OfS Board met on Wednesday. OfS have committed to sharing the papers from the Board meeting soon.

 

Loans

A parliamentary question from Peter Dowd on the accrual of debt interest on student loans had Sam Gyimah clarify that the Student Loans Company does not apply interest to accounts until the information about repayments is received from HMRC. This means that borrowers are not disadvantaged by the time taken to exchange the data between HMRC and SLC…The government is taking steps to develop systems to allow the sharing of student loan repayment information more frequently between HMRC and SLC from April 2019. This will allow for repayments to be credited and for interest calculations to be undertaken regularly throughout the year.

 

Freedom of Expression

Q – Baroness Deech: How they propose to include representatives of student victims of (1) inhibition of freedom of speech, and (2) disruption of meetings, in the preparation of new guidance to promote freedom of speech at universities.

A – Viscount Younger Of Leckie: At the free speech summit on 3 May 2018….it was agreed that the report from the Freedom of Speech in Universities inquiry by the Joint Committee on Human Rights (JCHR) would be used as the foundation for a shared approach to free speech. The JCHR inquiry included evidence from a number of groups including those who had experienced disruption of events and student representatives with a range of experiences related to free speech. The new guidance will be drafted by the Equality and Human Rights Commission, who will work with a number of groups including the National Union of Students.

Research Professional report on Sam Gyimah’s latest Free Speech interview with Spiked stating: He [Sam] suggested that UK academics were marking down students whose political opinions they disagreed with…In what is attributed as a direct quote from Gyimah, the minister said that “there seems to be the development of a political monoculture” in which students are afraid to speak up in class because “80 per cent of the class disagrees with you…and [one of] them is going to be the one who gives you your grades”.

Gyimah has not tried to distance himself from the quote…Jack Grove of Times Higher Education wrote…“Is Sam Gyimah really claiming…that students should be genuinely afraid that their left-leaning lecturers are marking them down because they disagree with their politics? Extraordinary.”

Gyimah replied to Grove: “Nothing extraordinary. We need real diversity of thought on campus, and to be mindful that in some cases a monoculture means students and lecturers with legitimate but maybe unpopular views self-censor for fear of opprobrium. This is what I’m hearing on campus.”

The minister’s evidence for campus inhibitions on free speech has moved some distance: from claims of systematic censorship by students’ unions and masked gangs closing down events to unsubstantiated anecdotes about reluctance to speak up in class. Very different things are being lumped together here… For a minister to accuse academics of political bias in assessing students—without a scrap of evidence—is totally irresponsible.

 

Value for Money

A short article in Times Higher this week discusses the four myths surrounding value for money. It digs below the surface to explain why the four factors can’t really be used to determine value for money. A clear and simple read. If you continue to read the comments section you’ll find some alternative viewpoints too.

 

Degree Apprenticeships

A parliamentary question tabled by Rehman Chishti established that there are 102 universities listed on the register of apprenticeship training providers and all are eligible to deliver anywhere in England.

A further question from Barry Sheerman asked: whether there are any requirements that must be satisfied in order for bachelor’s degrees pursued at an institution of higher education to be described by that institution as a degree apprenticeship.

Anne Milton responded: In England, providers who want to deliver apprenticeship training, including higher education institutions (HEIs) offering degree apprenticeships, must be on the register of apprenticeship training providers…Employers must choose a provider from the register to deliver their apprenticeship training. A degree can be included in an English apprenticeship if the degree meets the mandatory qualifications criteria laid out in the Institute for Apprenticeships (IfA) guidance. The IfA website lists the degree level apprenticeships that include a degree. The Enterprise Act 2016 protects the term ‘apprenticeship’ to make sure that training providers cannot brand their products as apprenticeships if they do not meet our core quality requirements.

 

Student Immigration

The Independent ran the editorial If Theresa May wants to improve the quality of our universities, she must begin by addressing the disastrous effects of her immigration policy.

 

Accelerated Degrees – no news yet

Lord Luce questioned the government this week asking What decisions have been made about the provision of accelerated degree courses in higher education following their public consultation completed on 11 February. The Government responded: The Department for Education received a range of detailed and comprehensive responses from providers, organisations and individuals across the higher education sector. We are currently considering these responses and will respond to the consultation in due course.

 

Widening Participation and Achievement

National Collaborative Outreach Programme

OfS have released their first annual report on the National Collaborative Outreach Programme’s (NCOP) delivery. NCOP is a collaborative network endeavour between HE, schools, colleges and local businesses. It delivers a sustained, tailored outreach programme within geographically targeted areas and aims to rapidly improve progression to HE for school pupils in areas where the numbers accessing HE are lower than expected by the young people’s GCSE success. The current NCOP commenced in January 2017 and consists of 29 partnerships to pupils in Years 9 to 13.

The report states that NCOP has actively engaged 12% (52,878 pupils) of the identified target population. This is forecast to increase to 114,700 pupils (25%) by the end of 2018. It emphasises that the first year of the programme has been focused on creating local partnership infrastructures and with these now established OfS expect to see significant increases in the numbers of young people engaged over the next year. Demonstrating impact is integral to the NCOP programme. OfS require clear evidence to continue with the programme in the future and a comprehensive evaluation framework including longitudinal tracking, analysis of national datasets, and randomised controlled trials is in place. The report concludes that progress is promising (see page 14 for details) although at present: “it is too early to evidence the causal impact of the programme in terms of which interventions have the most impact on students progressing to higher education.”

NCOP is expected to significantly contribute to the Government’s social mobility action plan (launched Dec 2017) which ‘places social mobility at the heart of education policy and seeks to provide a framework for action to help transform equality of opportunity. It emphasises the importance of leaving no community behind with resources targeted at the people and places that need it most’.

 

The social mobility goals are to:

  • double the proportion of young people from disadvantaged backgrounds in higher education by 2020
  • increase by 20 per cent the number of students in higher education from ethnic minority groups
  • address the under-representation of young men from disadvantaged backgrounds in higher education.

Chris Millward, Director for Fair Access and Participation, said:

“We know that sustained and targeted outreach is key to reducing the gaps in higher education participation…So I am very pleased to see the progress made by the OfS-funded NCOP… In its first year of operation, NCOP is already showing signs of success…It has reached significant numbers of schools, colleges and young people and looks set to increase its reach even further in the next year. And the early signs are that NCOP activities are contributing to improved information, advice and guidance for young people at key milestones in their education…NCOP is a great example of the kind of outreach activity we need – evidence-based, targeted, robustly evaluated, bringing local partners together and harnessing university resources and expertise to meet the needs of schools and teachers, students and their families. The OfS will ensure that this learning drives improvements to higher education outreach in the future.”

Gareth Oliver, Careers Lead at Broad Oak Sports College, said:

“Without the valuable support of [NCOP partner] GM Higher, both in terms of experience and one-to-one support, we would not have had the opportunity to access resources and programmes to aid the aspiration of our pupils. Already the number of pupils wanting to aspire to higher education has increased, but more importantly, the programmes and resources have allowed our pupils to have an ‘I can do it’ attitude. Schools like Broad Oak need organisations like GM Higher to ensure we break the mould that ‘higher education is only for the affluent families’.”

Next week (4-8 June) is an NCOP week of action aiming to spotlight the range of outreach activities occurring from motivational talks and role model sessions to live social media FAQs.

A timely blog by Stuart Billingham, Emeritus Professor of Lifelong Learning at York St John ponders the progress made in the 40 years Stuart has worked within the social mobility sphere. He urges patience from the Government, reviewing the initiatives they tried and dropped before they fully came to fruition, and noting that collaborative results take longer:

If quick returns are the priority, then learn the lessons of history and stop calling for greater collaboration and partnership working to widen participation. If, however, the real priority is to significantly and permanently change the social and economic student profile in our universities and colleges, then collaboration/partnership working is essential – but please don’t look always, or only, for quick wins.

 

School League Tables Outcry

The BBC ran an article on the new method by which secondary school league tables are devised stating it unfairly stigmatises schools in white working-class areas. Head teachers are opposed to the Progress 8 methodology calling it “toxic” for schools with a combination of high levels of deprivation and lower numbers of pupils speaking English as a second language. The DfE have responded: “Far from being unfair, our Progress 8 measure means that schools are now recognised for the progress made by all pupils, as every grade from every pupil contributes to the school’s performance – taking into account their ability when they started school.

 

Mental Health

A Debut study publicised on the Royal College of Midwives News site has demonstrated widespread reluctance to disclose mental health issues to potential employers amongst students in order to avoid negative impact on their career progression. 70% of the 1,000 full time employed graduates that were sampled would not inform their employer and 88% stated they believed there is still a negative stigma attached to admitting to suffering from a mental health issue.

Of the 70% who said they would avoid telling an employer about their mental health issues, 83% said they would be more inclined to seek mental health support if their employer offered an ‘off-the-record’ or fully anonymous service that would be kept separate from their employment record. Their preference for off the record support methods were: face-to-face meeting (61%), WhatsApp, or other instant online chat (19%), email (10%), via video call (7%), SMS/text-messaging (3%).

The study states that graduates don’t feel their workplaces are properly equipped to support workers with mental health issues. The graduates described their employer’s support system as: 15% – good; 51% – adequate; 34% – poor.

The study states: It appears that while mental health concerns are being discussed more openly in wider society, there is still work to be done in regards to the stigma associated with admitting to suffering from mental health issues and support offered to those transitioning from university to work.

CEO of Debut, Charlie Taylor, said that supporting new graduates as they transition from university to work should be a major consideration of progressive employers.  ‘If graduate recruitment specialists want to attract – and more importantly keep – the best talent as they emerge from education, they need to know what issues students and graduates are facing, and how best to support themGraduate programmes can be fiercely competitive, which can exacerbate mental health issues and employers need to ensure they are providing anonymous, ‘off the record’ support for this future workforce.”

 

Meanwhile in iNews Bristol’s VC has said poor mental health among students is the “single biggest public health issue” affecting universities and feels the perfectionism culture perpetuated through social media is a causal factor.

 

Disabled Students’ Allowances

The parliamentary questions pertaining to disabled students continue.

Q – Angela Rayner:

  1. what the evidential basis is for his statement that students spend on average £250 on computers.
  2. what costs Disabled Students’ Allowances are planned to cover.

 

A – Sam Gyimah:

  1. This figure comes from the most recent student income and expenditure survey …This shows that the average spend on computers by full-time students across the academic year was £253. The average spend on computers by part-time students across the academic year was £243.
  2. Disabled Students’ Allowances are available to help students with the additional costs they may face in higher education because of their disability. There are four allowances available and for 2017/18 these are: a specialist equipment allowance of up to £5,358 for the duration of the course, a non-medical helper allowance of up to £21,305 for each academic year, a general allowance of up to £1,790 for each academic year and a uncapped travel allowance for each academic year. They can be used for the purchase of specialist equipment, to pay for a non-medical helper to support students with their studies, for other assessed disability related costs and for travel.  As noted in the Oral Answer, the £200 student contribution is for computer hardware only. Students are not expected to pay for recommended specialist software or for training to use it.

Part Time Students

Welsh Universities will now be able to claim a full premium when recruiting part time students. Wales also enjoys a fee-waiver allocation for students in receipt of certain benefits when studying at less than 25%. It will be interesting to watch these developments in comparison to England’s declining part time student population.

 

HEPI

HEPI continue to share ideas and blog related to their prior report: Reaching the parts of society universities have missed: A manifesto for the new Director for Fair Access and Participation.

 

Sonia Sodha (The Observer) states:  If we were really committed to improving access to top universities, we would bite the bullet and introduce class-based quotas. Progress on this front has been pathetically slow: yes, young people from disadvantaged backgrounds are going to universities in greater numbers than before, but they remain disproportionately shut out of the highest-ranking institutions. The Office for Students should reintroduce a cap on student numbers…and introduce hard quotas for students from working- class backgrounds for each university. This would help break down the unfair and stubborn middle- class lock on privilege. It would also force more middle-class students down a vocational route – surely the only way we are ever going to get parity of esteem between post-18 vocational and academic qualifications.

 

Rosemary Bennett (The Times): [There should be] a universal system in transferrable credits so bright students who really take to their studies at university can trade up to a better institution after a year. If there is thriving competition between universities, as we are often told, it should not stop at the point of admission. Users need to be able to switch supplier.

 

Nik Miller (Bridge Group): The creation of the Office for Students is an important opportunity to… also look outwards; to convene influencers across sectors to deliver coherent approaches, and to dismantle prevailing contradictions….Employers play a critical role in determining students’ prospects. This demands greater scrutiny. For example, many employers continue to attract students from a limited list of the least diverse institutions, refuse to consider students below a certain A-Level tariff – as university contextual admissions opens the door for many students, it is slammed shut once more upon graduation – and offer unpaid and unadvertised internships.

 

Lorraine Dearden (Institute for Fiscal Studies): The Office for Students needs to fully link…data in one place. IFS research linking schools and Higher Education Statistics Agency (HESA) data shows that students who get the same GCSE results at age 16 are equally likely to progress to higher education, irrespective of their socio-economic status. However, there are socio-economic gaps in access to elite universities and the types of subjects studied, even allowing for school outcomes. We do not know fully whether this is because (i) bright disadvantaged students are less likely to apply for these courses, and/or (ii) they do, but do not get accepted, and/or (iii) their predicted grades and/or subject choice have some role. There are also socio-economic differences in drop-out rates, completion rates and outcomes once a person starts university. Good data would not only help us find out why these things are happening, but which access programmes are best at tackling them.

Read more sector change suggestions on the HEPI blog here.

 

T Levels

Damian Hinds, Education Secretary, has announced progress towards the commencement of T levels. T levels will be two year courses combining technical education and workplace experience making an important contribution to economic skills gaps and forming the third route for post-16 study (alongside apprenticeships and A levels).  The BBC report that the new two-year courses will have more teaching hours than most current technical programmes and will include a compulsory work placement of 40-60 working days. The Government have committed to learn from countries, work in partnership with business and the course content will be developed by expert employer panels. T Levels will commence from 2020 (construction, digital, and education and childcare) and be expanded into other sections from 2021 (finance, hair and beauty, engineering, and the creative industries). Controversy has dogged the announcement as earlier in the month a DfE official stated a 2020 start would be rushed and questioned whether the teaching would be of a high standard. These concerns were rejected and Hinds pushed ahead to unveil the 52 approved providers.

The Times article T levels have employers scratching their heads notes only 16% of employers  understand T levels: Business owners, who will be essential to the success of the new regime, say that they are not prepared for it. Just one in 12 employers at present provided placements of the duration required for T levels, and four in every five felt that financial support would be needed to enable them to offer the number of work placements needed.

Meanwhile Stage 2 kicks off for the 16 hopefuls (3 of which are universities) aiming to become Institutes of Technology. Research Professional also has a short article on it here.

Admissions

Next week the House of Lords will hold a one-hour debate on equality of opportunity in university admissions.

 

Fraudulent UCAS Applications

Previously The Independent challenged UCAS stating black students were 22 times more likely to have their university applications investigated for fraud than white students. UCAS investigated the issue and have published a report. Read the key points here. The story is covered by The Times and The Guardian.

 

Criminal Convictions

UCAS have also made news this week following their decision to not require applicants to declare criminal convictions when they apply for most courses.

Christopher Stacey, co-director of Unlock, said:

“Unlock very much welcomes the removal of the main criminal conviction box from the UCAS form. This is a significant change that has the potential to help many people with convictions see a university education as a positive way forward in their lives. For far too long, universities have operated arbitrary, unfair admissions practices towards those who ticked the box. Unlock has seen first-hand how people have been put off from applying to university as a result.

If universities are committed to widening participation, they should be considering the widest number of potential applicants. The change by UCAS provides a strong signal to universities that criminal records shouldn’t feature in their assessment of academic ability.

Many institutions are now rightly looking at how to amend their policies and practices. We look forward to working with UCAS and individual universities in developing fairer admissions policies towards students with criminal records.”

Nina Champion, Head of Policy at Prisoners’ Education Trust, said:

“People with convictions who are applying to university are showing a huge commitment to turning their lives around. As a society, we should be doing all we can to support them. The chance to go to university helps people to move fully away from crime, build careers and contribute to our communities. Their presence is also hugely beneficial for universities, which gain highly committed students, who help create a more diverse and inclusive learning environment for everyone. “We look forward to working with universities at revising their own admissions procedures in light of UCAS’ decision, ensuring fair chances for every student.”

Peter Stanford, Director of the Longford Trust, said:

“We…urge that, whatever arrangements universities now decide to put in place around risk assessment for those with criminal convictions, they do so in a manner that learns from the mistakes of the recent past, and enables the widest possible levels of participation”

 

Alternative Admissions

Jackie Labbe from De Montford University blogs for Wonkhe on the changes her university has made in Admissions to rely less on tariff based selection. Jackie states the changes have had a positive effect:

We support them [new students] via transitions programmes bridging their course of study and student services, so that any obstacles they have encountered in the past don’t continue to impede them.

We have seen success in our students’ improving outcomes, particularly our black and minority ethnic (BAME) students. We are now more than 50% BAME, and consider (in common with the sector) that the attainment gap is an unacceptable element of the status quo. We’re proud that our attainment gap is closing, and aim to continue to reduce it exponentially over the next few years.

 

Nursing – fall in Access course registrations

Nursing recruitment takes another hit as QAA data confirmed registrations onto the Access to HE Diplomas for nursing and health care fell by 18% (20,050 registrations) in 2016/17. Overall Access courses are down by 10%

Dr Greg Walker, Chief Executive of MillionPlus, calls on the HE Review panel to take the drop seriously:

“The news that registrations to these diplomas have dropped by almost a fifth in the space of a year is deeply concerning. The withdrawal of bursaries now appears to be impacting further down the supply chain for nursing degree students. A stalling pipeline of potential nursing students will offer no assurance to NHS employers as they struggle to fill vacant nursing posts…now is the time to review the impact of the shift away from bursaries.

Consultations

Click here to view the updated consultation tracker. Email us on policy@bournemouth.ac.uk if you’d like to contribute to any of the current consultations.

New consultations and inquiries this week:

Other news

Gender Gap: Using data from a French study Times Higher discusses how automatically considering women for senior positions would reduce the gender gap at the top.

Teaching excellence: Times Higher talk on how linking promotion to quality teaching may work better than the TEF!

Civic University: Read the latest from the Civic University forum.

Poaching: PIE news has an article on the poaching of international students that takes place in the US.

Subscribe!

To subscribe to the weekly policy update simply email policy@bournemouth.ac.uk

JANE FORSTER                                            |                   SARAH CARTER

Policy Advisor                                                                     Policy & Public Affairs Officer

65111                                                                                     65070

 

Follow: @PolicyBU on Twitter                   |                    policy@bournemouth.ac.uk

HE policy update for the w/e 1st September 2017

We continue our series of summer updates focussing on themes rather than news with a look at learning gain.  We have updates on the Industrial Strategy Bell review of Life Sciences, and an update on the TEF from UUK.

Learning Gain

Learning gain has become a potential hot topic for universities over the last year – could it be the magic bullet for problems with TEF metrics?  Why is it a policy issue and what are the implications of the policy context for universities and students?  Wonkhe recently published a helpful summary in July by Dr Camille B. Kandiko Howson, from Kings College.

Background – TEF – The Teaching Excellence Framework (TEF) includes learning gain alongside student outcomes more generally as one of its three main criteria for assessing teaching excellence (the others are teaching quality and learning environment).  The relevant TEF criteria are:

Student Outcomes and Learning Gain  
Employment and Further Study (SO1) Students achieve their educational and professional goals, in particular progression to further study or highly skilled employment  
Employability and Transferrable Skills (SO2) Students acquire knowledge, skills and attributes that are valued by employers and that enhance their personal and/or professional lives
Positive Outcomes for All (SO3) Positive outcomes are achieved by its students from all backgrounds, in particular those from disadvantaged backgrounds or those who are at greater risk of not achieving positive outcomes

Further definition was given in the “Aspects of Quality” guidance (see the TEF guidance issued by HEFCE):

Student Outcomes and Learning Gain is focused on the achievement of positive outcomes. Positive outcomes are taken to include:

  • acquisition of attributes such as lifelong learning skills and others that allow a graduate to make a strong contribution to society, economy and the environment,
  • progression to further study, acquisition of knowledge, skills and attributes necessary to compete for a graduate level job that requires the high level of skills arising from higher education

The extent to which positive outcomes are achieved for all students, including those from disadvantaged backgrounds, is a key feature. The distance travelled by students (‘learning gain’) is included”.

And it goes on:

  • Work across the sector to develop new measures of learning gain is in progress. Until new measures become available and are robust and applicable for all types of providers and students, we anticipate providers will refer to their own approaches to identifying and assessing students’ learning gain – this aspect is not prescriptive about what those measures might be.”

The TEF guidance issued by HEFCE included examples of the sorts of evidence that universities might want to consider including (amongst a much longer list):

  • Learning gain and distance-travelled by all students including those entering higher education part-way through their professional lives
  • Evidence and impact of initiatives aimed at preparing students for further study and research
  • Use and effectiveness of initiatives used to help measure and record student progress, such as Grade Point Average (GPA)
  • Impact of initiatives aimed at closing gaps in development, attainment and progression for students from different backgrounds, in particular those from disadvantaged backgrounds or those who are at greater risk of not achieving positive outcomes.

TEF Assessment – If you have been following the debates about the TEF in Year 2 (results now published), you will be aware that the assessment of institutions against these criteria was done in two ways – by looking at metrics (with benchmarking and subdivision into various sub-sets), and by review of a written provider assessment.

  • The metrics that were used in TEF Year 2 for Student Outcomes and Learning Gain were from the Destination of Leavers from Higher Education survey (DLHE), specifically the DLHE declared activity 6 months after graduation – were they in employment of further study, and if in employment, was it “highly skilled” as defined by SOC groups 1-3 (managerial and professional).
  • So the metrics used in Year 2 of TEF do not cover learning gain at all. In fact they only really relate to SO1 above, are of limited use in terms of employability for SO2. DLHE doesn’t measure employability, only employment. Of course, DLHE is being replaced, after major consultations by HESA throughout 2016 and 2017 with the new Graduate Outcomes survey, which will take a longer-term view and look at a broader range of outcomes. (read more in our Policy Update of 30th June 2017).
  • So for the TEF year 2, any assessment of learning gain was done through the written submissions – and as noted above there are no measures for this, it was left to providers to “refer to their own approaches to identifying and assessing students’ learning gain”.

Universities UK have published their review of Year 2 of the TEF (see next section below) which includes a strong endorsement from UUK members for a comparative learning gain metric in future iterations of the TEF.

Measuring Learning Gain – As referred to above, there is a HEFCE project to look at ways of measuring learning gain.

They are running 13 pilot projects:

  • careers registration and employability initiatives – this  uses surveys and is linked most closely to SO2 – employability
  • critical-thinking ‘CLA+’ standardised assessment tool – also uses the UK Engagement Survey (UKES). CLA+ is a US assessment that is done on-line and asks students to assess data and evidence and decide on a course of action or propose a solution. As such, it measures general skills but is not subject specific.
  • self-efficacy across a range of disciplines
  • skills and self-assessment of confidence measures
  • a self-assessment skills audit and a situational judgement test
  • HE in FE
  • A multi-strand one: standardising entry and exit qualifications, new measures of critical skills and modelling change in learning outcomes
  • a project that will analyse the Affective-Behaviour-Cognition (ABC) model data for previous years
  • research skills in 6 disciplines
  • psychometric testing
  • learning gain from work-based learning and work placements
  • a project evaluating a range of methodologies including degree classifications, UKES, NSS, Student Wellbeing survey and CLA+
  • employability and subject specific learning across a range of methods – includes a project to understand the dimensions of learning gain and develop a way to measure them, one to look at R2 Strengths, one to look at career adaptability and one looking at international experience.

These are long term (3 year) projects – HEFCE published a year 1 report on 6th July 2017 – you can read more on our 14th July policy update – this flags a couple of challenges including how to get students to complete surveys and tests that are not relevant to their degree (a problem also encountered by the UKES). The report suggests embedding measurement “in the standard administrative procedures or formal curriculum” – which means a survey or test through enrolment and as part of our assessment programme.

To become a core TEF metric there would need to be a national standard measure that was implemented across the sector. That means that have to be mass testing (like SATs for university students) or another national survey alongside NSS and the new Graduate Outcomes survey (the replacement for DLHE) – with surveys on enrolment and at other points across the lifecycle.

Some BU staff are taking a different approach – instead of looking at generic measures for generic skills they have been looking at measuring specific learning gain against the defined learning outcomes for cohorts of students on a particular course. This is a much more customised approach but the team have set some basic parameters for the questions that they have asked which could be applied to other courses. The methodology was a survey. (Dr Martyn Polkinghorne, Dr Gelareh Roushan, Dr Julia Taylor) (see also a more detailed explanation, March 2017)

Pros, cons and alternatives

In January 2016, HEPI published a speech delivered in December 2015 by Andreas Schleicher, Director for Education and Skills, and Special Advisor on Education Policy to the Secretary-General at the Organisation for Economic Co-operation and Development (OECD) in Paris. In the speech, the author argues strongly for institutions worldwide to measure and use learning gain data. He supports the use of specific measures for disciplines although points out the difficulties with this – not least in getting comparable data. So he also focuses on generic skills – but he doesn’t suggest a specific methodology.

An HEA presentation from December 2016 mentions a number of inputs that “predict both student performance and learning gains” – including contact hours, class size (and a host of other things including the extent and timing of feedback on assignments).

It is worth looking quickly at GPA (Grade Point Average) as this is also mentioned in the TEF specification as noted above. The HEA are looking at degree standards for HEFCE now, having done a pilot project on GPA in 2013-14.  The report notes that “potential capacity to increase granularity of awards, transparency in award calculations, international recognition and student engagement in their programmes”. The summary says, “The importance to stakeholders of a nationally-agreed, common scale is a key finding of the pilot and is considered crucial for the acceptance and success of GPA in the UK”, and that “The pilot providers considered that the development of widespread stakeholder understanding and commitment would require clear communication to be sustained over a number of years.”

Wonkhe have a round up on the background to the GPA debate from June 2016,

Although the big focus for the TEF was on outputs not inputs, the Department for Education has announced that it will start to look at including some of the inputs. See our HE policy update for 21st July where we look at the new teaching intensity measure that will be part of the subject level TEF pilots. You can read more about this in a THE article from 2nd August:

  • The pilot “will measure teaching intensity using a method that weights the number of hours taught by the student-staff ratio of each taught hour,” explains the pilot’s specification, published by the Department for Education“. Put simply, this model would value each of these at the same level: two hours spent in a group of 10 students with one member of staff, two hours spent in a group of 20 with two members of staff, one hour spent in a group of five students with one member of staff,” it explains. Once contact hours are weighted by class sizes, and aggregated up to subject level, those running the pilot will be able to calculate a “gross teaching quotient” score, which would be an “easily interpretable number” and used as a “supplementary metric” to inform subject-level assessments”.

The contact hours debate is very political – tied up with concerns about value for money and linked to the very topical debate on fees (speech on 20th July by Jo Johnson .and see our HE Policy Update for 21st July 2017)

This is all very interesting when, as mentioned above, the TEF specification for year two put so much emphasis on measuring outcome and not just inputs: “The emphasis in the provider submission should be on demonstrating the impact and effectiveness of teaching on the student experience and outcomes they achieve. The submission should therefore avoid focusing on descriptions of strategies or approach but instead should focus on impact. Wherever possible, impact should be demonstrated empirically. “

Experts and evidence – There will be a real push from the sector for evidence that the new teaching intensity measure and reporting of contact hours and other things really does make a difference to students before it is included in the TEF. The HEA’s position on this (2016) is a helpful summary of the debate about contact hours.

There is an interesting article in the HEPI collection of responses to the Green Paper in January 2016  from Graham Gibbs, former Professor at the University of Winchester and Director of the Oxford Learning Institute, University of Oxford, and author of Dimensions of quality and Implications of ‘Dimensions of quality’ in a market environment. He supports the use of learning gain metrics as a useful tool. He points out that “cohort size is a strong negative predictor of both student performance and learning gains”. He also adds “Russell Group Universities have comparatively larger cohorts and larger class sizes, and their small group teaching is less likely to be undertaken by academics, all of which save money but reduce learning gains”. He does not accept that contact hours, or institutional reputation (linked to high tariff entry and research reputation) impact learning gain.

There is an interesting article on the Higher Education Policy Institute (HEPI) website here written by the authors of an article that looked at class size.

Impact so far – So what happened in the TEF – a very quick and incomplete look at TEF submissions suggests that not many institutions included much about learning gain (or GPA) and those that did seem to fall into two categories – those participating in the pilot who mention the pilot, and some who mention it in the context of the TEF core data – e.g. Birmingham mention their access project and learning gain (but don’t really evidence it except through employment and retention). Huddersfield talk about it in the context of placements and work experience but again linked to employment outcomes, although they also mention assessment improvement.

Teaching Excellence Framework (TEF) – year 2 review

Universities UK have published their review of Year 2 of the TEF following a survey that UUK did of their members.

The key findings from the report are:

  • There appears to be general confidence that overall process was fair, notwithstanding the outcomes of individual appeals. Judgements were the result of an intensive and discursive process of deliberation by the assessment panel. There was a slight correlation between TEF results, entry tariff and league table rankings.
  • It is estimated that the cost of participating in the TEF for 134 higher education institutions was approximately £4 million. This was driven by the volume of staff engagement, particularly senior staff.
  • Further consideration will need to be given to how the TEF accounts for the diversity of the student body, particularly part-time students, and how the TEF defines and measures excellence. [UUK also raises a concern about judgements possibly being skewed by prior attainment]
  • If subject-level TEF is to provide students with reliable information it must address the impact of increased metric suppression [this relates to metrics which could not be used because of small numbers, particularly for part-time students and for the ethnicity splits], how judgments are made in the absence of data [particularly an issue for those institutions affected by the NSS boycott], the comparability of subject groupings and the increase in cost and complexity of submissions and assessment.

[To address the issue with suppression, the report noted that the splits for ethnicity will be reduced from 6 to 3 for subject level TEF (p35)]

These findings also suggest that if the TEF is to make an effective contribution to the ongoing success of the whole UK sector, the following issues would merit consideration as part of the independent review:

  • How the TEF defines and measures excellence in a diverse sector and supports development of teaching and learning practice.
  • The role that the TEF plays across the student decision-making process and the relationship with the wider student information landscape.
  • The process for the future development of the TEF and the role of the sector, including students and devolved nations.
  • The relationship between the TEF and quality assessment, including regulatory baselines and the Quality Code.

Figure 4 shows the data benchmarking flags received by providers at each award level – these two charts are interesting because they show that providers with negative flags still received gold (and silver).

The survey also asked about future developments for the TEF with learning gain being a clear leader – ahead of teaching intensity. HEFCE is running learning gain pilots, as discussed above, and teaching intensity will be the subject of a pilot alongside subject level TEF. Interestingly, on p 33 a chart shows that nearly 70% of respondents believed that “there is no proportionate approach for producing a robust subject level TEF judgement which will be useful for students”.

Industrial Strategy

Following our update on the Industrial Strategy last week there are a couple of updates. Innovate UK has announced funding for businesses to work on innovative technologies, future products and services. The categories link closely to the Industrial Strategy priorities including digital technologies, robotics, creative economy and design and space applications as well as emerging technologies and electronics.

There was also an announcement about funding for innovative medicines manufacturing solutions.

Sir John Bell has published his report for the government on Life Sciences and the Industrial Strategy. There are seven main recommendations under 4 themes, which are summarised below. You can read a longer summary on the BU Research Blog.

Some interesting comments:

  • The key UK attribute driving success in life sciences is the great strength in university-based research. Strong research-based universities underpin most of the public sector research success in the UK, as they do in the USA and in Scandinavia. National research systems based around institutes rather than universities, as seen in Germany, France and China, do not achieve the same productivity in life sciences as seen in university-focussed systems.” (p22)
  • “The decline in funding of indirect costs for charity research is coupled to an increasing tendency for Research Councils to construct approaches that avoid paying indirect Full Economic Costs (FEC). Together, these are having a significant impact on the viability of research in universities and have led to the institutions raising industrial overhead costs to fill the gap. This is unhelpful.” (p24)
  • “It is also recommended, that the funding agencies, in partnership with major charities, create a high-level recruitment fund that would pay the real cost of bringing successful scientists from abroad to work in major UK university institutions.” (see the proposal to attract international scientists below).
  • On clusters “Life sciences clusters are nearly always located around a university or other research institute and in the UK include elements of NHS infrastructure. However, evidence and experience suggests that governments cannot seed technology clusters and their success is usually driven by the underpinning assets of universities and companies, and also by the cultural features of networking and recycling of entrepreneurs and capital.” And “Regions should make the most of existing opportunities locally to grow clusters and build resilience by working in partnership across local Government, LEPs (in England), universities and research institutes, NHS, AHSNs, local businesses and support organisations, to identify and coalesce the local vision for life sciences. Science & Innovation Audits, Local Growth Funds and Growth Hubs (in England), Enterprise Zones and local rates and planning flexibilities can all be utilised to support a vision for life sciences. “ (see the proposal on clusters under “Growth and Infrastructure” – this was a big theme in the Industrial strategy and something we also covered in our Green Paper response)
  • On skills: “ The flow of multidisciplinary students at Masters and PhD level should be increased by providing incentives through the Higher Education Funding Council for England.2 and  “Universities and research funders should embed core competencies at degree and PhD level, for example data, statistical and analytical skills, commercial acumen and translational skills, and management and entrepreneurship training (which could be delivered in partnership with business schools). They should support exposure to, and collaboration with, strategically important disciplines including computer and data science, engineering, chemistry, physics, mathematics and material science.”

Health Advanced Research Programme (HARP) proposal – with the goal to create 2-3 entirely new industries over the next 10 years.

Reinforcing the UK science offer 

  • Sustain and increase funding for basic science to match our international competition – the goal is that the UK should attract 2000 new discovery scientists from around the globe
    • The UK should aim to be in the upper quartile of OECD R&D spending and sustain and increase the funding for basic science, to match our international competitors, particularly in university settings, encouraging discovery science to co-locate.
    • Capitalise on UKRI to increase interdisciplinary research, work more effectively with industry and support high-risk science.
    • Use Government and charitable funding to attract up to 100 world-class scientists to the UK, with support for their recruitment and their science over the next ten years.
  • Further improve UK clinical trial capabilities to support a 50% increase in the number of clinical trials over the next 5 years and a growing proportion of change of practice and trials with novel methodology over the next 5 years.

Growth and infrastructure – the goal is to create four UK companies valued at >£20 billion market cap in the next ten years.

NHS collaboration – the Accelerated Access Review should be adopted with national routes to market streamlined and clarified, including for digital products. There are two stated goals:

  • NHS should engage in fifty collaborative programmes in the next 5 years in late-stage clinical trials, real world data collection, or in the evaluation of diagnostics or devices.
  • The UK should be in the top quartile of comparator countries, both for the speed of adoption and the overall uptake of innovative, cost-effective products, to the benefit of all UK patients by the end of 2023.

Data – Establish two to five Digital Innovation Hubs providing data across regions of three to five million people.

  • Create a forum for researchers across academia, charities and industry to engage with all national health data programmes.
  • Establish a new regulatory, Health Technology Assessment and commercial framework to capture for the UK the value in algorithms generated using NHS data.
  • Two to five digital innovation hubs providing data across regions of three to five million people should be set up as part of a national approach and building towards full population coverage, to rapidly enable researchers to engage with a meaningful dataset. One or more of these should focus on medtech.
  • The UK could host 4-6 centres of excellence that provide support for specific medtech themes, focussing on research capability in a single medtech domain such as orthopaedics, cardiac, digital health or molecular diagnostics.
  • National registries of therapy-area-specific data across the whole of the NHS in England should be created and aligned with the relevant charity.

Skills

  • A migration system should be established that allows recruitment and retention of highly skilled workers from the EU and beyond, and does not impede intra-company transfers.
  • Develop and deliver a reinforced skills action plan across the NHS, commercial and third sectors based on a gap analysis of key skills for science.
    • Create an apprenticeship scheme that focuses on data sciences, as well as skills across the life sciences sector, and trains an entirely new cadre of technologists, healthcare workers and scientists at the cutting-edge of digital health.
    • Establish Institutes of Technology that would provide opportunity for technical training, particularly in digital and advanced manufacturing areas.
    • There should be support for entrepreneur training at all levels, incentivising varied careers and migration of academic scientists into industry and back to academia.
    • A fund should be established supporting convergent science activities including cross-disciplinary sabbaticals, joint appointments, funding for cross-sectoral partnerships and exchanges across industry and the NHS, including for management trainees.
    • High quality STEM education should be provided for all, and the government should evaluate and implement additional steps to increase the number of students studying maths to level 3 and beyond.

JANE FORSTER                                                             |                               SARAH CARTER

Policy Advisor                                                                                               Policy & Public Affairs Officer

65111                                                                                                              65070

Follow: @PolicyBU on Twitter                      |                               policy@bournemouth.ac.uk

 

HE policy update w/e 23rd June 2017

Two items have dominated this week – the Queen’s Speech at the state opening of Parliament, and the TEF results.

Queen’s Speech

The Queen’s Speech sets out the government’s legislative agenda for the session of parliament. In a rare departure this year the parliamentary legislative session is planned to last for two years, instead of one, to accommodate Brexit and the Repeal Bill. Both the Commons and Lords will debate the planned legislative programme for six working days.  Education will be debated on Tuesday 27 June by the Commons and Thursday 29 June by the Lords. Usually during the final days of debate two Opposition amendments are considered and one is voted upon – it will be interesting to see what they pick. The Commons vote on the final motion takes place on Thursday 29 June. The government must win this vote  -although the DUP are likely to support the government, Labour are hovering in the wings ready to capitalise on any opportunity.

The significance of the Queen’s Speech for HE was more about what it did not contain. Across the board many manifesto commitments were absent or lacked detail, but that is not unusual.

Schools were addressed with a commitment to increase the schools budget further and to make schools funding fairer. Furthermore, of importance to HE, in line with the ‘Schools that work for everyone’ consultation, the Queen’s Speech makes reference to encouraging more people, schools and institutions to come forward to help to create more good school places. This falls short of promising legislation to force universities or independent schools to sponsor or open free schools, as mentioned in the manifesto. However, legislation isn’t required to force universities into sponsorship.  We await the next steps in the response to the Schools consultation.  Labour’s Shadow Secretary of State for Education, Angela Rayner, has tabled the parliamentary question: What her policy is on the involvement of universities in academy sponsorship and the founding of free schools and charging maximum tuition fees. We’ll bring you the response in next week’s policy update. Grammar schools were not mentioned. While the policy has not been officially dropped the BBC cite a DfE source who stated ”the Queen’s Speech was an unambiguous decision not to go ahead with creating more grammar schools”.

The commitment remains to refreshing technical education, funding and delivering the new Institutes of Technology as part of the Industrial Strategy. Angela Rayner has also tabled a parliamentary question on reviewing funding across tertiary education. HEPI published a report on technical and professional education this week.

Immigration – the government pledged “A Bill to establish new national policies on immigration, completed by legislation to ensure that the UK makes a success of Brexit”. The new factor in this debate is the role of the DUP which has indicated it wants a policy that meets the skills needs of Britain. This may not completely dovetail with May’s commitment to the net migration target. In the election aftermath there have been rumours that the government will soften their immigration stance. However, the migration cap was confirmed again by Damien Green on Wednesday.

The Queen’s Speech also addressed Social Care, Mental Health and the tech sector. Please contact Sarah for a summary if these areas interest you.

The Teaching Excellence Framework (TEF)

Relish or rubbish it TEF is one of the most significant policy initiatives in recent years. Despite sector opposition and Lords legislative amendments, Jo Johnson’s drive to bring teaching excellence into focus survived largely intact with a review promised in 2019. The categorisation of universities into a single label of Gold, Silver or Bronze gives a highly visible message to the public. A debate rages on how much influence TEF will have on prospective students’ choices and their parents’ opinion. However, including the awards on unistats, and UCAS course pages means that  TEF is a force to be respected.  Jane’s blog for Wonkhe gives a personal perspective – the good outweighs the bad.

What is TEF?

TEF is a government endorsed evaluation of teaching excellence. Wonkhe have a useful beginner’s guide to the TEF which sets out the component parts within the three categories of Teaching Quality, Learning Environment and Student Outcomes and Learning (also see diagram, and explanation of  TEF flags). Controversy within the sector (and Lords debate during the HE and Research Bill) centred on the metrics- which use measures of student experience, retention, and outcomes as a proxy for teaching excellence. In May Jo Johnson stated that TEF was ‘an iterative process’ and would ‘evolve and develop’ over the years. New metrics including LEO will be considered for inclusion as TEF matures.

The government’s aims for TEF are to:

  • Inform prospective student choice
  • Recognise, reward and drive excellent teaching (balancing a research focus at the expense of teaching experience)
  • Inform and meet employer, business and industry needs

Read Wonkhe’s interesting political history of the methods successive policy makers have attempted to drive progress. And HEPI’s (short!) idiots guide to the arguments for and against the TEF.

Participation in TEF was voluntary but most (nearly all in England, fewer in the devolved administrations) chose to participate. TEF is linked to the raising of the higher fee cap.  However, to allow the HE and Research Act to pass swiftly the government agreed to postpone the further link which differentiated the fee cap based on TEF ratings. This has been postponed until 2020 and can only be reinstated after an independent review of TEF has been conducted. Read John Vinney’s research blog which highlights the Lords unease over the TEF fees link as the HE and Research Bill made its way through parliament.

TEF also aligns with the government’s social mobility agenda. The metrics deliberately split out widening participation indicators such as BME and part time students to ensure consideration of these groups at institutional level.

TEF – the outcome

As the data that underlines the metrics are widely published, he sector already had a ball park idea of where institutional ratings would fall, although the subtlety of the individual benchmarking process did make it hard to predict with confidence.  For some the TEF heralds a refreshing shake up of the sector, a move away from research influenced league tables.  For pre-results release comment see TEF will check the most complacent and privileged and Performance management is here to stay, but TEF needs a rethink.

The TEF results for all participating providers were released by HEFCE on Thursday 22 June. At the time of writing the HEFCE TEF webpages were very slow, as an alternative see this Times Higher page which lists all institutions results but not the provider results statements. The Times Higher page also compares each provider’s TEF result with their THE World University Ranking and REF GPA.

As the policy wonks digest the national results picture, questions emerge about the relative influence of the provider statement against metrics, and a good article by Wonkhe provides volumes and information on institutions that were up or downgraded against their initial metric based ranking. There are interesting results analysis tweets and diagrams by the University of Huddersfield.  Chris Husbands, the chair of the TEF, has responded to the reaction with a strong defence of the system on Wonkhe.

Jo Johnson, in the TEF results release, harks back to the original TEF objectives:  “These results, highlighting the extraordinary strengths of our higher education system, will help students choose which university or college to study at. The Teaching Excellence Framework is refocusing the sector’s attention on teaching – putting in place incentives that will raise standards across the sector and giving teaching the same status as research. Students, parents, employers and taxpayers all have a shared interest in ensuring that higher education equips the next generation of graduates for success.”  He also tweeted “Kudos to all 295 institutions that volunteered for the first Teaching Excellence Framework assessment”.

BU’s approach

BU’s continuing approach to TEF reflects our fundamental commitment to Fusion. Read John Vinney’s HEPI blog which addresses the importance of both research and teaching in inspiring learning excellence, and the comments from Professor Holley on this research blog: “BU is unusual in the sector in drawing together preparation for both REF and TEF, mirroring their Fusion agenda of excellence in research, education and professional practice. It is exciting to be at the centre of these policy opportunities, to build synergy in a way that will further enhance the student experience. At BU we pride ourselves on delivering innovative teaching and learning that works for all of our students, regardless of background.”  If you missed it, you can read about BU’s silver award here.

The Future

Amid the excitement of ‘results day’ it is easy to forget that TEF is still evolving. There will be an extended two-year subject level pilot in 2017/18 and 2018/19, with a final version rolled out in 2019/20 (TEF year 5). Despite extensive sector consultation and comment over the past year few decisions have been made about the complexity and level of detail that will dictate the subject level structural framework.  The approach based on many categories of disciplines will most genuinely reflect the learning experience of students but could be  burdensome and costly – some say broader groups will be easier and less time consuming to manage but will have a masking effect by grouping together subjects that don’t really belong together. For example, subjects as diverse as geography and nursing could banded together under a social sciences heading. Subject level TEF will also make labelling harder. How will a silver institution with a range of gold and bronze subject judgements market themselves effectively but unambiguously? Will parents and prospective students (who need clear, simple branding to make decisions) pay more attention to the Gold rating for their intended subject or an overall Bronze for the intended institution? If that doesn’t have you reaching for the headache medication read Wonkhe’s article which delves further into the complexities of subject level TEF.

Also don’t forget postgraduates. Postgraduate TEF was scheduled for TEF year 4 (assessed in 2018-19 based on 2017-18 data); however, many speculate that given the extension of the subject level TEF pilot and the independent review of TEF, as well as everything else, postgraduate TEF may be shelved until further notice.   See Wonkhe’s TEF article about postgraduate TEF.

But with the Bill passed, what will the Universities Minister do during this parliament? Perhaps focus more on the Science and Research part of his portfolio, with the Industrial Strategy and Brexit issues to deal with.

Lastly, at a June Wonkhe TEF conference Mark Jones (HEA) called on the sector to ‘take back control’ of teaching excellence and play a part in developing teaching metrics rather than simply critiquing them. He advocated engaging with Gibbs (2010) Dimensions of quality research and looking at international initiatives as part of potential metric development.  Chris Husbands repeated this call in his blog this week.

Media Coverage

Times Higher has a hub page where they gather together key articles and comment on the TEF, and Wonkhe gather together many articles and blogs whilst also providing key results analysis. You may like eight first lessons from the TEF results.

Media coverage has focussed mostly on the mixed ratings achieved by Russell Group members:

Sector response

Nick Hillman, Director of the Higher Education Policy Institute, said:  ‘The Teaching Excellence Framework would have comprehensively failed if it had simply replicated existing hierarchies. It was always designed to do something different to other league tables and rankings – namely, to show where there are pockets of excellence that have been ignored and to encourage improvements elsewhere.

‘So the fact that some of the results seem surprising suggests it is working. I visit around 50 universities a year so know the Gold ratings have been hard won by committed staff and students and are very well deserved.

‘Nonetheless, in this early guise, the TEF is far from a perfect assessment of teaching and learning. While it tells us a lot of useful things, none of them accurately reflects precisely what goes on in lecture halls. I hope university applicants will use the results in their decision making but they should do so with caution, not least because the ratings are for whole universities rather than individual courses.’

 

Jane Forster                                   Sarah Carter

VC’s Policy Adviser                                    Policy & Public Affairs Officer

 

HE policy update w/e 24th March 2017

Higher Education and Research Bill – the third reading of the Bill in the House of Lords was scheduled for Wednesday and was about to start when the attack took place in Westminster, so the session was cancelled. It has now been rescheduled for Tuesday 4th April.  The current version of the bill as amended at the report stage is here. There is a short list of amendments for the third reading – these are usually “tidying up” amendments rather than the more substantive ones that we have seen in the earlier stages – and are monstly (but not exclusively) government amendments.  The Bill will then return to the Commons – probably after Easter – when all six of the opposition and cross bench amendments made by the Lords are likely to be removed – including the one decoupling TEF ratings and fee increases, removing the Gold, Silver, Bronze TEF system and replacing it with a pass/fail, and measures aiming to support international students and staff studying and working in the UK.

There may be government amendments proposed in the Commons to seek to address some of the concerns behind the amendments to the TEF, but it seems unlikely that there will be concessions on international staff and students in the bill as these issues will be relevant to the separate consultation on immigration policy, which we are still waiting for. There will therefore inevitably be another process of “ping-pong” . If the Lords don’t accept the position approved by the Commons (and any concessions made) then there is a risk that the bill will run out of time in this session.

To respond to concerns raised by the Lords, Jo Johnson and the sponsor of the bill in the House of Lords, Viscount Younger of Leckie have written a number of letters during the report stage.

  • 15th March 2017 – powers to enter and search
  • 6th March 2017 – regulation (compliance with the Regulator’s Code – will require a statutory instrument but government agree), role of the Competition and Markets Authority (the government believe there is no overlap between the OfS and the CMA). One government amendment clarified that in addition to promoting competition, the OfS should have regard to the benefits of HEI collaboration for students and employers.
  • 3rd March 2017 – defending the TEF and its metrics, setting out the context and background and confirming a commitment to ensuring that the TEF supports widening participation.

There has not been a response to the amendments that were passed, so we will wait to see. In the meantime, there were some interesting articles about the future for the TEF on Wonkhe on Monday:

Another concern raised by the Lords and also raised in Education questions in the Commons this week related to free speech. Jo Johnson, the universities minister, added that the bill would safeguard free speech by extending the duty to take reasonably practicable steps to secure freedom of speech to all registered providers. On the same day, Johnson also wrote to universities asking them to pay particular attention to this issue. He advised: “Policies and codes of practice should not simply be allowed to gather dust; they are crucial to demonstrating to students that free speech should be at the heart of our university system. They need to be meaningful documents that students and staff understand and, crucially, respect.”

Brexit – with the PM expected to serve formal notice to start Brexit negotiations under Article 50 next week, Peers debated EU membership and UK science after the referendum on 23 March. They urged the government to replace any money lost from EU research programmes with fresh money from Westminster, rather than with the extra £4.7 million allocated to science and innovation in the 2016 autumn statement.

The Parliamentary and Scientific committee have published a statement on science priorities for Brexit.  It asks for immediate actions, sets out negotiation priorities and changes to domestic policy.  It’s very short and readable – a list of proposals rather than a long summary of evidence and background

Its first statement is about staff and skills – it calls for immediate reassurance for EEA staff working in the UK, research about mobility of skilled workers to inform immigration policy and for the government to develop a communications strategy that champions Britain as a welcoming hub for research and innovation.

On funding, it says that there must be no decline in overall funding for science and innovation across all disciplines, calls for continued participation in Horizon 2020 and for the government to “set the closest possible association for the UK with EU research and innovation programmes”.  It also proposes a target of 3% of GDP for combined public and private R&D investment, with at least 0.7% of GDP invested in research and development.    It calls for a comprehensive review of all current public funding for UK research and development to ensure there is no gap as the UK leaves the EU.

It sets out requirements to ensure that UK-based researchers are able to collaborate, including funding and infrastructure for partnerships.  On trade, it suggests that all government departments should have scientific advisers, and calls for a comprehensive review of the current regulatory environment.

Student Loans – in a written answer to a parliamentary question Jo Johnson noted that the latest Student Loans Company statistics show that there were around 113,600 English student loan borrowers known to be abroad at the beginning of the financial year 2016-17. Of these around 22 per cent were EU-domiciled borrowers. The figures also show that the overall outstanding loan balance of these borrowers resident abroad was around £1.6 billion, of which around £220 million was held by EU-domiciled borrowers. He added in a separate answer that the Student Loans Company established a repayments evasion unit in 2016 to detect borrowers who live abroad and who fail to repay their loans.

Advance marketing – along with Professor Debbie Holley, I am presenting some policy briefings and workshops – read more and book via the intranet.

HE policy update w/e17th March 2017

Brexit:

  • Research Professional illustrates the Brexit threats to research positioning and job losses by highlighting the difficulties facing an EU astronomy consortium. The consortium represents seven countries, led by the UK, but will move headquarters to an EU member state from January 2021. The move means the UK will lose the project’s leadership and the 12 UK universities may not continue post-Brexit. Research Professional notes that while access to research infrastructures is available to non-EU states, the EU membership plays a significant role in decisions on where to locate facilities. Gerry Gilmore (the consortium leader, from University of Cambridge) stated:
    The UK will lose substantial scientific leadership and influence in the EU. There is going to be bad news all around. I don’t think people realise how many new jobs and new opportunities have just been destroyed.”
  • The EU (Notification of Withdrawal) Bill has survived the parliamentary process and received Royal Assent on 16th March (BBC). This bill allows the Prime Minister to notify the EU of the UK’s intention to withdraw from the EU. The Lords made two amendments to the Bill – one relating to Parliament having a “meaningful vote” on the final arrangements and one requiring a guarantee for EU citizens to remain in the UK. The bill was approved by the House of Commons, which rejected the Lords bill and then went back to the Lords under what is called “ping-pong”. The Lords voted again on both issues but the House of Lords majority backed down and the bill was passed. The PM is expected to trigger article 50 later in March.
  • 2018/19 EU student and staff guarantees: During oral questions in the Lords Baroness Royall of Blaisdon pressed the government spokesperson (Viscount Younger of Leckie) when announcements would be made regarding fees and access to loans for 2018/19 EU student starters. Leckie gave a side stepping response: “The noble Baroness makes the important point that there are uncertainties arising from Brexit, but the Government have moved rapidly to give assurances to this sector… “We have also provided similar assurances that EU nationals starting courses in 2016-17 and 2017-18 remain eligible for Research Council postgraduate support. As I have said, we will ensure that students starting in 2018-19 have the information well in advance

International students:

  • The debate over the inclusion of international students in the long-term migrant numbers continues. Even senior ministers are rebelling – Boris Johnson, Phillip Hammond and Liam Fox have all protested, although Jo Johnson continues to toe the party line backing the PM’s stance to include international students within the original immigration statistics. Liam Fox spoke out this week about the value of overseas campuses.
  • On Monday the House of Lords defeated the government on the Higher Education and Research Bill (HERB), approving an amendment to prevent international students being counted as long-term migrants. The government have responded that “the proposed amendment would create a situation where we were potentially unable to apply basic visa checks, or impose conditions on a student visa. It would also mean that fresh primary legislation were needed just to make minor, technical changes to immigration rules.” (Wonkhe)
  • HERB is scheduled to have its third reading in the Lords on 22 March 2017 and then will go back to the Commons. The PM’s stance on international students seems rock solid (Financial Times) and Theresa May is not expected to waiver – the parliamentary ping pong regarding international students will surely make headlines over the coming weeks.
  • Meanwhile there are worries about student recruitment. Politics Home quotes an Office for National Statistics release stating the number of students coming to the UK dropped by 41,000 in 2016.

Higher Education and Research Bill:

  • The HE and Research Bill has finished its third reading in the House of Lords (although it will have to go back if the House of Commons makes any changes, as seems likely).  The report stage in the Lords is on 22nd March – usually only technical or minor amendments are made at this stage.  The current version of the bill as amended by the Lords is here.
  • The surprise amendment on international students is referred to above.
  • The government won the final vote on the proposed amendment that would have required UKRI and OfS to jointly revoke research degree awarding powers, the amendment was defeated. Wonkhe report that Lord Mackay made an impassioned speech noting that it was “extraordinary” that the OfS was not required to have any expertise or experience regarding research, and yet had the unilateral power to revoke research degree awarding powers, but to no avail. The Bill continues to say that research degree-awarding powers should be made by the OfS with advice from UKRI.

With long debates, late nights and a large number of amendments, it is fair to say that HERB has received an excellent level of scrutiny within the Lords. Lord Prior of Brampton notes: “Everyone who has contributed [to the Bill debates] can take some credit for having improved it considerably. For me, it is a good example of the value this House can bring to a Bill of this kind.”

HEFCE 2017/18 funding to universities: The grant letter details the overall funding to the sector for 2017/18. It includes doubled funding for the National Collaborative Outreach Programme (£60m pa), an additional £17m increase for mainstream quality-related research, a reduction of £40m for teaching (including a reduction in PGT FTE funding rate), maintaining the disabled students premium at the 2016/17 level, the inclusion of nursing, midwifery and allied health professions (£32m), cuts to the student premium budget for full time UG of £20m (part time UG funding remains static). Institutions will receive individual allocations in April although with a publication embargo in force until May. Capital allocations will be announced in March.

Student Loans Sale: A parliamentary question tabled by Steve McCabe requested publication of the ‘in-depth market testing exercise associated with the same of the student loan book. Jo Johnson has responded: “The Government ran a market testing process with a cross-section of potential investors in the student loan book from the end of September into November 2016. This sought feedback on potential sale structures and key features of the transaction and informed the design of the sale. This was a commercial rather than a public process and was conducted under non-disclosure agreements. We do not intend to publish a report of the details. Protecting the details of the conclusions of market testing will help the ongoing sale process achieve value for money for taxpayers.

Student Fees: On Thursday 16th the Petitions Committee released its latest decisions regarding recent petitions with a high number of signatures. This included a petition to government to change the University fees from £9250 back to the £3000 fee. The Committee agreed to wait for the Higher Education and Research Bill to complete its passage through Parliament before deciding whether to schedule a debate – effectively this was a dismissal of the petition.

Research Excellence Framework  The responses to the REF2021 consultation were due in by midday on 17th March.

  • There has been a lot of focus on one area, the definition of “research active staff” for the returns – there are some interesting views:
  • HEFCE blog (and BU’s reply) – HEFCE are proposing a negotiated definition for each university, BU is proposing all staff should be returned, including teaching only
  • Royal Society blog on Research Professional – they say staff shouldn’t be returned at all, it should be institutional
  • The PVC (Research and Enterprise) from Hertfordshire says on Times Higher Education that the solution is flawed and that clarity is needed

There are many other issues in the REF consultation, including the portability of outputs, which will have important consequences for institutions and their staff. The HEFCE REF consultation on the implementation of the REF 2021 closed on 17 March 2017.  You can read BU’s response here.

Blog by the Vice-Chancellor – what next for the Teaching Excellence Framework

The BBC 2 series “Meet the Lords” could not have been better timed. The House of Lords has flexed its muscles on the Article 50 Bill and this week’s episode coincided with them passing an amendment to the Higher Education and Research Bill (HE Bill) that breaks the link between the Teaching Excellence Framework (TEF) and fees. Since then another amendment has been passed that would change the nature of the TEF, and bring it under Parliamentary scrutiny.

It would be easy to dismiss these (as some have done) as acts of rebellion by a non-elected chamber that is in the case of the HE Bill, representing vested interests in the face of a genuine government attempt to reform a sector that is badly in need of it. The Department for Education could be forgiven if they had thought that the HE Bill was nearly home and dry. They had published a long list of amendments which had been largely welcomed by the sector. The TEF does not require Parliamentary approval. Universities UK and GuildHE, amongst others, had expressed support for the HE bill as amended and expressed support for the TEF – opposing the addition of more detail as it would reduce flexibility in future negotiations on the detail. But the House of Lords did not agree – they have not sought to add more detail in the TEF, but to change its nature completely. Reading the debates, it is clear that members of the House of Lords, like most of the sector, generally support the objectives of TEF in bringing focus on the quality of education and student outcomes. They support the provision of more and better information about universities for applicants and others. They, like many in the sector, also generally support an inflationary increase in fees.

In the latest amendment, the provisions for the TEF in clause 26 have been removed and the new clause instead requires the Secretary of State to bring forward a scheme to identify whether an institution meets or fails to meet expectations based on quality standards but it “must not be used to create a single composite ranking of English higher education providers”.  The arguments are neatly summarised by Lord Lucas: “Bronze will be seen as failing because these universities will be marked out as the bottom 20%. This is just not necessary. We have succeeded, in our research rankings, in producing a measure of sufficient detail and sophistication for people to read it in detail. It produces quite marked differences between institutions, but nobody reads it as a mark of a failing institution. It is information, not ranking…”.

An earlier amendment removed the differentiation between fees based on different ratings. The speeches in the House of Lords demonstrate that they are opposed to this link for different reasons, for example:

  • Baroness Deech “If we detach fees from gold, silver and bronze, we stand a chance of increasing social mobility under the amendment. If we do not, social mobility will be frozen and ghettoisation will increase.”
  • Baroness Wolf of Dulwich: “I want to cite three groups of academics ….all of which feel, as do students, that in their current state the TEF metrics are not up to the job of determining fee levels and that, until we are sure that we have valid and reliable measures, we should not do this.”
  • Lord Lipsey : “… what seems knocking on bizarre is to plough on with bringing in this link between fees and the TEF before we have got the TEF right….The Government would give themselves the best chance of proving themselves right and the sceptics wrong if they gave time for the TEF to settle down before they brought in the fees link.”
  • Lord Kerslake: “My second reason for not making the link is that the TEF rating will relate to the university, not the subject or course. We will not see subject-level ratings until 2020 and yet we know that it is perfectly possible to have a mediocre course in an otherwise excellent university, and indeed vice versa. It can be argued that the TEF ranking gives an indication of the overall ​student experience at a particular institution, but the variation which so obviously exists within institutions makes that argument quite unconvincing.”

Except for the subject level fee point (which has not become a topic of debate yet), these are all arguments that were made by the sector in responding to the Green Paper and the TEF consultation. These are all things that we have continued to raise as we discuss the implications of subject-level TEF.

So as it stands, the TEF has lost both of its “incentives” – aka its carrot and its stick, which were both in the form of the impact on fees and reputation. It is not at all clear what will happen next – some ideas are given in this Wonkhe blog. In blogs on the Times Higher Education, Maddaleine Ansell of the University Alliance and Sorana Vieru gave very different perspectives.

So what compromise could there be to address all the concerns and yet still preserve the positive aspects of the TEF – i.e. the increasing focus on education and outcomes? I go back to BU’s response to the Green Paper, when we said that the TEF should model itself on the REF.. It should celebrate excellence wherever it is found, there should not be a link with tuition fees and there should be no forced ranking. To achieve that now, a remodelled TEF could include the following features:

  • no link to fees
  • have two rather than three levels of award – perhaps indicating good and outstanding. The last category is those who fail their quality assessment and don’t qualify for TEF.
  • take a different approach to benchmarking that does not force differentiation
  • include a place for commendations

I am not convinced by the argument that no-one would participate in the TEF without the direct financial incentive. That does not hold true for the REF. The REF has increased the focus on impact and had a beneficial impact on research. (We have some reservations about the changes proposed in the latest REF consultation, but that is a separate issue.) The concerns about the TEF would be mitigated substantially if the Olympic rating system and the link to fees were dropped. The sector would be able to engage in a much more constructive debate about subject-level TEF.

The TEF does not need to be thrown out completely – but this is an opportunity to go back to where this started from and ensure that the TEF brings focus on the quality of education and student outcomes.

HE policy update w/e 27th January 2017

Industrial Strategy Green Paper

The Government launched the Industrial Strategy Green Paper and consultation this week. The paper focuses on improving Britain’s innovation and productivity in key areas alongside upskilling the workforce to become world leading. The government suggest a number of areas of industry specialism that should be supported:

  • clean energy
  • robotics
  • healthcare
  • space technology
  • quantum technology
  • advanced computing and communications

The document frequently references the role of Universities as innovation leaders pushing for commercialisation and greater productive cooperation with business. It states that the ‘neglect of technical education’ should be redressed and insinuates that higher-level technical education will be pushed towards the new Institutes of Technology (£170 government investment announced – see below). There is an emphasis on rebalancing the difference in Britain’s economic geography through infrastructure investment. In addition, it criticises how UK research funding is currently heavily invested in the ‘golden triangle’ (Oxford, Cambridge, London) and calls to build on research strengths in businesses as well as other universities. The strategy has a strong focus on STEM and Wonkhe have reported that The British Academy are urging the government not to forget investment in social sciences and humanities teaching and research, which they argue are vital to the continued development of the UK’s services sectors.

The consultation ends in April, we’ll be in touch shortly about how you can contribute to a BU response.

While the strategy has only just been launched it was preceded by the announcement of the new Industrial Strategy Challenge Fund (Nov 2016) and consultative workshops. The workshops aimed to ensure that the challenges identified match UK business capability and are based on the best available evidence for scientific and commercial success on the global stage. The challenges mirror the industry specialisms proposed in the green paper but also mention the creative industries and integrated cities. The workshops conclude this week, implementation plans are expected to follow from the government and the first challenge is expected to be announced in March.

In an interesting article in The Conversation Graham Galbraith, VC at Portsmouth, urges Universities to shun new institutions for innovation and instead form a network of hubs building on relationships with employers, skills organisations and FE colleges. Furthermore he resists the government’s distinction between academic and technical education, seeing the productivity answer through flexible routes to university study and developing skills courses that employers need in accessible ways. He believes the university sector would deliver this far more quickly than new Institutes of Technology. Galbraith also criticises REF 2021: “The government wants the UK to be better at commercialising its world-class, basic research. But the… require[ment]…to include all academic staff…will have the effect of making universities re-balance their staff’s priorities so that there is more focus only on peer-reviewed research and less on outward-facing activities like business collaborations.”

Brexit –The Supreme Court has ruled that Parliament must vote to trigger Article 50 which begins the Brexit process. The government timescale is to trigger Article 50 by end of March and to this end they have introduced a European Withdrawal Bill (EWB). The European Withdrawal Bill gives the PM the power to notify the European Council of the UK’s intention to withdrawn from the EU through the required Act of Parliament. It is being fast tracked through Parliament. Parliamentary time is scheduled for 31 Jan, 1 Feb, 6-8 Feb.  The House of Commons Education Select Committee continues visits to Universities (Oxford, UCL) to examine impact of Brexit on HE. At the UCL visit (Wednesday) Michael Arthur (Provost) broke the UCAS data embargo revealing a 7% drop in EU applicants in the current cycle. The Guardian leads with ‘first decrease after almost a decade of unbroken growth blamed on… Brexit’. Committee Chair, Neil Carmichael is reported on Twitter as asking whether HE needs a sector-specific Brexit deal – panel response ‘yes absolutely!’

Higher Education and Research Bill (HERB) – The Lords continue to scrutinise the HERB carefully with the long list of amendments.  The list has stopped growing quite so quickly but new amendments proposed this week include one to set up a new UKRI visa department that will sponsor academics (507ZA). So far apart form the first one, no amendments other than government amendments have been passed, but the level of debate and the length of the list suggests that there may have to be some concessions by the government. James Younger, the government lead on the Bill in the Lords, wrote to Peers on 25th January about the bill.

Given the timing of the Brexit discussions, Wonkhe speculate that to achieve the timescales for the Bill and to clear sufficient parliamentary time for the European Withdrawal Bill to be passed the government may make concessions on HERB.  Key discussions this week:

  • NSS statistically unfit for TEF – Lord Lipsey discussed the statistical inadequacies of NSS and the implication for this as a TEF metric. The NSS in the TEF is using—or rather, abusing—statistics for a purpose for which the NSS was never designed.” Lipsey acknowledged that the Government have gently retreated from the emphasis on NSS scores – in their latest instructions to assessors they stated: “assessors should be careful not to overweight information coming from the NSS“. This was reinforced by Chris Husbands, Chair of TEF, who informed a meeting at the House of Commons this week that his team would “not be overweighting the NSS” when awarding ratings this year.  The proposed amendment was withdrawn after Viscount Younger: stressed the NSS was not the primary source of information for the TEF and that the framework was about much more than metrics. “Providers submit additional evidence alongside their metrics, and this evidence will be given significant weight by the panel”. HE continued: “we cannot ignore the only credible, widely used metrics that captures students’ views”.
  • There were also debates about the gold/silver/bronze ratings and the government provided reassurance that Bronze was “above a high quality baseline”. This contradicts statements made by some in DfE before the final specification was agreed about Bronze institutions “needing improvement”. The panel have praised positive communication on this subject.
  • Validation – The government have issued a factsheet for the Lords on Validation which provides explanation from the perspective of an alternative provider seeking to enter a validation arrangement. It describes Clause 46 of HERB, which gives the Office for Students (OfS) power to commission authorised HE providers to provide validation if other providers decline. It states such authorised providers are free to choose whether they wish offer this service, however once an arrangement is in place the OfS could require them to validate award) delivered by other registered HE providers. The commissioned arrangement would be made public.  The controversial Clause 47 which appoints OfS as the validator of last resort was also discussed. The controversy arises as OfS isn’t an academic institution and doesn’t hold Degree Awarding Powers. The OfS will advise the Secretary of State (SoS) if intervention is required (likely through an evidence based report and stakeholder consultation) and the SoS would then authorise the intervention through regulation which is subject to parliamentary scrutiny.
  • Contract Cheating – The amendment proposed by Lord Storey on contract cheating was withdrawn following Government reassurance. Lord Storey provided a passionate discourse including detailed sector information and cheating statistics. Baroness Goldie confirmed that the Government were addressing cheating referencing the (Aug 2016 published) QAA investigation and Jo Johnson’s commitment to close working to progress the recommendations. She revealed that the Minster would shortly announce a new initiative to tackle cheating in conjunction with QAA, Universities UK, NUS and HEFCE.

TEF

The 15 page written submissions for year 2 of the TEF were finalised and submitted this week, and this was the final opportunity for institutions to opt out of the TEF. Although there may have been others who have not published their positions, most Scottish Universities have opted out, as well as the Open University. Given the difference in the Scottish funding system they have less to gain from the TEF – but the 4 who have opted in have noted international reputation as a crucial factor. The OU explain their non-participation is due to the poor fit of the metrics with their social mobility demographic.

And the future of the TEF? According to Research Professional, a German academic has criticised the way that teaching excellence funding is being used in Germany.

“Whereas lower-ranked universities have tended to spread their funding from the programme thinly across faculties and courses, higher-ranked institutions have had the luxury of being able to focus on priority areas, the analysis found.

“You are starting to see emerging differences between disciplines taught at different universities,” Bloch told Times Higher Education on 17 January. For the first time, elite universities are starting to build up strong institutional identities when it comes to teaching, in an effort to get further ahead.

“It will be a long time before we reach the stratification that you see in the American system [around teaching], but we are seeing a difference for the first time in how resources in teaching are distributed,” he said.

UCAS 2016 entrants report – this data includes applications, offers and placed rates by sex, area background (LPN-polar 3), and ethnicity. BU’s report can be selected from the drop down menu towards the end of the webpage. The Guardian reports on the lower offer rates to black applicants. Wonkhe covers the HEIs that have a significant upward or downward trend in acceptances

Research Impact training: Parliament are running a Research, Impact and the UK Parliament event in Bristol on Wednesday 1 March. It covers the basics of the Parliamentary process and how academics can engage with parliament through their knowledge and research to inform scrutiny and legislation, including the impact of influencing policy to support REF submissions.