Tagged / student outcomes

HE Policy Update for the w/e 18th October 2019

Nationally, of course, this week has been dominated by Brexit and the Queen’s Speech. The biggest HE story has been OfS’ launch of their Value for Money Strategy.  We have missed out Brexit because it is dating too quickly and other sources are available!

NSS – more change to come?

The OfS have announced that they are reviewing the NSS (again).

  • In the next few months, detailed analysis of recent trends will be published: areas for which levels of satisfaction have increased, and where the survey results indicate that more work needs to be done to improve students’ experience. We will also be looking at some of the key themes emerging from the student comment sections, which offer respondents the opportunity to comment on an open-ended question.
  • Like all such surveys, however, the NSS has its limitations. It only surveys final year undergraduate students: those on shorter courses, or in other years, are currently excluded.
  • The survey also has its critics. There have been mixed views about its role in the TEF, with some querying whether NSS provides a proxy for teaching quality, and others disappointed that it doesn’t carry enough weight in the TEF. Some have questioned the design of the survey – for example, its use of a five point ‘Likert’ scale. Others have queried its timing. Students are asked to complete it at a stage in their final year when many will be doing their assessments.
  • ..this review…will include:
    • Plans to pilot an expanded survey for all undergraduates – not just those in their final year, as at present – phased over the next two years. Expanding the NSS in this way will give a voice to all students and will provide a much richer picture of the student academic experience.
    • Comprehensive review and testing of the survey questions (and scales) to ensure they remain fit for purpose, making changes where appropriate.
    • Plans to explore new survey questions around student mental health and wellbeing provision – something we are hearing strongly from students they wish to see.
  • There will be opportunities for you to have your say in the course of a consultation to be launched in spring 2020. More detail on the consultation will follow later this year.

Outcomes for Disabled Students

The OfS have had a busy week. They have published a new Insight Brief on outcomes for disabled students.

  • Disabled students are now a vital and significant part of campus life. However, challenges remain. Disabled students are less likely to continue their degrees, graduate with a good degree, and progress onto a highly skilled job or further study. This Insight brief asks what universities and colleges are doing to rectify these problems. What can the data tell us about the extent of these access and participation gaps? Are teaching and learning practices inclusive enough? Are funding changes exacerbating the difficulties that disabled students face?
  • The OfS is concerned about persistent gaps in access, success and progression for disabled students. We are looking to ensure that universities and colleges close these gaps through our regulation of providers’ access and participation plans and our funding and promotion of effective practice.
  • Teaching and learning in higher education is becoming more inclusive, but these positive developments are uneven. Universities and colleges could go further by, for example, offering alternative formats of course materials as standard, and ensuring more buildings are accessible.
  • Through the Disabled Students’ Commission, we will bring together a range of experts and educators, including a student representative, to highlight the barriers which remain and explore ways to dismantle them.

The brief cites “Effective practice for universities and colleges [taken from the Institute for Employment Studies, ‘Review of support for disabled students in higher education in England’, p5]

To better support disabled students and progress towards a more inclusive environment, universities and colleges need:

  • their senior management to commit to inclusive practice and culture
  • to involve all university staff in encouraging students to disclose an impairment.
  • more comprehensive written policies detailing inclusive support
  • to take a whole institution approach to inclusive support
  • build considerations of inclusivity and accessibility into curriculum design and programme review
  • to offer alternative formats of lectures and course materials as standard practice
  • to build considerations of inclusivity and accessibility into purchasing of services and equipment
  • better sharing of good practice internally and across the sector
  • better advice, guidance and training on digital accessibility for staff.

Queen’s Speech

Her Majesty has read her speech, wearing full robes and crown (last time she was in a suit and hat). You can read the Speech in full and the background briefing which provides a bit more detail and sets out a summary of the 26 bills. Not all the changes are legislation. The contents page contains links (useful because it is 130 pages long).

There is a nice explainer from the Institute for Government.

  • The Queen’s Speech can be voted down. This would be of major political significance, as it would clearly call into question the ability of the government to command the confidence of Parliament. Historically, a defeat on the address has been treated as an implicit loss of confidence in a government as it suggests that there is no majority to be found in the Commons for its programme for government.
  • It is rare for the government to be defeated on the address in the Commons – as governments usually have a majority in the House. But it has happened – most recently in 1924, when Stanley Baldwin’s minority government was defeated. Baldwin then resigned as prime minister, and the opposition went on to form a new government.
  • As no government has been defeated on the address since the passage of the Fixed-term Parliaments Act (FTPA) in 2011, it is unclear what would happen if such a situation were to arise. This is because a defeat on the address would not meet the requirements under the FTPA to trigger an election. But any defeat might encourage the opposition to then table a formal vote of no confidence, under the FTPA, in the government. There would also be intense political pressure on the government.

The PM has already said if the Government is defeated on the Queen’s Speech vote he does not intend to step down.

On HE specifically, the briefing notes say:

  • We are committed to making sure that higher education funding reflects a sustainable model that supports high quality provision, maintaining our world-leading reputation for higher education and delivering value for money for both students and the taxpayer.
  • We want to ensure we deliver better value for students in post-18 education, have more options that offer the right education for each individual, and provide the best access for disadvantaged young people.
  • We want to establish the UK as a global science superpower, building on our existing world-excellence. We will boost public R&D funding, launch a comprehensive UK Space Strategy, introduce a fast-track immigration scheme for top scientists and researchers and develop proposals for a new funding agency.
    • Backing a new approach to funding emerging fields of research and technology, broadly modelled on the US Advanced Research Projects Agency. We will work with industry and academics to finalise this proposal
    • Reducing bureaucracy in research funding to ensure our brilliant scientists are able to spend as much time as possible creating new ideas, not filling in unnecessary forms.
  • The R&D funding plans we will unveil in autumn 2019 will help accelerate our ambition to reach 2.4 per cent of GDP spent on R&D by 2027. This boost in funding will allow us to invest strategically in cutting-edge science, while encouraging the worlds most innovative businesses to invest in the UK.
  • There will be a Medicines and Medical Devices Bill to “Allow the UK to take a lead role in global research to find cures for rare diseases and improve treatments for patients around the world”.

Other relevant highlights:

  • An immigration bill, ending free movement, will lay the foundation for a fair, modern and global immigration system. My Government remains committed to ensuring that resident European citizens, who have built their lives in, and contributed so much to, the United Kingdom, have the right to remain. The bill will include measures that reinforce this commitment [Immigration and Social Security Co-ordination (EU Withdrawal) Bill]. 
  • Measures will be brought forward to support and strengthen the National Health Service, its workforce and resources, enabling it to deliver the highest quality care. New laws will be taken forward to help implement the National Health Service’s Long Term Plan in England, and to establish an independent body to investigate serious healthcare incidents [Health Service Safety Investigations Bill].
  • My Government will bring forward proposals to reform adult social care in England to ensure dignity in old age. My Ministers will continue work to reform the Mental Health Act to improve respect for, and care of, those receiving treatment.
  • My Ministers will ensure that all young people have access to an excellent education, unlocking their full potential and preparing them for the world of work. 
  • A white paper will be published to set out my Government’s ambitions for unleashing regional potential in England, and to enable decisions that affect local people to be made at a local level.
  • My Government is committed to establishing the United Kingdom as a world-leader in scientific capability and space technology. Increased investment in science will be complemented by the development of a new funding agency, a more open visa system, and an ambitious national space strategy.
  • My Government will take steps to protect the integrity of democracy and the electoral system in the United Kingdom.

Plus: criminal justice, longer sentencing, sustainable fiscal strategy allowing investment in economic growth, post-Brexit regimes for fisheries, agriculture and trade, financial services, domestic abuse, divorce, pension regulation, national infrastructure strategy, a Drones bill, railway reform and broadband, environmental protection, animal welfare, defence.

During the parliamentary debates on the Queen’s Speech this week Labour’s Angela Rayner (shadow Education Secretary) called for the restoration of university maintenance grants and the implementation of a system of post qualification admissions. There has been a reinvigorated wave of parliamentary questions surrounding research and outward mobility programmes. And the Royal Society published their analysis of Brexit’s harm to UK science research. Finally, Wonkhe dissect the mention of research funding within the Queen’s speech.

OfS Value for Money Strategy

I think I was expecting something new.  But no.  Read their news story here

According to a 2018 survey commissioned by the OfS, just 38 per cent of students believe their course offers good value for money.

The value for money strategy, published by the OfS today, identifies the ways in which the OfS will deliver better value for money for students and taxpayers – in line with the priorities identified in the 2018 student survey. The strategy also defines the OfS’s regulatory role in these areas and outlines how it will measure its success.

Among the priorities identified are:

  • improving teaching quality – over 90 per cent of students responding to the OfS survey felt that the quality of teaching, assessment and feedback are very important in demonstrating value for money
  • promoting transparency around fees and funding – 88 per cent of respondents said that seeing a breakdown of how fees are spent would be helpful in judging value
  • protecting students as consumers and improving consumer information – 24 per cent said they were not informed or prepared for the level of costs that came with being a student
  • securing positive employment outcomes – 65 per cent of respondents said getting a job and earning more were important factors in judging value for money.

The OfS will continue to survey students and graduates to measure student perceptions of value for money, the outcomes of which will form one measure of its progress in this area. The OfS will also consider measures of student experience and outcomes, including the National Student Survey, the Graduate Outcomes Survey, and data on graduate earnings.

The actual strategy is here but you’ve pretty much got it in the bullets above.

This is their definition of value for money:

  • Students receive value for money when they experience the full benefits of higher education – both during their studies and afterwards – in exchange for the effort, time and money they invest.
  • Taxpayers receive value for money when higher education providers use public money and student fees efficiently and effectively to deliver graduates, from all backgrounds, who contribute to society and the economy.

In the document, they also say:

  • We recognise that value for money means different things to different students. Tracking students’ perceptions of the value for money of their education will allow us to monitor progress without imposing our own definition on students.

So they are going to measure something that is not defined, when they know it means different things to different people at different stages?  And if it doesn’t improve they will hold universities to account for not improving something that is not defined? Is that unreasonable?

To be fair, they are also going to

  • assess value for money for students and taxpayers by analysing data on the benefits that have been delivered – for example positive student outcomes – and comparing this with data on the costs incurred”.

And this:

  • While our focus is on student outcomes, we make sure that providers use any income from taxpayers appropriately in delivering these outcomes. Providers receiving funding from the OfS or UK Research and Innovation (UKRI) must comply with our conditions of registration. This includes demonstrating that they have adequate and effective arrangements in place to manage public money appropriately and in accordance with the principle of value for money – it must be used economically, efficiently and effectively. These requirements apply even if a provider passes funds to another entity to deliver teaching or research. We will issue further guidance for providers about how they can meet these requirements.
  • We collect Transparent Approach to Costing (TRAC) data from providers in receipt of OfS funding to establish the cost of their various activities18. The data is benchmarked so providers can understand the cost of their activities in comparison with other similar providers. This helps them to determine where they can improve the value for money they offer to students and taxpayers.

How is BEIS getting on?

The National Audit Office has published a Departmental Overview for BEIS, describing what it does, its spending, recent and planned changes, and what to look out for across its main business areas and services. A summary of their overview prepared by Dods is below – it acts a good lookahead for certain projects and the likelihood of targets being met.

Specifically of interest are details on delivering an industrial strategy and investing in science, research and innovation. It recommends keeping an eye on whether the Department is stimulating additional investment from private sector companies in research and development to support the government’s target of spending 2.4% of GDP on research and development by 2027. This has been a key area of concern, given that the uplift required from Government to reach 2.4% without private sector support would be huge. It is widely expected that reaching 2.4% will rely very heavily on private sector investment. Key developments identified in this area are as follows:

Industrial Strategy Challenge Fund

  • The Industrial Strategy Challenge Fund is a key part of the government’s Industrial Strategy. The Fund, which is administered by UKRI, provides investment in projects that seek to address the grand challenges. The Fund is organised in waves.
  • In 2018-19, £325 million was invested across Waves 1 and 2. The Fund is also a key part of the government’s aim for 2.4% of GDP to be spent on research and development by 2027.

Productivity review

  • In May 2018, the Department launched a call for evidence to review the actions that could be most effective in improving the productivity and growth of small and medium-sized businesses. The Department has yet to publish the results of its review.

Things to look out for:

  • How the Department is monitoring the progress of the projects that were awarded funding through the Industrial Strategy Challenge Fund, and the extent to which they help to address the four grand challenges.
  • Whether government support is stimulating additional investment from private sector companies in research and development to support the government’s target of spending 2.4% of GDP on research and development by 2027.
  • Whether the Department and other government departments are coordinating effectively to deliver the Industrial Strategy, including the actions taken by the Industrial Strategy Council.

The report outlines the 5 objectives of the Department:

  1. Deliver an ambitious industrial strategy; increase UK economic performance and earning power, whilst promoting scientific innovation and local growth.
  2. Maximise investment opportunities; increase investment and employment following Brexit and maintain business and investor confidence amidst deal preparations/ exiting the EU.
  1. Promote competitive markets and responsible business practices; Secure better outcomes for consumers by creating a more competitive environment for businesses and improve corporate governance.
  1. Ensure the UK has a reliable, low-cost and clean energy system; Provide clean, secure and affordable energy supplies for consumers and businesses and support clean growth and promote global action on climate change .
  1. Build a flexible, innovative, collaborative business-facing department; Elevate the Department to an exceptional standard and enable digital, data and technology to deliver services for staff, people and businesses.

Education Statistics

The DfE have released lots of statistics

  • Destinations of KS4 and 16 to 18 KS5 students (2018) remains static with 94% of pupils were in sustained education, employment or apprenticeships in the year after key stage 4, unchanged from 2016/17. Overall, 88% of students (who took mainly level 3 qualifications) went to a sustained education, apprenticeship or employment destination. Students taking qualifications at level 2 and below were less likely to have a sustained destination overall. However, they were more likely to enter apprenticeships and employment.
  • A level and other 16 to 18 results (2018) – A level attainment increased for students at the end of 16-18 study in comparison to 2018.

A schools funding announcement was also made this week.

Other news

Brain retain: An early day motion in Parliament congratulated Glasgow which resume.io have recognised as the top graduate destination.

Commuter Students: HEPI have a blog on commuter students arguing that a student centred model is essential for both residential and commuter students. However, the blog, written by the VC of Manchester Met says three overarching strands of support would compensate commuter students for their lack of residential experience:

  • The first is to ensure that we use data on the journey of individual students to inform the support that we give them. We are investing in a Student Journey Transformation Programme that aims to ensure we have a clear picture of each student and their needs. The approach uses technology in an innovative way to support students and enable staff to identify any potential issues at an early stage.
  • The second dimension is campus design, where even simple things such as lockers can make a difference. Lockers mean commuter students do not have to carry around a day’s worth of materials. This removes a practical barrier to taking part in activities and events. Access to plug sockets means they can charge laptops and phones, supporting them to work on campus.
  • We are also working to provide more areas for students to spend time between timetabled sessions and to build their academic community. If the only options are studying in the library or sitting in a catering outlet where there is an expectation to buy something, there is a greater likelihood that students will drift off campus.
  • Thirdly, clear, sensible timetabling helps students plan their week, including travel, work and family commitments. While we have long provided personalised timetables for each student, we are looking at what more we can do. In one faculty, we have identified programmes with high numbers of students with caring responsibilities and scheduled lectures for a restricted number of days with start and finish times that accommodate these responsibilities. We need to understand the effects of this pilot, especially how well it supports students, before extending it.

Student Carers: Wonkhe have a new blog: Carers need more visibility in HE.

Student Votes: Wonkhe detail a piece by i News reporting that the number of students and young people registered to vote has spiked by around 50 per cent when compared to a similar period before the last general election.

Apprenticeships/Disability: HEPI have a blog on the new apprenticeship system and whether it works for disabled students.

Trust: The OfS blog on how leaders can rebuild public trust.

Lecture alternatives: The Wonkhe blog Is the lecture dead? considers an alternative learning model.

Subscribe!

To subscribe to the weekly policy update simply email policy@bournemouth.ac.uk

JANE FORSTER                                            |                       SARAH CARTER

Policy Advisor                                                                     Policy & Public Affairs Officer

Follow: @PolicyBU on Twitter                   |                       policy@bournemouth.ac.uk

 

HE policy update for the w/e 1st September 2017

We continue our series of summer updates focussing on themes rather than news with a look at learning gain.  We have updates on the Industrial Strategy Bell review of Life Sciences, and an update on the TEF from UUK.

Learning Gain

Learning gain has become a potential hot topic for universities over the last year – could it be the magic bullet for problems with TEF metrics?  Why is it a policy issue and what are the implications of the policy context for universities and students?  Wonkhe recently published a helpful summary in July by Dr Camille B. Kandiko Howson, from Kings College.

Background – TEF – The Teaching Excellence Framework (TEF) includes learning gain alongside student outcomes more generally as one of its three main criteria for assessing teaching excellence (the others are teaching quality and learning environment).  The relevant TEF criteria are:

Student Outcomes and Learning Gain  
Employment and Further Study (SO1) Students achieve their educational and professional goals, in particular progression to further study or highly skilled employment  
Employability and Transferrable Skills (SO2) Students acquire knowledge, skills and attributes that are valued by employers and that enhance their personal and/or professional lives
Positive Outcomes for All (SO3) Positive outcomes are achieved by its students from all backgrounds, in particular those from disadvantaged backgrounds or those who are at greater risk of not achieving positive outcomes

Further definition was given in the “Aspects of Quality” guidance (see the TEF guidance issued by HEFCE):

Student Outcomes and Learning Gain is focused on the achievement of positive outcomes. Positive outcomes are taken to include:

  • acquisition of attributes such as lifelong learning skills and others that allow a graduate to make a strong contribution to society, economy and the environment,
  • progression to further study, acquisition of knowledge, skills and attributes necessary to compete for a graduate level job that requires the high level of skills arising from higher education

The extent to which positive outcomes are achieved for all students, including those from disadvantaged backgrounds, is a key feature. The distance travelled by students (‘learning gain’) is included”.

And it goes on:

  • Work across the sector to develop new measures of learning gain is in progress. Until new measures become available and are robust and applicable for all types of providers and students, we anticipate providers will refer to their own approaches to identifying and assessing students’ learning gain – this aspect is not prescriptive about what those measures might be.”

The TEF guidance issued by HEFCE included examples of the sorts of evidence that universities might want to consider including (amongst a much longer list):

  • Learning gain and distance-travelled by all students including those entering higher education part-way through their professional lives
  • Evidence and impact of initiatives aimed at preparing students for further study and research
  • Use and effectiveness of initiatives used to help measure and record student progress, such as Grade Point Average (GPA)
  • Impact of initiatives aimed at closing gaps in development, attainment and progression for students from different backgrounds, in particular those from disadvantaged backgrounds or those who are at greater risk of not achieving positive outcomes.

TEF Assessment – If you have been following the debates about the TEF in Year 2 (results now published), you will be aware that the assessment of institutions against these criteria was done in two ways – by looking at metrics (with benchmarking and subdivision into various sub-sets), and by review of a written provider assessment.

  • The metrics that were used in TEF Year 2 for Student Outcomes and Learning Gain were from the Destination of Leavers from Higher Education survey (DLHE), specifically the DLHE declared activity 6 months after graduation – were they in employment of further study, and if in employment, was it “highly skilled” as defined by SOC groups 1-3 (managerial and professional).
  • So the metrics used in Year 2 of TEF do not cover learning gain at all. In fact they only really relate to SO1 above, are of limited use in terms of employability for SO2. DLHE doesn’t measure employability, only employment. Of course, DLHE is being replaced, after major consultations by HESA throughout 2016 and 2017 with the new Graduate Outcomes survey, which will take a longer-term view and look at a broader range of outcomes. (read more in our Policy Update of 30th June 2017).
  • So for the TEF year 2, any assessment of learning gain was done through the written submissions – and as noted above there are no measures for this, it was left to providers to “refer to their own approaches to identifying and assessing students’ learning gain”.

Universities UK have published their review of Year 2 of the TEF (see next section below) which includes a strong endorsement from UUK members for a comparative learning gain metric in future iterations of the TEF.

Measuring Learning Gain – As referred to above, there is a HEFCE project to look at ways of measuring learning gain.

They are running 13 pilot projects:

  • careers registration and employability initiatives – this  uses surveys and is linked most closely to SO2 – employability
  • critical-thinking ‘CLA+’ standardised assessment tool – also uses the UK Engagement Survey (UKES). CLA+ is a US assessment that is done on-line and asks students to assess data and evidence and decide on a course of action or propose a solution. As such, it measures general skills but is not subject specific.
  • self-efficacy across a range of disciplines
  • skills and self-assessment of confidence measures
  • a self-assessment skills audit and a situational judgement test
  • HE in FE
  • A multi-strand one: standardising entry and exit qualifications, new measures of critical skills and modelling change in learning outcomes
  • a project that will analyse the Affective-Behaviour-Cognition (ABC) model data for previous years
  • research skills in 6 disciplines
  • psychometric testing
  • learning gain from work-based learning and work placements
  • a project evaluating a range of methodologies including degree classifications, UKES, NSS, Student Wellbeing survey and CLA+
  • employability and subject specific learning across a range of methods – includes a project to understand the dimensions of learning gain and develop a way to measure them, one to look at R2 Strengths, one to look at career adaptability and one looking at international experience.

These are long term (3 year) projects – HEFCE published a year 1 report on 6th July 2017 – you can read more on our 14th July policy update – this flags a couple of challenges including how to get students to complete surveys and tests that are not relevant to their degree (a problem also encountered by the UKES). The report suggests embedding measurement “in the standard administrative procedures or formal curriculum” – which means a survey or test through enrolment and as part of our assessment programme.

To become a core TEF metric there would need to be a national standard measure that was implemented across the sector. That means that have to be mass testing (like SATs for university students) or another national survey alongside NSS and the new Graduate Outcomes survey (the replacement for DLHE) – with surveys on enrolment and at other points across the lifecycle.

Some BU staff are taking a different approach – instead of looking at generic measures for generic skills they have been looking at measuring specific learning gain against the defined learning outcomes for cohorts of students on a particular course. This is a much more customised approach but the team have set some basic parameters for the questions that they have asked which could be applied to other courses. The methodology was a survey. (Dr Martyn Polkinghorne, Dr Gelareh Roushan, Dr Julia Taylor) (see also a more detailed explanation, March 2017)

Pros, cons and alternatives

In January 2016, HEPI published a speech delivered in December 2015 by Andreas Schleicher, Director for Education and Skills, and Special Advisor on Education Policy to the Secretary-General at the Organisation for Economic Co-operation and Development (OECD) in Paris. In the speech, the author argues strongly for institutions worldwide to measure and use learning gain data. He supports the use of specific measures for disciplines although points out the difficulties with this – not least in getting comparable data. So he also focuses on generic skills – but he doesn’t suggest a specific methodology.

An HEA presentation from December 2016 mentions a number of inputs that “predict both student performance and learning gains” – including contact hours, class size (and a host of other things including the extent and timing of feedback on assignments).

It is worth looking quickly at GPA (Grade Point Average) as this is also mentioned in the TEF specification as noted above. The HEA are looking at degree standards for HEFCE now, having done a pilot project on GPA in 2013-14.  The report notes that “potential capacity to increase granularity of awards, transparency in award calculations, international recognition and student engagement in their programmes”. The summary says, “The importance to stakeholders of a nationally-agreed, common scale is a key finding of the pilot and is considered crucial for the acceptance and success of GPA in the UK”, and that “The pilot providers considered that the development of widespread stakeholder understanding and commitment would require clear communication to be sustained over a number of years.”

Wonkhe have a round up on the background to the GPA debate from June 2016,

Although the big focus for the TEF was on outputs not inputs, the Department for Education has announced that it will start to look at including some of the inputs. See our HE policy update for 21st July where we look at the new teaching intensity measure that will be part of the subject level TEF pilots. You can read more about this in a THE article from 2nd August:

  • The pilot “will measure teaching intensity using a method that weights the number of hours taught by the student-staff ratio of each taught hour,” explains the pilot’s specification, published by the Department for Education“. Put simply, this model would value each of these at the same level: two hours spent in a group of 10 students with one member of staff, two hours spent in a group of 20 with two members of staff, one hour spent in a group of five students with one member of staff,” it explains. Once contact hours are weighted by class sizes, and aggregated up to subject level, those running the pilot will be able to calculate a “gross teaching quotient” score, which would be an “easily interpretable number” and used as a “supplementary metric” to inform subject-level assessments”.

The contact hours debate is very political – tied up with concerns about value for money and linked to the very topical debate on fees (speech on 20th July by Jo Johnson .and see our HE Policy Update for 21st July 2017)

This is all very interesting when, as mentioned above, the TEF specification for year two put so much emphasis on measuring outcome and not just inputs: “The emphasis in the provider submission should be on demonstrating the impact and effectiveness of teaching on the student experience and outcomes they achieve. The submission should therefore avoid focusing on descriptions of strategies or approach but instead should focus on impact. Wherever possible, impact should be demonstrated empirically. “

Experts and evidence – There will be a real push from the sector for evidence that the new teaching intensity measure and reporting of contact hours and other things really does make a difference to students before it is included in the TEF. The HEA’s position on this (2016) is a helpful summary of the debate about contact hours.

There is an interesting article in the HEPI collection of responses to the Green Paper in January 2016  from Graham Gibbs, former Professor at the University of Winchester and Director of the Oxford Learning Institute, University of Oxford, and author of Dimensions of quality and Implications of ‘Dimensions of quality’ in a market environment. He supports the use of learning gain metrics as a useful tool. He points out that “cohort size is a strong negative predictor of both student performance and learning gains”. He also adds “Russell Group Universities have comparatively larger cohorts and larger class sizes, and their small group teaching is less likely to be undertaken by academics, all of which save money but reduce learning gains”. He does not accept that contact hours, or institutional reputation (linked to high tariff entry and research reputation) impact learning gain.

There is an interesting article on the Higher Education Policy Institute (HEPI) website here written by the authors of an article that looked at class size.

Impact so far – So what happened in the TEF – a very quick and incomplete look at TEF submissions suggests that not many institutions included much about learning gain (or GPA) and those that did seem to fall into two categories – those participating in the pilot who mention the pilot, and some who mention it in the context of the TEF core data – e.g. Birmingham mention their access project and learning gain (but don’t really evidence it except through employment and retention). Huddersfield talk about it in the context of placements and work experience but again linked to employment outcomes, although they also mention assessment improvement.

Teaching Excellence Framework (TEF) – year 2 review

Universities UK have published their review of Year 2 of the TEF following a survey that UUK did of their members.

The key findings from the report are:

  • There appears to be general confidence that overall process was fair, notwithstanding the outcomes of individual appeals. Judgements were the result of an intensive and discursive process of deliberation by the assessment panel. There was a slight correlation between TEF results, entry tariff and league table rankings.
  • It is estimated that the cost of participating in the TEF for 134 higher education institutions was approximately £4 million. This was driven by the volume of staff engagement, particularly senior staff.
  • Further consideration will need to be given to how the TEF accounts for the diversity of the student body, particularly part-time students, and how the TEF defines and measures excellence. [UUK also raises a concern about judgements possibly being skewed by prior attainment]
  • If subject-level TEF is to provide students with reliable information it must address the impact of increased metric suppression [this relates to metrics which could not be used because of small numbers, particularly for part-time students and for the ethnicity splits], how judgments are made in the absence of data [particularly an issue for those institutions affected by the NSS boycott], the comparability of subject groupings and the increase in cost and complexity of submissions and assessment.

[To address the issue with suppression, the report noted that the splits for ethnicity will be reduced from 6 to 3 for subject level TEF (p35)]

These findings also suggest that if the TEF is to make an effective contribution to the ongoing success of the whole UK sector, the following issues would merit consideration as part of the independent review:

  • How the TEF defines and measures excellence in a diverse sector and supports development of teaching and learning practice.
  • The role that the TEF plays across the student decision-making process and the relationship with the wider student information landscape.
  • The process for the future development of the TEF and the role of the sector, including students and devolved nations.
  • The relationship between the TEF and quality assessment, including regulatory baselines and the Quality Code.

Figure 4 shows the data benchmarking flags received by providers at each award level – these two charts are interesting because they show that providers with negative flags still received gold (and silver).

The survey also asked about future developments for the TEF with learning gain being a clear leader – ahead of teaching intensity. HEFCE is running learning gain pilots, as discussed above, and teaching intensity will be the subject of a pilot alongside subject level TEF. Interestingly, on p 33 a chart shows that nearly 70% of respondents believed that “there is no proportionate approach for producing a robust subject level TEF judgement which will be useful for students”.

Industrial Strategy

Following our update on the Industrial Strategy last week there are a couple of updates. Innovate UK has announced funding for businesses to work on innovative technologies, future products and services. The categories link closely to the Industrial Strategy priorities including digital technologies, robotics, creative economy and design and space applications as well as emerging technologies and electronics.

There was also an announcement about funding for innovative medicines manufacturing solutions.

Sir John Bell has published his report for the government on Life Sciences and the Industrial Strategy. There are seven main recommendations under 4 themes, which are summarised below. You can read a longer summary on the BU Research Blog.

Some interesting comments:

  • The key UK attribute driving success in life sciences is the great strength in university-based research. Strong research-based universities underpin most of the public sector research success in the UK, as they do in the USA and in Scandinavia. National research systems based around institutes rather than universities, as seen in Germany, France and China, do not achieve the same productivity in life sciences as seen in university-focussed systems.” (p22)
  • “The decline in funding of indirect costs for charity research is coupled to an increasing tendency for Research Councils to construct approaches that avoid paying indirect Full Economic Costs (FEC). Together, these are having a significant impact on the viability of research in universities and have led to the institutions raising industrial overhead costs to fill the gap. This is unhelpful.” (p24)
  • “It is also recommended, that the funding agencies, in partnership with major charities, create a high-level recruitment fund that would pay the real cost of bringing successful scientists from abroad to work in major UK university institutions.” (see the proposal to attract international scientists below).
  • On clusters “Life sciences clusters are nearly always located around a university or other research institute and in the UK include elements of NHS infrastructure. However, evidence and experience suggests that governments cannot seed technology clusters and their success is usually driven by the underpinning assets of universities and companies, and also by the cultural features of networking and recycling of entrepreneurs and capital.” And “Regions should make the most of existing opportunities locally to grow clusters and build resilience by working in partnership across local Government, LEPs (in England), universities and research institutes, NHS, AHSNs, local businesses and support organisations, to identify and coalesce the local vision for life sciences. Science & Innovation Audits, Local Growth Funds and Growth Hubs (in England), Enterprise Zones and local rates and planning flexibilities can all be utilised to support a vision for life sciences. “ (see the proposal on clusters under “Growth and Infrastructure” – this was a big theme in the Industrial strategy and something we also covered in our Green Paper response)
  • On skills: “ The flow of multidisciplinary students at Masters and PhD level should be increased by providing incentives through the Higher Education Funding Council for England.2 and  “Universities and research funders should embed core competencies at degree and PhD level, for example data, statistical and analytical skills, commercial acumen and translational skills, and management and entrepreneurship training (which could be delivered in partnership with business schools). They should support exposure to, and collaboration with, strategically important disciplines including computer and data science, engineering, chemistry, physics, mathematics and material science.”

Health Advanced Research Programme (HARP) proposal – with the goal to create 2-3 entirely new industries over the next 10 years.

Reinforcing the UK science offer 

  • Sustain and increase funding for basic science to match our international competition – the goal is that the UK should attract 2000 new discovery scientists from around the globe
    • The UK should aim to be in the upper quartile of OECD R&D spending and sustain and increase the funding for basic science, to match our international competitors, particularly in university settings, encouraging discovery science to co-locate.
    • Capitalise on UKRI to increase interdisciplinary research, work more effectively with industry and support high-risk science.
    • Use Government and charitable funding to attract up to 100 world-class scientists to the UK, with support for their recruitment and their science over the next ten years.
  • Further improve UK clinical trial capabilities to support a 50% increase in the number of clinical trials over the next 5 years and a growing proportion of change of practice and trials with novel methodology over the next 5 years.

Growth and infrastructure – the goal is to create four UK companies valued at >£20 billion market cap in the next ten years.

NHS collaboration – the Accelerated Access Review should be adopted with national routes to market streamlined and clarified, including for digital products. There are two stated goals:

  • NHS should engage in fifty collaborative programmes in the next 5 years in late-stage clinical trials, real world data collection, or in the evaluation of diagnostics or devices.
  • The UK should be in the top quartile of comparator countries, both for the speed of adoption and the overall uptake of innovative, cost-effective products, to the benefit of all UK patients by the end of 2023.

Data – Establish two to five Digital Innovation Hubs providing data across regions of three to five million people.

  • Create a forum for researchers across academia, charities and industry to engage with all national health data programmes.
  • Establish a new regulatory, Health Technology Assessment and commercial framework to capture for the UK the value in algorithms generated using NHS data.
  • Two to five digital innovation hubs providing data across regions of three to five million people should be set up as part of a national approach and building towards full population coverage, to rapidly enable researchers to engage with a meaningful dataset. One or more of these should focus on medtech.
  • The UK could host 4-6 centres of excellence that provide support for specific medtech themes, focussing on research capability in a single medtech domain such as orthopaedics, cardiac, digital health or molecular diagnostics.
  • National registries of therapy-area-specific data across the whole of the NHS in England should be created and aligned with the relevant charity.

Skills

  • A migration system should be established that allows recruitment and retention of highly skilled workers from the EU and beyond, and does not impede intra-company transfers.
  • Develop and deliver a reinforced skills action plan across the NHS, commercial and third sectors based on a gap analysis of key skills for science.
    • Create an apprenticeship scheme that focuses on data sciences, as well as skills across the life sciences sector, and trains an entirely new cadre of technologists, healthcare workers and scientists at the cutting-edge of digital health.
    • Establish Institutes of Technology that would provide opportunity for technical training, particularly in digital and advanced manufacturing areas.
    • There should be support for entrepreneur training at all levels, incentivising varied careers and migration of academic scientists into industry and back to academia.
    • A fund should be established supporting convergent science activities including cross-disciplinary sabbaticals, joint appointments, funding for cross-sectoral partnerships and exchanges across industry and the NHS, including for management trainees.
    • High quality STEM education should be provided for all, and the government should evaluate and implement additional steps to increase the number of students studying maths to level 3 and beyond.

JANE FORSTER                                                             |                               SARAH CARTER

Policy Advisor                                                                                               Policy & Public Affairs Officer

65111                                                                                                              65070

Follow: @PolicyBU on Twitter                      |                               policy@bournemouth.ac.uk

 

HE policy update w/e 16th June 2017

New Parliament – On Monday we sent out a special edition policy update to keep you current on the political arrangements as the new government is formed. If you missed it you can read it here. Locally, all the incumbents were re-elected, meaning the whole of Dorset continues to be represented by Conservatives. A breakdown of the local MPs, the profile of their vote share, and current political interest areas is available here. It has now been confirmed that the Queen’s Speech and state opening of Parliament will take place on Wednesday 21 June. Since Monday’s update it has been confirmed that Jo Johnson remains in post as Universities Science Research and Innovation Minister. Anne Milton is the new Apprenticeships and Skills Minister. Locally Tobias Ellwood will move to the Ministry for Defence.

  • Student voting preferences: YouGov’s post-election poll states that 64% of full time students voted Labour, 19% for Conservatives, 10% Lib Dems. For graduates Labour got 49% and Conservatives 32%.
  • Effect of age: The survey states that young turnout was not as high as the media initially reported – 59% of 20-24 year olds voted. The survey highlights that age is a new dividing line in British politics. For every 10 years older a voter is, the likelihood they will vote Conservative increases.
  • Effect of education: The survey reports that education is also an electoral demographic divide with support. In the recent election support for the Conservatives decreased the more educated a voter was, with the reverse for Labour and the Lib Dems. Age is a factor, the young have more qualifications than the old, however YouGov report even accounting for this the Conservatives still have a graduate problem.

Longitudinal Education Outcomes (LEO) data – The full longitudinal education outcomes (LEO) data was released this week. It shows graduate earnings and employment outcomes from 2014/15 taking data from the students graduating 1, 3 and 5 years before 2014/15. The methodological of how the data measured prior attainment has changed and ethnicity identifiers have been removed from the dataset for this release. LEO will be published alongside the Key Information Set on Unistats. Wonkhe ran a live LEO blog on release day (BU got a mention) and have an assortment of articles discussing the LEO findings as well as university rankings for each subject area. Polar data is available so comparison of the class effect on graduate earnings is possible even at a subject level. BU is generally positioned well within the LEO data, which is consistent with our DLHE outcomes data.

Gender pay gaps: Wonkhe reported on the first trial release of LEO data highlighting that the pay gap between women and men is visible from graduation. Wonkhe have explored this gender pay gap through the full LEO dataset released this week. Their new article identifies that, while the gender gap remains, subject area has an affect and where there are lower numbers of men than women on a subject, e.g. nursing, the men outperform the women’s pay by an even greater margin. The article questions whether universities are failing to prepare women to enter the most well-paying graduate jobs, and failing to encourage women’s aspirations on the same par as men. The article also anticipates that when the pay data can be cut by ethnicity that further gender racial divides will been seen. The Guardian also report on the gender pay gap.

Brexit – residency rights for EU citizens wishing to remain in the UK post Brexit are not as black and white as it seems. This report from Migration Watch UK on the EC’s negotiating position explores the shades of grey. There are ongoing rumours of pressure to soften the approach to Brexit but no indication of it – the formal negotiations with the EU start on Monday.

Higher Education and Research Act (HERA) – With Jo Johnson, Justine Greening and Greg Clark’s continuation of their cabinet roles the sector anticipates that both TEF and the HE and Research Act will move forward with more certainty now. UUK have published a briefing on the implementation of the Higher Education and Research Act 2017. UUK remain positive in their approach to the act whilst acknowledging the potential risk to institutional autonomy. The act replaces HEFCE with the OfS, establishes the combined UKRI, and begins to establish the new regulatory system for the sector. UUK call for universities to engage and influence how OfS and UKRI approach their remit and to consider the implications of these split bodies with reference to the relationship between teaching and research within universities.

Regulation: The sector will be regulated through the register of HE providers. The OfS can vary the conditions applied to providers (as the pool of providers will be wider) and requirements relating to access and participation. A technical consultation on registration fees is expected during autumn 2017. Student protection plans will be a requirement of registration, including transparency in enabling provision for student transfers. The OfS will consult on whether there are appropriate bodies that could perform quality assessment and data collection in advance of April 2018 and that would command the confidence of the sector.

Teaching quality: During amendment through parliament conditions of registration relating to quality and standards of teaching meant conditions should relate to sector recognised standards. The detail and ownership the sector will have over the definition of standards is unclear. However, amendments within the Lords ensured that ‘quality’ and ‘standards’ should be properly defined and separate and the independent ability of institutions to set their own standards was protected. The UK-wide standing committee on quality assessment is working to coordinate a shared regulatory baseline and is also reviewing how the quality code, including standards, may need to evolve in the context of the new regulations. HEFCE is also expected to conduct a review of the Annual Provider Review in the autumn.

Degree awarding powers: will be subject to independent quality advice from either the designated quality body or an independent committee, and replicates much of the role of the QAA’s Advisory Committee on degree awarding powers (Section 46). A consultation on how the OfS should exercise its new powers, including ‘probationary’ degree awarding powers, and the removal of degree awarding powers is expected. There are additional conditions to be met before OfS can vary or revoke degree awarding powers or university title, royal charters cannot be revoked in full. There is to be additional ministerial oversight of new providers without a validation track record. Amendment discussions secured tightened regulation around degree awarding powers and university title to protect both students and the sector reputation on sector entry for new providers.

Financial powers: OfS will have the ability to make grants or loans to a HE provider, replicating HEFCE’s powers to provider funding for high cost or strategic/vulnerable subjects. It’s likely any support for providers in financial difficulty would require DfE and Treasury input.

Fee limits & TEF: Fee limit changes require (active) approval by both Commons and Lords, even if the increase is below inflation. An approved access and participation plan is required. There are three levels of fee limits:

  • the higher amount which will ordinarily increase by inflation (LINKED TO TEF)
  • an intermediate cap LINKED TO TEF (but won’t be implemented before 2020)
  • a basic cap (currently set at £9,000)

Until the academic year 2020/21 all providers participating in TEF with approved access plans will be permitted to charge the full inflationary increase up to the higher amount. Before differential fees determined by TEF rating can be implemented an independent review of TEF must take place. The review would need to take place in winter 2018/19 for differential fees to be implemented in 2020/21. The review will cover:

  • the process by which ratings are determined under the scheme and the sources of statistical information used in that process
  • whether process and statistical information are fit for purpose in determining ratings under the scheme
  • the names of the ratings under the scheme and whether those names are appropriate
  • the impact of the scheme on the ability of higher education providers to which the scheme applies to carry out their functions (including in particular their functions relating to teaching and research)
  • an assessment of whether the scheme is in the public interest
  • any other matters that the appointed person considers relevant

Subject level TEF have been delayed by an additional year but will be piloted in 17/18 and 18/19.

UKRI: will operate from April 2018 and is expected to commence by drafting its research and innovation strategy in collaboration with the sector. Research England will have to consult on the terms and conditions attached to the quality-related funding it provides. The government must publish details of the funding provided to UKRI, the terms and conditions attached, and the amount granted to each of the seven councils. This is designed to give public oversight of the process, and to encourage responsible allocation of funding to the different councils. The dual support system will not be undermined. The Act enshrines the Haldane principle within the legislation ‘decisions on individual research proposals are best taken following an evaluation of the quality and likely impact of the proposals (such as a peer review process)’. UKRI should give equal regard to all nations of the UK.

Widening Participation – The Social Mobility Commission have published the Social Mobility Barometer surveying the public’s attitude towards UK social mobility. The Barometer is new and there will be follow up polls each year until 2021. It was run by YouGov. Press coverage: BBC; TES focus on the belief education will be better in the future.

  • 48% of the public believe that where you end up in society today is mainly determined by your background and who your parents are; 32% believe everyone has a fair chance to get on regardless of their background.
  • 79% believe that there is a large gap between the social classes in Britain today.
  • A large majority of people believe that poorer people are held back at nearly every stage of their lives – from childhood, through education and into their careers.
  • 71% believe opportunity is dependent on where a person lives (something the government’s intended Industrial Strategy aims to tackle)
  • Young people increasingly feel they are on the wrong side of a profound unfairness in British society. The report links this dissatisfaction with the recent election where record numbers of young people voted.
  • Personal finances, job security and housing are key issues.
  • 76% of the public say poorer people are less likely to attend a top university and 66% say poorer people have less opportunity for a professional career.

Fees and Funding

The House of Commons Library have published a clear briefing paper on HE funding in England. It covers the 2012/13 higher fee increase, removal of maintenance grants and student loan repayment threshold decisions. It also summarises the public spend on HE (within England) and the impact of student loans on the national debt.

Jane Forster                                   Sarah Carter

VC’s Policy Adviser                                    Policy & Public Affairs Officer