Higher Education and Research Bill

Lord Willetts Excerpts

Committee: 4th sitting (Hansard): House of Lords
Wednesday 18th January 2017 Lords Chamber

[Baroness Lister of Burtersett (Lab)]

My Lords, I do not think anybody is suggesting that universities should just be left to get on with it. I preface my remarks by saying how important I believe teaching to be. I went into higher education halfway through my working life. I had never taught, and I was shocked to discover there was nothing to train me how to teach: it was just assumed that an academic could relay their subject and teach it. That is completely different now. All universities have very good support to ensure that their staff teach well.

That said, I accept that it is important that there is some kind of assessment of teaching to balance the research assessment—the REF, as it is now called—to which my noble friend Lord Desai referred. REF is based on a direct assessment of the quality of the research; as I understand it, TEF will not be. I will not repeat the good critique that has been made by colleagues both now and at Second Reading of the metrics currently proposed, and I am not sure what the answer is. I can remember—I cannot remember in which year it was now—something called the TQA, or teaching quality assessment. I can remember quaking in my boots as some independent assessor came in to observe my lectures and tutorials. I am not sure what happened to it. It was a huge bureaucratic burden on the universities, so I am not saying that that is necessarily the answer. I am not sure what the answer is, but it is quite clear from what is being said in the sector, by students and people around the Committee that, as proposed, those metrics are not.

In his summing up, will the Minister explain exactly how he thinks the proposed metrics will tell us anything about actual teaching quality? What will be fed back to individual lecturers about their teaching? At Second Reading he said that,

“The TEF is designed to improve teaching”.—[Official Report, 6/12/16; col. 721]


How will it improve teaching? Will he explain that to us? If I were still lecturing, how would I know how to improve my teaching on the basis of the TEF and these metrics? It is not clear to me at all how that will happen.

Given the widespread disquiet and difficulties of doing this, will the Minister reflect on the likely adverse implications of this traffic light system, which the noble Lord, Lord Lucas, on Second Reading called a “ranking system for turkeys”? Perhaps that is appropriate in the consumer culture we are talking about, but it is not appropriate for education.

[Lord Willetts (Con)]

My Lords, I shall comment briefly on some of the remarks about the NSS and perhaps try to address some of the concerns and offer noble Lords on both sides of the Committee a bit of assurance about what is happening here.

I should begin by drawing attention to the fact that I am a visiting professor at King’s College London, which sadly scores rather low on the NSS. I will not detain the Committee with a special pleading of why I think that is a completely misleading picture of the excellent work done at King’s. I also chair the advisory board of the Times Higher, which itself produces university rankings.

Surely what we are trying to do is embark on a journey towards what should be reliable metrics of teaching quality and learning gain. Of course, we do not have those yet. The question is whether we do anything now or wait until we have these superior and trusted metrics. The dilemma that one faces is that, back in 2010, there really was only the NSS, and it has been caricatured as simply a question of a student’s kind of, “What’s it like for you?”. We have already seen changes in the NSS and, if I may get into the technical language, it is becoming much more like the National Survey of Student Engagement which does try to get closer to the academic experience of the student.

The measure that will be used in formulating the TEF is not the generic question, “How was it for you?”. My understanding is that that is not what will appear in the TEF. There will be the earlier questions in the NSS. The NSS has more than 20 questions, and incidentally is completed by hundreds of thousands of students. It is the earlier questions that are closest to engagement that will be the ones used in the TEF. They are particularly questions about teaching on their course and on assessment and feedback.

The noble Lord who spoke for the Opposition when he opened said there had been no evidence that anything had been getting better. I can tell him that the fact that many universities have done disappointingly badly on assessment and feedback has led universities to change their practice and give students much more prompt reactions on their essays or other forms of work than they used to receive. I would argue that assessment and feedback are regarded as having genuine value and significance in the world of universities. Those measures are the measures extracted from the NSS which will be part of the overall metric for the TEF. The others which I think will have higher weight are the learning environment and student outcomes.

These are not perfect measures. We are on a journey, and I look forward to these metrics being revised and replaced by superior metrics in the future. They are not as bad as we have heard in some of the caricatures of them, and in my experience, if we wait until we have a perfect indicator and then start using it, we will have a very long wait. If we use the indicators that we have, however imperfect, people then work hard to improve them. That is the spirit with which we should approach the TEF today.

[Lord Lipsey]

Before the noble Lord sits down, will he explain what consolation he will offer to those institutions which are put out of business, at worst, while we perfect the metric that is being used in this case?

[Lord Willetts]

There are genuine questions, including the impact on overseas students, and I understand that issue. But I think that it would not be possible to envisage fees increasing without some kind of measures of the teaching performance in universities.

Given the difficulty of getting any measures, my view is that the measures we have are the best ones currently available. I think that the message that should go out from your Lordships’ House is surely that we would see them improved, changed and reviewed—and improved rapidly. It would be particularly regrettable—I know that I am turning to a later stage in our debate—if we bring in measures, if we amend the legislation, to make future changes in the metrics harder rather than easier by requiring a more elaborate process for them to be changed in the future. I am absolutely not saying that we now have a reliable and authoritative measure of teaching quality.

[Baroness Royall of Blaisdon (Lab)]

My Lords, the noble Lord, Lord Willetts, said that we are embarking on a journey, which indeed we are, but I feel that the car in which we will travel does not yet have all the component parts. I therefore wonder if, when we have concluded all our debates, rather than going full speed ahead into a TEF for everybody who wants to participate, we should have some pilots. In that way the metrics could be amended quite properly before everybody else embarks on the journey with us.

I speak to the amendments in this grouping, many of which I support and I remind the House of my interest as a pro-chancellor at Bath University. Like all other noble Lords, I celebrate quality and excellence, and students should and must expect to receive high-quality teaching in their higher education. This should always have been the case, but is especially important now when students leave university with a debt of perhaps £50,000.

How the quality is measured and the metrics used are of the utmost importance, and it is clear from everything that has been said that the Government have not solved the conundrum yet. However, it is very good news that Chris Husbands is assisting the Government in this task. I have to say that Bath has one of the highest levels of student satisfaction, of which I am very proud. Much of that is down to good teaching. In 11 departments we have 100% satisfaction rates, which is great, but I also have to wonder that there must be some instances in some universities where students are completing the student satisfaction surveys in their rooms and possibly they have never even been to a lecture. That metric is slightly questionable.

I would be grateful if the Minister can say who will make the judgment in respect of what the metrics will be and who will judge each university that is part of the system? Those people are incredibly important.

While I support the TEF in general, whatever system is introduced must not be the traffic light system currently under consideration and it should not be linked to fees. The real problem is when the quality of teaching in a university is measured across the board. As the noble Lord, Lord Kerslake, said, excellence in some departments will be eclipsed by poor teaching in other departments and vice versa. Creating a system that assesses the quality of a whole institution and allows that whole institution to raise the fees of every course based on that assessment, when the quality of teaching will vary—potentially drastically—for every student at that institution, is therefore fundamentally unworkable. It risks creating the potential that students undertake courses that are not of high quality but at an institution that was deemed by the TEF to provide general high quality, and are therefore unfairly charged higher fees for poor-quality degrees. As has been said on all sides of the House, the bronze, silver and gold proposals are entirely inappropriate and fraught with difficulties, not least the potential for jeopardising the excellent international reputation of our universities. Why would a foreign student paying hefty fees wish to study at a bronze university, and why should our own students go to British universities that are deemed inadequate? Students who begin their degrees at a gold university that is judged to be silver or bronze at the end of the course would feel disillusioned and, literally, short-changed. Amendments 176, 177 and 195 are particularly interesting, and I hope that the Government will give them favourable consideration.