Higher Education and Research Bill

Debate between Viscount Hanworth and Lord Lipsey

Committee: 4th sitting (Hansard): House of Lords
Wednesday 18th January 2017 Lords Chamber

[Viscount Hanworth (Lab)]

My Lords, I should like to testify that there is something utterly perverse in the current system of rating the quality of the provisions of individual departments within universities and of universities as a whole. The system depends on the National Student Survey, which aims to determine the degree of customer satisfaction. Because the ratings of the NSS are determined within these organisations, and because they can make no reference to what is happening elsewhere, they cannot possibly serve as a valid standard for comparison across the sector.

The NSS is subject to the social dynamics of small groups of students, and it can produce highly variable results from year to year. It is well known that it can be strongly influenced by the interaction of staff with students. There is a strong temptation for academics to appeal to their students, in ways that may be more or less subtle, to give ratings that will be beneficial both to themselves and to their students. This has often swayed the outcomes. Quite apart from these difficulties in assessing the true degree of customer satisfaction, it is questionable whether customer satisfaction should be the principle to guide the provision of teaching. It is now a principle that also guides many other aspects of the provision to students. The quality of sports facilities, catering, entertainment and much else besides has been influenced by the need to increase student satisfaction.

However, the effects on teaching of an adherence to this principle can be dire. It has been a common experience that, the more difficult a course and the more vigorously it is taught, the lower is its NSS rating. University administrators, who nowadays control the activities of academic staff, have requested the removal of courses that have scored badly. Among such courses have been some of the essential STEM courses, which often form the backbones of academic disciplines. I propose that we cease to use the NSS as a basis for assessing the qualities of universities. We should cease to make such assessments, or to use them, until we can be sure of their validity.

[Lord Lipsey (Lab)]

My Lords, I chair the Trinity Laban Conservatoire of Music and Dance, which I think is a very effective conservatoire. On Monday night I was closeted with my board, making one of the most difficult decisions that as chairman I have faced: should we go in to the TEF, which I think is supposed to close in about a week’s time, or not? The situation was simple. None of us thinks anything of it, particularly because of the presence within it of the metric of the National Student Survey, on which I will say a bit more in a minute and a lot more in our next debate.

But if we did not go in for it, we would have £250 less per student to spend on teaching, on instruments and on bringing them up to our very high standard. The board decided to go ahead. I very much hope that, before we finish with the Bill, they will be shown to have been right for a different reason—because the Government have backed off from these really very ill-considered decisions.

Incidentally, I endorse what the noble Lord, Lord Kerslake, said about Chris Husbands: if there is a man who can sort out TEF, it is Chris, and we should wish him every power and a fair wind from Ministers at his back.

I am a bit of a statistician; I chair the All-Party Group on Statistics. I will go into this in more detail on a subsequent occasion, as I said, but the NSS seems to be a statistic that makes the statement on the side of the Leave buses an exemplar of statistical validity. It is just frightful. In particular, for a small institution such as mine, the sample sizes are tiny. It has had the most coruscating reviews from the Royal Statistical Society. The Office for National Statistics put it more cautiously but nevertheless said the same thing: you cannot use it to compare institutions—which is exactly what the gold, silver and bronze ratings do.

This is the first time that a piece of legislation for the post-fact era, where facts no longer matter, has made it to the statute book. It must be changed. Fortunately, it can relatively easily be changed, because I think we are all after the same thing: we are after a true measure of teaching effectiveness. I do not mean just whether students like it. At one stage, I joked to my board that I was thinking of withdrawing all music teaching at Trinity Laban and instead providing free beer in the bar every night. They would be jolly satisfied with the quality of their courses if they had free beer every night, but they would not be learning to play their instruments—which is bloody hard work, I can tell noble Lords who have not tried it. For that reason, this metric is dotty.

I have one or two other points to make. Information is very important in the new era. It is difficult enough to choose an institution now and, if the Government get their way and there is a proliferation of institutions, it will be more difficult in future for students to choose institutions. One thing that does not help is misinformation. We did not do terribly well in the National Student Survey this year. It was fine for me because I was able to say, as I had pointed out every year to the board, that the previous year had been completely different, because this number fluctuates almost completely randomly. But I had members of staff who were reduced to tears and considering resignation because we had a bad NSS score. Think how much more that will be so if it is incorporated into the midst of the TEF. Managers would then say, “You have a very bad NSS score, so we will do badly in the TEF, so we will have less grant”. The pressure will be enormous, crushing and based on wholly false information. We need proper information and a proper TEF based on the kind of assessment that Chris, with his team, is well capable of undertaking. New metrics are being developed that would help with this, although whether they will be available under the Government’s timetable is not yet clear.

We can get a TEF that works, which I would welcome. There are institutions that have not been as successful in their teaching as they have in other aspects of their work. If it fulfilled the Conservative election manifesto in the process, that is the sort of thing that we have to put up with in life. But please do not let us take this false step of a phony TEF that will reward only those who are good at gaming these things, not those who are doing what we really want: teaching well.