Technology Rules: The Advent of New Technologies in the Justice System (Justice and Home Affairs Committee Report)

Baroness Chakrabarti Excerpts

Monday 28th November 2022 Grand Committee

[Baroness Chakrabarti (Lab)]

My Lords, what an absolute honour to follow that contribution from the noble Baroness, Lady Sanderson of Welton. Your Lordships can imagine what the contribution her fabulous communication skills and powers of analysis made to the work that we did on this report. I now have the daunting privilege of being the last member of the recently constituted Justice and Home Affairs Committee to contribute. We have also had two expert contributions from a technology expert in the noble Lord, Lord Clement-Jones, and of course the noble and learned Lord, Lord Hope. I will try not to repeat too much but will add just a little framing and a few points of emphasis.

First—this is relevant beyond even the vital business of this report—I had never sat on one of the House of Lords’ select committees before, and it was and continues to be a wonderful experience. This was a perfect subject to examine with the rigour of a Lords Select Committee in a totally cross-party way. It feels almost odd now to be a few swords away from the noble Baroness, Lady Sanderson of Welton, and the noble Lord, Lord Hunt, because on the journey that we went on together on this committee, there was no significant partisanship at all. Rights and freedoms and the rule of law should not be a partisan issue. That was definitely my experience of being on the committee of the noble Baroness, Lady Hamwee—she chaired it with the elegance of a society host, the creativity of a film director and the rigour of a judge.

I was reading in the press just today some comments from the American computer science genius and polymath Jaron Lanier. He was talking about the rise of these technologies in general, not about the criminal justice system in particular, and he told the Guardian:

“People survive by passing information between themselves. We’re putting that fundamental quality of humanness through a process with an inherent incentive for corruption and degradation. The fundamental drama of this period is whether we can figure out how to survive properly with those elements or not.”


That is a comment on the rise of these very exciting new technologies in general but I suggest that, of all the spheres in which artificial intelligence and these new technologies are being employed, the criminal justice sphere is special. There are great potential benefits, as we have heard, but real dangers as well. Why are the criminal justice system and the ambit of the home department so special? It is because we are talking about people’s rights and freedoms. We are thinking about the right to life and to protect people, our communities and victims and potential victims, but we are also talking about the gravest rights, freedoms and liberties of the subject. That came through very clearly in both the evidence to and the private deliberations of our committee.

I remind noble Lords that it was just over 40 years ago that, in response to the Brixton riots in this city, Lord Scarman produced his report because there was a crisis of trust and confidence in policing in so many of our communities. Not long after that legendary Scarman report, a Conservative Thatcher Government produced the Police and Criminal Evidence Act 1984. There was inevitably some controversy attached to it but, none the less, I would consider it a piece of human rights legislation, because it attempted to set a framework of principles and law for governing police power.

We would not dream today of rescinding or repealing that Act. It has been amended, but it is still on the statute book. The idea is that police power, while essential, needs to be regulated and consolidated in one place. Of course, new and intrusive technologies have emerged. The PACE codes have had to be updated and the legislation itself has been amended, but some basic principles and ideas of accessibility and transparency in the use of intrusive police power hold still, over 40 years later.

I do not believe that noble Lords and Ministers would dream of rescinding that, and nor should the Government think that such a framework is not needed today in relation to these new powers—these powers which we cannot even see being used, or understand, because they are effectively in a black box, or in a jar in the form of the pill but I cannot say what is in the pill that I am taking. That is why regulation and framework legislation is required.

It is simply not enough to rely on the current arrangement of broad police discretion and the occasional police witness to our committee or some other forum to say, “Oh, but you know: proportionality”. We are compliant with human rights proportionality as it if is a mantra. That is not detailed enough for regulation. It would not be detailed enough for powers of arrest and it certainly would not be detailed enough for the use of drugs. We need to get into the black box: we need to prescribe it and to decide what is legitimate and proportionate in the use of this technology and its design. Legislation is absolutely essential to avoid what the noble Baroness, Lady Sanderson of Welton, called the Wild West—because that is exactly where we are now in the use of this technology in the criminal justice system and, to some extent, at the border in relation to its intrusive use.

In addition to this framework legislation—the Police and Criminal Evidence Act and an AI Act for the 21st century—we need a national body that will do the prescription and kitemarking. There is no doubt that we need this because of the black box. Lay citizens and even parliamentarians cannot understand the technologies, read and decipher the algorithms, and understand whether coded bias is being baked in—which is happening.

I commend the Netflix documentary on facial technology that features the noble Baroness, Lady Jones of Moulsecoomb, from this House. It is a wonderful documentary. I hope that noble Lords, Ministers and their officials—who are passing them notes, probably saying “Yes, it’s a great documentary”—will watch it.

Kitemarking is essential before any procurement of these technologies and algorithms within the criminal justice system. It should not be left to local police officers, or even PCCs, to have lunch with some people who are selling their wares and decide what is a good deal or not.

In addition to the kitemarking of the product, there is a great opportunity for His Majesty’s Government and the United Kingdom in going down the road being advocated in our report. We could be world leaders in the kitemarking and regulation of this technology. In years to come, if we take up the recommendations from this committee, there could be countries all over the world that say, “We go for the UK AI in criminal justice model”. It is the equivalent of saying they want to contract in English law or in Delaware law, or whatever it is. This technology is being developed and used all over the world, and if we get ahead of the kitemarking and regulation game, others may contract into our arrangements and adopt our technologies and systems over time.

It is completely without justification, it seems to me, for private companies to be experimenting on our populations, including with their intimate data and with policing and intelligence and so on, and then claiming that they will not engage with transparency or legality because of commercial sensitivities. That is a swindle and a scandal, and it needs to end. We would not allow arms companies or drugs companies to behave this way; we certainly should not be allowing it in these deals that are being done in the 43 forces with these people in the Wild West—I will not say who it is that rides around on horses in the Wild West, but the point is made.

To conclude, we are just asking for this technology to be governed by the rule of law, for Parliament to step up and, crucially, for Ministers to step up, as their predecessors did in the Thatcher Government in the 1980s in response to the Brixton riots and the Scarman report. Only this time, we are asking that this be done before a scandal and before a crisis of confidence that reaches the kind of levels where it will be harder to use the technology in a positive way in the future.