How the Government can improve its use of artificial intelligence

by Peter Griffin / 12 June, 2019
Photo/Getty Images

Photo/Getty Images

RelatedArticlesModule - Artificial intelligence nz government

Our use of AI for problem-solving is okay so far, but the Government needs to do better.

Here’s the good news about our government departments’ use of artificial intelligence (AI): they haven’t massively screwed up, so far. But they could if they continue with what researchers describe as a “piecemeal” approach to the use of computer algorithms to automate systems and, more importantly, make predictions that could affect our lives.

There’s a lot of hype about predictive algorithms, but they are nothing new to government. The RoC*RoI predictive model, developed by Department of Justice senior psychologists more than 25 years ago, is used to predict criminals’ risk of reconviction and risk of imprisonment.

It is fairly uncontroversial. A computer algorithm, fed basic social and demographic details and an individual’s criminal history, consistently outperforms the judgments of trained experts when it comes to picking whether a person is likely to reoffend or end up back in prison.

But as the mountain of data we generate grows, the Government is naturally tempted to break down the departmental silos in which information has traditionally been kept and put it all together to give a more complete picture of each person.

We shouldn’t necessarily fear that. The data-driven approach, Bill English’s “social investment”, could lead to better provision of taxpayer services, better-functioning health and social welfare systems and the fairer sharing of wealth.

But as a group of University of Otago researchers note in a newly released Law Foundation-funded report, we need a stronger focus on “accuracy, transparency, control and bias” when designing and deploying algorithms across government.

A stocktake by the Department of Internal Affairs and Statistics NZ last year revealed that 32 algorithms were being used in 14 government agencies. They include Neet (Not in Education, Employment or Training), the Ministry of Social Development’s predictive modelling tool to identify school leavers who may be at greater risk of long-term unemployment, and ACC’s system for automating compensation claims that leaves staff only a few to process manually.

So far, so good. But there’s no independent audit of how accurate these algorithms are and whether they are less biased than the humans who would otherwise be making decisions about us. There’s no system to question the outcome of an algorithm-generated decision to see what factors were considered.

We need to get our house in order. But we have an advantage here.

James Maclaurin. Photo/Supplied

“Unlike some countries that use commercial AI products, we’ve tended to build our government AI tools in-house, which means we know how they work,” says the report’s co-author, James Maclaurin, an Otago philosophy of science professor. “That’s a practice we strongly recommend our Government continues.”

There are numerous overseas examples of the troubling results that arise when private companies are contracted by government departments to apply their proprietary algorithms. The most famous example is Compas, the system used by US judges to determine bail and sentencing limits.

An investigation by journalists at non-profit news organisation ProPublica in 2016 of the system’s automatic risk assessments revealed Compas was biased against African Americans. Northpointe, the company that built Compas, defended its algorithm, but the system’s inner workings are kept secret to protect the company’s interests, so it is still unclear how it works.

The Otago researchers argue for transparency into algorithms used in the public arena and propose a register of predictive algorithms used by the Government, complete with layperson summaries of how they work and whether they have been bought commercially or developed in-house.

But they go further, calling for the formation of an independent regulator, akin to the Privacy Commissioner, to oversee use of algorithms in government. It is a sensible proposal given how much we have to lose if public trust is undermined.

By sorting out the Government’s use of algorithms, we may also identify an approach to the bigger problem: the use of algorithms by Google, Facebook and the plethora of companies that collect and mine our data every day, using methods cloaked in secrecy. That’s where sunlight really needs to be applied.

This article was first published in the June 8, 2019 issue of the New Zealand Listener.


Sir Roger Hall on why we need to treasure NZ's portrait art
107286 2019-06-18 00:00:00Z Arts

Sir Roger Hall on why we need to treasure NZ's por…

by Roger Hall

On an Australian art tour, playwright Sir Roger Hall found that a portrait gallery can be so much more than a snapshot of a country’s social history.

Read more
ANZ boss's departure: 'What was the NZ board doing to monitor expenses?'
Why you shouldn't force kids to eat everything on their plates
107161 2019-06-18 00:00:00Z Nutrition

Why you shouldn't force kids to eat everything on…

by Jennifer Bowden

Forcing children to finish everything on their plates sets them up for a bad relationship with food.

Read more
Can defending free speech boost David Seymour's fortunes?
107279 2019-06-17 00:00:00Z Politics

Can defending free speech boost David Seymour's fo…

by Graham Adams

The policies announced at Act’s relaunch are mostly standard party fare, but freedom of expression is an issue that could pull in new voters.

Read more
Oranga Tamariki inquiry won't be released to the public in full
107264 2019-06-17 00:00:00Z Social issues

Oranga Tamariki inquiry won't be released to the p…

by RNZ

Oranga Tamariki's inquiry into its attempt to take a newborn baby from its mother at Hawke's Bay Hospital will not be released to the public in full.

Read more
Writer Stephanie Johnson on five pioneering Kiwis who crossed the ditch
106770 2019-06-17 00:00:00Z Profiles

Writer Stephanie Johnson on five pioneering Kiwis…

by Diana Wichtel

Stephanie Johnson likes a good story and she’s found one in a collection of colourful Kiwis who made their mark in Australia.

Read more
The science behind finding the perfect sports bra
107091 2019-06-17 00:00:00Z Health

The science behind finding the perfect sports bra

by Ruth Nichol

Insufficient breast support is a barrier to exercise for many women, but with the right sports bra, there can be less bounce in your step.

Read more
Jessica McCormack: The Kiwi jeweller sparkling in Mayfair
106986 2019-06-16 00:00:00Z Profiles

Jessica McCormack: The Kiwi jeweller sparkling in…

by Clare de Lore

Diamonds and books are New Zealand designer Jessica McCormack’s best friends.

Read more