Facial recognition tech not reliable – and consequences troubling

by RNZ / 15 May, 2018

Help us find and write the stories Kiwis need to read

Photo/123RF

The Privacy Commissioner says businesses should take great care when using facial recognition technology because there is a high risk of misidentification.

Inquiries about a Dunedin man mistakenly identified as a shoplifter at a New World store revealed that New Zealand's largest supermarket company has rolled out facial recognition CCTV technology in some of its North Island stores.

The man was allegedly mistakenly identified due to human error, and Foodstuffs NZ claimed facial recognition was not used in the South Island.

However, the Otago Daily Times reported a different security system that "bridges the gap between businesses and the police" was now used at the Centre City New World in Dunedin, among other South Island stores.

Privacy Commissioner John Edwards said that despite the technology being "cutting edge", it's not particularly reliable - even in law enforcement.

A report from the Independent found that the facial recognition software used by London Metropolitan Police came up with false positives 98 percent of the time.

"If a major law enforcement organisations in one of the biggest cities in the world can't get it right then you'd have to query the diligence that a domestic commercial user in New Zealand has applied to the equipment," Mr Edwards told Morning Report.

"If you've got a higher level of confidence in the accuracy of your technology than it is able to deliver, you can accuse somebody of being untrustworthy, you can exclude them from your store, you can take all sorts of actions that are completely unjustified.

"If they are throwing money at technology that is potentially going to get them into more trouble than it solves, then that would seem like a false economy," he said.

Mr Edwards also pointed to troubling research from the US which showed that data sets used to teach the programmes can be influenced by an ethnic bias.

A recent study showed one software could identify white males 99 percent of the time, but was less reliable with other genders and ethnicities. Women of colour were accurately identified only 65 percent of the time.

"That's pretty significant, and I doubt the software we're talking about here has been generated in New Zealand so you'd have to wonder whether it's been tested on a New Zealand population to a degree that gives a user sufficient confidence that it's not going to tarnish the customer group that it tries to stop," Mr Edwards said.

In order to look into the issue, the commission would probably need someone to complain about the use of the technology, Mr Edwards said.

However, he said, consumers should be told if they are entering shops and premises where their faces are being filmed and their data stored, and why it was happening.

"The interesting question is whether there's an obligation to provide a bit more transparency about the technology that's being plied over those images - and that's something we haven't addressed yet," he said.

"That's something that maybe the select committee will take an opportunity to look at with a new privacy bill in the house."

This article was first published on RNZ.

RelatedArticlesModule - Privacy

Latest

Father figure: Jordan Watson on his 'How to Dad' series
93157 2018-07-21 00:00:00Z Social issues

Father figure: Jordan Watson on his 'How to Dad' s…

by North & South

The breakout Youtube star talks about 'How to Dad', paternity leave, and his own dad.

Read more
With friends like Donald Trump, who needs enemies?
93834 2018-07-21 00:00:00Z World

With friends like Donald Trump, who needs enemies?…

by Paul Thomas

The US President treats his Western allies to a tongue-lashing while cosying up to Vladimir Putin, causing alarm at home and around the world.

Read more
Who Is America? is predictably alarming – and scarily relevant
93831 2018-07-21 00:00:00Z Television

Who Is America? is predictably alarming – and scar…

by Diana Wichtel

Only Bernie Sanders comes out unscathed in Sacha Baron Cohen’s absurdist new series Who Is America?

Read more
Organic wine is getting bigger in New Zealand. These are our top picks
93885 2018-07-21 00:00:00Z Wine

Organic wine is getting bigger in New Zealand. The…

by Michael Cooper

Quality rather than quantity drives New Zealand's organic wine producers.

Read more
Killer robots: The question of how to control lethal autonomous weapons
93876 2018-07-20 08:23:45Z Tech

Killer robots: The question of how to control leth…

by Peter Griffin

The computer scientist who has become a leading voice on the threat posed by killer robots describes himself as an “accidental activist”.

Read more
The man who's making sure performing artists are seen in the regions
93813 2018-07-20 00:00:00Z Theatre

The man who's making sure performing artists are s…

by Elisabeth Easther

For 35 years, Steve Thomas has been at the helm of Arts On Tour, taking musical and theatrical acts from Kaitaia to Stewart Island.

Read more
The Eco Economy: Millennials, money and saving sustainably
93645 2018-07-20 00:00:00Z Economy

The Eco Economy: Millennials, money and saving sus…

by Sharon Stephenson

Millenials are leading the rise of the eco economy.

Read more
Cuba Libre is a new Caribbean-influenced restaurant-bar in Ponsonby
93862 2018-07-19 15:05:51Z Auckland Eats

Cuba Libre is a new Caribbean-influenced restauran…

by Kate Richards

Rum, cigars and Cuban sandwiches are on the menu at new Ponsonby restaurant, Cuba Libre.

Read more