Adversarial Pattern Shirts Confound Object Detection Systems

Computers are getting way too good at identifying us (systems in China are taking masks into account).


(Bright adversarial pattern shirt)

It turns out, confounding software into not realizing what it's looking at is a matter of fooling several different smaller systems at once.

Think about a person, for example. Now think of a person who looks nothing like that. And now do it again. Humanity, after all, contains multitudes, and a person can have many different appearances. A machine learning system needs to understand the diverse array of different inputs that, put together, mean "person." A nose by itself won't do it; an eye alone will not suffice; anything could have a mouth. But put dozens or hundreds of those priors together, and you've got enough for an object detector.

Code does not "think" in terms of facial features, the way a human does, but it does look for and classify features in its own way. To foil it, the "cloaks" need to interfere with most or all of those priors. Simply obscuring some of them is not enough. Facial recognition systems used in China, for example, have been trained to identify people who are wearing medical masks while trying to prevent the spread of COVID-19 or other illnesses.

And of course, to make the task even more challenging, different object detection frameworks all use different mechanisms to detect people, Goldstein explained. "We have different cloaks that are designed for different kinds of detectors, and they transfer across detectors, and so a cloak designed for one detector might also work on another detector," he said.

Science fiction writer Philip K. Dick, in his 1977 novel A Scanner Darkly, described a scramble suit, a device that enables the wearer to defy description, both in person and in surveillance videos:


(Explanatory Scramble suit video from the movie version)

The scramble suit was an invention of the Bell laboratories, conjured up by accident by an employee named S. A. Powers... Basically, his design consisted of a multifaceted quartz lens hooked up to a million and a half physiognomic fraction-representations of various people: men and women, children, with every variant encoded and then projected outward in all directions equally onto a superthin shroudlike membrane large enough to fit around an average human.
(Read more about Philip K. Dick's scramble suit)

I love this story, take a look at similar instances:

- Let's Hear It For The Vague Blur!
- Face Recognition Now Sees Through Disguises
- HyperFace Aims To Foil Facial Recognition
- Camouflage To Confound Face Recognition
- RealFace Glamoflage T-Shirt Like PKD's Scramble Suit
- CV Dazzle Anti-Surveillance Make-Up
- Project KOVR Fashion Protection From Infosphere
- Deep Learning Creates New Faces

Scroll down for more stories in the same category. (Story submitted 3/29/2020)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Surveillance ")

Airport Security Now Using Predator-Style Heat Vision Helmets
'Want some candy?'

'Alexa For Residential' A Landlord's Dream (Tenant's Nightmare?)
'...unseen mechanical entities... that are in our very midst. One of them following each of us.' - Philip K. Dick, 1960.

Foiling Facial Recognition, Fighting Coaster Viruses, Harlan Ellison-Style
I have no mouth and I must scream.

Adversarial Pattern Shirts Confound Object Detection Systems
Ah, to be a vague blur!

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Las Vegas Tunnels To Have Autonomous Teslas
'...just a steady velvety whirr as the taxi sped along.'

TCL CSOT 17-Inch Printed OLED Scrolling Display
'..a wide sheet of clear material suddenly flared with light and swirling colour.'

Reachy Humanoid VR Teleoperation App
"I went to the control room where the three other men were manipulating their mechanical men...'

Unitree A1 Robot ala Black Mirror and Snow Crash
'The legs are long, curled way up to deliver power...'

DALL-E Makes Creative Images From Text
Okay, sf fans. If you could have some art created from a science fiction sentence, what sentence would you pick?

BladeBUG Robots Clean Massive Wind Turbine Blades
'There were the cleaners, with large padded feet, who were apparently polishing their way the whole length...'

Looms To Manually Weave Lunar Rover Wheels
It's fascinating to me how the Apollo program forced people to think outside their usual boxes.

IceBot Antarctic (Planetary?) Robotic Explorers Made Of Ice
'Some will combine in place to form more complicated structures, like excavators or centipedes.'

Glad 2020 Is Over
Maybe you missed one of these?

PEDOT Polymer Could Enhance Brain-Machine Interfaces
'the hair-fine wire going deep into Owen's brain, down into the pleasure center.'

Study: Robots Encourage Humans To Take Risks
Not exactly Three Laws compliant.

Kinetic Buildings And Psychotropic Houses
'There was a dim whirring, and the spheres tipped and began to rotate...'

Jupe Urban Escape Pods Have Tesla, SpaceX Roots
'The houses are prefabricated units... and they sell at the flat rate of five hundred dollars a room set up.'

Best Robot Dance Video Of 2020
'I can Mashed Potato... I can do the Twist.'

Vertical Farm In Singapore's Output Is 1.5 Tons Per Day
'A towering eighty-story structure like the office "In-and-Out" baskets stacked up to the sky.'

3D Printed 'Blisk' Manufactured In Orbit
'It can be mass-produced only in the orbiting factories...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.