Adversarial Pattern Shirts Confound Object Detection Systems

Computers are getting way too good at identifying us (systems in China are taking masks into account).


(Bright adversarial pattern shirt)

It turns out, confounding software into not realizing what it's looking at is a matter of fooling several different smaller systems at once.

Think about a person, for example. Now think of a person who looks nothing like that. And now do it again. Humanity, after all, contains multitudes, and a person can have many different appearances. A machine learning system needs to understand the diverse array of different inputs that, put together, mean "person." A nose by itself won't do it; an eye alone will not suffice; anything could have a mouth. But put dozens or hundreds of those priors together, and you've got enough for an object detector.

Code does not "think" in terms of facial features, the way a human does, but it does look for and classify features in its own way. To foil it, the "cloaks" need to interfere with most or all of those priors. Simply obscuring some of them is not enough. Facial recognition systems used in China, for example, have been trained to identify people who are wearing medical masks while trying to prevent the spread of COVID-19 or other illnesses.

And of course, to make the task even more challenging, different object detection frameworks all use different mechanisms to detect people, Goldstein explained. "We have different cloaks that are designed for different kinds of detectors, and they transfer across detectors, and so a cloak designed for one detector might also work on another detector," he said.

Science fiction writer Philip K. Dick, in his 1977 novel A Scanner Darkly, described a scramble suit, a device that enables the wearer to defy description, both in person and in surveillance videos:


(Explanatory Scramble suit video from the movie version)

The scramble suit was an invention of the Bell laboratories, conjured up by accident by an employee named S. A. Powers... Basically, his design consisted of a multifaceted quartz lens hooked up to a million and a half physiognomic fraction-representations of various people: men and women, children, with every variant encoded and then projected outward in all directions equally onto a superthin shroudlike membrane large enough to fit around an average human.
(Read more about Philip K. Dick's scramble suit)

I love this story, take a look at similar instances:

  - Let's Hear It For The Vague Blur!
  - Face Recognition Now Sees Through Disguises
  - HyperFace Aims To Foil Facial Recognition
  - Camouflage To Confound Face Recognition
  - RealFace Glamoflage T-Shirt Like PKD's Scramble Suit
  - CV Dazzle Anti-Surveillance Make-Up
  - Project KOVR Fashion Protection From Infosphere
  - Deep Learning Creates New Faces

Scroll down for more stories in the same category. (Story submitted 3/29/2020)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Surveillance ")

'Alexa For Residential' A Landlord's Dream (Tenant's Nightmare?)
'...unseen mechanical entities... that are in our very midst. One of them following each of us.' - Philip K. Dick, 1960.

Foiling Facial Recognition, Fighting Coaster Viruses, Harlan Ellison-Style
I have no mouth and I must scream.

Adversarial Pattern Shirts Confound Object Detection Systems
Ah, to be a vague blur!

A Passing Drone Has Covid-19 Advice
'Gold dots against blue, basketball-sized, twelve feet up.' Larry Niven, 1972.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Jet-Powered Flying Suits Tested By Navy
'With his motor in operation, he moves like a diver, head foremost...'

Pub Installs Electrified Fence Around Bar
'I start twelve immensely strong wires--naked, not insulated --from a big dynamo...'

What Does A Tesla Full Self-Driving Car See?
'All objects within my panoramic gaze trembled and vibrated like quick motion pictures...'

BioVYZR Is Ready, Anti-Covid19 PAPR Lovers
'Some clad in the insulated space-suits, with their transparent glassite helmets.'

Tesla Will Have Metal Gear Snake Autocoupler, Musk Confirms
'Its motion was so swift, complex, and perfect that at first I did not see it as a machine, in spite of its metallic glitter.'

Starlink Satellites Leading Edge On-Orbit Debris Mitigation
Propulsion-assisted orbital decay, brought to you by SpaceX.

Healight Ultraviolet Endotracheal Device Has Covid-19 Treatment Potential
'He applied the tip of the instrument to the interior of the wound...'

Parents Use AI To See One Last Message From Their Deceased Son
'...what's to keep me from showing face, Man?'

Satoshi Tomizu Creates Pocket Universes And Worldcraft Bubbles In Glass
'The Worldcraft bubble glittered, catching the light...'

Space Hero Inc. Offers Trip To ISS As Reality Show Prize
'This is Elmer Schmitz, presenting to you the finalists in our Aviation Quiz Program...'

I Love Ceiling-Mounted Robots
'Immediately an enormous apparatus fell on to her out of the ceiling...'

Armano Remote Control Excavator
'The bulldozer moved through the... mine... '

OK, NASA 3D Printer Of Food Not Yet Star Trek Food Synthesizer
Maybe not, but we're seeing definite progress.

Kelly Clarkson Show Like Black Mirror '15 Million Merits'
'These people are pieces of software called avatars.'

Salto Jumping Robot Now Sticks Landing!
'Lucky touched the leap knob and the hopper's leg retracted.'

Gyroscopic Median-Straddling Mass Transit Vehicles
'It was among these leviathans that the little gyrocar was daring to thrust its puny self...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.