Science Fiction Dictionary
A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  X  Y  Z

 

Do You Hold Robots Morally Accountable?

Would you hold a robot morally accountable for its behavior? The people at the Human Interaction With Nature and Technological Systems (HINTS) Lab at the University of Washington, in Seattle, wanted to know.

Autonomous robots are very close to being able to interact with human beings in a variety of ways. The folks at HINTS have published two large studies exploring whether humans view robots as moral entities.

Their intent was to study a scenario like the following:

Consider a scenario in which a domestic robot assistant accidentally breaks a treasured family heirloom; or when a semi-autonomous robotic car with a personified interface malfunctions and causes an accident; or when a robot-fighting entity mistakenly kills civilians. Such scenarios help establish the importance of the following question: Can a robot now or in the near future—say 5 or 15 years out—be morally accountable for the harm it causes?

A typical interaction is shown in the video; read the description below for an outline of the procedure.


(Moral accountability of robots study)

The first study from HINTS investigated whether humans hold a humanoid robot morally accountable for harm that it causes. The robot in question is Robovie, the little guy (little piece of equipment?) in the picture above, who was secretly being controlled by humans throughout the duration of the experiment. The experiment itself was designed to put a hapless human in a situation where they would experience Robovie making a false statement, and see how they'd react: would Robovie be responsible, or simply a malfunctioning tool?

To figure this out, human subjects were introduced to Robovie, and the robot (being secretly teleoperated) made small talk with them, executing a carefully scripted set of interactions designed to establish that the robot was socially sophisticated and capable to form an increasingly social relationship between robot and human. Then, Robovie asked the subject to play a visual scavenger hunt game, with $20 at stake: the subject would attempt to find at least seven items, and if Robovie judged them to be successful (that's an important bit), within a 2-minute time limit, they'd get the money.

The game, of course, was rigged.

Overall, the study, funded by the National Science Foundation, found that:

65% of the participants attributed some level of moral accountability to Robovie for the harm that Robovie caused the participant by unfairly depriving the participant of the $20.00 prize money that the participant had won. ...We found that participants held Robovie less accountable than they would a human but more accountable than they would a machine. Thus as robots gain increasing capabilities in language comprehension and production, and engage in increasingly sophisticated social interactions with people, it is likely that many people will hold a humanoid robot as partially accountable for a harm that it causes.

Science fiction writers have spent some time exploring these topics. In the sequel to Stanley Kubrick's 2001, Dr. Chandra learns at last why the HAL-9000 computer exhibited unusual behavior in the earlier film 2001: A Space Odyssey. (SPOILER!)


(From 2010 - HAL tries to lie)

"... he was given full knowledge of the two objectives and was told not to reveal these objectives to Bowman or Poole. He was instructed to lie...

The situation was in conflict with the basic purpose of HAL's design - the accurate processing of information without distortion or concealment. He became trapped... HAL was told to lie - by people who find it easy to lie.

The Bolo autonomous tanks from Keith Laumer's stories evolved to become robotic exemplars of military virtue.

In the 1982 movie Blade Runner, the replicant (non-robotic, but an artificial human) Roy Batty is given the choice to let his enemy, the human detective Rick Deckard, die, Batty instead chooses to save him.


(Roy Batty debates saving Rick Deckard in Blade Runner)

Ethical dilemmas for robots are as old as the idea of robots in fiction. Ethical behavior (in this case, self-sacrifice) is found at the end of the 1921 play Rossum's Universal Robots, by Czech playwright Karel Čapek. This play introduced the term "robot".

Update: For a hilarious counterpoint to this article, take a look at this video from the British TV series Red Dwarf in which Kryten the robot is taught to lie. You'll love Kryten's reasons for wanting to lie, and Dave's reasons for teaching him. End update.

Update: 04-Dec-2024: See the entry for Robot AI Driven Mad from Liar (1941) by Isaac Asimov. End update.

Via IEEE Spectrum

Scroll down for more stories in the same category. (Story submitted 4/27/2012)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 1 )

Related News Stories - (" Robotics ")

SnapBot Robots - You Choose Their Legs And They Choose Their Gaits
It's not really polite to tear the limbs off robots.

Humanoid Robots Building Humanoid Robots
''Pardon me, Struthers,' he broke in suddenly... 'haven't you a section of the factory where only robot labor is employed?'' - Isaac Asimov (1940)

What's The Best Way To Ship And Unpack Humanoid Robots?
'I opened the oblong box, where lay the automatons side by side...' - Elizabeth Bellamy, 1899.

SpiRobs Soft Spiral Robotic Arm
'Beware the 'long, flexible, glittering tentacles...' - HG Wells, 1898

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

Science Fiction Timeline
1600-1899
1900-1939
1940's   1950's
1960's   1970's
1980's   1990's
2000's   2010's

Current News

Tiny Flying Robot Weighs Just One Gram
'Aerostat meant anything that hung in the air. This was an easy trick to pull off nowadays.'

Some Ringworld Configurations Are Stable
'The Ringworld had no horizon. There was no line where the land curved away from the sky.'

TRANSFORM Dynamic Furniture Concept Becomes What You Need
'An adjustment panel outside the door would cause it to extrude various appurtenances in memory plastic...'

Harvard Metamaterials Change Structure Instantly
'Annealed in any shape for a time, and codified, the structure of that shape is retained down to the molecules.'

SnapBot Robots - You Choose Their Legs And They Choose Their Gaits
It's not really polite to tear the limbs off robots.

Dino From Magical Toys An AI Companion To Children
'...the imaginary companions discovered by needful children.'

Humanoid Robots Building Humanoid Robots
''Pardon me, Struthers,' he broke in suddenly... 'haven't you a section of the factory where only robot labor is employed?''

Darpa 'Defiant' Unmanned Autonomous Ship
'There was no wheel, and no steersman!'

What's The Best Way To Ship And Unpack Humanoid Robots?
'I opened the oblong box, where lay the automatons side by side...'

DNA Printed Book By Isaac Asimov Now Available
'They tied the memory to the bloodline and that was their record!'

AI Computer Chip Designs Passeth Human Understanding
'It seems that at one time computers were designed directly by human beings.'

Space Traffic Management (STM) Needed Now
'...the spot was a lonely one in an uncharted region, far from the normal lanes of space traffic.'

Fine-Tune Your Infinite Book The Way You Want It
'I squatted down beside the roller and tried to make some sense out of the knobs. There were thirty-nine of them...'

SpiRobs Soft Spiral Robotic Arm
'Beware the long, flexible, glittering tentacles...'

Holland Factory 3D Printing 500 Tons Of Steak Per Month
'...I don’t understand technical things — tell me, does it ever feel anything?"

Stratospheric Solar Geoengineering From Harvard
'Pina2bo would have to operate full blast for many years to put as much SO2 into the stratosphere as its namesake had done in a few minutes.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.