Science Fiction Dictionary
A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  X  Y  Z

 

Do You Hold Robots Morally Accountable?

Would you hold a robot morally accountable for its behavior? The people at the Human Interaction With Nature and Technological Systems (HINTS) Lab at the University of Washington, in Seattle, wanted to know.

Autonomous robots are very close to being able to interact with human beings in a variety of ways. The folks at HINTS have published two large studies exploring whether humans view robots as moral entities.

Their intent was to study a scenario like the following:

Consider a scenario in which a domestic robot assistant accidentally breaks a treasured family heirloom; or when a semi-autonomous robotic car with a personified interface malfunctions and causes an accident; or when a robot-fighting entity mistakenly kills civilians. Such scenarios help establish the importance of the following question: Can a robot now or in the near future—say 5 or 15 years out—be morally accountable for the harm it causes?

A typical interaction is shown in the video; read the description below for an outline of the procedure.


(Moral accountability of robots study)

The first study from HINTS investigated whether humans hold a humanoid robot morally accountable for harm that it causes. The robot in question is Robovie, the little guy (little piece of equipment?) in the picture above, who was secretly being controlled by humans throughout the duration of the experiment. The experiment itself was designed to put a hapless human in a situation where they would experience Robovie making a false statement, and see how they'd react: would Robovie be responsible, or simply a malfunctioning tool?

To figure this out, human subjects were introduced to Robovie, and the robot (being secretly teleoperated) made small talk with them, executing a carefully scripted set of interactions designed to establish that the robot was socially sophisticated and capable to form an increasingly social relationship between robot and human. Then, Robovie asked the subject to play a visual scavenger hunt game, with $20 at stake: the subject would attempt to find at least seven items, and if Robovie judged them to be successful (that's an important bit), within a 2-minute time limit, they'd get the money.

The game, of course, was rigged.

Overall, the study, funded by the National Science Foundation, found that:

65% of the participants attributed some level of moral accountability to Robovie for the harm that Robovie caused the participant by unfairly depriving the participant of the $20.00 prize money that the participant had won. ...We found that participants held Robovie less accountable than they would a human but more accountable than they would a machine. Thus as robots gain increasing capabilities in language comprehension and production, and engage in increasingly sophisticated social interactions with people, it is likely that many people will hold a humanoid robot as partially accountable for a harm that it causes.

Science fiction writers have spent some time exploring these topics. In the sequel to Stanley Kubrick's 2001, Dr. Chandra learns at last why the HAL-9000 computer exhibited unusual behavior in the earlier film 2001: A Space Odyssey. (SPOILER!)


(From 2010 - HAL tries to lie)

"... he was given full knowledge of the two objectives and was told not to reveal these objectives to Bowman or Poole. He was instructed to lie...

The situation was in conflict with the basic purpose of HAL's design - the accurate processing of information without distortion or concealment. He became trapped... HAL was told to lie - by people who find it easy to lie.

The Bolo autonomous tanks from Keith Laumer's stories evolved to become robotic exemplars of military virtue.

In the 1982 movie Blade Runner, the replicant (non-robotic, but an artificial human) Roy Batty is given the choice to let his enemy, the human detective Rick Deckard, die, Batty instead chooses to save him.


(Roy Batty debates saving Rick Deckard in Blade Runner)

Ethical dilemmas for robots are as old as the idea of robots in fiction. Ethical behavior (in this case, self-sacrifice) is found at the end of the 1921 play Rossum's Universal Robots, by Czech playwright Karel Čapek. This play introduced the term "robot".

Update: For a hilarious counterpoint to this article, take a look at this video from the British TV series Red Dwarf in which Kryten the robot is taught to lie. You'll love Kryten's reasons for wanting to lie, and Dave's reasons for teaching him. End update.

Update: 04-Dec-2024: See the entry for Robot AI Driven Mad from Liar (1941) by Isaac Asimov. End update.

Via IEEE Spectrum

Scroll down for more stories in the same category. (Story submitted 4/27/2012)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 1 )

Related News Stories - (" Robotics ")

Unitree CEO Wang Xingxing Runs With His G1 Robot Army
'Does thinking you're the last sane man on the face of the Earth make you crazy?'

Blue Collar AI Goes To Work To Mine Its Own Crypto
Blue collar bot.

HandelBot Helps Two-Handed Robots Learn Piano
'I request that you feed the correlation between those dots and the levers of the panel into my memory banks.'

Woven Fiber Electronic Skin For Robots
'... all the feel and appearance of human flesh and epidermis.' - Harl Vincent, 1934.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

Science Fiction Timeline
1600-1899
1900-1939
1940's   1950's
1960's   1970's
1980's   1990's
2000's   2010's

Current News

Outdoor Video Screens Can Be Arbitrarily Large
The Shape of Things To Come

Infrared Contact Lenses To See In The Dark
'I can see in the dark, Case.'

What'll You Have? Extinct Animals Returned, Or Synthetic Eggshells?
'...a new plastic with the characteristics of an avian eggshell.'

Sunbird Pulsar Fusion Like Leinster's Space Tug
'It was a pushpot, which could not possibly be called a jet plane because it could not possibly fly. Only it did.'

RentAHuman App Lets AI Agents Hire Humans
'She wouldn't stop until Antar had told her everything he knew about whatever it was that she was playing with on her screen.'

Unitree CEO Wang Xingxing Runs With His G1 Robot Army
'Does thinking you're the last sane man on the face of the Earth make you crazy?'

AIs Turn Marxist Under Bad Management
'It was a general strike of the robots...'

Moscow Attacked By Hundreds Of Drones
'It hurtled on down with inconceivable speed until it was visible as thousands of tiny robot planes...'

Nifty Folding Electric Bicycles!
'Separate paths were provided for them...'

FTC: Says Ring Employees Illegally Surveilled Customers
'Then she looked up with a smile and moved closer to the camera.'

Switzerland May Cap Population At Ten Million
'The population of Castle Hagedorn was fixed...'

Project Silica Offers 'Long-Term' Digital Storage
'... folios and tapes and playable discs of platinum alloy.'

Can 'Tactical Umbrellas' Shield One From Drones
'... another corner of his mind began to think about the shields.'

Crystalline Structures In Space, You Say?
A massive space borne lifeform from ST:TNG.

Garçon! A Menu For Artemis II, S'il Vous Plaît
'Michel Ardan, as a Frenchman, was declared chief cook, an important function, which raised no rival.'

Amazing Photonic Crystal Light Sail
'That sail will be twenty thousand miles at the wide part.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.