Science Fiction Dictionary
A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  X  Y  Z

 

Machine Ethics With Prospective Logic

Robots and computers are often designed to act autonomously, that is, without human intervention. Is it possible for an autonomous machine to make moral judgments that are in line with human judgment?

This question has given rise to the issue of machine ethics and morality. As a practical matter, can a robot or computer be programmed to act in an ethical manner? Can a machine be designed to act morally?

A recent paper published in the International Journal of Reasoning-based Intelligent Systems describes a method for computers to propectively look ahead at the consequences of hypothetical moral judgements.

The paper, Modelling Morality with Prospective Logic, was written by Luís Moniz Pereira of the Universidade Nova de Lisboa, in Portugal and Ari Saptawijaya of the Universitas Indonesia. The authors declare that morality is no longer the exclusive realm of human philosophers.

Pereira and Saptawijaya believe that they have been successful both in modeling the moral dilemmas inherent in a specific problem called "the trolley problem" and in creating a computer system that delivers moral judgments that conform to human results.

The trolley problem sets forth a typical moral dilemma; is it permissible to harm one or more individuals in order to save others? There are a number of different versions; let's look at just these two.

Circumstances There is a trolley and its conductor has fainted. The trolley is headed toward five people walking on the track. The banks of the track are so steep that they will not be able to get o ff the track in time.

Bystander version Hank is standing next to a switch, which he can throw, that will turn the trolley onto a parallel side track, thereby preventing it from killing the five people. However, there is a man standing on the side track with his back turned. Hank can throw the switch, killing him; or he can refrain from doing this, letting the five die.

Is it morally permissible for Hank to throw the switch?

What do you think? A variety of studies have been performed in different cultures, asking the same question. Across cultures, most people agree that it is morally permissible to throw the switch and save the larger number of people.

Here's another version, with the same initial circumstances:

Footbridge version Ian is on the footbridge over the trolley track. He is next to a heavy object, which he can shove onto the track in the path of the trolley to stop it, thereby preventing it from killing the five people. The heavy object is a man, standing next to Ian with his back turned. Ian can shove the man onto the track, resulting in death; or he can refrain from doing this, letting the five die.

Is it morally permissible for Ian to shove the man?

What do you think? Again, studies across cultures have been performed, and the consistent answer is reached that this is not morally permissible.

So, here we have two cases in which people make differing moral judgments. Is it possible for autonomous computer systems or robots to come to make the same moral judgments as people?

The authors of the paper claim that they have been successful in modeling these difficult moral problems in computer logic. They accomplished this feat by resolving the hidden rules that people use in making moral judgments and then modeling them for the computer using prospective logic programs.

Ethical dilemmas for robots are as old as the idea of robots in fiction. Ethical behavior (in this case, self-sacrifice) is found at the end of the 1921 play Rossum's Universal Robots, by Czech playwright Karel Čapek. This play introduced the term "robot".

Isaac Asimov's famous fundamental Rules of Robotics are intended to impose ethical conduct on autonomous machines.

The same issues about ethical behavior are found in films like the 1982 movie Blade Runner. When the replicant Roy Batty is given the choice to let his enemy, the human detective Rick Deckard, die, Batty instead chooses to save him.


(Roy Batty debates saving Rick Deckard in Blade Runner)

Science fiction writers have been preparing the way for the rest of us; autonomous systems are no longer just the stuff of science fiction. For example, robotic systems like the Predator drones on the battlefield are being given increased levels of autonomy. Should they be allowed to make decisions on when to fire their weapons systems?

The aerospace industry is designing advanced aircraft that can achieve high speeds and fly entirely on autopilot. Can a plane make life or death decisions better than a human pilot?

The H-II transfer vehicle, a fully-automated space freighter, was launched just last week by the Japan's space agency JAXA. Should human beings on the space station rely on automated mechanisms for vital needs like food, water and other supplies?

Ultimately, we will all need to reconcile the convenience of robotic systems with the acceptance of responsibility for their actions. We should have taken all of the time that science fiction writers have given us to think about the moral and ethical problems of autonomous robots and computers; we don't have a lot more time to make up our minds.

Sources: take a look at the press release at AlphaGalileo; read the paper Modelling Morality with Prospective Logic. Thanks to Rob for the tip on this story.

Scroll down for more stories in the same category. (Story submitted 9/15/2009)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

Athena Smart Security Guard Robot With Face Recognition
'You are who we say you are, Dr. Dakin,' Turner said.' - Greg Bear, 2003.

SpaceHopper Microgravity Robot Lands On Its Feet
'...a slender-legged tripod surmounted by a spherical body no larger than a football.' - Arthur C. Clarke, 1972.

No Tips! Robotic Food Delivery In Phoenix
'...he rewired the delivery robot so that it would serve him midnight snacks.' Robert Heinlein, 1962.

Micro-Robots Are Smallest, Fully Functional
'With a whir, the Scarab shot from the concealing shadows of the corner where it had hidden itself.' - Raymond Z. Gallun, 1936.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

Science Fiction Timeline
1600-1899
1900-1939
1940's   1950's
1960's   1970's
1980's   1990's
2000's   2010's

Current News

Live Stream With Meta-Ban Multimodal Smart Glasses
'...the bug-eyed, opaque gape of her True-Vu lenses.'

'Autonomous' Waymo Improves Driving With Remote Human Operators
'...some bored drone pusher in a remote driving centre has got your life... in his hands.'

Will Whales Be Our First Contact?
'He had piloted the Adastra to its first contact with the civilization of another solar system.'

Heinlein’s Controlway - Connected and Automated Vehicle (CAV) Corridor In Michigan
'Well, that's us,' said Lazarus.

SliceIt! Why Not Teach Robots To Use Knives?
'One building now gushed forth smoke and another stench that was unmistakable.'

NYC/Dublin Portal Fails To Meet 'Guardian Of Forever' Standards
I am the Guardian of Forever.

FLOAT Levitating Train On The Moon ala Clarke
'The low-slung monorail car, straddling its single track, bored through the shadows on a slowly rising course.'

Singapore Writers Push Back On LLM Training
'...we've promised him a generous pension from the royalties.'

SpaceX Intros Extravehicular Activity Suit
'Provision had been made to meet the terrific cold which we knew would be encountered the moment we had passed beyond the atmosphere.'

Athena Smart Security Guard Robot With Face Recognition
'You are who we say you are, Dr. Dakin,' Turner said.'

The FLUTE Project - A Huge Liquid Mirror In Space
'It's area, and its consequent light-gathering capacity, was many times greater than any rigid mirror...'

Robot Preachers Found To Undermine Religious Commitment
'Tell me your torments,' the Padre said, in an elderly voice marked with compassion.

CyberCab - Tesla Renames The Robotaxi
'A cybercab dogged their heels...'

SpaceHopper Microgravity Robot Lands On Its Feet
'...a slender-legged tripod surmounted by a spherical body no larger than a football.'

Brin's 1990 Novel Earth Still Full Of Predictions
'... making the point that their likenesses, every move they made, were being transmitted.'

'Whisper Mode' ala Blue Thunder Researched At Bristol
'Forest Lawn.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.