iCub Robot ARCHER Gets Weapons Training

ARCHER, the Augmented Reward Chained Regression algorithm was developed to help robots learn the skill of archery. In the following video, you can see the iCub robot learn all by itself to aim and shoot arrows at the target.


(iCub robot learns archery with ARCHER)

The learning algorithm, called ARCHER (Augmented Reward Chained Regression) algorithm, was developed and optimized specifically for problems like the archery training, which have a smooth solution space and prior knowledge about the goal to be achieved. In the case of archery, we know that hitting the center corresponds to the maximum reward we can get. Using this prior information about the task, we can view the position of the arrow’s tip as an augmented reward. ARCHER uses a chained local regression process that iteratively estimates new policy parameters which have a greater probability of leading to the achievement of the goal of the task, based on the experience so far. An advantage of ARCHER over other learning algorithms is that it makes use of richer feedback information about the result of a rollout.

For the archery training, the ARCHER algorithm is used to modulate and coordinate the motion of the two hands, while an inverse kinematics controller is used for the motion of the arms. After every rollout, the image processing part recognizes automatically where the arrow hits the target which is then sent as feedback to the ARCHER algorithm. The image recognition is based on Gaussian Mixture Models for color-based detection of the target and the arrow’s tip.

As you can see, iCub learned in just eight tries to hit the target.

I'm trying to think of a specific sf scenario in which a robot is taught to use a weapon, but I can't. Readers?

Speaking of robots that aim and shoot by themselves, see this video of the X-Brat Robot Autonomous Mech

From Petar Kormushev's website; thanks to an anonymous reader who tipped me on this story.

Scroll down for more stories in the same category. (Story submitted 9/26/2010)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

Delightful Plen2 Mirror Robot - The Anti-Terminator
The anti-Terminator.

Petman Robot Pushes Itself To The Limit
'There was the butler robot, hard at work, his copper face expressionless...'- Frederik Pohl, 1954.

UR3 Robot At Work On Copies Of Itself
'I don't mean that you should construct this ultra-microrobot with your own fingers, of course...'- Raymond Z. Gallun, 1937.

Bridge-MINDER Repair Robot
'The repair robots had started out on their rounds...'- Stanislaw Lem, 1954.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

XM82 Personal Flamethrower Now In Development
'Skeletons in tatters. Burned by a flesh gun'

Graphene Cytobot - Cyborg Bacterial Spores May Help Astronauts
'[It] had not yet objected to being made over into a portion of an electronic system... '

Delightful Plen2 Mirror Robot - The Anti-Terminator
Time for fun, Will Robinson!

LiquiGlide Will Be Everywhere
'They poured the remnants of eggs out of their frictionless cups...'

US Customs Now Doing Facial Recognition At DC Airport
Are you who you say you are?

How Many Systems In That Galactic Empire Now?
'An Empire to twenty million stellar systems...'

Petman Robot Pushes Itself To The Limit
'There was the butler robot, hard at work, his copper face expressionless...'

Coleus LED 'Skylight' Dispenses Natural Sunlight Indoors
'How do they work it so that the sky is visible at every level of the city?'

UR3 Robot At Work On Copies Of Itself
'I don't mean that you should construct this ultra-microrobot with your own fingers, of course...'

3D Printing 'Terminator T-1000-Style'
Not quite 'a mimetic polyalloy...'

Bridge-MINDER Repair Robot
'The repair robots had started out on their rounds...'

Super Ball Bot Tensegrity Robot For Solar System Exploration
'Each leg in turn acted as a pivot around which the creature whirled its body...'

Norlin Shoe Drone Robot UAV In-Store Delivery Thing
'Robot-salesmen were everywhere, gesturing, pleading, shrilling.'

iSkin On-Body Touch Sensors
'Three rows of four colored dots appeared on the heel of my left hand.'

Britain To Build Spaceport, First In Europe
'The space-ports at the three great cities...'

MC10 Electronics Skin Stickers
'Every diaper... a fine copper wire…'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.