iCub Robot ARCHER Gets Weapons Training

ARCHER, the Augmented Reward Chained Regression algorithm was developed to help robots learn the skill of archery. In the following video, you can see the iCub robot learn all by itself to aim and shoot arrows at the target.

(iCub robot learns archery with ARCHER)

The learning algorithm, called ARCHER (Augmented Reward Chained Regression) algorithm, was developed and optimized specifically for problems like the archery training, which have a smooth solution space and prior knowledge about the goal to be achieved. In the case of archery, we know that hitting the center corresponds to the maximum reward we can get. Using this prior information about the task, we can view the position of the arrow’s tip as an augmented reward. ARCHER uses a chained local regression process that iteratively estimates new policy parameters which have a greater probability of leading to the achievement of the goal of the task, based on the experience so far. An advantage of ARCHER over other learning algorithms is that it makes use of richer feedback information about the result of a rollout.

For the archery training, the ARCHER algorithm is used to modulate and coordinate the motion of the two hands, while an inverse kinematics controller is used for the motion of the arms. After every rollout, the image processing part recognizes automatically where the arrow hits the target which is then sent as feedback to the ARCHER algorithm. The image recognition is based on Gaussian Mixture Models for color-based detection of the target and the arrow’s tip.

As you can see, iCub learned in just eight tries to hit the target.

I'm trying to think of a specific sf scenario in which a robot is taught to use a weapon, but I can't. Readers?

Speaking of robots that aim and shoot by themselves, see this video of the X-Brat Robot Autonomous Mech

From Petar Kormushev's website; thanks to an anonymous reader who tipped me on this story.

Scroll down for more stories in the same category. (Story submitted 9/26/2010)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

FEDOR Humanoid Robot To Join Russians In Space
Am enjoying view of Russian robot.

MicroTug Is A Micro Robot Beast
'And it had been dragging something...' - Maurice A. Hugi (Eric Frank Russel), 1941.

Linear Elastic Actuator in Parallel (LEAP) - It's A Hopping Robot
'...Probably the most grotesque forms of transportation ever invented.'- Isaac Asimov, 1954.

Smart Glove Controls 3D Printed Robotic Arm (Waldo!)
'Waldo flexed and extended his fingers gently; the... waldoes... followed in exact, simultaneous parallelism.'- Robert Heinlein, 1942.



Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.






Current News

GyroGlove Idea For Parkinson's Was Suggested In 1926
'The gyroscope was revolving at the rate of three thousand revolutions a minute, and the slight humming was hardly noticeable...'

Otto Self-Driving Truck Kit Delivers Budweiser Beer
'Trucks gulped packages and scurried like beetles...'

Airnest Drone Flight Logging Tool
'He reached to unsnap the cartograph from his belt.'

Untethered Drone Gets Wireless Power
'We'll use my 'broomstick'.'

ESA Plans Akon Projectile To Europa ala Jules Verne
'... might [it] not be possible to project a shot up to the moon?'

Transparent OLED TV By Panasonic
It's the look of things to come.

Shape-Memory Metal Transforms Millions Of Times
'Annealed in any shape for a time, and codified, the structure of that shape is retained down to the molecules.'

Advertising Drones Hover Over Traffic In Mexico
'Blurbflies are allowd to travel the streets, buzzing their adverts alive and direct...'

How Can Amazon Patent A Voice-Controlled Drone?
''Tight mid-shot...' he told it.'

'North Sense' Wearable Piercing From Cyborg Nest
'The fingers opened from the many-scaled stellarimeter grafted onto his palm.'

proCover Smart Sock Prosthetic Limb Enhancement
'Series of chemelectric afferent nerve-analogues, which permitted it to gauge to an ounce...'

Robots And AIs Will Replace Humans At 7 Percent Of U.S. Jobs
'And Mike took on endless new jobs.'

Human Doctors Still Better Than Computers
'Nowadays surgery was normally done by autodocs...'

FEDOR Humanoid Robot To Join Russians In Space
Am enjoying view of Russian robot.

BMW Self-Balancing Motorcycle - Never Put Feet On Road
'He had never ridden any motorized device that lacked onboard steering and balance systems...'

MicroTug Is A Micro Robot Beast
'And it had been dragging something...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise | - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.