Bionic Eye-Hand Combo Robot Grasps Objects On Its Own

Intelligent prosthetic limbs - with their own eyes - that allow the wearer to reach for objects automatically? A great idea from British biomedical engineers.


(Deep Learning eye-hand robot)

The goal of this work was to enable trans-radial amputees to use a simple, yet efficient, computer vision system to grasp and move common household objects with a two-channel myoelectric prosthetic hand. Approach. We developed a deep learning-based artificial vision system to augment the grasp functionality of a commercial prosthesis. Our main conceptual novelty is that we classify objects with regards to the grasp pattern without explicitly identifying them or measuring their dimensions. A convolutional neural network (CNN) structure was trained with images of over 500 graspable objects.

Finally, the system was tested with two trans-radial amputee volunteers controlling an i-limb UltraTM prosthetic hand and a motion controlTM prosthetic wrist; augmented with a webcam. After training, subjects successfully picked up and moved the target objects with an overall success of up to 88%.

In addition, we show that with training, subjects’ performance improved in terms of time required to accomplish a block of 24 trials despite a decreasing level of visual feedback. Significance. The proposed design constitutes a substantial conceptual improvement for the control of multi-functional prosthetic hands. We show for the first time that deep-learning based computer vision systems can enhance the grip functionality of myoelectric hands considerably.

A couple of science-fictional predecessors to this idea occur to me.

In his 1941 novel Methuselah's Children, sf author Robert Heinlein writes about a human baby modified by an alien race. The baby was given the following "improvements" (among others):

"...it's body architecture has been redesigned for greater efficiency, our useless simian hangovers have been left out, and its organs have been rearranged in a more sensible fashion. You can't say it's not human, for it is... an improved model. Take that extra appendage at the wrist. That's another hand, a miniature one... backed up by a microscopic eye. You can see how useful that would be, once you got used to the idea."

Trust Robert Heinlein to breathe life into old cliches like "hand-eye coordination".

I'm also fascinated by the idea that robotic hands could be, in effect, independent robots in their own right. Check out the robotic surgeon hand from Philip K. Dick's 1955 short story War Veteran:

From time to time V-Stephens examined his wristwatch and then turned his attention back to the object crawling up and down the sealed edges of the entrance-lock.

The object moved slowly and cautiously. It had been exploring the lock for twenty-nine hours straight; it had traced down the power leads that kept the heavy plate fused in place... During the last hour it had cut its way throught the rexeroid surface to within an inch of the terminals. The crawling, exploring object was V-Stephen's surgeon-hand, a self-contained robot of precision quality usually joined to his right wrist.

Via Deep learning-based artificial vision for grasp classification in myoelectric hands and KurzweilAI.

Scroll down for more stories in the same category. (Story submitted 4/15/2017)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

China Deploys Robot Traffic Police
'The robot came up smooth and fast as a rocket...' - Harry Harrison, 1958.

Unusual Twist On Woman Dates Robot
'My hearing, vision and awareness went along with that excellent imitation of a young Adonis...' - Manly Wade Wellman, 1938.

Blood Battery Robotic Fish
'With one fluid motion, it surged forward, plunged, and was gone.'- Michael Swanwick, 2002.

Bee+ Robobee Now With Four Wings
'It was a tiny thing, scarcely more than an inch and a half in length...' - Raymond Z. Gallun, 1936.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

China Deploys Robot Traffic Police
'The robot came up smooth and fast as a rocket...'

Better Than Dune Chromoplastic? This Guy Might Have Done It
'But when Old Father Sun departs, the chromoplastic reverts to transparency in the dark.'

Gather, An AI Warehouse Inventory Drone Startup
'It extended three of its tiny arms sideways to lock onto the registration pins...'

China's Artificial Intelligence-Enhanced Education
'The grey gas not only cut off his vision, but also his other senses...'

Orbital Manufacturer 'Made in Space' Gets $73 Million NASA Contract
'Mass-produced in the orbiting factories...'

Soli Gesture Tech Will Be In Google Pixel 4
'I enjoy watching this way, but - He waved his hand and the circuit switched abruptly.'

Uber Eats Pairs Cars With Drones
Fresh grub? Let's hope they aren't delivering grubs.

Space-Based Solar Power Roundup
SF writers popularized and elaborated on this idea a generation before the first patents were filed.

Lost Language Meanings Found By Machine Learning
'The autopilot would need data before it could begin a translation...'

'Aerogel' Sheets For Martian Gardens
'Sealed to the ground along all the sides, Honey, he growled...'

France's 'Red Team' Of Science Fiction Authors
'They're the only experts we have.'

Dim The Sun With Stratospheric Controlled Perturbation Experiment
'Those twin volcanoes; d'ye see them, Mr. Renner?'

Mashambas Skyscraper Farm Design Wins
'...a towering eighty-story structure like the office In-and Out baskets stacked up to the sky.'

Self-Driving Tractors From China Plan Ahead
'Machines that seemingly with full consciousness walked out into the fields to do their daily work.'

Jet-Powered Hoverboard Works!
L'audace, l'audace, toujours l'audace!

Nobe 3-Wheel Electric Vehicle Parking Like I, Robot
Spidercar, Spidercar, does whatever a spidercar does.

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.