Bionic Eye-Hand Combo Robot Grasps Objects On Its Own

Intelligent prosthetic limbs - with their own eyes - that allow the wearer to reach for objects automatically? A great idea from British biomedical engineers.


(Deep Learning eye-hand robot)

The goal of this work was to enable trans-radial amputees to use a simple, yet efficient, computer vision system to grasp and move common household objects with a two-channel myoelectric prosthetic hand. Approach. We developed a deep learning-based artificial vision system to augment the grasp functionality of a commercial prosthesis. Our main conceptual novelty is that we classify objects with regards to the grasp pattern without explicitly identifying them or measuring their dimensions. A convolutional neural network (CNN) structure was trained with images of over 500 graspable objects.

Finally, the system was tested with two trans-radial amputee volunteers controlling an i-limb UltraTM prosthetic hand and a motion controlTM prosthetic wrist; augmented with a webcam. After training, subjects successfully picked up and moved the target objects with an overall success of up to 88%.

In addition, we show that with training, subjects’ performance improved in terms of time required to accomplish a block of 24 trials despite a decreasing level of visual feedback. Significance. The proposed design constitutes a substantial conceptual improvement for the control of multi-functional prosthetic hands. We show for the first time that deep-learning based computer vision systems can enhance the grip functionality of myoelectric hands considerably.

A couple of science-fictional predecessors to this idea occur to me.

In his 1941 novel Methuselah's Children, sf author Robert Heinlein writes about a human baby modified by an alien race. The baby was given the following "improvements" (among others):

"...it's body architecture has been redesigned for greater efficiency, our useless simian hangovers have been left out, and its organs have been rearranged in a more sensible fashion. You can't say it's not human, for it is... an improved model. Take that extra appendage at the wrist. That's another hand, a miniature one... backed up by a microscopic eye. You can see how useful that would be, once you got used to the idea."

Trust Robert Heinlein to breathe life into old cliches like "hand-eye coordination".

I'm also fascinated by the idea that robotic hands could be, in effect, independent robots in their own right. Check out the robotic surgeon hand from Philip K. Dick's 1955 short story War Veteran:

From time to time V-Stephens examined his wristwatch and then turned his attention back to the object crawling up and down the sealed edges of the entrance-lock.

The object moved slowly and cautiously. It had been exploring the lock for twenty-nine hours straight; it had traced down the power leads that kept the heavy plate fused in place... During the last hour it had cut its way throught the rexeroid surface to within an inch of the terminals. The crawling, exploring object was V-Stephen's surgeon-hand, a self-contained robot of precision quality usually joined to his right wrist.

Via Deep learning-based artificial vision for grasp classification in myoelectric hands and KurzweilAI.

Scroll down for more stories in the same category. (Story submitted 4/15/2017)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

Do We Really Want Backflipping Robots?
Also includes wonderful blooper reel.

Cassie 'Halfbot' Best Half (Lower) Of Humanoid Robot
We can always make it limp along if it gets threatening.

Autonomous Concrete Floor Finishing Robot
Keep those construction site robots coming.

effie Automated Ironing Appliance
'Household Automata received an urgent task to develop production units of бытовые тканевые разглаживk

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Slaughterbot AI KIller Quadcopter Drones
'The real border was defended by... a swarm of quasi-independent aerostats.'

Do We Really Want Backflipping Robots?
Also includes wonderful blooper reel.

RNA-Based Biocomputing Device
Living things can sense and analyze complex signals in living cells.

Seasteading Floating Cities
'It was a remarkable island, circular, about half a kilometer in diameter.'

Tesla Semi 'Electrotruck' Unveiled
Elon Musk unveils yet another technological marvel.

Watch What People Are Seeing Via Brain Scanning
'had managed to see through the other man's eyes as the other man, all unaware, washed their Zis limousine sixteen hundred meters away...'

Integrated Circuits Printed Right Onto Fabric!
'...a shirt that displayed email on its sleeve.

Interstellar Asteroid Visits Our Solar System
'This asteroid had whirled in from the cold of the interplanetary space...'

PRIMA Bionic Vision Restoration
'The VISOR... was a medical device used in the Federation to aid patients who have suffered loss of eyesight...'

Audi Traffic Jam Pilot Knows If You're Sleeping
'Even here, riding a garbage truck to eternity, the machine watched him...'

UM Hall Thruster Breaks Records
Someday, we'll see an ion drive used to get to Mars.

Ionity Ultra-fast Charging Station Network
'Recharge the batteries... in almost every town and village...'

VAuth Voice Security Wearable From University of Michigan
'Siri, I gave you a voice command...' 'Yes, but do I know you?'

Ubiquiti FrontRow Camera Records Your Life
Why be choosy? Just upload your whole life to the Internet, and be done with it.

Ancient Ocean On Ceres?
'We sailed gently forward, hull down to the asteroid's surface... A little sea was now beneath us.'

SmileCloud Bubloons Are Custom Clouds
'Spurgle kicked at the letter G... It was a monstrous white thing, ten feet thick, half a city block long...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.