Robots Learn To Understand Outdoor Scenes

Computer vision systems used by robots can now do a better job in understanding outdoor scenes, thanks to researchers at Carnegie Mellon University.


(Computers see outdoors)

“When people look at a photo, they understand that the scene is geometrically constrained,” said Abhinav Gupta, a post-doctoral fellow in CMU’s Robotics Institute. “We know that buildings aren’t infinitely thin, that most towers do not lean, and that heavy objects require support. It might not be possible to know the three-dimensional size and shape of all the objects in the photo, but we can narrow the possibilities. In the same way, if a computer can replicate an image, block by block, it can better understand the scene.”

This novel approach to automated scene analysis could eventually be used to understand not only the objects in a scene, but the spaces in between them and what might lie behind areas obscured by objects in the foreground, said Alexei A. Efros, associate professor of robotics and computer science at CMU. That level of detail would be important, for instance, if a robot needed to plan a route where it might walk, he noted.

In the new method devised by Gupta, Efros and Hebert, the image is first broken into various segments corresponding to objects in the image. Once the ground and sky are identified, other segments are assigned potential geometric shapes. The shapes also are categorized as light or heavy, depending on appearance; a surface that appears to be a brick wall, for instance, would be classified as heavy.

The computer then attempts to reconstruct the image using the virtual blocks. If a heavy block appears unsupported, the computer must substitute an appropriately shaped block, or make assumptions that the original block was obscured in the original image.

This capability is assumed by science fiction writers like Philip K. Dick, whose "leadies" from his 1964 novel The Penultimate Truth were robots that roamed the surface of the earth while most of humanity was kept underground.

From CMU.

Scroll down for more stories in the same category. (Story submitted 9/13/2010)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

China Delivery Robot Development Quickens During COVID-2019 Outbreak
'Something very much like a camouflage-painted kangaroo.' - Bruce Sterling, 1994.

Qbit Robot Bartender Also Makes Coffee
'...he sipped the cognac that the robot bartender handed him.' - Alfred Bester, 1956.

Out-Of-Work Blue Collar Robots Need Your Help
'His legs relaxed with a rattle as he cut off all power below his waist... and ran his eye down the Help Wanted - Robot column...' - Harry Harrison, 1956.

Massage Robot Has Soft Hands, Er, Pads
'The automatic massager began to fumble gently over my naked form.' - AE van Vogt, 1944

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Neural Net Discovers Antibiotic
'...instantly the TEMS was ... creating and discarding scores of new sciences.'

China Delivery Robot Development Quickens During COVID-2019 Outbreak
'Something very much like a camouflage-painted kangaroo.'

Via Virtual Reality, Mother Encounters Deceased Daughter
'But that barrier was going to melt away someday soon. The transhumanists had promised...'

Clothes That Do Photosynthesis
'Clothes are no longer made from dead fibers of fixed color and texture...'

Stratuscent Electronic Nose
'It's picking up diphenyl compounds and tetra hydrocarbons.'

CIMON Companion Robot For Space Station Astronauts
'... in some departments their power is absolute.'

Qbit Robot Bartender Also Makes Coffee
'...he sipped the cognac that the robot bartender handed him.'

Moving Desks Not SciFi After All
'Charged with hope, he zipped from stack to stack...'

Cruise Autonomous Car Drives Aimlessly For An Hour
Convincing video shows progress (and limitations).

Fast Charging A Bus In 20 Seconds
'... in almost every town and village.'

Realistic Translation With The Waverly Labs Ambassador
'The speech patterns you actually hear decode the brainwave matrix which has been fed into your mind by your Babel fish.'

Biotech Firms Raised $Millions For Anti-Agathics (Longevity Drugs)
'Against Death doth no simple grow.'

Out-Of-Work Blue Collar Robots Need Your Help
'His legs relaxed with a rattle as he cut off all power below his waist... and ran his eye down the Help Wanted - Robot column...'

The Dawn Of Orbiting Manufacturing In 2020?
'It can be mass-produced only in the orbiting factories.'

Smart Contact Lenses Charges With 3D Printed Antenna
'He realized that it was not quite a clear lens.'

Segway S-Pod Fulfills Dire 1928 SciFi Prophecy
'Noiselessly, on rubber-tired wheels, they journeyed down the long aisles...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.