Science Fiction
Dictionary
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
 |
SayCan with PaLM - Google's Robot Helper
Google's everyday robots are getting better and better at what robots need to do - help people!
Think I saw this in Iron Man 1 (2003) Dum-E https://t.co/5NvGPKGZhs
— Bill Christensen (@Technovelgy) April 29, 2023
Large language models can encode a wealth of semantic knowledge about the world. Such knowledge could in principle be extremely useful to robots aiming to act upon high-level, temporally extended instructions expressed in natural language. However, a significant weakness of language models is that they lack contextual grounding, which makes it difficult to leverage them for decision making within a given real-world context. For example, asking a language model to describe how to clean a spill might result in a reasonable narrative, but it may not be applicable to a particular agent, such as a robot, that needs to perform this task in a particular environment.We propose to provide this grounding by means of pretrained behaviors, which are used to condition the model to propose natural language actions that are both feasible and contextually appropriate. The robot can act as the language model’s “hands and eyes,” while the language model supplies high-level semantic knowledge about the task.
(say-can robot helper)We show how low-level tasks can be combined with large language models so that the language model provides high-level knowledge about the procedures for performing complex and temporally extended instructions, while value functions associated with these tasks provide the grounding necessary to connect this knowledge to a particular physical environment.
We evaluate our method on a number of real-world robotic tasks, where we show that this approach is capable of completing long-horizon, abstract, natural language instructions on a mobile manipulator.
(Via say-can)
Science fiction of course features many helpful robots, like TARS and CASE from the movie Interstellar.
Scroll down for more stories in the same category. (Story submitted 4/27/2023)
Follow this kind of news @Technovelgy.| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |
Would
you like to contribute a story tip?
It's easy:
Get the URL of the story, and the related sf author, and add
it here.
Comment/Join discussion ( 0 )
Related News Stories - (" Robotics ")
Robot Hand Creeps Along, Separate From It's Owner
'The crawling... object was V-Stephen's surgeon-hand...' - Philip K. Dick, 1955.
Korean Exoskeleton Suit F1 Helps You Put It On
'Better late than never.'
Humanoid Robots Spotted In Homes Performing Household Chores
'... nothing was perfected until M. Pantalon announced the completion of his automatic valet.' Arthur Bird, 1899.
Bambot Open Source Cheap Delivery Robot
'Not since the time he rewired the delivery robot...'
Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.
Science Fiction
Timeline
1600-1899
1900-1939
1940's 1950's
1960's 1970's
1980's 1990's
2000's 2010's
Current News
Robot Hand Creeps Along, Separate From It's Owner
'The crawling... object was V-Stephen's surgeon-hand...'
Taikonauts Exercise In China's Tiangong Space Station
'Joe got out the gravity-simulator harnesses...'
Korean Exoskeleton Suit F1 Helps You Put It On
'Better late than never.'
Have AI Researchers Given Up On 'Bio-Babies'?
'You couldn't have the capstone without the pyramid to hold it up.'
Bunker Busters and Bore-Pellets
'The first revelation of the new Soviet bore-pellets.'
'Spikeless' Brand Swizzle Stick Detects Spiked Drinks
'the unobtrusive inspections with tiny remote-cast snoopers...'
Heart Patches Grown In The Lab Repair Hearts
I'm hoping that this procedure becomes a normal part of medical practice!
Humanoid Robots Spotted In Homes Performing Household Chores
'... nothing was perfected until M. Pantalon announced the completion of his automatic valet.'
Musk Proposes Sites For Martian Cities
'...its streets were of remarkable width, with few or no buildings so high as mosques, churches, State-offices, or palaces in Tellurian cities.'
Bambot Open Source Cheap Delivery Robot
'Not since the time he rewired the delivery robot...'
Robot Collective Acts Like A Smart Material
'...it was all composed of tiny, identical cubes, carefully laid to form a tilelike surface.'
Vipera Electric Skis From Frigid Dynamics
'JOAN strapped on her power-skis...'
Pixel Watch 'Loss of Pulse Detection' And Philip K. Dick
'He carried on his person a triggering mechanism sensitive to his heartbeat.'
Nuclear Plant Restarted To Power AI To Feed Us Dreams
'...Anything was possible in my imaginary environment.'
SpaceX's Starman Tesla Roadster In Space
'Somewhere in space, a chrome and blue automobile raced the green light of Earth.'
Pivotal Blackfly Electric Aircraft Lifts And Hovers
'That explains how it was so easy for me to remain motionless in midair...'
