Science Fiction
Dictionary
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
 |
SayCan with PaLM - Google's Robot Helper
Google's everyday robots are getting better and better at what robots need to do - help people!
Think I saw this in Iron Man 1 (2003) Dum-E https://t.co/5NvGPKGZhs
— Bill Christensen (@Technovelgy) April 29, 2023
Large language models can encode a wealth of semantic knowledge about the world. Such knowledge could in principle be extremely useful to robots aiming to act upon high-level, temporally extended instructions expressed in natural language. However, a significant weakness of language models is that they lack contextual grounding, which makes it difficult to leverage them for decision making within a given real-world context. For example, asking a language model to describe how to clean a spill might result in a reasonable narrative, but it may not be applicable to a particular agent, such as a robot, that needs to perform this task in a particular environment.We propose to provide this grounding by means of pretrained behaviors, which are used to condition the model to propose natural language actions that are both feasible and contextually appropriate. The robot can act as the language model’s “hands and eyes,” while the language model supplies high-level semantic knowledge about the task.
(say-can robot helper)We show how low-level tasks can be combined with large language models so that the language model provides high-level knowledge about the procedures for performing complex and temporally extended instructions, while value functions associated with these tasks provide the grounding necessary to connect this knowledge to a particular physical environment.
We evaluate our method on a number of real-world robotic tasks, where we show that this approach is capable of completing long-horizon, abstract, natural language instructions on a mobile manipulator.
(Via say-can)
Science fiction of course features many helpful robots, like TARS and CASE from the movie Interstellar.
Scroll down for more stories in the same category. (Story submitted 4/27/2023)
Follow this kind of news @Technovelgy.| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |
Would
you like to contribute a story tip?
It's easy:
Get the URL of the story, and the related sf author, and add
it here.
Comment/Join discussion ( 0 )
Related News Stories - (" Robotics ")
Robotic Hands Have More Than One Use
'The crawling, exploring object was V-Stephen's surgeon-hand...' - Philip K. Dick, 1955.
'No, I'm Not A Robot' - Robot
'... with a weird simulation of life, the ten forked ends of each arm commenced a rattling pressing of the buttons.' - Schachner and Zagat, 1931.
Barista Robot Perfects Latte Swirl With Multi-DOF Wriggle
'It's done with a flip of the third joint of the tentacle on the down beat.' - Anthony Boucher, 1943.
Safe Street Rebel Autonomous Vehicle Luddites And Schachner's 1931 Robot-Deranger
'Then the spreading beam of the deranging ray struck them, and they stood an instant transfixed...' - Schachner/Zagat, 1931
Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.
Science Fiction
Timeline
1600-1899
1900-1939
1940's 1950's
1960's 1970's
1980's 1990's
2000's 2010's
Current News
18 Wheels Mutant Centipede Vehicle
'If a centipede were a dinosaur and made of metal to boot...'
Octopus Suckers Inspire Transdermal Patches
'...a capsule which he placed against his wrist.'
Robotic Hands Have More Than One Use
'The crawling, exploring object was V-Stephen's surgeon-hand...'
Space Weather To Universe Weather
'It radiates outward in a cone which, by the time it has reached our section of space, is many lightyears across.'
That's MOXIE! Terraforming Mars Baby Steps
'Drake was the young spatial engineer he employed to terraform the little rock.'
'No, I'm Not A Robot' - Robot
'... with a weird simulation of life, the ten forked ends of each arm commenced a rattling pressing of the buttons.'
Missing Jet Finally Found
Ah, what could have been - still in the future.
Philippines Coast Guard Cuts Chinese Barrier
'Each of the four areas is enclosed by a sonic wall...'
Barista Robot Perfects Latte Swirl With Multi-DOF Wriggle
'It's done with a flip of the third joint of the tentacle on the down beat.'
Vendetta 2023 All-Terrain Skateboard Could Use Neal Stephenson's Smartwheels
'If you surf over a bump... If you surf over a pothole...'
Safe Street Rebel Autonomous Vehicle Luddites And Schachner's 1931 Robot-Deranger
'Then the spreading beam of the deranging ray struck them, and they stood an instant transfixed...'
The Electric Balance Bicycle And The Decline Of Western Civilization
'Noiselessly, on rubber-tired wheels, they journeyed...'
'Droplet' Battery Microscale Power Pack
'...a power pack the size of a pea.'
ARX-5 Doing Robot Arm Dancing
It's Data's day - at last.
CD, DVD Bit Rot And PKD's Civic Notification Distorter
'...copy two of the original document no longer can be superimposed on copy one.'
Inbiodroid Prometheus 2.0 Telepresence Avatar Robot
My prize robot, tall, dashing would speak and act for me...
