Science Fiction Dictionary
A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  X  Y  Z

 

SayCan with PaLM - Google's Robot Helper

Google's everyday robots are getting better and better at what robots need to do - help people!

Large language models can encode a wealth of semantic knowledge about the world. Such knowledge could in principle be extremely useful to robots aiming to act upon high-level, temporally extended instructions expressed in natural language. However, a significant weakness of language models is that they lack contextual grounding, which makes it difficult to leverage them for decision making within a given real-world context. For example, asking a language model to describe how to clean a spill might result in a reasonable narrative, but it may not be applicable to a particular agent, such as a robot, that needs to perform this task in a particular environment.

We propose to provide this grounding by means of pretrained behaviors, which are used to condition the model to propose natural language actions that are both feasible and contextually appropriate. The robot can act as the language model’s “hands and eyes,” while the language model supplies high-level semantic knowledge about the task.


(say-can robot helper)

We show how low-level tasks can be combined with large language models so that the language model provides high-level knowledge about the procedures for performing complex and temporally extended instructions, while value functions associated with these tasks provide the grounding necessary to connect this knowledge to a particular physical environment.

We evaluate our method on a number of real-world robotic tasks, where we show that this approach is capable of completing long-horizon, abstract, natural language instructions on a mobile manipulator.

(Via say-can)

Science fiction of course features many helpful robots, like TARS and CASE from the movie Interstellar.

Scroll down for more stories in the same category. (Story submitted 4/27/2023)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

Robot With Human Brain Organoid - 'A Thrilling Story Of Mechanistic Progress'
'A human brain snugly encased in a transparent skull-shaped receptacle.' - Otis Adelbert Kline, 1936.

Optimus Robot Will Be A Good Nanny, Says Musk
'Nanny is different,' Tom Fields murmured... 'she's not like a machine. She's like a person.' - Philip K. Dick, 1955.

LORIS Passive-Gripper Climbing Robot
'At the end of each appendage's eight fingers there are tinier appendages...' - Ken MacLeod, 2003.

Athena Smart Security Guard Robot With Face Recognition
'You are who we say you are, Dr. Dakin,' Turner said.' - Greg Bear, 2003.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

Science Fiction Timeline
1600-1899
1900-1939
1940's   1950's
1960's   1970's
1980's   1990's
2000's   2010's

Current News

Cognify - A Prison Of The Mind We've Seen Before In SF
'So I serve a hundred years in one day...'

Robot With Human Brain Organoid - 'A Thrilling Story Of Mechanistic Progress'
'A human brain snugly encased in a transparent skull-shaped receptacle.'

Goodness Gracious Me! Google Tries Face Recognition Security
'The actuating mechanism that should have operated by the imprint of her image on the telephoto cell...'

With Mycotecture, We'll Just Grow The Space Habitats We Need
'The only real cost was in the plastic balloon that guided the growth of the coral and enclosed the coral's special air-borne food.'

Can A Swarm Of Deadly Drones Take Out An Aircraft Carrier?
'The border was defended by... a swarm of quasi-independent aerostats.'

WiFi and AI Team Up To See Through Walls
'The pitiless M rays pierced Earth and steel and densest concrete as if they were so much transparent glass...'

Climate Engineering In California Could Make Europe's Heat Waves Worse
'Pina2bo would have to operate full blast for many years to put as much SO2 into the stratosphere as its namesake had done in a few minutes.'

Optimus Robot Will Be A Good Nanny, Says Musk
'Nanny is different,' Tom Fields murmured... 'she's not like a machine. She's like a person.'

ESA To Build Moon Bases Brick By Printed LEGO Brick
'We made a crude , small cell and were delighted - and, I admit, somewhat surprised - to find it worked.'

Does The Shortage Of Human Inputs Limit AI Development?
'...we've promised him a generous pension from the royalties.'

Textiles That Harvest Energy And Store It
'The clothes and jewelery drew their tiny power requirements from her movements.'

LORIS Passive-Gripper Climbing Robot
'At the end of each appendage's eight fingers there are tinier appendages...'

Neuroplatform Human Brain Organoid Bioprocessor Uses Less Electricity
'Cultured brains on a slab.'

Drug To Regenerate Teeth In Humans
'We want to do something to help those who are suffering from tooth loss or absence,' said lead researcher Katsu Takahashi.

Coin-Sized Nuclear Battery Good For 100 Years
'...power pack the size of a pea.'

Live Stream With Meta-Ban Multimodal Smart Glasses
'...the bug-eyed, opaque gape of her True-Vu lenses.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.