VirtualHome: Teaching Robots To Do Chores Around The House

Before we can have Robert Heinlein's wonderful home robot Flexible Frank (from his 1956 classic The Door into Summer...

Just what did I want Flexible Frank to do? Answer: any work a human being does around a house. He didn't have to play cards, make love, eat or sleep, but he did have to clean up after the card game, cook, make beds, and tend babies - at least he had to keep track of a baby's breathing and call someone if it changes.

...We need to train them. Hence, VirtualHome, the activity simulator for teaching household tasks to robots.


(VirtualHome video: Teaching Robots To Do Chores)

In this paper, we are interested in modeling complex activities that occur in a typical household. We propose to use programs, i.e., sequences of atomic actions and interactions, as a high level representation of complex tasks. Programs are interesting because they provide a non-ambiguous representation of a task, and allow agents to execute them. However, nowadays, there is no database providing this type of information. Towards this goal, we first crowd-source programs for a variety of activities that happen in people’s homes, via a game-like interface used for teaching kids how to code. Using the collected dataset, we show how we can learn to extract programs directly from natural language descriptions or from videos. We then implement the most common atomic (inter)actions in the Unity3D game engine, and use our programs to “drive” an artificial agent to execute tasks in a simulated household environment. Our VirtualHome simulator allows us to create a large activity video dataset with rich ground-truth, enabling training and testing of video understanding models. We further showcase examples of our agent performing tasks in our VirtualHome based on language descriptions.

(From VirtualHome: Simulating Household Activities via Programs [pdf])

I just love the idea of a household robot, maybe one of the following will be perfected in my lifetime:

  - Twendy-One Robot Is Your Humanoid Helper
  - REEM-B Robot Autonomous Helper Video
  - Care-O-Bot Robot Does Chores One-Handed
  - Basil Reification Robot
  - Toyota Delivery Robot Home Helper
  - ATLAS Robot Now Does Housework!
  - Elon Musk et. al. OpenAI Household Robot
  - Housekeeping Robots Easy To Imagine, Tough To Make

Scroll down for more stories in the same category. (Story submitted 6/7/2018)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Robotics ")

Tesla Will Have Metal Gear Snake Autocoupler, Musk Confirms
'Its motion was so swift, complex, and perfect that at first I did not see it as a machine, in spite of its metallic glitter.' - HG Wells, 1898.

I Love Ceiling-Mounted Robots
'Immediately an enormous apparatus fell on to her out of the ceiling...' - EM Forster, 1911.

Salto Jumping Robot Now Sticks Landing!
'Lucky touched the leap knob and the hopper's leg retracted.' - Isaac Asimov, 1954.

It's Time For Robots With Soft, Sensitive Skin
Sure, solid metal skin robots looked great once - like in science fiction movies of the 1920's.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Tesla Will Have Metal Gear Snake Autocoupler, Musk Confirms
'Its motion was so swift, complex, and perfect that at first I did not see it as a machine, in spite of its metallic glitter.'

Starlink Satellites Leading Edge On-Orbit Debris Mitigation
Propulsion-assisted orbital decay, brought to you by SpaceX.

Healight Ultraviolet Endotracheal Device Has Covid-19 Treatment Potential
'He applied the tip of the instrument to the interior of the wound...'

Parents Use AI To See One Last Message From Their Deceased Son
'...what's to keep me from showing face, Man?'

Satoshi Tomizu Creates Pocket Universes And Worldcraft Bubbles In Glass
'The Worldcraft bubble glittered, catching the light...'

Space Hero Inc. Offers Trip To ISS As Reality Show Prize
'This is Elmer Schmitz, presenting to you the finalists in our Aviation Quiz Program...'

I Love Ceiling-Mounted Robots
'Immediately an enormous apparatus fell on to her out of the ceiling...'

Armano Remote Control Excavator
'The bulldozer moved through the... mine... '

OK, NASA 3D Printer Of Food Not Yet Star Trek Food Synthesizer
Maybe not, but we're seeing definite progress.

Kelly Clarkson Show Like Black Mirror '15 Million Merits'
'These people are pieces of software called avatars.'

Salto Jumping Robot Now Sticks Landing!
'Lucky touched the leap knob and the hopper's leg retracted.'

Gyroscopic Median-Straddling Mass Transit Vehicles
'It was among these leviathans that the little gyrocar was daring to thrust its puny self...'

Bigrating Laser Beam-Riding Light Sail Is Self-Correcting
'That sail will be twenty thousand miles at the wide part.'

ISS Astronauts Test Estee Lauder 'Advanced Night Repair' Skin Serum
'Out in the New Moon, just ask for what you want...'

LG Wing Twisting Smartphone Might Be Fun
'A polycarbon screen unfurled...'

Mushroom Coffin Returns You To Nature, Naturally
'She touched the leaf. She was wanted.'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.