Filmmaking Robot Has Roving Artistic Vision

Here's something new - a robot that makes its own movies. The eyes of the robot travel around the city on buses; the brain of the robot sits in an art gallery. The eyes of the robot collect short snippets of video, which are then transmitted to the brain of the robot as soon as the bus comes within range of a wireless Internet note.

The brain of the robot splits the video into individual frames and analyzes each one; 20 numbers reflecting the arrangement of color, shape, and detail within each frame are specified. For twelve hours a day, the robot traces a path through this visual space. But at the end of the day, the robot looks over its day's work, and joins the best parts together as a finished film. Neural networks and heuristic rules are used, but the finished film is mainly selected based on the smoothness of its movement through space.


(Selected robot film images)

The robot does not judge all of the still images it uses in creating its dreamlike movies. These are called waypoints, or targets; it traces lines between these points. The other pictures are selected because they live on the path to the next wave point. The 20 numbers that pertain to each image are fed into its five the judge mental faculties, which are:

  • Fine art. A neural network is trained to like a selection of fine art images found on the web. Most are impressionist paintings from ibiblio's web museum, but there is some contemporary and New Zealand art.
  • David Hall. David divided 100 of the robot's images into three sets, depending whether they were good, bad, or neither. A network was trained to like the good ones and hate the bad ones.
  • Enthusiast. Each day a network starts from scratch and tries to learn from and reinforce the judgement of the other two.
  • Away from mean. This heuristic prefers images on the edge of the space. Images in the centre will get included anyway, as paths traced between remote waypoints will cross the centre.
  • Away from recents. This heuristic dislikes waypoints similar to ones recently used.
The robot has a capacity of up to 5 million images; once this maximum capacity has been reached, the robot will replace its least favorite images with new ones. The robot is even capable of creating false memories, by combining and manipulating well liked and overused images.

This new robot bears an intriguing resemblance to a fictional robot camera created by science fiction writer Karen Traviss. In her 2004 novel City of Pearl, she writes about bee cam, a small, airborne, self-guided personal camcorder.

This fictional device is a little more advanced in terms of being able to determine its own direction; it is implied that the bee cam is able to find its way back to a specified location.

...He made a mental note to have the bee cam permanently active in the future, just in case he missed another chance of good footage...

He set the bee cam to focus on any movement and enjoyed the day around him. Who would have thought he would end up doing wildlife documentaries?
(Read more about the bee cam)

The filmmaking robot project was apparently headed by Douglas Bagnall, who is so incredibly modest that it is almost impossible to determine who conceived of this idea. You can see one it its films here. Story found here.

Scroll down for more stories in the same category. (Story submitted 3/30/2006)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 3 )

Related News Stories - (" Robotics ")

Tesla Will Have Metal Gear Snake Autocoupler, Musk Confirms
'Its motion was so swift, complex, and perfect that at first I did not see it as a machine, in spite of its metallic glitter.' - HG Wells, 1898.

I Love Ceiling-Mounted Robots
'Immediately an enormous apparatus fell on to her out of the ceiling...' - EM Forster, 1911.

Salto Jumping Robot Now Sticks Landing!
'Lucky touched the leap knob and the hopper's leg retracted.' - Isaac Asimov, 1954.

It's Time For Robots With Soft, Sensitive Skin
Sure, solid metal skin robots looked great once - like in science fiction movies of the 1920's.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Jet-Powered Flying Suits Tested By Navy
'With his motor in operation, he moves like a diver, head foremost...'

Pub Installs Electrified Fence Around Bar
'I start twelve immensely strong wires--naked, not insulated --from a big dynamo...'

What Does A Tesla Full Self-Driving Car See?
'All objects within my panoramic gaze trembled and vibrated like quick motion pictures...'

BioVYZR Is Ready, Anti-Covid19 PAPR Lovers
'Some clad in the insulated space-suits, with their transparent glassite helmets.'

Tesla Will Have Metal Gear Snake Autocoupler, Musk Confirms
'Its motion was so swift, complex, and perfect that at first I did not see it as a machine, in spite of its metallic glitter.'

Starlink Satellites Leading Edge On-Orbit Debris Mitigation
Propulsion-assisted orbital decay, brought to you by SpaceX.

Healight Ultraviolet Endotracheal Device Has Covid-19 Treatment Potential
'He applied the tip of the instrument to the interior of the wound...'

Parents Use AI To See One Last Message From Their Deceased Son
'...what's to keep me from showing face, Man?'

Satoshi Tomizu Creates Pocket Universes And Worldcraft Bubbles In Glass
'The Worldcraft bubble glittered, catching the light...'

Space Hero Inc. Offers Trip To ISS As Reality Show Prize
'This is Elmer Schmitz, presenting to you the finalists in our Aviation Quiz Program...'

I Love Ceiling-Mounted Robots
'Immediately an enormous apparatus fell on to her out of the ceiling...'

Armano Remote Control Excavator
'The bulldozer moved through the... mine... '

OK, NASA 3D Printer Of Food Not Yet Star Trek Food Synthesizer
Maybe not, but we're seeing definite progress.

Kelly Clarkson Show Like Black Mirror '15 Million Merits'
'These people are pieces of software called avatars.'

Salto Jumping Robot Now Sticks Landing!
'Lucky touched the leap knob and the hopper's leg retracted.'

Gyroscopic Median-Straddling Mass Transit Vehicles
'It was among these leviathans that the little gyrocar was daring to thrust its puny self...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.