Science Fiction
Dictionary
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
 |
MovieReshape Like Bruce Sterling's Video-Manicuring
MovieReshape is a system that makes possible "quick and easy" manipulation of the body shape of a human actor in video footage. The system makes use of a morphable model of human shape in three dimensions; the model was created using laser scans of real people.
(MovieReshape Morphable body model [pdf])
(a) Samples of the pose and shape parameter
space that is spanned by the model.
(b) The average human shape with the
embedded kinematic skeleton.
Take a look at this short video demonstrating MovieReshape; it's a remarkable tool
(MovieReshape like Sterling's video-manicuring program)
Our system takes as input a single-view or multi-view video sequence with footage of a human actor to be spatio-temporally reshaped (Fig. 2). There is no specific requirement on the type of scene, type of camera, or appearance of the background.As a first step, the silhouette of the actor in the video footage is segmented using off-the-shelf video processing tools. The second step in the pipeline is marker-less model fitting. There, both the shape and the pose parameters of the 3D model are optimized such that it reprojects optimally into the silhouette of the actor in each video frame. Once the model is tracked, the shape parameters of the actor can be modified by simply tweaking a set of sliders corresponding to individual semantic shape attributes. Since the original PCA parameter dimensions of the morphable shape model do not directly correspond to plausible shape attributes, we learn a mapping from intuitive attributes, such as muscularity or weight, to the underlying PCA space.
Now reshaping can be performed by adjusting plausible parameter values. Once the target set of shape attributes has been decided on, they are applied to the actor in all frames of the video input by performing image-based warping under the influence of constraints that are derived from the re-projected modified body model.
It looks like real-life technology has finally caught up with Bruce Sterling's video-manicuring program from his 1985 novel Schismatrix:
Lindsay had a brief glimpse of the man's true appearance - white hair in spiky disarray, red-rimmed eyes - before a video-manicuring program came on line. The program raced up the screen one scan line at a time, subtly smoothing, deleting and coloring.
(Read more about Sterling's video-manicuring program)
I think that Ray Bradbury should also get an honorable mention for the spot-wavex scrambler from his 1953 classic Fahrenheit 451.
From MovieReshape: Tracking and Reshaping of Humans in Videos [pdf] via Gizmodo.
Scroll down for more stories in the same category. (Story submitted 10/11/2010)
Follow this kind of news @Technovelgy.| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |
Would
you like to contribute a story tip?
It's easy:
Get the URL of the story, and the related sf author, and add
it here.
Comment/Join discussion ( 0 )
Related News Stories - (" Engineering ")
Vipera Electric Skis From Frigid Dynamics
'JOAN strapped on her power-skis...' - Ursula K. Le Guin, 1964.
Pivotal Blackfly Electric Aircraft Lifts And Hovers
'That explains how it was so easy for me to remain motionless in midair...' - RH Roman, 1929.
Tiny Flying Robot Weighs Just One Gram
'Aerostat meant anything that hung in the air. This was an easy trick to pull off nowadays.' - Neal Stephenson, 1995.
Some Ringworld Configurations Are Stable
'The Ringworld had no horizon. There was no line where the land curved away from the sky.'
Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.
Science Fiction
Timeline
1600-1899
1900-1939
1940's 1950's
1960's 1970's
1980's 1990's
2000's 2010's
Current News
Robot Hand Creeps Along, Separate From It's Owner
'The crawling... object was V-Stephen's surgeon-hand...'
Taikonauts Exercise In China's Tiangong Space Station
'Joe got out the gravity-simulator harnesses...'
Korean Exoskeleton Suit F1 Helps You Put It On
'Better late than never.'
Have AI Researchers Given Up On 'Bio-Babies'?
'You couldn't have the capstone without the pyramid to hold it up.'
Bunker Busters and Bore-Pellets
'The first revelation of the new Soviet bore-pellets.'
'Spikeless' Brand Swizzle Stick Detects Spiked Drinks
'the unobtrusive inspections with tiny remote-cast snoopers...'
Heart Patches Grown In The Lab Repair Hearts
I'm hoping that this procedure becomes a normal part of medical practice!
Humanoid Robots Spotted In Homes Performing Household Chores
'... nothing was perfected until M. Pantalon announced the completion of his automatic valet.'
Musk Proposes Sites For Martian Cities
'...its streets were of remarkable width, with few or no buildings so high as mosques, churches, State-offices, or palaces in Tellurian cities.'
Bambot Open Source Cheap Delivery Robot
'Not since the time he rewired the delivery robot...'
Robot Collective Acts Like A Smart Material
'...it was all composed of tiny, identical cubes, carefully laid to form a tilelike surface.'
Vipera Electric Skis From Frigid Dynamics
'JOAN strapped on her power-skis...'
Pixel Watch 'Loss of Pulse Detection' And Philip K. Dick
'He carried on his person a triggering mechanism sensitive to his heartbeat.'
Nuclear Plant Restarted To Power AI To Feed Us Dreams
'...Anything was possible in my imaginary environment.'
SpaceX's Starman Tesla Roadster In Space
'Somewhere in space, a chrome and blue automobile raced the green light of Earth.'
Pivotal Blackfly Electric Aircraft Lifts And Hovers
'That explains how it was so easy for me to remain motionless in midair...'
