A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
VToonify Video Manicuring Program
VToonify offers controllable high-resolution portrait video style transfer.
Generating high-quality artistic portrait videos is an important and desirable task in computer graphics and vision. Although a series of successful portrait image toonification models built upon the powerful StyleGAN have been proposed, these image-oriented methods have obvious limitations when applied to videos, such as the fixed frame size, the requirement of face alignment, missing non-facial details and temporal inconsistency.
In this work, we investigate the challenging controllable high-resolution portrait video style transfer by introducing a novel VToonify framework. Specifically, VToonify leverages the mid- and high-resolution layers of StyleGAN to render high-quality artistic portraits based on the multi-scale content features extracted by an encoder to better preserve the frame details. The resulting fully convolutional architecture accepts non-aligned faces in videos of variable size as input, contributing to complete face regions with natural motions in the output. Our framework is compatible with existing StyleGAN-based image toonification models to extend them to video toonification, and inherits appealing features of these models for flexible style control on color and intensity.
This work presents two instantiations of VToonify built upon Toonify and DualStyleGAN for collection-based and exemplar-based portrait video style transfer, respectively. Extensive experimental results demonstrate the effectiveness of our proposed VToonify framework over existing methods in generating high-quality and temporally-coherent artistic portrait videos with flexible style controls.
VToonify: Controllable High-Resolution Portrait Video Style Transfer [pdf])
The VToonify software progam makes a curated, manicured version of one's visage seem easy. Maybe as easy as Bruce Sterling's video-manicuring program from his 1985 novel Schismatrix:
Lindsay had a brief glimpse of the man's true appearance - white hair in spiky disarray, red-rimmed eyes - before a video-manicuring program came on line. The program raced up the screen one scan line at a time, subtly smoothing, deleting and coloring.
(Read more about Sterling's video-manicuring program)
Scroll down for more stories in the same category. (Story submitted 9/27/2022)
Follow this kind of news @Technovelgy.
| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |
you like to contribute a story tip?
Get the URL of the story, and the related sf author, and add
Comment/Join discussion ( 0 )
Related News Stories -
Philips Smart Palm Recognition Smart Deadbolt
'A palm lock must be keyed to one individual's hand shape...' - Frank Herbert, 1965.
MAGGIE Mars Aerial and Ground Global Intelligent Explorer
'placed in the wings of a plane to generate power from the light falling on that surface...' - John W. Campbell, 1930.
Pipedream Underground Delivery At Peachtree Corners
'...open mouths of pneumatic tubes, an endless row of them, each marked with its destination.' - Miles J. Breuer, 1932
Hangzhou Robotic Trash Sorting
'...good enough to recognize most things they pick up.' - Harry Harrison, 1956.
Technovelgy (that's tech-novel-gee!)
is devoted to the creative science inventions and ideas of sf authors. Look for
the Invention Category that interests
you, the Glossary, the Invention
Timeline, or see what's New.
Prophetic Offers Lucid Dreaming Halo With Morpheus-1 AI
''Leads trail away from insertion points on her face and wrist... to a lucid dreamer...'
More Like A Tumblebug Than A Motorcycle
'It is about the size and shape of a kitchen stool, gyro-stabilized on a single wheel...'
Tesla Camera-Only Vision Predicted In 1930's SF
'By its means, the machine can see.'
First Ever Proof Of Water On Asteroids
'Yes, strangely enough there was still sufficient water beneath the surface of Vesta.'
Aptera Solar EV More Stylish Than Heinlein Steel Tortoise
'When confronted by hills, or rough terrain, it did not stop, but simply slowed until the task demanded equaled its steady power output.'
Gigantic Space Sunshade Would Fight Global Warming
'...the light of the sun had been polarized by two crossed fields so that no radiation could pass.'
Untethered Spacewalk's 50th Anniversary
'But that space walk of mine wasn't so very amazing.'
ESA Designs Huge Inflatable Moonbase
'It was like being inside a balloon; indeed, that was exactly where he was.'
AlphaGarden Robot Cares For Gardens Better Than Humans
'...a simple clock-set servok with pipe and hose arms.'
Let's Make Slaver Sunflowers! Engineering Plants To Reflect Light
'The mirror-blossom was a terrible weapon.'
TeslaBot Uber Driver (2024) And The Automatic Motorist (1911)
'Robots have worse problems than anybody'
DiffuseBot Uses Generative AI To Invent New Soft Robots
'It embodies several small-scale multiple stampers, apparently for dealing with sheet metal.'
Philips Smart Palm Recognition Smart Deadbolt
'A palm lock must be keyed to one individual's hand shape...'
BMind Smart Mirror from Baracoda
Mirror, mirror, on the wall, who has the greatest wellness of all?
Ballie Your AI Robot Companion From Samsung
Projects your content anywhere you like.
Holobox? Who Doesn't Want A Home Hologram?
'...there appeared standing upon the disk, the image of a man...'
More SF in the News Stories
More Beyond Technovelgy science news stories