A B C D E F G H I J K L M N O P Q R S T U V W X Y Z
VToonify Video Manicuring Program
VToonify offers controllable high-resolution portrait video style transfer.
Generating high-quality artistic portrait videos is an important and desirable task in computer graphics and vision. Although a series of successful portrait image toonification models built upon the powerful StyleGAN have been proposed, these image-oriented methods have obvious limitations when applied to videos, such as the fixed frame size, the requirement of face alignment, missing non-facial details and temporal inconsistency.
In this work, we investigate the challenging controllable high-resolution portrait video style transfer by introducing a novel VToonify framework. Specifically, VToonify leverages the mid- and high-resolution layers of StyleGAN to render high-quality artistic portraits based on the multi-scale content features extracted by an encoder to better preserve the frame details. The resulting fully convolutional architecture accepts non-aligned faces in videos of variable size as input, contributing to complete face regions with natural motions in the output. Our framework is compatible with existing StyleGAN-based image toonification models to extend them to video toonification, and inherits appealing features of these models for flexible style control on color and intensity.
This work presents two instantiations of VToonify built upon Toonify and DualStyleGAN for collection-based and exemplar-based portrait video style transfer, respectively. Extensive experimental results demonstrate the effectiveness of our proposed VToonify framework over existing methods in generating high-quality and temporally-coherent artistic portrait videos with flexible style controls.
VToonify: Controllable High-Resolution Portrait Video Style Transfer [pdf])
The VToonify software progam makes a curated, manicured version of one's visage seem easy. Maybe as easy as Bruce Sterling's video-manicuring program from his 1985 novel Schismatrix:
Lindsay had a brief glimpse of the man's true appearance - white hair in spiky disarray, red-rimmed eyes - before a video-manicuring program came on line. The program raced up the screen one scan line at a time, subtly smoothing, deleting and coloring.
(Read more about Sterling's video-manicuring program)
Scroll down for more stories in the same category. (Story submitted 9/27/2022)
Follow this kind of news @Technovelgy.
| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |
you like to contribute a story tip?
Get the URL of the story, and the related sf author, and add
Comment/Join discussion ( 0 )
Related News Stories -
'Make Sunsets' Tweaks Climate By Atmospheric Alteration
'Pina2bo would have to operate full blast for many years to put as much SO2 into the stratosphere as its namesake had done in a few minutes.' - Neal Stephenson, 2021.
Fusion Power Breakthrough?
'The prospect of enough D-N beryllium to make fusion power really cheap...' - Gerald Vance, 1956.
Thin Film Dome Protects Cities From Nuclear Blasts
'What fabric can take that kind of a load? Synthetic spider silk.' - Robert Heinlein, 1939.
Cyborg Eye Flashlight Lights Up The Room
'Foyle pressed a tooth with his tongue and the peripheral cells of his retina were excited into emitting a soft light.' - Alfred Bester, 1956.
Technovelgy (that's tech-novel-gee!)
is devoted to the creative science inventions and ideas of sf authors. Look for
the Invention Category that interests
you, the Glossary, the Invention
Timeline, or see what's New.
'Courier Commons' By Tomorrow Lab, From Karl Schroeder (and Bruce Sterling?)
'The pokkecon rang again. *The coffee’s for him?* Tsuyoshi said.'
Terrifying Robotic Apple Harvester
'... little machines, that went from plant to plant.'
Jetson-Style Clockwork Robot Nail Salon Coming To Target Near You
The Jetsons imagined so much future.
Mechanical Horse Sculpture Gallops In Place
'Rod placed the brain inside the panel... the horse raised its head, wiggled its ears, blinked twice, gave a tentative whinny.'
'Make Sunsets' Tweaks Climate By Atmospheric Alteration
'Pina2bo would have to operate full blast for many years to put as much SO2 into the stratosphere as its namesake had done in a few minutes.'
Eviation Alice Electric Plane First Flight
'A white electric plane approached at great speed...'
Hotels Turn To Robots As Human Workers Regroup
'Chain of hotels that specialized in non-human service.'
Changesite Mineral To Be Mined On Moon By China
'But then... not every bulldozer operator works on the Moon.'
Tongue-Controlled Tong Wearable Mouth Computer
'Griff found the white and pink map distracting and switched it off using his tongue mouse.'
Is It Better To Be Short?
'He was one of the smaller, energy-saving new breed...'
Taikonaut Tai Chi Foot Loops
'Jimmy Cardigan and Harlowe, staring through the darkside port, had their feet in the foot-loops...'
Space Billboards Would Ruin Our View Of The Cosmos
'But the rising sign, as it had been designed to do, held his eyes. A vast circle of scarlet stars came up into the greenish desert dusk.'
Orion's 'Skip-to-M'Lou' Entry
'A lightning pilot possibly could land that tin toy without power and still walk away from it provided he had the skill to play Skip-to-M’Lou in and out of the atmosphere...'
MarsCat and MetaCat, Your Robot Cat Companions
'It was you who betrayed me — you and your robot cat.'
Mars Mission Using Nuclear Thermal Propulsion
'with its atomic engine as noiseless as a dancing sunbeam...'
Physiotherapists Get Help From Robots
'Most of the Members went into cold-rest; the others tended them...'
More SF in the News Stories
More Beyond Technovelgy science news stories