Fujitsu Touchscreen Mixes Real And Virtual Worlds

This demo from Fujitsu presents a convincing case for their innovative touchscreen projector technology. Take a look at the video, and see how real-world materials like books and magazines can be copied into a virtual space and then manipulated.


(Touchscreen interface projector from Fujitsu)

"We think paper and many other objects could be manipulated by touching them, as with a touchscreen. This system doesn't use any special hardware; it consists of just a device like an ordinary webcam, plus a commercial projector. Its capabilities are achieved by image processing technology."

This technology measures the shape of real-world objects, and automatically adjusts the coordinate systems for the camera, projector, and real world. In this way, it can coordinate the display with touching, not only for flat surfaces like tables and paper, but also for the curved surfaces of objects such as books.

This system also includes technology for controlling color and brightness, in line with the ambient light, and correcting for individual differences in hand color. In this way, it can identify fingertips consistently, with little influence from the environment or individual differences.

Also, in situations that don't use touch, the system can be operated by gesturing. In this demo, when you move your fist, you can manipulate the viewpoint for 3D CAD data. So, there could be applications for this touch system by combining it with current gesture systems.

I was thinking that this device could be used in several different contexts. For one thing, it would be ideal for students who need to work with their own computer word processing or other report-preparation systems to quickly bring in materials that had not been digitized. For example, suppose you had found an illustration in a book or magazine that you wanted to include in a report.

Another use would be at a government center where you needed to present documents in order to obtain a drivers license or pay a fine. You could put your information on the desk in front of the clerk, who would quickly manipulate your paper items and bring them into an onscreen, computerized system. I could see how this would be useful in banks or other such institutions as well.

I can't think of a specific science fictional example for this interface. The earliest use of a projected virtual interface that I can think of is the virtual keyboard presented in Frederik Pohl's 1965 novel The Age of the Pussyfoot.

I'll probably be called for overreaching on this one, but the first thing I thought of when viewing how this technology works was the scenes in the memorable 1982 movie Tron when Jeff Bridges was digitally scanned and then captured, forced to enter the virtual world of the computer.


(Captured and pulled into a virtual world in Tron)

Via DigInfo.

Scroll down for more stories in the same category. (Story submitted 4/16/2013)

Follow this kind of news @Technovelgy.

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 1 )

Related News Stories - (" Computer ")

Kelly Clarkson Show Like Black Mirror '15 Million Merits'
'These people are pieces of software called avatars.' Neal Stephenson, 1992.

Neuralink Will Land A Chip In Your Brain
'What are you talking about? Do you mean a neural lace?' - Iain M. Banks, 2010.

100 Terabyte Exadrive SSD Also Has Biggest Price
'A man could carry AIs or complete planetary dataspheres in a Schrön loop.' - Dan Simmons, 1989.

Google Now Expects Chips To Design Themselves
'What lay down there? Energy, tubes and pipes, wiring, transformers, self-contained machinery...' - Philip K. Dick, 1960.

 

Google
  Web TechNovelgy.com   

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

 

 

 

 

 

Current News

Jet-Powered Flying Suits Tested By Navy
'With his motor in operation, he moves like a diver, head foremost...'

Pub Installs Electrified Fence Around Bar
'I start twelve immensely strong wires--naked, not insulated --from a big dynamo...'

What Does A Tesla Full Self-Driving Car See?
'All objects within my panoramic gaze trembled and vibrated like quick motion pictures...'

BioVYZR Is Ready, Anti-Covid19 PAPR Lovers
'Some clad in the insulated space-suits, with their transparent glassite helmets.'

Tesla Will Have Metal Gear Snake Autocoupler, Musk Confirms
'Its motion was so swift, complex, and perfect that at first I did not see it as a machine, in spite of its metallic glitter.'

Starlink Satellites Leading Edge On-Orbit Debris Mitigation
Propulsion-assisted orbital decay, brought to you by SpaceX.

Healight Ultraviolet Endotracheal Device Has Covid-19 Treatment Potential
'He applied the tip of the instrument to the interior of the wound...'

Parents Use AI To See One Last Message From Their Deceased Son
'...what's to keep me from showing face, Man?'

Satoshi Tomizu Creates Pocket Universes And Worldcraft Bubbles In Glass
'The Worldcraft bubble glittered, catching the light...'

Space Hero Inc. Offers Trip To ISS As Reality Show Prize
'This is Elmer Schmitz, presenting to you the finalists in our Aviation Quiz Program...'

I Love Ceiling-Mounted Robots
'Immediately an enormous apparatus fell on to her out of the ceiling...'

Armano Remote Control Excavator
'The bulldozer moved through the... mine... '

OK, NASA 3D Printer Of Food Not Yet Star Trek Food Synthesizer
Maybe not, but we're seeing definite progress.

Kelly Clarkson Show Like Black Mirror '15 Million Merits'
'These people are pieces of software called avatars.'

Salto Jumping Robot Now Sticks Landing!
'Lucky touched the leap knob and the hopper's leg retracted.'

Gyroscopic Median-Straddling Mass Transit Vehicles
'It was among these leviathans that the little gyrocar was daring to thrust its puny self...'

More SF in the News Stories

More Beyond Technovelgy science news stories

Home | Glossary | Invention Timeline | Category | New | Contact Us | FAQ | Advertise |
Technovelgy.com - where science meets fiction™

Copyright© Technovelgy LLC; all rights reserved.