Science Fiction Dictionary
A  B  C  D  E  F  G  H  I  J  K  L  M  N  O  P  Q  R  S  T  U  V  W  X  Y  Z

Home | Dictionary | Timeline | New

Google Zero-Shot Translation Gives Star Trek Fans Hope

Google's efforts to improve machine translation of languages are legendary (like Google Translate Has 51 Offline Language Packs), but now they are going well beyond what most science fiction fans are willing to suspend their disbelief for.

Zero-shot translation involves translation between language pairs that have never been explicitly seen by the system before.

Here’s how it works. Let’s say we train a multilingual system with Japanese⇄English and Korean⇄English examples, shown by the solid blue lines in the animation. Our multilingual system, with the same size as a single GNMT system, shares its parameters to translate between these four different language pairs. This sharing enables the system to transfer the “translation knowledge” from one language pair to the others. This transfer learning and the need to translate between multiple languages forces the system to better use its modeling power.

This inspired us to ask the following question: Can we translate between a language pair which the system has never seen before? An example of this would be translations between Korean and Japanese where Korean⇄Japanese examples were not shown to the system. Impressively, the answer is yes — it can generate reasonable Korean⇄Japanese translations, even though it has never been taught to do so. We call this “zero-shot” translation, shown by the yellow dotted lines in the animation. To the best of our knowledge, this is the first time this type of transfer learning has worked in Machine Translation.

The success of the zero-shot translation raises another important question: Is the system learning a common representation in which sentences with the same meaning are represented in similar ways regardless of language — i.e. an “interlingua”? Using a 3-dimensional representation of internal network data, we were able to take a peek into the system as it translates a set of sentences between all possible pairs of the Japanese, Korean, and English languages.

Via Zero-Shot Translation with Google’s Multilingual Neural Machine Translation System.

Scroll down for more stories in the same category. (Story submitted 11/13/2016)

| Email | RSS | Blog It | Stumble | del.icio.us | Digg | Reddit |

Would you like to contribute a story tip? It's easy:
Get the URL of the story, and the related sf author, and add it here.

Comment/Join discussion ( 0 )

Related News Stories - (" Artificial Intelligence ")

LLM 'Cognitive Core' Now Evolving
'Their only check on the growth and development of Vulcan 3 lay in two clues: the amount of rock thrown up to the surface... and the amount of the raw materials and tools and parts which the computer requested.' - Philip K. Dick, 1960.

When Your Child's Best Friend Is An AI
'Figments of his mind in one sense, of course, for he had shaped them...' - Clifford Simak, 1963.

Australian Authors Reject AI Training Of Llama
'It's done with a flip of the third joint of the tentacle on the down beat.' - Anthony Boucher, 1943.

Does AI Provide A Way Forward For Talk Therapy
'And there in the next room by the sofa sat a familiar suitcase, that of his psychiatrist Dr. Smile.' - Philip K. Dick, 1965.

	Web TechNovelgy.com

Technovelgy (that's tech-novel-gee!) is devoted to the creative science inventions and ideas of sf authors. Look for the Invention Category that interests you, the Glossary, the Invention Timeline, or see what's New.

Science Fiction Timeline
1600-1899
1900-1939
1940's   1950's
1960's   1970's
1980's   1990's
2000's   2010's

Current News

LLM 'Cognitive Core' Now Evolving
'Their only check on the growth and development of Vulcan 3 lay in two clues: the amount of rock thrown up to the surface... and the amount of the raw materials and tools and parts which the computer requested.'

Has Elon Musk Given Up On Mars?
'There ain't no such thing as a free lunch.'

Bacteria Turns Plastic Into Pain Relief? That Gives Me An Idea.
'I guess there's nobody round this table who doesn't have a Crosswell [tapeworm] working for him in the small intestine.'

When Your Child's Best Friend Is An AI
'Figments of his mind in one sense, of course, for he had shaped them...'

China's Drone Mothership Can Carry 100 Drones
'So the parent drone carries a spotter that it launches...'

Drones Recharge In Mid-Air Like Jets Refuel!
'...nurse drones that would cruise around dumping large amounts of power into randomly selected pods.'

Australian Authors Reject AI Training Of Llama
'It's done with a flip of the third joint of the tentacle on the down beat.'

Is China Mining Helium-3 On The Moon's Farside?
'...for months Grantline bores had dug into the cliff.'

Maybe It's Too Soon To Require Autonomous Mode
'I hope all those other cars are on automatic,' he said anxiously.

Is Agentic AI The Wrong Kind Of Smartness?
'It’s smart enough to go wrong in very complicated ways, but not smart enough to help us find out what’s wrong.'

Heat Waver - The First Ever Combo Solar Collector And Wind Turbine
'...like a spray of tulips mounted fanwise.'

Tesla 'Fleet Response Agents' Bolster FSD Autonomy
'You hate the whole idea that some bored drone pusher in a remote driving centre has got your life... in his hands.'

Mori3 Autonomous Shapeshifting Robot
'My homeland is being threatened by the Replicators. Thus far all attempts to stop them have failed.'

Tesla Seeks 'Tesla Robotaxi' And 'Robobus' Trademarks Ignoring Prior Art
'A robobus had just rolled up to the curb.'

Scary Grid Safety Robots
'The ultimate horror for our paranoid culture...'

Does AI Provide A Way Forward For Talk Therapy
'And there in the next room by the sofa sat a familiar suitcase, that of his psychiatrist Dr. Smile.'

More SF in the News Stories

More Beyond Technovelgy science news stories