Introducing KIKI, The World's First Text-to-Sign Translation Engine Designed to Enhance Accessibility for Emergency Alerts

In This Article:

The revolutionary avatar was designed by NHK Enterprises Inc. and NHK Global Media Services, a division of Japan's Public Broadcaster, in collaboration with global marketing company Media.Monks

NEW YORK, May 30, 2024 /PRNewswire/ -- S4Capital's operating brand Media.Monks, a digital-first marketing and advertising services company, partnered with NHK Enterprises Inc. and NHK Global Media Services, a division of Japan's Public Broadcaster, to create the world's first text-to-sign translation engine for emergency alerts. KIKI is a lifelike virtual avatar designed to generate dynamic Japanese Sign Language (JSL) interpretations from text inputs for public distribution in real-time. KIKI generates JSL disaster messaging for the Deaf community in less than 10 seconds, taking into account the language's unique syntax, the importance of pausing, and the evocation of emotion not conveyed through closed captions.

There are more than 300,000 people in the Deaf community in Japan, a region with one of the highest earthquake risks in the world. Closed captioning on emergency alerts doesn't capture the same meaning, word order, or emotion for those who communicate primarily through sign language. For the Deaf community, transcribed spoken word is an entirely different language than sign language. During an emergency, closed captioning alone requires them to translate an entirely different language as they read the alert. That's why NHK Enterprises Inc. and NHK Global Media Services sought to address this lack of accessibility and linguistic diversity during emergency alerts in Japan.

In collaboration with JSL experts, including professors from Tsukuba University of Technology, NHK Enterprises Inc. and NHK Global Media Services built an extensive database of JSL signs through motion capture technology with unprecedented accuracy and realism.

Media.Monks brought KIKI to life through advanced 3D technology, giving her natural human characteristics and a personality to enhance the experience with lifelike quality and resolution that fosters trust and inclusivity. From there, Media.Monks designed a cutting-edge web platform to dynamically translate plain text into expressive, lifelike sign language videos delivered in real-time through KIKI's hyper-realistic personality.

During the January 1, 2024, 7.6 magnitude earthquake in Japan, the innovative system developed by Media.Monks communicated life-saving emergency alerts in JSL across the region, enhancing accessibility and inclusivity on a wide scale. In Spring 2025, KIKI will become the first ambassador at Tokyo's Deaflympics.