Vivo’s New App Can Convert Speech to Sign Language in Real-time

Anurag — Fri, 03 Mar 2023 13:47:32 +0000

Today is World hearing day and Vivo has launched a new Sign Language Interpreter app that can convert speech to sign language and text in real-time. The app can also translate sign language gestures used by people into text or spoken language, creating a way for those who don’t understand sign language to communicate with them.

With the help of Vivo’s sign language interpreter app, hearing-impaired folks can not only communicate more effectively with family and friends but also order meals and shop more conveniently. It comes with several functions, including Speech-to-text, text-to-speech, text-to-sign language, and sign language-to-text.

Sign language recognition technology has faced several challenges over the years, such as accurately tracking finger joint movements in a limited space, detecting their direction and movement trajectory, dealing with the unique grammatical order and omitted expressions of sign language, and distinguishing similar-looking sign language movements.

However, the OrginOS team has successfully tackled these challenges and made significant progress in sign language recognition technology. The Sign Language Interpreter app can already recognize 1,200 sign language vocabulary, and that too with an accuracy rate of over 80% — equivalent to Chinese HSK level 4. It has covered more than 8,000 words in the Chinese general dictionary.

In the future, the OriginOS development team will continue to work on the app and improve its accuracy. It plans to continue upgrading the sign language recognition to cover the HSK Level 6 of the Chinese language, and the translation function be optimized for more usage scenarios.

Related:

(Via)

The post Vivo’s New App Can Convert Speech to Sign Language in Real-time appeared first on Gizmochina.

Vivo Sign language interpreter Archives - Gizmochina

Vivo’s New App Can Convert Speech to Sign Language in Real-time