Researchers at Microsoft are developing software that will enable the Microsoft Xbox One video game console to automatically read sign language.
The system works with Microsoft Kinect, a webcam-style add-on peripheral for the Xbox One console. Kinect allows users to control and interact with the Xbox without the need to touch a game controller. Instead, users can interact using gestures and spoken commands.
Using Kinect, Microsoft researchers are now developing automatic sign language interpretation software for multiple languages and sign languages. Although still in the development phase, Microsoft says that the early results are encouraging.
Below is a video demonstration of a version that interprets both ASL or Chinese sign language into English.