The video above shows the hurdles event in Kinect Sports made accessible to players who are blind, using a technique called real time sensory substitution. Using video analysis, visual cues that indicate when to jump are detected and then translated into vibrotactile cues provided with a Wii remote, which should allow someone who is blind to play this game without visual feedback.
I can see this system greatly assisting some learning disabled players in getting the timing of jumps right too. Fantastic stuff, with so many possibilities.
Read more at the SpecialEffect Accessible GameBase.
0 comments on “Real Time Sensory Substitution”