Designing a mixed reality experience to help low vision people "seeing" the world by spatial sound
The problem
Low vision people or blind people, they have difficulties in seeing the 3D world; they mainly use sound and touch to get this information. At the same time, applications of mixed reality technology are mostly in the visual perspective, an exploration in the hearing space innovative.
Our solution
We get the inspiration from bats; they use the ultrasound to detect the environment. We also get inspiration from Seeing AI. We try to use the spatial sound in Hololens to help low vision people or blind people get the environment information (mainly direction and distance).
* Seeing AI is an artificial intelligence application developed by Microsoft. It is a free app that narrates the world around you. Designed for the blind and low vision community, this ongoing research project harnesses the power of AI to open up the visual world and describe nearby people, text and objects.
My work
Interaction design
Teammate
