The Challenge
My grandfather has recently completely lost hearing in both ears, after about 15 years of steady decline caused by Ménière's disease. During that time neither himself or my family made meaningful effort to learn sign language, as it was considered ‘too complicated’ and ‘too much effort’. As a result, the only way to communicate with my grandfather now is via handwritten notes, slowing down communication considerably and making him feel isolated and overlooked.
I believe this is a common trajectory for a lot of families which could be very different if only sign language learning was made more accessible and casual, similar to to playing a fun game. The accurate hand tracking feature of the Oculus Integration SDK offers a new exciting way of bringing sign gesture learning into VR:
The Result
The bootcamp timeline allowed me to spend circa 25 hours on the prototype spread over a week. The full list of app features is included below:
- Developed for Quest 2
- Oculus Integration SDK
- Hand tracking and hand pose detection
- Hand poses inventory based on ASL (American Sign Language) fingerspelling
- Hand pose skeleton debugging - guiding the user to the correct hand pose
- Finger-spelling word challenge
- Integrated UI
Reflecting on the Project
Overall I was quite happy with the one week progress this week, particularly given the challenging scope. I would have liked to have more time to research sign language in general which would have perhaps helped with designing the learning experience. I would have also wanted to spend more time on developing the spelling challenge experience in making it more fun and engaging.
The below are some of the features I would like to develop in the future:
Copyright © 2021 agnieszka zielke - All Rights Reserved.
Powered by GoDaddy Website Builder