Undergraduates' Video Game Wins RESNA 2024 Student Design Challenge
Meaningful game design and collaboration helps visually impaired kids play on an equal footing
A team of six Stevens Institute of Technology students recently claimed first place in the national Rehabilitation Engineering and Assistive Technology Society of North America (RESNA) 2024 Student Design Challenge Competition with their music and rhythm-based video game, Haptic Hero, which they designed for players with visual impairments.
With over three billion people worldwide playing video games on devices ranging from home consoles to mobile apps, gaming is becoming increasingly diverse. For many, gaming offers more than just entertainment; it provides a sense of community. However, games haven’t always been accessible to everyone, especially those with disabilities.
A key issue is that designing accessibility from the outset of product development remains a significant challenge in the gaming industry, limiting opportunities for visually impaired students.
Haptic Hero, modeled after Guitar Hero, replaces visual cues with “haptic” feedback — that is, using sound and vibration to guide players. The student project showcases assistive technology designs that enhance independence for individuals with disabilities.
Stevens mechanical engineering major, Richard He ’24, expressed that winning this award highlights the importance of accessibility in gaming and validates the efforts of the team to create an inclusive experience for all players.
“The recognition our team received makes me proud because we were able to bring universal design to the forefront with Haptic Hero,” said He. “The innovative thinking found throughout the Stevens curriculum helped us come together as an interdisciplinary team to tackle this challenge and create a project that can improve lives.”
He was joined by fellow mechanical engineering majors, Sebastian Almonte ’24, Emanuel Diaz ’24 and Paul Leible ’24, as well as computer science majors Hasumi Tanemori ’24 and Kimberly Tsang ’24, to develop a fun, affordable and easy-to-learn game for visually impaired young people.
Their faculty advisor, Frank Fisher, Stevens professor of mechanical engineering and associate dean for undergraduate studies in the Charles V. Schaefer, Jr. School of Engineering and Science, praised the team’s commitment and potential to change lives with their student-generated idea.
“I am very proud of this prestigious external recognition that the team has rightfully earned for their outstanding project. Through the project, the team was able to utilize their creativity, passion and the knowledge gained from their coursework to envision and develop a clever prototype that could potentially impact the lives of children impacted by disabilities,” said Fisher.
Award-winning design promotes inclusivity in gaming
The Haptic Hero project began its journey to recognition at the 2024 Stevens Innovation Expo, where it was celebrated for its award-winning design. However, the project’s roots trace back to He and his collaboration with Ian Matty at the MakerSpace in Mountain Lakes Public Library (MLPL).
The idea emerged from He’s experiences working with Matty at an MLPL MakerSpace tech week at Saint Joseph’s School for the Blind in Jersey City, New Jersey. Recognizing Matty’s extensive experience with the visually impaired community, He was inspired to involve him in the senior design project. This collaboration ignited the project’s inception, focusing on accessibility and universal design.
The Haptic Hero team used inexpensive electronic components throughout their development process and consulted extensively with visually impaired students to guide their design. They attended conferences like Inclusion in Science Learning a New Direction (ISLAND): A Conference on Disability and STEM in 2023 in Princeton, New Jersey; and they visited St. Joseph’s School for the Blind to gather feedback on their 3D-printed control pad.
“I knew that the Haptic Hero team had excellent technical skills. However, I discovered that they would create a truly innovative social video game when all six team members enthusiastically braved awful weather to be part of the Abacus Bee in Princeton,” said Matty, an advocate for universal design. “The team was energetic at seeking prototype feedback, making sure they gave all of the kids and families opportunities to be part of their design process.”
This experience and feedback helped shape the game’s design, ensuring it met the needs and desires of its intended audience. Matty emphasized the importance of creating games like Haptic Hero to help visually impaired kids play on an equal footing, fostering a more inclusive world. He noted the team’s genuine appreciation for universal design.
“It was demonstrated by their ability to adjust their designs quickly, iterating often and connecting with their users,” said Matty.
In addition to winning the RESNA competition, the Haptic Hero project also received the 2024 AT IMPACT Student Award, a recognition from the Initiative to Mobilize Partnerships for Successful Assistive Technology Translation (IMPACT) Center at the University of Pittsburgh. The award celebrates visionary creators whose groundbreaking products show promise in unlocking human potential. The team also received the John Barnes Senior Design Award, supporting Stevens Senior Design groups pursuing projects that merge art and engineering, highlighting their achievement in combining these disciplines.
Haptic Hero’s journey from conception to award-winning design not only garnered recognition from various organizations and competitions, but it has also highlighted the potential for innovation and compassion to create a more inclusive future. The team’s dedication to accessibility and inclusion in gaming is a testament to the impact of meaningful design and collaboration.