+60173309581
Five Bachelor’s in Interactive Media and Immersive Technology (Honours) with a specialism in VR/AR students from the Asia Pacific University of Technology & Innovation (APU) have achieved remarkable success at XR JAM 2025: FutureScape, clinching the First Runner-Up position and the coveted People’s Choice Award.
Competing under the team name MetaMorph, students Cheon Zi Chen, Hendry Tam Chee Seng, Chin Guan Yu, Lee Zheng Wei, and Lim Chun Keat impressed judges and participants alike with their pioneering project, HearMe2, an immersive XR translation prototype designed to empower the Deaf-mute community.
Innovating for Inclusivity: The Birth of HearMe2
Held from 24th to 26th October 2025 at Xsolla Curine Academy and co-organised by VORTEXR Club, KL ACM SIGGRAPH and Taylor’s University Agents of Tech, XR JAM 2025 saw 13 top Malaysian university teams racing against time in an intense 48-hour innovation challenge.
Guided by mentor Ts Muhammad Nur Affendy Nor’a, a specialist in computer vision, spatial interaction design and hand gesture recognition for AR from APU’s School of Computing (SoC), Team MetaMorph set out to reimagine communication accessibility. Their solution, HearMe2, leverages extended reality’s immersive capabilities to facilitate seamless, real-time interaction between the Deaf-mute community and the wider public.
A Groundbreaking XR Translator for Real-World Accessibility
HearMe2 stands out as a transformative prototype that addresses longstanding communication barriers. The solution integrates computer vision technology for real-time tracking of hand gestures, paired with an AI-driven classification model built on Bahasa Isyarat Malaysia (BIM) standards.
Beyond gesture recognition, HearMe2 offers an intuitive XR interface that enhances user experience and reduces communication barriers.
Beyond gesture recognition, HearMe2 offers:
- Real-time AI translation into Malay, English, and Chinese
- Text-to-speech capability, empowering Deaf-mute users to vocalise responses
- An intuitive XR interface that enhances user experience and reduces communication friction
By blending XR and AI, HearMe2 showcases how emerging technologies can redefine accessibility, promote social inclusion, and create new pathways for community engagement.
Recognition, Rewards, and a Global Stage
Team MetaMorph’s outstanding performance, bolstered by strong teamwork, technical mastery and effective mentorship, earned them RM2,000 in cash prizes and 25 exclusive Berjaya Times Square Theme Park vouchers.
In an even greater honour, organisers announced that HearMe2—along with all other winning entries—has been selected for showcase at ACM SIGGRAPH Asia, one of the world’s most prestigious gatherings in computer graphics and interactive technologies.
The event, set to take place in Malaysia next year, will give Team MetaMorph a powerful platform to present their innovation to international researchers, industry leaders and global XR trailblazers.
A Testament to APU’s Strength in Emerging Technologies
This dual win underscores APU students’ ability to unite technical excellence with user-centric design, delivering solutions that respond to real-world challenges in accessibility and communication.
Speaking on his students’ achievements, mentor Ts Muhammad Nur Affendy Nor’a shared, “MetaMorph’s achievement is a testament to APU’s commitment to empowering students with cutting-edge skills and fostering solutions that make a real difference and are impactful in society.”
He also extended appreciation to Professor Ir EUR ING Dr Vinesh Thiruchelvam, Chief Innovation and Enterprise Officer at APU; Assistant Professor Ts Dr Siti Azreena Mubin, XR Studio Lead; and Associate Professor Ts Dr Tan Chin Ike, Head of the School of Computing, for their unwavering support and guidance.
Pioneering the Future of XR Innovation
MetaMorph’s success reflects APU’s rising influence as a leader in XR innovation within Malaysia and beyond. By nurturing talent that not only excels technically but also thinks empathetically, APU continues to drive the creation of meaningful technologies that bridge gaps, elevate communities, and transform lives.
As HearMe2 prepares for its global debut, the team’s journey stands as an inspiring example of how passion, innovation and purposeful design can redefine the future of immersive technology—and make the world a more inclusive place for all.