Digital musical instrument mobile app for children with sensorimotor impairment

This paper presents the development and evaluation of HandI, a motion-based digital musical instrument (DMI) mobile app, for the musical engagement and expression of children with sensorimotor impairment. HandI uses the smartphone’s orientation as the input control for musical expression, attempting to remove sensorimotor barriers and empower such children to engage and express themselves through music-making. An evaluation with music practitioners and caregivers (N = 10) yielded positive feedback on the app’s effectiveness in engaging sensorimotor-impaired children with musical games, while also yielding suggestions to improve the control interaction and functionality to better cater to children’s diversified learning needs. The findings of this study shed light on the design of human-computer interfaces (HCI) and adaptive technology for the musical enjoyment and empowerment of children with functional diversity, helping to create a more equal, diversified, and inclusive (EDI) learning environment.