MusiFace 1.1

Music has long been expressed through the manipulation of various human extremities, utilizing the intricate control offered by our fingers, hands, mouths, and feet. Notably, our faces are equipped with over 50 muscles capable of producing a wide array of expressions; however, making music through these facial movements has not been feasible until now. Recent advancements in face tracking technologies mark a significant evolution in this area.

MusiFace, also known as MusEmoji, is a pioneering Augmented Reality Face Tracking application that facilitates playing MIDI musical instruments through facial expressions. This innovative app serves as both a MIDI controller and synthesizer, offering access to 12 standard MIDI instruments that can be played across their complete octave ranges. It notably features built-in voice control, allowing individuals with disabilities to engage in hands-free music creation. Additionally, the app is designed for use by children aged nine and older and incorporates parental controls for enhanced oversight.

The MusiFace app is localized in 20 of the world’s most widely spoken languages and offers a selection of 30 practice melodies representative of those cultural regions. Each melody can be interpreted in multiple notational formats, including standard sheet music notation, solfege, American and Asian styles, as well as the exclusive MusEmoji notation. Comprehensive instructions and performance videos are readily accessible within the app's information section.

Furthermore, MusiFace integrates gamification elements alongside a demo feature that makes learning enjoyable while simultaneously enhancing users' music-making skills through facial muscle exercises.

This application leverages ARKit alongside the TrueDepth camera found in iPad Pro and iPhone X models and later for precise face and head tracking.