Zhe Wang & Daniel Heitz

Mienophone

A digital synthesizer using facial expressions to modulate sounds Mienophone is a musical instrument that can be controlled by emotions, expressed through the users face. It uses AI-powered algorithms to detect human emotions through facial recognition and controls specific parameters of a digital synthesizer based on this data in realtime. In the context of a sound installation, it comes as a complete hardware device with camera and speakers. The Mienophone software can also be run on a website using client side hardware.