Adaptive Use Musical Instruments (AUMI) software interface enables people who have very limited controlled (voluntary) movement to independently engage in music making.

The Adaptive Use Musical Instruments software interface enables the user to play sounds and musical phrases through movement and gestures. This is an entry to improvisation rather than “hitting the right notes” or playing set pieces of music. Instead, the software uses music as a way for participants to express a range of affects, both by themselves and in response to, or in conversation with, others.

While the AUMI interface can be used by anyone, the focus has been on working with people who have profound physical disabilities. In taking these participants as its starting point, the project attempts to make musical improvisation and collaboration accessible to the widest possible range of individuals. This approach also opens up the possibility of learning more about the relations between ability, the body, creativity and improvisation, from within a cultural context that does not always acknowledge or accept people with disabilities.

This iOS version of AUMI runs on devices with cameras, and can run on iPhones, iPod touches and iPads. A large assortment of sounds can be triggered with configurable amounts of sensitivity. AUMI also can be used as a MIDI controller to access other iOS based synthesizers or external equipment (using the iPad's Camera Connection kit or via Core MIDI over WiFi.)

AUMI can also import audio from other iOS or desktop apps to be used as melodic or percussive instruments.

AUMI can capture a record of the movement in the session, which can be exported and turned into reports in a clinical setting.

What’s New

Version 2.0.0

AUMI now has new instruments, a face tracker, more scales , a reorganized instrument and video list, time quantization, and chords!
It's more responsive, and on recent devices, this mean you can use higher resolution video.
The logging options have been enhanced to make them optional and easier to maintain.

Ratings and Reviews

5.0 out of 5
1 Rating

1 Rating

happyfromlondon ,

After updates, works beautifully!!

This is an excellent app, not just because it’s now free but because it’s the closest thing to a Soundbeam on an iPad. It works really well in my music sessions. One of my students, whom I’ve known for most of her school days, was so excited when she realised that her movements were creating beautiful arpeggios on the kalimba sound. We incorporate its use into our improvising sessions (The Improvise Approach). One student makes music using the AUMI app and others have ThumbJam on their iPads. Each player is connected to their own personal speaker (WOWee speakers are designed to vibrate, giving an extra stimulation and awareness of what THEY are doing). I introduced the AUMI app as a shared focus activity by connecting my iPad to the class screen so that everyone could see each student moving and playing melodies. They absolutely LOVED IT!!!!! Have a look at www.improviseapproach in the video section and you’ll see a video of using it per se and including it with the Improvise Approach music backing tracks. It really is a no-brainer!

Developer Response ,

Thanks so much!
AUMI was shown last year at the "OHMI" fest ( in Birmingham last year - so keep spreading the word in Olde Blighty!

TrinityFields ,

Not responsive enough

I completely applaud the reasoning behind this app- I would love it to work for the pupils but it doesn't.
It just doesn't work like it should- doesn't move with pupils, pupils get frustrated and lose interest because of this. Even I struggle to get it to track my movements properly.
Go for the far better Airharp or Airvox apps.
Guys you really need to sort this out, I've used lots of gesture based programs with SEN pupils and this just doesn't work for purpose.

MUSEproject ,

Not great

It just doesn't work as it should. See previous comments by other users, this just isn't fit for purpose yet, please update and improve it! For this price I expected much more.


Deep Listening Institute, Ltd.
62.3 MB

Requires iOS 9.3 or later. Compatible with iPhone, iPad and iPod touch.



Age Rating


  • Family Sharing

    Up to six family members will be able to use this app with Family Sharing enabled.

You May Also Like