- creative field installation, interface
- Client Name Till Engert, Steffen Rummel
- Project URL vimeo.com
- Completion Date 11/22/2015
The aim of this project, led by Professor Jörg Remy, is to develop improved techniques for the rehabilitation of the motor skills of stroke patients, by using real-time sonification of arm movement.
This form of therapy was developed by the Institute for Music Physiology and Music Medicine at the Technical College for Music, Theater and Media in Hanover, where, under the guidance of Dr. Daniel Scholz, we’re expanding on the initial concept.
By retraining muscle memory with the aid of musical concepts, you will gain better control of your arms’ motor skills. Additionally, continual practise will boost your motivation.
In our system we use a stereo vision distance sensor, the programming language Max/MSP and Ableton Live.
The sensor records movements of the patient’s arm, which gets translated into MIDI data by Max/MSP and is used by Ableton Live to trigger virtual instruments. Vertical movement corresponds to a scale chosen by the therapist, whereas horizontal movement allows ‘playing’ different instruments. In a typical exercise the patient would try to play a melody by following a movement pattern suggested by the therapist. Furthermore, the transmitted data is saved for measuring the patient’s progress.