Sensing Music-related Actions (2008-2012)
Sensing Music-related Actions is a joint research project of the departments of Musicology and Informatics, directed by professor Rolf Inge Godøy, and has received external funding through the VERDIKT program of the The Research Council of Norway. The principal objective is to explore action-sound couplings in human-computer interaction. This will be achieved through the development of sensor technologies and machine learning techniques for capturing complex body movement from continuous streams of sensor data. Through observation studies and laboratory experiments we will try to understand more about relationships between action and sound, and explore how such relationships can be used in the development of active media devices.
People
- Director: Professor Rolf Inge Godøy
- Faculty: Professor Jim Tørresen, Associate professor Mats Høvin
- Postdoctoral researcher: Alexander Refsum Jensenius
- PhD researchers: Ståle Skogstad, Kristian Nymoen
Quick facts
- Years: 2008-2012
- Funding: Norwegian Research Council
- Director: Professor Rolf Inge Godøy
Research questions and methods
The basic research question that underlies this project is:
-
How can action-sound couplings be exploited in human-computer interaction?
A number of sub-questions are linked to this:
- Which sensor technologies can be used to capture complex body movement?
- Which machine-learning techniques can be used to extract semantic actions from a continuous stream of movement data?
- How are actions and sounds coupled in everyday life?
- How can such theories and technologies be used to control sound and music?
- How can we create musical structures that can be controlled by the user?
Aims and objectives
Principal objective:
- Exploring action-sound couplings in human-computer interaction.
Sub-goals:
- Develop sensor technologies for capturing complex body movement.
- Develop machine-learning techniques and segmentation methods for extracting semantic actions from a continuous stream of sensor data.
- Develop theories of action-sound couplings in everyday life.
- Develop prototypes of enactive media devices that allow for continuously controlling music based on the actions of the user.
- Develop hypermusic structures that can be used in the enactive media devices.
Unit: UiO, webmaster@uio.no
Document created: 11.12.2009, modified: 22.02.2010Manage document