Full video of TouchNoise.

The project covers a series of research topics including the following:

  • interactive media scoring and its backgrounds in computer science, media sciences, and musicology,
  • techniques of interactive and adaptive music, including generative music,
  • musical interaction techniques and sound synthesis approaches for novel digital musical interfaces and instruments
  • Auditory Displays and Sonic Interaction Design to supporthuman-computer interaction and interface accessibility.

overShoulderShot

Some of the results of this project are:

  • an approach for interactive ambient music generation,
  • accompanying research on the use of ambient music for interactive media scoring,
  • the digital musical interface TouchNoise,
  • experiments in the sonification of free-hand gestures to support free-hand interaction,
  • studies for sound-based navigation in two-dimensional search spaces.

Publications

  • @article{TouchNoiseCMJ,
       author = {Axel Berndt and Nadia Al-Kassab and Raimund Dachselt},
       title = {The Sonic Affordances of a System for Multitouch Manipulation of Stereophonic Noise Spectra},
       journal = {Computer Music Journal},
       volume = {41, Number 4},
       year = {2017},
       month = {12},
       pages = {32--44},
       doi = {10.1162/comj_a_00438 },
       url = {https://doi.org/10.1162/comj_a_00438 },
       publisher = {MIT Press}
    }

    List of additional material

  • @inproceedings{fixme,
       author = {Axel Berndt and Nadia Al-Kassab and Raimund Dachselt},
       title = {TouchNoise: A New Multitouch Interface for Creative Work with Noise},
       booktitle = {Proceedings of Audio Mostly 2015},
       year = {2015},
       month = {10},
       location = {Thessaloniki, Greece},
       pages = {1--8},
       numpages = {8},
       doi = {10.1145/2814895.2814896},
       url = {http://dx.doi.org/10.1145/2814895.2814896},
       publisher = {ACM}
    }

    List of additional material

    Video

  • Ambiente Musik zur Vertonung immersiver interaktiver Medien

    Ambiente Musik zur Vertonung immersiver interaktiver Medien.

    Berndt, A.;

    In Jahrbuch immersiver Medien 2014: Klänge, Musik und Soundscapes.Schüren Verlag,95-105,2014.

    @incollection{Ambient-2014-JIM,
       author = {Axel Berndt},
       title = {Ambiente Musik zur Vertonung immersiver interaktiver Medien},
       booktitle = {Jahrbuch immersiver Medien 2014: Kl\"{a}nge, Musik und Soundscapes},
       series = {Jahrbuch immersiver Medien},
       volume = {2014},
       year = {2014},
       month = {10},
       pages = {95--105},
       numpages = {11},
       publisher = {Sch\"{u}ren Verlag},
       address = {Marburg, Germany}
    }

    List of additional material

  • TouchNoise: A Particle-based Multitouch Noise Modulation Interface

    TouchNoise: A Particle-based Multitouch Noise Modulation Interface.

    Berndt, A.; Al-Kassab, N.; Dachselt, R.;

    In Proceedings of New Interfaces for Musical Expression (NIME) 2014.NIME 2014, London, UK.Goldsmiths, University of London,2014.

    @inproceedings{TouchNoise-2014-NIME,
       author = {Axel Berndt and Nadia Al-Kassab and Raimund Dachselt},
       title = {TouchNoise: A Particle-based Multitouch Noise Modulation Interface},
       booktitle = {Proceedings of New Interfaces for Musical Expression (NIME) 2014},
       year = {2014},
       month = {7},
       location = {London, UK},
       numpages = {4},
       publisher = {Goldsmiths, University of London},
       address = {London, UK}
    }

    List of additional material

  • Im Dialog mit Musik: Zur Rolle der Musik in Computerspielen

    Im Dialog mit Musik: Zur Rolle der Musik in Computerspielen.

    Berndt, A.;

    In Kieler Beiträge zur Filmmusikforschung.Kieler Gesellschaft für Filmmusikforschung,293-323,2013.

    @article{350,
       author = {Axel Berndt},
       title = {Im Dialog mit Musik: Zur Rolle der Musik in Computerspielen},
       booktitle = {Kieler Beitr\"{a}ge zur Filmmusikforschung},
       volume = {9},
       year = {2013},
       month = {3},
       pages = {293--323},
       publisher = {Kieler Gesellschaft f\"{u}r Filmmusikforschung},
       address = {Kiel, Germany}
    }

    List of additional material

  • Variance in Repetitive Games Music

    Variance in Repetitive Games Music.

    Berndt, A.;

    In Proceedings of the International Computer Music Confonference 2012.ICMC 2012ICMA, University of Ljubljana,412-415,2012.

    @inproceedings{fixme,
       author = {Axel Berndt},
       title = {Variance in Repetitive Games Music},
       booktitle = {Proceedings of the International Computer Music Confonference 2012},
       year = {2012},
       month = {9},
       pages = {412--415},
       publisher = {ICMA, University of Ljubljana},
       address = {Ljubljana, Slovenia}
    }

    List of additional material

  • A Survey of Variation Techniques for Repetitive Games Music

    A Survey of Variation Techniques for Repetitive Games Music.

    Berndt, A.; Dachselt, R.; Groh, R.;

    In Audio Mostly 2012: 6th Conference on Interaction with Sound - Sound and Future Vision.ACM SIGCHI,61-67,2012.

    @inproceedings{fixme,
       author = {Axel Berndt and Raimund Dachselt and Rainer Groh},
       title = {A Survey of Variation Techniques for Repetitive Games Music},
       booktitle = {Audio Mostly 2012: 6th Conference on Interaction with Sound - Sound and Future Vision},
       year = {2012},
       month = {9},
       pages = {61--67},
       publisher = {ACM SIGCHI},
       address = {Corfu, Greece}
    }

    List of additional material

Student Theses

  • Joshua Peschke

    Drum Synthesis based on Geometric Forms and Corresponding Interaction Concepts

    Joshua Peschke December 1st, 2014 until May 31st, 2015

    Supervision: Raimund Dachselt, Axel Berndt

  • Thomas Meerpohl

    Newton: Interface Concepts for Controlling of Audio Effects and Synthesis Parameters based on 2D Physics Engines

    Thomas Meerpohl December 1st, 2014 until May 31st, 2015

    Supervision: Raimund Dachselt, Axel Berndt

  • Nadia Al-Kassab

    A Multitouch Interface for a Digital Musical Instrument

    Nadia Al-Kassab March 1st, 2014 until August 31st, 2014

    Supervision: Raimund Dachselt, Axel Berndt

  • Maxim Müller

    Interaktive Ambiente Musik

    Maxim Müller March 1st, 2013 until August 31st, 2013

    Supervision: Raimund Dachselt, Axel Berndt

  • Anna-Marie Balcke

    Collaborative Working in Multitouch Environments

    Anna-Marie Balcke January 20th, 2014 until July 21st, 2014

    Supervision: Raimund Dachselt, Axel Berndt

  • Hendrik Schuster

    Erweiterte Untersuchung zum Design auditorischer Zeiger

    Hendrik Schuster May 1st, 2013 until October 31st, 2013

    Supervision: Raimund Dachselt, Axel Berndt

  • Michael Möhler

    Bewegungssonifikation

    Michael Möhler May 1st, 2013 until October 31st, 2013

    Supervision: Raimund Dachselt, Axel Berndt

  • Nadia Al-Kassab

    Multi-Touch-Interaktion mit Klangpartikeln

    Nadia Al-Kassab February 1st, 2013 until July 31st, 2013

    Supervision: Raimund Dachselt, Axel Berndt