AudioInSpace is a space shooter game where the game's soundtrack affects the behavior of the player's weapons and vice versa. The weapon's bullets are represented as particles, the position and color of which are controlled by a compositional pattern producing network that uses the game audio's current pitch information and the position of the bullet (relative to where it was fired from) as its input. This allows the audio to indirectly control the trajectory, speed and color of the players' bullets. The player can control the behavior of their weapons via interactive evolution, choosing their favorite weapon among 12 options.
Amy K. Hoover, William Cachia, Antonios Liapis and Georgios N. Yannakakis: "AudioInSpace: Exploring the Creative Fusion of Generative Audio, Visuals and Gameplay," in Evolutionary and Biologically Inspired Music, Sound, Art and Design (EvoMusArt), vol. 9027, LNCS. Springer, 2015. PDF BibTex