Networked_Music_Review

Learning Auditory Models of Machine Voices

Tags:
sound
object
responsive
paper
voice

Jo-Anne
Green

blendie.jpg LEARNING AUDITORY MODELS OF MACHINE VOICES [PDF] by Kelly Dobson and Brian Whitman (MIT Media Lab) and Daniel P.W. Ellis (LabROSA, Electrical Engineering, Columbia University).

ABSTRACT: Vocal imitation is often found useful in Machine Therapy sessions as it creates an emphatic relational bridge between human and machine. The feedback of the machine directly responding to the person’s imitation can strengthen the trust of this connection. However, vocal imitation of machines often bear little resemblance to the target due to physiological limitations. In practice, we need a way to detect human vocalization of machine sounds that can generalize to new machines. In this study we learn the relationship between vocal imitation of machine sounds and the target sounds to create a predictive model of vocalization of otherwise humanly impossible sounds. After training on a small set of machines and their imitations, we predict the correct target of a new set of imitations with high accuracy. The model outperforms distance metrics between human and machine sounds on the same task and takes into account auditory perception and constraints in vocal expression.

Blendie:

Machine Therapy:


May 22, 15:20
Trackback URL

Leave a comment

Live Stage

Interviews

Current interview:
Karen Van Lengen

Previous Interviews:

Tags

freq alpha

music ~ sound ~ livestage ~ performance ~ installation ~ audio/visual ~ instrument ~ radio ~ audio ~ calls + opps ~ networked ~ experimental ~ event ~ festival ~ mobile ~ interactive ~ participatory ~ live ~ collaboration ~ electronic ~ video ~ distributed ~ reblog ~ concert ~ environment ~ locative media ~ workshop ~ electroacoustic ~ nature ~ tool ~ field recording ~ software ~ exhibition ~ writings ~ recording ~ improvisation ~ net_music_weekly ~ history ~ space ~ acoustic ~ sonification ~ sound sculpture ~ voice ~ body ~ immersion ~ mapping ~ VJ/DJ ~ noise ~ soundscape ~ remix ~ public ~ laptop ~ wearable ~ generative ~ light ~ visualization ~ interview ~ city ~ site-specific ~ platform ~ interface ~ diy ~ found ~ cinema ~ algorithmic ~ virtual ~ architecture ~ controller ~ spatialization ~ second life ~ electromagnetic ~ sensor ~ conference ~ hacktivism ~ net art ~ urban ~ robotic ~ webcast ~ streaming ~ responsive ~ narrative ~ game ~ circuit bending ~ object ~ ecology ~ dance ~ intervention ~ biotechnology ~ score ~ lecture ~ ambient ~ resource ~ composer ~ open source ~ paper ~ sound walk ~ multimedia ~ wireless device ~ telematic ~ image ~ art + science ~ augmented ~ motion tracking ~ data ~ hybrid ~ auralization ~ mashup ~ listening ~ social network ~ intermedia ~ text ~ mixed reality ~ nmr_commission ~ film ~ surveillance ~ 3D ~ pyschogeography ~ acousmatic ~ toy ~ wireless network ~ opera ~ synesthesia ~ livecoding ~ news ~ political ~ privacy ~ 8bit ~ podcast ~ gesture ~ copyright ~ web 2.0 ~ sample ~ newsletter ~ avatar ~ residency ~ theater ~ play ~ soundtrack ~ conversation ~ place ~ spoken word ~ physical ~ technology ~ upgrade! ~ recycle ~ cassette ~ feedback ~ processing ~ presence ~ language ~ social media ~ emergence ~ tactical ~ tactile ~ identity ~ asynchronous ~ chance ~ community ~ broadcasts ~ code ~ new media ~ jazz ~ ubiquitous ~ aesthetics ~ Artificial Intelligence ~ tangible ~ haptics ~ interdisciplinary ~ tv ~ e-literature ~ courses ~ chiptune ~ activist ~ glitch ~ conductor ~ context-aware ~ audio tour ~ post-convergence ~ archives ~ synchronous ~ research ~ hardware ~ simulation ~ audiotape ~ therapy ~ business ~ symposium ~ wiki ~ multimodal ~ relational ~ im/material ~ satellite ~
3D ~ 8bit ~ acousmatic ~ acoustic ~ activist ~ aesthetics ~ Artificial Intelligence ~ algorithmic ~ ambient ~ annotate ~ architecture ~ archives ~ art + science ~ audio tour ~ audiotape ~ augmented ~ auralization ~ audio/visual ~ avatar ~ biotechnology ~ body ~ broadcasts ~ business ~ calls + opps ~ cassette ~ chance ~ chiptune ~ circuit bending ~ city ~ code ~ collaboration ~ community ~ composer ~ concert ~ conductor ~ conference ~ context-aware ~ controller ~ conversation ~ copyright ~ courses ~ data ~ distributed ~ diy ~ e-literature ~ ecology ~ electroacoustic ~ electromagnetic ~ electronic ~ emergence ~ environment ~ event ~ exhibition ~ experimental ~ feedback ~ festival ~ field recording ~ film ~ found ~ game ~ generative ~ gesture ~ glitch ~ hacktivism ~ haptics ~ hardware ~ hybrid ~ identity ~ image ~ im/material ~ immersion ~ improvisation ~ instrument ~ interactive ~ interdisciplinary ~ interface ~ intermedia ~ intervention ~ interview ~ jazz ~ language ~ laptop ~ lecture ~ light ~ listening ~ cinema ~ livecoding ~ livestage ~ locative media ~ mapping ~ mashup ~ mixed reality ~ mobile ~ motion tracking ~ multimedia ~ multimodal ~ nature ~ net_music_weekly ~ net art ~ networked ~ audio ~ dance ~ installation ~ live ~ music ~ narrative ~ radio ~ sound ~ text ~ theater ~ video ~ new media ~ news ~ newsletter ~ nmr_commission ~ noise ~ object ~ open source ~ opera ~ performance ~ platform ~ tool ~ play ~ physical ~ place ~ podcast ~ political ~ post-convergence ~ presence ~ privacy ~ processing ~ public ~ paper ~ pyschogeography ~ reblog ~ recording ~ recycle ~ relational ~ remix ~ research ~ residency ~ resource ~ responsive ~ robotic ~ sample ~ satellite ~ score ~ second life ~ sensor ~ simulation ~ site-specific ~ social media ~ social network ~ software ~ sonification ~ sound sculpture ~ sound walk ~ soundscape ~ soundtrack ~ space ~ spatialization ~ spoken word ~ streaming ~ surveillance ~ symposium ~ synchronous ~ synesthesia ~ tactical ~ tangible ~ telematic ~ history ~ participatory ~ technology ~ asynchronous ~ wireless network ~ therapy ~ tactile ~ toy ~ tv ~ ubiquitous ~ upgrade! ~ urban ~ virtual ~ visualization ~ VJ/DJ ~ voice ~ wearable ~ web 2.0 ~ webcast ~ wiki ~ wireless device ~ workshop ~ writings ~

What is this?

Networked_Music_Review (NMR) is a research blog that focuses on emerging networked musical explorations.

Read more...

NMR Commissions

NMR commissioned the following artists to create new sound art works. More...
More NMR Commissions

Net_Music_Weekly

Regurgitated Monologues

 [Image: Garrett Phelan] Garrett Phelan works and lives in Dublin, Ireland. In recent years Phelan has focussed his practice on extensive explorations into the formation of opinion ... Read more
Previous N_M_Weeklies

Newsletters & RSS

NMR offers a weekly review and a monthly e-mail newsletter and several RSS feeds. Read more...
Sign up to receive NMR by email

Bloggers

Guest Bloggers:

F.Y.I.

networked_performance
Turbulence
New York State Music Fund
Feed2Mobile
New American Radio

Turbulence Works

More commissions