Recognizing Liars From The Sound of Their Voice? (Engineering)

Faster speech rate, greater intensity in the middle of the word, and falling pitch at the end of the word: that is the prosody¹ to adopt if one wants to come across as reliable and honest to one’s listeners. Scientists from the Science and Technology for Music and Sound laboratory (CNRS/Ircam/Sorbonne Université/Ministère de la Culture)² and the Perceptual Systems Laboratory (CNRS/ENS PSL) have conducted a series of experiments³  to understand how we decide, based on the voice, whether a speaker is honest and confident, or on the contrary dishonest and uncertain. They have also shown that this signature was perceived similarly in a number of languages (French, English, Spanish), and that it is registered “automatically” by the brain: even when participants were not judging the speaker’s certainty or honesty, this characteristic sound impacted how they memorized the words. Prosody consequently conveys information on the truth-value or certainty of a proposition. Scientists are now trying to understand how speakers produce such prosody based on their intentions. This research was published on 8 February 2021 in Nature Communications.

Examples of these sounds:

Recognize a liar by the sound of his voice? (honesty) © CNRS https://soundcloud.com/cnrs_officiel/reconnaitre-un-menteur-son-de-sa-voix-honnetete/s-4WGDJYCjsyg
Recognize a liar by the sound of his voice? (certainty) © CNRS https://soundcloud.com/cnrs_officiel/reconnaitre-un-menteur-au-son-de-sa-voix-certitude/s-NyE7ZqgK0Km

Featured image: Two types of judgements (certainty, honesty) are based on a single acoustic signature: high pitch that falls at the end of the word, intensity in the middle of the word, and fast speech rate. Above: certainty, below: honesty. © Jean-Julien Aucouturier and Louise Goupil, STMS laboratory (CNRS/Ircam/Sorbonne Université/Ministère de la Culture)


Notes:

  1. Prosody refers to the “melody” of a phrase or word: its pitch, rate, and intensity.
  2. Jean-Julien Aucouturier now works at the FEMTO-ST laboratory (CNRS/Université de Bourgogne-Franche Comté/ENSMM/UTBM), and Louise Goupil at the University of East London.
  3. Scientists used vocal signal processing techniques to create random pronunciations of words (rising pitch, falling pitch, etc.), and then asked multiple groups of participants whether these words were pronounced with certainty or honesty. The software they developed as part of this effort, CLEESE, is open source: https://forum.ircam.fr/projects/detail/cleese/

Reference: Listeners’ perceptions of the certainty and honesty of a speaker are associated with a common prosodic signature. Louise Goupil, Emmanuel Ponsot, Daniel Richardson, Gabriel Reyes, Jean-Julien Aucouturier. Nature communications, le 8 february 2021. DOI : 10.1038/s41467-020-20649-4


Provided by CNRS

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s