The texture of sounds: do you hear rough or smooth sounds?

On 20 November, the journal JASA published a new article on the association of sounds with shapes and textures, by a group of international scientists including Caterina Petrone (LPL-CNRS) and Susanne Fuchs (ZAS Berlin, currently Iméra/ILCB Chair).

According to the results of this study, the alveolar trill Is perceived as jagged/rough by speakers of different languages. The researchers believe that this association may be more universal than the famous bouba/kiki effect.

Reference: A. Ćwiek, R. Anselme, D. Dediu, S. Fuchs, S. Kawahara, G. E. Oh, J. Paul, M. Perlman, C. Petrone, S. Reiter, R. Ridouane, J. Zeller, B. Winter. The Alveolar Trill Is Perceived as Jagged/Rough by Speakers of Different Languages. J. Acoust. Soc. Am. 156, 3468–3479 (2024)

Full text: https://pubs.aip.org/asa/jasa/article/156/5/3468/3321514/The-alveolar-trill-is-perceived-as-jagged-rough-by

Abstract:
Typological research shows that across languages, trilled [r] sounds are more common in adjectives describing rough as opposed to smooth surfaces. In this study, this lexical research is built on with an experiment with speakers of 28 different languages from 12 different families. Participants were presented with images of a jagged and a straight line and imagined running their finger along each. They were then played an alveolar trill [r] and an alveolar approximant [l] and matched each sound to one of the lines. Participants showed a strong tendency to match [r] with the jagged line and [l] with the straight line, even more consistently than in a comparable cross-cultural investigation of the bouba/kiki effect. The pattern is strongest for matching [r] to the jagged line, but also very strong for matching [l] to the straight line. While this effect was found with speakers of languages with different phonetic realizations of the rhotic sound, it was weaker when trilled [r] was the primary variant. This suggests that when a sound is used phonologically to make systemic meaning contrasts, its iconic potential may become more limited. These findings extend our understanding of iconic crossmodal correspondences, highlighting deep-rooted connections between auditory perception and touch/vision.

 

Illustration: Fig. 1 The oscillograms and spectrograms for the recording of (a) the alveolar trill [r] and (b) the alveolar lateral approximant [l]. The superimposed red line is the intensity curve with a range between 55 and 85dB. The jagged line (c) and the flat line (d) were the corresponding visual stimuli presented to participants in the experiment.

Credits: Authors

What impact do head nods have on prosodic prominence?

We are pleased to announce the latest publication by Mariapaola d'Imperio - AMU professor and member of the LPL - in collaboration with Christopher Carignan, Núria Esteve-Gibert, Hélène Lœvenbruck and Marion Dohen in The Journal of the Acoustical Society of America:

Reference: Carignan, C., Esteve-Gibert, N., Lœvenbruck, H., Dohen, M., D'Imperio, M. (2024). Co-speech head nods are used to enhance prosodic prominence at different levels of narrow focus in French. The Journal of the Acoustical Society of America.

Access to the full text of the article (via AMU): https://pubs.aip.org/asa/jasa/article/156/3/1720/3312732/Co-speech-head-nods-are-used-to-enhance-prosodic

 

 

Credits: Authors

Half a century of speech prosody research in Aix-en-Provence

In its "Bookshop" section, CNRS SHS highlights the latest book by Daniel Hirst, Emeritus Research Director at the LPL, published last June by Springer: "Speech Prosody: From Acoustics to Interpretation".

Co-founder of SProSIG in 2000, an international group for the study of speech prosody under the umbrella of ISCA and IPA, and organizer of the first international congress on prosody in 2002 (which became "Speech Prosody"), the author presents a personal vision of speech prosody in general, and more specifically of the various themes in which he has been interested for several decades. Topics covered include the acoustic description of prosody, its transcription, the relationship between lexical and non-lexical prosody, the nature of prosodic structure, the phonology of prosody, the modeling of speech rhythm and melody, and the central question of the varied and sometimes rather mysterious ways in which prosody contributes to the interpretation of utterances. In his final chapter, Daniel Hirst outlines the directions he believes will be most productive and fruitful for future research into speech prosody.

Reference: Daniel Hirst. Speech Prosody: From Acoustics to Interpretation. Springer Verlag, Berlin. Juin 2024. https://link.springer.com/book/9783642407710

 

Credits: Springer Verlag