Can we predict what is happening in the brain while we are speaking?

Youssef Hmamouche (LPL post-doc) and Laurent Prévot (AMU professor and director of the LPL) - in collaboration with Magalie Ochs (LIS) and Thierry Chaminade (INS) - have just published an article about the BrainPredict tool, which aims to predict and visualize brain activity during human-human or human-robot conversations. The first experiments were carried out with 24 adult participants engaging in natural conversation, which lasted approximately 30 minutes. The first promising results open the way for future studies where there is integration, for example, of other sociolinguistic parameters, or aspects linked to certain language pathologies.

From lip- to script-reading: new ANR contract awarded

The LPL is pleased to announce that the project "From lip- to script-reading: An integrative view of audio-visual associations in language processing" (AVA), submitted by Chotiga Pattamadilok, LPL researcher, was validated in the framework of the last ANR PRC selection.

The early exposure to speech and speakers’ articulatory gestures is the basis of language acquisition and is a fingerprint of audiovisual association learning. Is this initial ability to associate speech sounds and visual inputs a precursor of infants’ reading ability? Answering this question requires a good understanding of the cognitive/neural bases of both language abilities and whether they interact within the language system. Studies comparing task performance and spatio-temporal dynamics of brain activity associated with these abilities will be conducted. At the theoretical level, the outcome should lead to an elaboration of a unified framework explaining how multi-modal inputs jointly contribute to form a coherent language representation. At the practical level, the new perspective of a link between the developmental trajectories of “lip-reading” and “script-reading” should contribute to language learning and facilitate early detection and remediation of reading deficits.

Laboratoire Parole et Langage, Aix-Marseille Univ. (coordinator)
Laboratoire D'Etude des Mécanismes Cognitifs, Univ. Lyon 2
Laboratoire de Psychologie et NeuroCognition, Univ. Grenoble Alpes
SFR Santé Lyon-Est, Univ. Lyon 1