Our brains “time-stamp” the order of incoming sounds

Our brains “time-stamp” the order of incoming sounds, allowing us to correctly process the words that we hear, shows a new study by a team of psychology and linguistics researchers ¹.

“To understand speech, your brain needs to accurately interpret both the speech sounds’ identity and the order that they were uttered to correctly recognize the words being said,” explains Laura Gwilliams, the paper’s lead author. “We show how the brain achieves this feat: Different sounds are responded to with different neural populations. And, each sound is time-stamped with how much time has gone by since it entered the ear. This allows the listener to know both the order and the identity of the sounds that someone is saying to correctly figure out what words the person is saying.”

While the brain’s role in processing individual sounds has been well-researched, there is much we don’t know about how we manage the fast auditory sequences that constitute speech. Additional understanding of the brain’s dynamics can potentially lead to addressing neurological afflictions that diminish our ability to understand the spoken word.

In the new study, the scientists aimed to understand how the brain processes the identity and order of speech sounds, given that they unfold so quickly. This is significant because your brain needs to accurately interpret both the speech sounds’ identity (e.g., l-e-m-o-n) and the order that they were uttered (e.g., 1-2-3-4-5) to correctly recognize the words being said (e.g. “lemon” and not “melon”).

To do so, they recorded the brain activity of more than 20 human subjects—all native English speakers—while these subjects listened to two hours of an audiobook. Specifically, the researchers correlated the subjects’ brain activity in relation to the properties of the speech sounds that distinguish one sound from another (e.g. “m” vs “n”).

The researchers found that the brain processes speech using a buffer, thereby maintaining a running representation—i.e., time-stamping—of the past three speech sounds. The results also showed that the brain processes multiple sounds at the same time without mixing up the identity of each sound by passing information between neurons in the auditory cortex.

“We found that each speech sound initiates a cascade of neurons firing in different places in the auditory cortex,” explains Gwilliams. “This means that the information about each individual sound in the phonetic word ‘k-a-t’ gets passed between different neural populations in a predictable way, which serves to time-stamp each sound with its relative order.”

More on the subject:

Freeing the Language Within: on how babies extract words out of sounds