What you see affects what you hear.

foghorn

foghorn

Valued Senior Member
The McGurk Effect.

Watch the BBC clip at time tag 0:25.

You see a man saying ba ba ba ba

They change the picture to show the same man but now he ‘seems’ to be saying something else instead of ba ba ba ba. Yet the audio sound was not changed when the picture changed.
 
Interesting!

To me, it sounds a bit like "fah fah fah" when the "wrong" video is used. How about you?
 
James R said:
To me, it sounds a bit like "fah fah fah" when the "wrong" video is used. How about you?
Click to expand...
I get ba ba ba on first picture then fah fah with changed picture.
And only ba ba ba with eyes closed all the way through.
I did wonder how this was first noticed because I sort of guessed it must have been with some use of modern technical equipment. How would they have noticed in the ‘olden days’?
It was in 1976:
This effect was accidentally discovered while McGurk and his assistant, MacDonald, were conducting a study on the perception of language by infants at various developmental stages.
During the study, they would, in one location, play the video of a mother speaking and, in another, the sound of her voice.
In the experiment, they directed a technician to dub, with the auditory syllable “ba,” a videotape with a visual of “ga.” When the dubbed tape was played, MacDonald and McGurk perceived “da”—a phoneme distinct from the dubbed audio and the visual.
Both McGurk and MacDonald were confused. Eventually, however, they realized that the phenomenon stemmed not from a mistake by the technician but from an idiosyncrasy in human perception.
Click to expand...
https://www.simplypsychology.org/mcgurk-effect.html
 
James R said:
Interesting!

To me, it sounds a bit like "fah fah fah" when the "wrong" video is used. How about you?
Click to expand...
I read the text and decided to listen to the clip first to "train" brain to beat it. I listened twice then watched it with no sound so I could see the split screen.
Then I watched it with sound and my brain was still fooled despite the training session.
A nice video and I have never heard of the effect although it does not surprise me too much.
The brain fills in gaps for us and gets it wrong sometimes.
A lawn mower sounds like a bee in the room (I have a phobia)
A tree in an unfamiliar park looks like a man dressed in black.
Words too, we do not read every letter in a word we estimate it from the overall shape.
Have you tried that test to try and read a sentence, with all the vowels taken out? Easier than you think!
 
Pinball1970 said:
I read the text and decided to listen to the clip first to "train" brain to beat it. I listened twice then watched it with no sound so I could see the split screen.
Then I watched it with sound and my brain was still fooled despite the training session.
A nice video and I have never heard of the effect although it does not surprise me too much.
The brain fills in gaps for us and gets it wrong sometimes.
A lawn mower sounds like a bee in the room (I have a phobia)
A tree in an unfamiliar park looks like a man dressed in black.
Words too, we do not read every letter in a word we estimate it from the overall shape.
Have you tried that test to try and read a sentence, with all the vowels taken out? Easier than you think!
Click to expand...
There is not much between b, v and f sounds. I recall that in S American Spanish the b sounds often sounds like v. V is itself just a sounded version of f. But interesting that we all instinctively use lip reading to some extent, to complement what we think we have heard . We use other cues too, notably context, to resolve ambiguity in what our ears present to us.
 
exchemist said:
There is not much between b, v and f sounds. I recall that in S American Spanish the b sounds often sounds like v. V is itself just a sounded version of f. But interesting that we all instinctively use lip reading to some extent, to complement what we think we have heard . We use other cues too, notably context, to resolve ambiguity in what our ears present to us.
Click to expand...
We are talking about English in this case, also intonation, facial expressions help us.
Flicking from one side of the screen to the other did completely fool my brain watching the video however.
 
Pinball1970 said:
We are talking about English in this case, also intonation, facial expressions help us.
Flicking from one side of the screen to the other did completely fool my brain watching the video however.
Click to expand...
Sure, but what I mean is there is unacknowledged ambiguity in some of theses sounds, depending on exactly how they are enunciated. The Japanese, to give another example, have a single sound for what we would write as l and r. When they speak English it sounds just sufficiently wrong to our ears that we tend to think they are confusing the letters. And then the Russians, and Cockneys, and Brazilians, tend to pronounce their ls a bit like ws.
 
foghorn said:
The br got me. my bold.
Supposedly, that might be possible. However, since all words br some counting vowels, It would make it more difficult.?
Click to expand...
Mmm. I read the sentence and thought I had it all.
I will have to search to find the br!
 
foghorn said:
The br got me. my bold.
Supposedly, that might be possible. However, since all words br some counting vowels, It would make it more difficult.?
Click to expand...
Got it!

"Supposedly that might be possible. However, since all words bar some contain vowels, it would make it more difficult."
 
You must log in or register to reply here.
Back
Top