Aside from it being an uncomfortable experience, I literally feel like I can't understand what the person is saying anymore without being able to look at the mouth.
This one researcher criticizing that study pointed out that kids with hearing/language problems often read lips a bit even if they can mostly understand by hearing. So maybe you're unconsciously reading lips?

