Search PubMed⌕ Search

SEARCH · Search PubMed

Results for “Lipreading”

Search indexed PubMed citations on genomics, clinical trials, systematic reviews and public health. Explore titles, authors and supplied subject terms, then open the PubMed record.

Quote a phrase for an exact phrase match. Source license links do not imply unrestricted reuse.

At least 127 records · Page 7Linked to original sources
PubMed1987

Speech perception with multi-channel cochlear implant of short duration pulse strategy.

A multi-channel cochlear implant (Nucleus type) was implanted in a 40-year-old female Japanese patient who became totally deaf after meningitis. The formant-based speech processing strategy was used, but a narrow pulse width of 22-42 microseconds was required because of intermittent difficulty in controlling the pulse amplitude. The patient was tested with a speech tracking test and could recognize 24 bunsetsues (the minimum meaningful unit of the Japanese sentence) per minute using the cochlear implant plus lipreading and 14.3 bunsetsues for the lipreading alone after 3.5 months' training. The patient was also able to understand usual conversational sentences spoken a little slowly. Scores of vowel and consonant tests reached 70% and 54% respectively for the cochlear implant alone, and 100% and 73% for the cochlear implant plus lipreading. This study has also shown that cochlear stimulation with very narrow pulse widths can be used, and restore speech comprehension ability for the Japanese.

Acoustic Stimulation↗
PubMed1985

Speech-tracking performance in single-channel cochlear implant subjects.

This study evaluated 20 deaf adults' ability to understand connected discourse under two conditions: (a) lipreading alone (LA), and (b) lipreading plus electrical stimulation by a single-channel cochlear implant (LI). Performance was evaluated using the speech-tracking procedure, which required the deaf receiver to repeat verbatim textual material read by another individual. The reception of ongoing speech was measured in terms of the number of words repeated correctly per minute. The results revealed, on the average, a significantly higher tracking rate in the LI condition (28.6 wpm) than the LA condition (16.4 wpm). There was a significant learning effect across sessions for both conditions. Subjects who were previous hearing aid users achieved a significantly higher tracking rate in the LI condition than did subjects who had no previous experience with amplification. Significant subject differences were present as a function of condition. Sixteen of the 20 subjects achieved higher tracking rates in the LI than in the LA condition. However, 4 of these 16 subjects showed similar relative gains in both conditions and 3 showed a decrease in performance in the LA condition over time. The remaining 4 subjects showed nearly equivalent tracking rates in both conditions over time. The data suggest that the majority of subjects were able to learn to make use of the cues provided by electrical stimulation by a single-channel cochlear implant to enhance their lipreading skills, at least for highly redundant material in a communicative situation.

Adolescent↗
PubMed1992

Normal-hearing and hearing-impaired subjects' ability to just follow conversation in competing speech, reversed speech, and noise backgrounds.

The performance on a conversation-following task by 24 hearing-impaired persons was compared with that of 24 matched controls with normal hearing in the presence of three background noises: (a) speech-spectrum random noise, (b) a male voice, and (c) the male voice played in reverse. The subjects' task was to readjust the sound level of a female voice (signal), every time the signal voice was attenuated, to the subjective level at which it was just possible to understand what was being said. To assess the benefit of lipreading, half of the material was presented audiovisually and half auditorily only. It was predicted that background speech would have a greater masking effect than reversed speech, which would in turn have a lesser masking effect than random noise. It was predicted that hearing-impaired subjects would perform more poorly than the normal-hearing controls in a background of speech. The influence of lipreading was expected to be constant across groups and conditions. The results showed that the hearing-impaired subjects were equally affected by the three background noises and that normal-hearing persons were less affected by the background speech than by noise. The performance of the normal-hearing persons was superior to that of the hearing-impaired subjects. The prediction about lipreading was confirmed. The results were explained in terms of the reduced temporal resolution by the hearing-impaired subjects.

Audiometry↗
PubMed1989

Effect of text complexity on connected discourse tracking rate.

The effect of three levels of text complexity upon connected discourse tracking rates was investigated in normal listeners who tracked by lipreading alone and by lipreading with auditorily presented voice pitch. Text complexity affected connected discourse tracking under both lipreading conditions, with tracking rates decreasing as the level of text complexity increased. The improvement in tracking rate with the addition of voice pitch information was found to be invariant over changes in text complexity when expressed as a simple difference between the two tracking rates.

Female↗
PubMed2002

Auditory-visual speech perception and aging.

OBJECTIVE: This experiment was designed to assess the integration of auditory and visual information for speech perception in older adults. The integration of place and voicing information was assessed across modalities using the McGurk effect. The following questions were addressed: 1) Are older adults as successful as younger adults at integrating auditory and visual information for speech perception? 2) Is successful integration of this information related to lipreading performance? DESIGN: The performance of three groups of participants was compared: young adults with normal hearing and vision, older adults with normal to near-normal hearing and vision, and young controls, whose hearing thresholds were shifted with noise to match the older adults. Each participant completed a lipreading test and auditory and auditory-plus-visual identification of syllables with conflicting auditory and visual cues. RESULTS: The results show that on average older adults are as successful as young adults at integrating auditory and visual information for speech perception at the syllable level. The number of fused responses did not differ for the CV tokens across the ages tested. Although there were no significant differences between groups for integration at the syllable level, there were differences in the response alternatives chosen. Young adults with normal peripheral sensitivity often chose an auditory alternative whereas, older adults and control participants leaned toward visual alternatives. In additions, older adults demonstrated poorer lipreading performance than their younger counterparts. This was not related to successful integration of information at the syllable level. CONCLUSIONS: Based on the findings of this study, when auditory and visual integration of speech information fails to occur, producing a nonfused response, participants select an alternative response from the modality with the least ambiguous signal.

Acoustic Stimulation↗
PubMed1996

Auditory and visual speech perception: confirmation of a modality-independent source of individual differences in speech recognition.

Two experiments were run to determine whether individual differences in auditory speech-recognition abilities are significantly correlated with those for speech reading (lipreading), employing a total sample of 90 normal-hearing college students. Tests include single words and sentences, recorded on a videodisc by a male speaker [Bernstein and Eberhardt, Johns Hopkins Lipreading Corpus, The Johns Hopkins University, Baltimore, MD, 1986]. The auditory speech was presented with a white noise masker, at -7 dB Sp/N. The correlations between overall auditory and visual performance were 0.52 and 0.43 in the two experiments, consistent with the existence of a modality-independent ability to perceive linguistic "wholes" on the basis of linguistic fragments. Subjects in the second experiment also identified printed sentences, with 40%-60% portions of the printed characters deleted. Performance on this graphical "fragmented-sentences test" also correlated significantly with auditory speech recognition, providing a possible clue to the cognitive basis for the look-versus-listen correlation. The existence of a modality-independent source of variance in speech-recognition abilities may be a partial explanation of the difficulty in demonstrating strong associations between psychoacoustic measures of spectral or temporal acuity, and speech discrimination or identification. Female subjects in both experiments were significantly better lipreaders than their male counterparts.

Adolescent↗
PubMedDate not supplied

Auditory and visual cueing of the [+/- rounded] feature of vowels.

That lipreading plays a role in phoneme recognition, even when the acoustic signal alone is phonologically unambiguous, has been concluded from experiments in the perception of discrepant combinations of acoustic and visual speech signals. Little is known about the effect of visual information on explicitly phonetic judgments, the kind of judgments made by trained observers that are the basis for describing the phonological pattern of a language. In this study some isolated vowels, most of them similar to vowels in standard French, were produced in ten random orders by an experienced phonetician. The acoustic signals and frontal views of the lower half of the speaker's face were recorded on video tape. By computer editing, audiovisual stimuli were prepared in which pairs of vowels supposed to differ primarily in rounding were variously combined. Twenty French-speaking speech researchers carried out three tasks: to decide on the rounding of each vowel by sound alone, by sight alone, and by sound when accompanied by matching or discrepant images of the talker. Their summed responses indicate that, despite the instruction to base decisions on the auditory signal, visual evidence of speech activity significantly "perturbed" subjects' rounding judgments. However, the lipreading effect varied greatly across both subjects and vowels. Most subjects judged most vowels strictly on the basis of the auditory information, while for others lipreading exerted paramount influence. Only a small minority responded so as to indicate any integration of discrepant rounding information registered by ear and eye.

Auditory Perception↗
PubMed1993

New developments in speech pattern element hearing aids for the profoundly deaf.

Two new developments in speech pattern processing hearing aids will be described. The first development is the use of compound speech pattern coding. Speech information which is invisible to the lipreader was encoded in terms of three acoustic speech factors; the voice fundamental frequency pattern, coded as a sinusoid, the presence of aperiodic excitation, coded as a low-frequency noise, and the wide-band amplitude envelope, coded by amplitude modulation of the sinusoid and noise signals. Each element of the compound stimulus was individually matched in frequency and intensity to the listener's receptive range. Audio-visual speech receptive assessments in five profoundly hearing-impaired listeners were performed to examine the contributions of adding voiceless and amplitude information to the voice fundamental frequency pattern, and to compare these codings to amplified speech. In both consonant recognition and connected discourse tracking (CDT), all five subjects showed an advantage from the addition of amplitude information to the fundamental frequency pattern. In consonant identification, all five subjects showed further improvements in performance when voiceless speech excitation was additionally encoded together with amplitude information, but this effect was not found in CDT. The addition of voiceless information to voice fundamental frequency information did not improve performance in the absence of amplitude information. Three of the subjects performed significantly better in at least one of the compound speech pattern conditions than with amplified speech, while the other two performed similarly with amplified speech and the best compound speech pattern condition. The three speech pattern elements encoded here may represent a near-optimal basis for an acoustic aid to lipreading for this group of listeners. The second development is the use of a trained multi-layer-perceptron (MLP) pattern classification algorithm as the basis for a robust real-time voice fundamental frequency extractor. This algorithm runs on a low-power digital signal processor which can be incorporated in a wearable hearing aid. Aided lipreading for speech in noise was assessed in the same five profoundly hearing-impaired listeners to compare the benefits of conventional hearing aids with those of an aid which provided MLP-based fundamental frequency information together with speech+noise amplitude information. The MLP-based pattern element aid gave significantly better performance in the reception of consonantal voicing contrasts from speech in pink noise than that achieved with conventional amplification and consequently, it also gave better overall performance in audio-visual consonant identification.(ABSTRACT TRUNCATED AT 400 WORDS)

Algorithms↗
PubMed2006

[Performances and complications of cochlear implant in 134 adult patients implanted since 1990].

OBJECTIVE: The aim of this study was to analyse performance of cochlear implants in a retrospective series of adults with postlingually in order to search for predictive factors and identify complications. METHODS: Between 1990 and 2003, 134 adult patients were implanted: 129 patients on one side and 5 patients on both sides. Hearing benefit at 6, 12, 24 and 36 months and performance at 12 months were analyzed as function of the etiology, age at implantation, lipreading and speech coding strategy. RESULTS: Compared to performances before implantation, cochlear implants provided significant and rapid improvement at 6 months (p<0.0001). The results were not correlated with age at implantation, etiology or lipreading ability before implantation. Performances were worse in patients with meningitis (p<0.01), but the percentage of improvement was similar between the different etiologies. Major complications were rare: one case of regressive postoperative facial nerve weakness. CONCLUSION: Cochlear implants provide significant and rapid improvement, with low morbidity. Results are not correlated with age at implantation, etiology or lipreading ability.

Adolescent↗
PubMed2003

[Use of the auditory brainstem neuroprosthesis in the Czech Republic].

BACKGROUND: Auditory brainstem implant (ABI) is an electroprosthetic device enabling sound sensations in deaf persons with a bilateral lesion of auditory nerves. Stimulation of auditory nuclei in the floor of the IVth ventricle is realized by an electrode array introduced during surgery in the lateral recess of the IVth ventricle. METHODS AND RESULTS: The main indication group for ABI is represented by patients with neurofibromatosis 2 (NF2) suffering from bilateral vestibular schwannomas. During surgery aimed at tumour removal, auditory nerve function and integrity are almost always destroyed, therefore, an ABI can be introduced as an one stage procedure. Implantees use the device mainly as the aid in lipreading, only very rarely they can comprehend speech without visual cues. Auditory brainstem implant programme has been introduced in the Czech Republic in the year 1999. It was the very first ABI surgery in the Central Europe. Since that time, 5 patients had received the auditory brainstem implant, from which the first four use the device for a longer time. CONCLUSIONS: The last operated patient has not been activated yet. It may be said, that ABI represents a benefit to all our patients, in one implanted this benefit is significant, since he can understand speech without lipreading, the other implantees use the device as an aid in lipreading. In one female patient, the device benefit is severely limited by a motoric handicap after partial cerebellar resection during surgery. Nevertheless, she uses the implant on a daily basis, but contact with her is limited and difficult.

Adult↗
PubMed1983

Clinical trial of a multiple-channel cochlear prosthesis. An initial study in four patients with profound total hearing loss.

The clinical trial of a multiple-channel cochlear prosthesis was undertaken in four patients with postlingual deafness and profound total hearing loss. The results of open-set speech tests confirmed that, using electrical stimulation alone, one patient could have a meaningful conversation without resorting to lipreading (for example, this patient uses the prosthesis to converse with her husband on the telephone). The results of closed-set speech tests also suggested that a multiple-channel stimulator is more effective than a single-channel one in conveying speech information. The cochlear prosthesis was especially effective in all four patients when it was used in conjunction with lipreading, and speech-tracking tests showed that the patients could combine the information obtained from both electrical stimulation and lipreading.

Adult↗
PubMed1996

Within-subject comparison of speech perception benefits for congenitally deaf adolescents with an electrotactile speech processor and a cochlear implant.

This study assessed speech perception benefits for three congenitally deaf adolescents who used an electrotactile speech processor (Tickle Talker(TM)) and subsequently went on to use a Nucleus Minisystem 22 cochlear implant. Both devices provided significant and comparable benefits for all children in the device plus lipreading condition. All children benefited from the additional information provided by either the Tickle Talker(TM) or the cochlear implant, and were able to perceive speech information with these devices that was not available through either aided residual hearing or lipreading. None of the three children were able to understand open-set words or sentences using either hearing aids alone or Tickle Talker(TM) alone, without the aid of lipreading. Two of the children showed significant open-set speech perception benefits while using their cochlear implant alone.

Adolescent↗
PubMed2003

Audio-visual integration in schizophrenia.

Integration of information provided simultaneously by audition and vision was studied in a group of 18 schizophrenic patients. They were compared to a control group, consisting of 12 normal adults of comparable age and education. By administering two tasks, each focusing on one aspect of audio-visual integration, the study could differentiate between a spatial integration deficit and a speech-based integration deficit. Experiment 1 studied audio-visual interactions in the spatial localisation of sounds. Experiment 2 investigated integration of auditory and visual speech. The schizophrenic group performed as the control group on the sound localisation task, but in the audio-visual speech task, there was an impairment in lipreading as well as a smaller impact of lipreading on auditory speech information. Combined with findings about functional and neuro-anatomical specificity of intersensory integration, the data suggest that there is an integration deficit in the schizophrenic group that is related to the processing of phonetic information.

Adult↗
PubMed1979

Auditory-visual perception of speech with reduced optical clarity.

Optical cues for visual and auditory-visual (A-V) perception of speech were varied by placing a sheet of rough-surfaced Plexiglas between talker and lipreader and systematically changing the distance between Plexiglas and talker. This distorts the optical environment in a way that is analogous to masking or filtering in the acoustic domain. In studies with normal-hearing adults and with hearing-impaired children, speech (words, sentences) was presented live under different degrees of optical distortion, and observers attempted to identify the stimuli. Visual-along (lipreading) scores dropped abruptly to the chance level as Plexiglas distance (blurring) was increased. A-V scores were relatively high for clear conditions but diminished gradually as Plexiglas distance (blurring) was increased. Under extremely poor optical conditions, A-V scores reached a plateau. This represents essentially auditory perception without meaningful optical cues for speech. Results parallel those of previous acoustic studies that compared auditory with A-V perception of speech as a function of S/N ratio or sensation level, demonstrating a reciprocal aspect of optical and acoustic cues for speech perception. Optical distortion seems to have potential as an auditory training technique to shift attention of hearing-impaired observers to non-dominant acoustic cues during A-V perception of speech.

Adolescent↗
PubMed1982

Auditory, visual, and auditory-visual perception of vowels by hearing-impaired children.

The vowels (foreign letters in text) were presented through auditory, visual, and combined auditory-visual modalities to hearing-impaired children having good, intermediate, and poor auditory work-recognition skills. When they received acoustic information only, children with good word-recognition skills confused neighboring vowels (i.e., those having similar formant frequencies). Children with intermediate work-recognition skills demonstrated this same difficulty and confused front and back vowels. Children with poor word-recognition skills identified vowels mainly on the basis of temporal and intensity cues. Through lipreading alone, all three groups distinguished spread from rounded vowels but could not reliably identify vowels within the categories. The first two groups exhibited only moderate difficulty in identifying vowels audiovisually. The third group, although showing a small amount of improvement over lipreading alone, still experienced difficulty in identifying vowels through combined auditory and visual modes.

Adolescent↗
PubMed1988

Phonemic information transmitted by a multichannel electrotactile speech processor.

A wearable electrotactile speech processor was evaluated in a study with seven normally hearing and four hearing-impaired subjects. The processor estimated the fundamental frequency, the second-formant frequency, and amplitude of the acoustic speech signal. These parameters were presented as a pattern of electrical pulses applied to eight electrodes positioned over the digital nerve bundles on one hand. The device was shown to provide useful information for the recognition of phonemes in closed sets of words using tactile information alone. The device also supplemented lipreading to improve the recognition of open-set words. The recognition of duration and first- and second-formant frequencies of vowels and the recognition of voicing and manner of consonants were improved over recognition with lipreading alone. Recognition of final consonants was improved more than recognition of initial consonants. These results indicate that the device may be useful to both severely and profoundly hearing-impaired people.

Adult↗
PubMed1992

Discovery and expository methods in teaching visual consonant and word identification.

An experiment was conducted to examine the processes involved in lipreading as well as to investigate an optimal approach to teaching lipreading skill. We compared discovery and expository methods of learning to lip-read. Twenty-six college students with normal hearing were trained over 3 days to lip-read consonant-vowel (CV) syllables. The training material consisted of a prerecorded videotape of four different talkers. The task was a forced-choice procedure with feedback. Subjects learned with training, but there was no difference between the two learning methods. As a retention measure, subjects returned 4 weeks later and repeated the training. There were significant savings of the original learning. Three weeks after the retention phase, subjects were tested with a 10-item forced-choice monosyllabic word task. Those subjects who had extensive training on CV syllables did no better on identifying the monosyllabic words than did a control group of 9 subjects with no training. Nevertheless, performance for all three groups (discovery, expository, and no training) improved during training in the word identification task.

Adolescent↗
PubMed1995

Priming the visual recognition of spoken words.

A preliminary investigation was conducted to understand the effects of word visibility and prime association factors on visual spoken word recognition in lipreading, using a related/ unrelated prime-target paradigm. Prime-target pairings were determined on the basis of paper-and-pencil word associations completed by 85 participants with normal hearing. Spoken targets included 60 single-syllable Modified Rhyme Test words, prerecorded on laser video disc. Participants included 20 individuals with normal hearing and at least average lipreading skill for sentence-length materials. In related prime-target pairings, more targets with a high prime association were identified than with a low prime association. In unrelated prime-target pairings, a larger number of more-visible than less-visible targets was correctly identified. Individual participant differences were not statistically significant. Results from the present study suggest implications for models of visual spoken word recognition.

Adult↗