Issue StoriesSailing Out of the Windless Sea of Monosyllables: The Use of Speech Perception Tests in Aural Rehabilitationby Mark C. Flynn, PhD We need to use tests that correlate with real-life speech environments, provide goals/outcome measures for AR programs, and assist in predicting hearing aid/implant outcomes. Tests of speech perception have traditionally been used as global measures of performance, particularly in the areas of hearing aid comparison, hearing instrument success, and patient selection for cochlear implants. Unfortunately, the utility of these measures in planning individualized rehabilitation programs or measuring aural rehabilitation program success is limited. In most cases, the results of rehabilitation are too subtle to be detected in gross measures of improvement in speech perception. New measures of speech perception are now being developed, expanding the utility of speech perception testing through examination of the use of contextual effects and a measurement of meta-linguistic proficiency. It is hoped that these new measures may assist the identification of functional goals and the measurement of program benefit. Exploring Speech Perception Tests Furthermore, the recognition of words in sentences depends on linguistic context and metalinguistic skillsboth of which are important to the perception of speech in conversations. Open-set tests of sentence perception still lack full external generalizability. Communication, which often occurs in the form of sentences, is rarely devoid of external context. Speech is interactive and based on the context of the linguistic environment (ie, the relationship between the preceding utterance and the target utterance). One difficulty with traditional assessments of speech perception is that they do not reflect the dynamic nature of communication.3 Typically, in a test of sentence perception, the conditions are held constant, each stimulus sentence is presented only once, the listeners ability varies due to perceptual ability, and responses are scored as percent correct.4 While these testing conditions are reliable and easily standardized allowing for comparison and replication of procedures, they differ from true communication exchanges where sentences are not isolated events and recognition is not reliant solely on perceptual capabilities but rather on the ability to use the linguistic context and environmental cues. Several authors5,6 recommend the development and use of speech perception tests which better estimate an individuals communicative competence in real-life situations. Unrelated lists of sentences may underestimate a persons speech perception capabilities because the lists do not take advantage of the dynamic exchange of information and use of context and environment.3,5 Unfortunately, the transition from open-set tests of recognition of words in sentences to speech perception in the real world is too large to control all of the variables influencing intelligibility.7 Hence, the task is to isolate aspects of communication which appear to be important in conversational speech perception for measurement as discrete variables. First, we need to look at the applicability of traditional speech perception tests in measuring aural rehabilitation outcomes. Problems in Using Speech Perception Tests for AR Outcomes Similarly, speech perception tests have been constructed for a number of different purposes, such as to: assess the degree of impairment caused by a hearing loss8; allow checks to determine the accuracy of the audiogram9; compare hearing aid fittings10-12; provide information about performance before and after a cochlear implant13; assist diagnosis of different types of peripheral and central pathology14; estimate age related decline in performance15,16; assess the adequacy of hearing aid fitting17,18; and provide information about different levels of auditory perception and how they relate to each other.19,20 For any investigation into the nature of speech perception, a careful analysis of the issues needs to be considered to ensure that the required tests match the purposes of the design. Unfortunately, few speech perception tests have been developed for the use of specifically measuring the outcome of an aural rehabilitation program. Problem 2: Practice effects. We must ensure that the material presented is novel and has not been previously presented to the client. Montgomery & Demorest21 reported that study participants were able to remember the test materials, even when a period of several weeks elapsed between presentations. One potential solution is to use standardized lists of materials of equivalent difficulty. Despite the use of equivalent lists, a number of researchers report the occurrence of learning effects during speech perception tests.22-24 Therefore, the difference in performance may be due to improving ability rather than differences between situations or devices. Two possible solutions for this problem include randomizing the order of intervention in the design22,24 and providing sufficient training.23 Despite measures taken to reduce practice effects, it is important that measurement is conducted to ascertain if performance was confounded by practice effects. This could be through using unseen practice lists or through testing with similar material each week. Problem 3: Possible acclimatization. While the comprehensive review of the literature by Turner et al.25 indicated that the acclimatization effect for current hearing aids varies and may not be as large as first thought26,27, it is likely that newer speech processing digital hearing aids may show similar acclimatization effects to multiple-channel cochlear implants.28 Therefore, it is possible that improvements in speech perception observed after fitting hearing instruments could be the result of acclimatization rather than aural rehabilitation. Problem 4: Test-retest reliability. Tye-Murray29 discussed the issue of test-retest reliability and the problems posed, especially when testing children. For example, variability occurring due to different times in the day, motivational factors, and the inherent high variability within a speech perception test. While in a research setting this can be controlled for by having increased number of materials and participants, it is more difficult to control for in a clinical setting where the time for a practical assessment is usually much shorter. Problem 5: Performance over time. Often a clients improvement in conversational fluency over time is not an increase in access to the speech spectrum per se but an improvement in the use of conversational strategies. Therefore, we may see large improvements in conversational fluency (ie, through the participants improved use of conversational strategies) which do not result in an improvement in speech perception score. Problem 6: Are we really testing communication? One of the problems of aural rehabilitation is that we are aiming to improve communication effectiveness or fluency. Unfortunately, we rarely have measures that allow us to examine this area. Speech perception tests have three main areas that make them difficult to assess real-life communication skills in a meaningful way.30 First, materials are typically presented in unrelated lists of materials consisting often of vowels, consonants, words, or sentences. Second, the client is usually required to repeat verbatim. Third, the tests are rarely interactive. Unfortunately, this model does not resemble real-world communication whereby conversation takes place in a range of environments, speech is contextually based and results in the assembly of new information (as opposed to repetition), and is dynamic. The remainder of this article will detail four assessments designed for adults with a hearing loss that may provide more information regarding the communication of the individual and, in particular, be suitable to for use in aural rehabilitation programs. They are contextually based, adaptive, interactive, and/or based on conversational measures. The Effect of Context A study by Flynn, Dowell & Clark32 examined the effect of context on speech perception and the interaction of context with background noise. They compared speech perception using standard CUNY sentences33 and the Connected Speech Testv2 (CSTv2)34 at different signal-to-noise levels. Thirty-four adults who had severe-to-profound hearing loss and used hearing aids were tested. As expected, the increase in context available with the CSTv2 sentences is considerable, where the sentences are related not only to a central topic but also to each other. Additionally, contextual processing increased for this population, not only as the test became increasingly based on linguistics, but also as the acoustic conditions deteriorate with background noise. It is important, however, to note that this improvement with context was not uniform. Figure 1 shows clearly that some participants demonstrated large gains in information transmitted with the addition of contextual cues, whereas other participants showed little or no improvement. This variability was independent of pure-tone average and the other speech perception tests.
The reported variability in performance may reflect differing metalinguistic skills between listeners, which are not assessed using conventional speech perception measures. The difference between traditional and context laden tests of speech perception may be predictive of this ability to adapt and/or cope with a substantial hearing loss. Additionally, this may assist the dispensing professional in determining how well a person will adapt to an amplification device. It may be that people who show a larger no-context/context test difference may be quicker at acclimatizing to a new device. Conversely, people who show little difference between conditions may need extra time allocated in the clinic for acclimatization. While the addition of context and the evaluation of contextual information provided by different speech perception tests is a move forward in the evaluation of people with a hearing impairment, the test is still not adaptive. It tells us about contextual information but does not tell us what information/cues the person may require in order to fully understand a message. Adaptive Testing Procedures In this way, Sent-Indent holds at least four advantages over tests of word and sentence perception. 1. It allows the results to be presented in a way that is more meaningful than a speech perception score, for the participant, family member and care-giving staff. It is not an abstract score. For example, for a patient to obtain 100% of the message when wearing hearing aids, repetition of the sentence may be required. Without hearing aids, the message may need to be presented with audio-visual cues. 2. The assessment and presentation of results in this manner relates directly to aural rehabilitation goals. 3. Sent-Ident can be conducted in the rest home by an audiologist and/or trained staff. It could be possible for trained staff to use Sent-Ident as a method of objectively identifying people who may be in need of aural rehabilitation services. Patients could then be classified according to this information, and then staff could be aware of the minimum amount of cues required to communicate effectively with a resident. 4. The procedures can be adapted to demonstrate other important concepts such as the importance of distance and background noise. Sent-Ident, therefore, provides one method of assessment of performance of the adult with a hearing impairment that may provide more information than the traditional assessment of word and sentence perception without losing objectivity. Despite this considerable advantage, Sent-Ident does not take the interactive and contextual nature of conversation into account. Conversational Interaction within Speech Perception Tests
An adjacency pair consists of an utterance produced by one speaker that is intended to result in a specific type of response by the listener. Therefore, these utterances have a high degree of facilitative context because the listener gains access to context not just through the sentence form (as in open-set tests of sentence perception), but also through apriori knowledge of the grammatical shape, pragmatic function, and semantic intent of the target utterance. Adjacency pairs may therefore offer great potential in speech perception testing and aural rehabilitation. Adjacency pairs had been used previously in speech perception tests by Gagne, Tugby & Michaud37 and Erber.5 Both studies showed a clear advantage in the use of the initiating sentence and the use of context. The research of Flynn & Dowell38 expanded the paradigm of Erber5, taking into consideration the effects of related context, disruptive context and neutral context. Flynn & Dowell38 used four different question types: 1) no question, as in a standard speech perception paradigm; 2) a related question; 3) an unrelated question, and 4) a neutral question as shown in the following paradigm: Reply (target sentence): He twisted his ankle playing tennis last night.
The results demonstrated that in all conditions where there was a preceding question, speech perception significantly improved (p<.05), and increasing the cohesion between the question and the reply further improved speech perception scores. The potential uses of such a form of assessment include using it as a measure of contextual processing. A gross measurement could be made of a persons ability to process contextual information and the effects of negative context. Another perhaps more interesting use was reported by Flynn & Dowell38 in that they showed that adjacency pairs were extracting differences in terms of semantic, grammatical, pragmatics, and auditory priming. Therefore, if perception of adjacency pairs relates to the four aspects of linguistic functioning as suggested, then the assessment and comparison between these different situations may provide important information for aural rehabilitation. The difference between a good communicator and a poor communicator may relate to one particular aspect, such as the ability to recognize the pragmatic aspects of adjacency pairs. Consequently, aural rehabilitation could focus on this one area of deficiency to provide improvement. Therefore, a speech perception test could provide specific goals for aural rehabilitation instead of the general aim of conversational fluency. A final use of adjacency pairs could be in the aural rehabilitation program itself. There may be some adults with a hearing loss who do not fully understand or use the facilitative benefit of contextual information in their communication. Adjacency pairs could be used as a method to improve contextual skills and as a practice task to demonstrate the importance of context versus no context. Despite the benefits of using an interactive test of speech perception, the task is still removed from conversation or real-life speech perception; the listener is required to repeat back exactly what they heard and the nature of the question/answer pair are structured. In this way the participant still does not have control over the fluency of the conversation or access to conversational repair strategies. Conversational Fluency
The difficulty has been how to measure conversational fluency in a way that is robust and representative of real-life experience. For example, tracking success in a task of conversational fluency may vary with the ability of the communication partner, and baseline measures depend on the nature of the material (ie, the topic of conversation). Additionally, how do we measure performance in the clinic? Rarely do communication problems arise in the clinic, because these settings are usually relatively quiet, have low reverberation communication environments, and involve a cooperative communication partner. Additionally we might be interested in how to define conversation time clinically. Erber39 provided an excellent outline for the types of behaviors that may be of interest. These were:
Essentially, Erber39 considered a fluent conversation to be one in which clarification time was minimal, ideas were easily exchanged, and speaking time was shared. Tye-Murray29 built upon this framework and suggested that we might want to measure the mean length turn ratio (MLT ratio) whereby a comparison is made between the talkers mean length of speaking turn (MLT). If these ratios are equal, then it can be said that speaking time was shared. Difficulty arises in how might these be measured in a clinical context. One method might be through the use of the Dyalog computer software developed by Erber.39 Dyalog is one way in which we could objectively measure conversational fluency. The software is relatively simple and can be easily included into the clinical context. The clinician has a conversation, which can be controlled using the TOPICON procedure30, and records the occurrences and time of conversation breakdown and repair by pressing the space bar. Additional variables, such as background noise and speaker type, can also be controlled. Dyalog can then measure (over a set conversation time) the duration of conversation (in seconds) taken by clarification, the proportion of conversation time consumed by clarification, the number of occurrences of clarification, the average time per occurrence of clarification, and the overall duration of the conversation. Dyalog can then be used to track/create the goals of aural rehabilitation. For example, if the goal of the program is conversational fluency, then one can objectively measure the components of conversational fluencythe amount of time in clarification can be tracked and measured. Presumably the goal of intervention would be to reduce the occurrence of communication breakdowns and the amount of time spent in each episode of communication breakdown. Alternatively, the goal could, in fact, be the opposite: to increase the amount of time in clarification. For people who bluff and nod their way through conversations, the aim could be for them to use more clarification strategies that are effective and efficient, ensuring that the important information is transferred. The Future of Speech Perception Tests Speech perception tests still have a valuable and important role to play in any assessment of the client. However, the limitations should be recognized, and valuable effort should be made to ensure that we establish measures that provide an improved assessment in terms of aural rehabilitation. The measurement of assessment and performance in an aural rehabilitation program should ideally consist of a quality-of-life measure, a well-selected measure of speech perception, and a measure that is conversationally based. The overall aim should be to develop a communication profile rather than a speech perception score. One crucial part omitted from the discussion of speech perception tests is that they should be selected with reference to an overall model of speech perception. There should be a firm clinical and theoretical rationale for why a test needs to focus at the phoneme, syllable, word, or sentence level. It is hoped that, in the future, tests could be selected from a battery of assessments that allow the clinician to target specific areas of auditory processing that can lead directly to amplification solutions or rehabilitation outcomes and/or goals. There has been relatively little discussion on the area of the receptive meta-linguistic skills needed for speech perception. It should be noted that these measures have not been sufficiently researched, and that these are ideas as to where assessments of communication performance in the hearing impaired should be heading. We are in desperate need to develop tests that are:
We are on the way to achieving these goals. More than 30 years ago, James Jerger made a call to action: ...we are, at the moment, becalmed in a windless sea of monosyllables. We can only sail further on the fresh winds of imagination.1 Hopefully, we will soon be able to answer this call. Acknowledgments
Correspondence can be addressed to Mark C. Flynn, PhD, Oticon A/S, Strandvejen 58, 2900 Hellerup, Denmark; email: mcf@oticon.dk. References |
|
|
ADDITIONAL ONLINE RESOURCES |
Featured Employer
|