Papers - Ishida, Mako

Perceptual restoration of locally time-reversed speech: Non-native listeners’ performance in their L2 vs. L1

Ishida M.

Attention, Perception, and Psychophysics (Attention, Perception, and Psychophysics)   2021

ISSN  19433921

　View Summary

Nonnative listeners are generally not as good as native listeners in perceptually restoring degraded speech and understand what was being said. The current study investigates how nonnative listeners of English (namely, native Japanese speakers who learned English as a second language) perceptually restore temporally distorted speech in their L2 English as compared with native English listeners (L1 English) reported in Ishida et al. (Cognition, 151, 68–75, 2016), and as compared with the listeners’ native tongue (L1 Japanese). In the experiment, listeners listened to locally time-reversed words and pseudowords in their L2 English and L1 Japanese where every 10, 30, 50, 70, 90, or 110 ms of speech signal was flipped in time—these stimuli contained either many fricatives or stops. The results suggested that the intelligibility of locally time-reversed words and pseudowords deteriorated as the length of reversed segments increased in both listeners’ L2 English and L1 Japanese, while listeners understood locally time-reversed speech more in their L1 Japanese. In addition, lexical context supported perceptual restoration in both listeners’ L1 Japanese and L2 English, while phonemic constituents affected perceptual restoration significantly only in listeners’ L1. On the other hand, locally time-reversed words and pseudowords in L1 Japanese were much more intelligible than those in L1 English reported in Ishida et al. It is possible that the intelligibility of temporally distorted lexical items depends on the structure of basic linguistic units in each language, and the Japanese language might have a unique characteristic because of its CV and V structure.

• Access to Document (DOI)

Perceptual restoration of temporally distorted speech in L1 vs. L2: Local time reversal and modulation filtering

Ishida M., Arai T., Kashino M.

Frontiers in Psychology (Frontiers in Psychology)  9 ( SEP )  2018.09

　View Summary

Speech is intelligible even when the temporal envelope of speech is distorted. The current study investigates how native and non-native speakers perceptually restore temporally distorted speech. Participants were native English speakers (NS), and native Japanese speakers who spoke English as a second language (NNS). In Experiment 1, participants listened to "locally time-reversed speech" where every x-ms of speech signal was reversed on the temporal axis. Here, the local time reversal shifted the constituents of the speech signal forward or backward from the original position, and the amplitude envelope of speech was altered as a function of reversed segment length. In Experiment 2, participants listened to "modulation-filtered speech" where the modulation frequency components of speech were low-pass filtered at a particular cut-off frequency. Here, the temporal envelope of speech was altered as a function of cut-off frequency. The results suggest that speech becomes gradually unintelligible as the length of reversed segments increases (Experiment 1), and as a lower cut-off frequency is imposed (Experiment 2). Both experiments exhibit the equivalent level of speech intelligibility across six levels of degradation for native and non-native speakers respectively, which poses a question whether the regular occurrence of local time reversal can be discussed in the modulation frequency domain, by simply converting the length of reversed segments (ms) into frequency (Hz).

• Access to Document (DOI)

Simultaneous articulatory and acoustic distortion in L1 and L2 Listening: Locally time-reversed "fast" speech

Ishida M.

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH (Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH)  2017-August   571 - 575 2017

ISSN  2308457X

　View Summary

The current study explores how native and non-native speakers cope with simultaneous articulatory and acoustic distortion in speech perception. The articulatory distortion was generated by asking a speaker to articulate target speech as fast as possible (fast speech). The acoustic distortion was created by dividing speech signals into small segments with equal time duration (e.g., 50 ms) from the onset of speech, and flipping every segment on a temporal axis, and putting them back together (locally time-reversed speech). This study explored how "locally time-reversed fast speech" was intelligible as compared to "locally time-reversed normal speech" measured in Ishida, Samuel, and Arai (2016). Participants were native English speakers and native Japanese speakers who spoke English as a second language. They listened to English words and pseudowords that contained a lot of stop consonants. These items were spoken fast and locally time-reversed at every 10, 20, 30, 40, 50, or 60 ms. In general, "locally time-reversed fast speech" became gradually unintelligible as the length of reversed segments increased. Native speakers generally understood locally time-reversed fast spoken words well but not pseudowords, while non-native speakers hardly understood both words and pseudowords. Language proficiency strongly supported the perceptual restoration of locally time-reversed fast speech.

• Access to Document (DOI)

Missing phonemes are perceptually restored but differently by native and non-native listeners

Ishida M., Arai T.

SpringerPlus (SpringerPlus)  5 ( 1 )  2016.12

　View Summary

This study investigates how similarly present and absent English phonemes behind noise are perceived by native and non-native speakers. Participants were English native speakers and Japanese native speakers who spoke English as a second language. They listened to English words and non-words in which a phoneme was covered by noise (added; phoneme + noise) or replaced by noise (replaced; noise only). The target phoneme was either a nasal (/m/ and /n/) or a liquid (/l/ and /r/). In experiment, participants listened to a pair of a word (or non-word) with noise (added or replaced) and a word (or non-word) without noise (original) in a row, and evaluated the similarity of the two on an eight-point scale (8: very similar, 1: not similar). The results suggested that both native and non-native speakers perceived the ‘added’ phoneme more similar to the original sound than the ‘replaced’ phoneme to the original sound. In addition, both native and non-native speakers restored missing nasals more than missing liquids. In general, a replaced phoneme was better restored in words than non-words by native speakers, but equally restored by non-native speakers. It seems that bottom-up acoustic cues and top-down lexical cues are adopted differently in the phonemic restoration of native and non-native speakers.

• Access to Document (DOI)

Some people are "More Lexical" than others

Ishida M., Samuel A.G., Arai T.

Cognition (Cognition)  151   68 - 75 2016.06

ISSN  00100277

　View Summary

People can understand speech under poor conditions, even when successive pieces of the waveform are flipped in time. Using a new method to measure perception of such stimuli, we show that words with sounds based on rapid spectral changes (stop consonants) are much more impaired by reversing speech segments than words with fewer such sounds, and that words are much more resistant to disruption than pseudowords. We then demonstrate that this lexical advantage is more characteristic of some people than others. Participants listened to speech that was degraded in two very different ways, and we measured each person's reliance on lexical support for each task. Listeners who relied on the lexicon for help in perceiving one kind of degraded speech also relied on the lexicon when dealing with a quite different kind of degraded speech. Thus, people differ in their relative reliance on the speech signal versus their pre-existing knowledge.

• Access to Document (DOI)

Perception of an existing and non-existing L2 English phoneme behind noise by Japanese native speakers

Ishida M., Arai T.

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH (Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH)  2015-January   3408 - 3411 2015

ISSN  2308457X

　View Summary

This study investigates how similarly a person hears an existing and non-existing speech sound behind noise in L2, as compared to L1 reported in Mattys, Barkan, and Samuel (2014). Participants were Japanese native speakers who spoke English as a second language. They listened to English words and non-words in which a phoneme was covered by noise (added) or replaced by noise (replaced). The target phoneme was either a liquid or a nasal. In experiment, participants listened to a pair of a word with noise (added or replaced) and a word without noise (normal) in a row, and evaluated the similarity of the two by using an 8-point scale. The results suggested that L2 listeners perceived the added and replaced sound significantly differently. L2 listeners found the added sound (a phoneme + noise) more similar to a normal sound than the replaced sound (noise only), as was also reported in L1 listeners. At the same time, they also perceived the illusory sound of a missing phoneme in the replaced condition. A missing nasal was significantly more restored than a missing liquid. There was no lexical effect in perceptual restoration of phonemes among L2 listeners, although it was reported among L1 listeners.

Using ultrasound for teaching and researching articulation

Wilson Ian, Arai Takayuki, Ishida Mako, Mizoguchi Ai

THE JOURNAL OF THE ACOUSTICAL SOCIETY OF JAPAN (Acoustical Society of Japan)  70 ( 10 ) 560 - 564 2014

ISSN  0369-4232

• Access to Document (DOI)