Modified Rhyme Test for Evaluating Turkish Speech Intelligibility

  • Umut Arıöz Computer Engineering, Engineering Faculty, Gazi University
  • Banu Günel Informatics Institute, METU
Keywords: Modified rhyme test, phonetic analysis, speech intelligibility, Turkish language


Objective: There are both objective and subjective tests for evaluating the speech intelligibility. Speech Intelligibility Index (SII) and Modified Rhyme Test (MRT) are the most common methods for objective and subjective tests, respectively. While objective tests do not depend on the language, subjective tests are applied to the hearing-impaired subjects in their language. In these tests, hearing-impaired subjects try to recognize the sound by looking at the word lists in their hand. The word lists can be presented as two-word or six-word choices in design. However, the preferred type a is six-word choice for MRT. Up to now, these word lists were developed in different languages with different methods. For Turkish language, only two-word choice lists were developed; there was no study related to the Turkish language with six-word choice. In this study, we aimed to develop applicable six-word Turkish MRT lists by using hearing-impaired subjects.Methods: In this study, three different six-word Turkish MRT lists were developed according to the phonetic characteristics of the Turkish language, and these lists were tested via 12 hearing-impaired subjects. In the lists, 5 different Turkish phonetic characteristics were taken into account. For the analysis, the detailed audiograms (18 octave band) of hearing-impaired subjects were used.Results: Detailed statistical analysis for phonetic variations were shown for each hearing-impaired subject. Having correct structure and robust word choices for MRT lists were shown by comparing the equivalent speech spectrum levels of sounds and MRT results of the hearing-impaired subjects.Conclusion: New Turkish MRT lists were developed according to the phonetic characteristics of the Turkish language. Usability of the lists was shown by audiological test with the hearing-impaired subjects. Statistical analysis and the results of tests showed that developed Turkish MRT lists can be used in audiological studies as a reference material.


Pisoni DB, Hunnicutt S. Perceptual evaluation of MITalk: The MIT unrestricted text-to-speech system, Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing; New York: IEEE Press, 1980; 5: 572 -5.

House AS, Williams CE, Hecker MHL, Kryter KD. Articulation testing methods: consonantal differentiation with a closed response set. Journal of the Acoustical Society of America. 1965;37: 158–66.

Villchur E. Simulation of the effect of recruitment on loudness relationships in speech, Journal of the Acoustical Society of America. 1974;56:1601–11.

ANSI-S3.5 (1969). American National Standard methods for the calculation of the Articulation Index, American National Standards Institute, Inc.: New York.

Steeneken H, Houtgast T. A physical method for measuring speech transmission quality. Journal of the Acoustical Society of America, 1980;67: 318-26.

ANSI-S3.5 (1997). American National Standard methods for the calculation of the Speech Intelligibility Index. American National Standards Institute, Inc.: New York.

Voiers WD. Speech Intelligibility and Speaker Recognition. In: Hauley, Dowden (Eds.), Hutchinson and Ross Inc. 1977.

ITU-T Recommendation P.85. Telephone transmission quality subjective opinion tests. A method for subjective performance assessment of the quality of speech voice output devices.1994.

Sherbecoe RL, Studebaker GA. Audibility-index functions for the connected Speech Test. Ear & Hearing, 2001;23: 385-98.

Fairbanks G. "Test of phonemic differentiation: The rhyme test", J.Acoust. Soc.Am. 1985;30:596-600.

Li Z, Tan EC, McLoughlin I. Teo TT. Proposal of standards for intelligibility tests of Chinese speech, IEE Proc. on Vision, Image and Signal Processing, 2000; 147:254-60.

Tihelka D. Matoušek J. The Design of Czech Language Formal Listening Tests for the Evaluation of TTS Systems, In Proceedings of Fourth International Conference on Language Resources and Evaluation - LREC 2004, Lisbon, Portugal, vol VI, 1099-2002.

Sak H, Güngör T, Safkan Y. A corpusbased concatenative speech synthesis system for Turkish. Turkish Journal of Electrical Engineering, and Computer Sciences, 2006;14: 209-23.

Palaz H, Bicil Y, Kanak A, Dogan MU. New Turkish Intelligibility Test for Assessing Speech Communication Systems. Journal of Speech Communication, 2005; 47: 411-23.

Salza PL, Foti E, Nebbia L, Oreglia M. MOS and pair comparison combined methods for quality evaluation of text to speech systems. Acta Acustica, 1996;82: 650-6.

Royster HL. The Noise-Vibration Problem-Solution Workbook. ISBN: 1931504148. Aiha Press.2001.

Sauert B, Vary P. Near End Listening Enhancement Optimized With Respect To Speech Intelligibility Index. 17th European Signal Processing Conference (EUSIPCO 2009). Glasgow, Scotland, August 24-28.

Loizou PC. Speech Enhancement: Theory and Practice, Second Edition. Taylor & Francis Group, LLC. Press. 2013.

International Phonetic Association (IPA), (1999). Handbook of the International Phonetic Association—A Guide to the Use of the International Phonetic Alphabet, Cambridge University Press, Cambridge, UK.

Original Research