The acoustic analysis of the dialog speech

Shigeyoshi Kitazawa

Department of Computer Science, Shizuoka University

5-1 Johoku, Hamamatsu, 432, Japan

e-mail: kitazawa@cs.shizuoka.ac.jp

Dialog speech communicates a lot of implicit nonverbal information as well as verbal information. We look into some examples of dialog speech from the point of acoustic analysis, and present preliminary results of the machine readable form of the analysis data. First, we validated the study of the dialog speech along the development of speech processing technologies as well as related sciences such as the new trends of linguistic study and the behavior science. Secondly, we emphasized the necessity of a further extended new framework for research of speech technology. Then, we considered concrete method incorporating nonverbal information into the dialog speech. The concepts of the nonverbal speech information that follows the original definition by Trager are inherited into the field of sociolinguistics and behavior science as the concept of the paralanguage and recently formalized as the "a guideline to Text Encoding and Interchange (TEI)". We adopted this formalization as a new framework of dialog speech encoding. Finally, we have shown an example of labeling of dialog speech with the method incorporating the TEI as the description of the nonverbal aspects of the dialog speech. We are going to develop this approach toward the applications of speech recognition, linguistic analysis and dialog analysis.

Keywords: dialog speech, para-language, nonverbal communication, TEI