- 상태공유 HMM을 이용한 서브워드 단위 기반 립리딩
- Subword-based Lip Reading Using State-tied HMM
- ㆍ 저자명
- 김진영,신도성,Kim. Jin-Young,Shin. Do-Sung
- ㆍ 간행물명
- 음성과학
- ㆍ 권/호정보
- 2001년|8권 3호|pp.123-132 (10 pages)
- ㆍ 발행정보
- 한국음성과학회
- ㆍ 파일정보
- 정기간행물| PDF텍스트
- ㆍ 주제분야
- 기타
In recent years research on HCI technology has been very active and speech recognition is being used as its typical method. Its recognition, however, is deteriorated with the increase of surrounding noise. To solve this problem, studies concerning the multimodal HCI are being briskly made. This paper describes automated lipreading for bimodal speech recognition on the basis of image- and speech information. It employs audio-visual DB containing 1,074 words from 70 voice and tri-viseme as a recognition unit, and state tied HMM as a recognition model. Performance of automated recognition of 22 to 1,000 words are evaluated to achieve word recognition of 60.5% in terms of 22word recognizer.