CHƯƠ H CH C C LIP TRACKING PROGRAM IMPLEMENTED ON FPGA ác giả óm tắt i c t m c g c m i gi i ti m g t t i i t g n g t t á t tác g i m i t các c i i c m t có i giải t t t i c t c t ả c ác v g m i Do c t[.]
CHƯƠ H CH C C LIP TRACKING PROGRAM IMPLEMENTED ON FPGA ác giả: óm tắt: i c tmc gc gt t m t có i giải t v g m i Do ct t t g m m g tmc gm i c i giải t t t m m t có t i c i i g g im i t c i m m m i n ó : t gt i i tt g C gi i át ti m g t t i i t g tác g i m i t c i i c t i c t c t ả c ác t giải t t ct c i t c gt it m m i g c g C gc t c t giải t t c m i gắ tc i t t ả th g i m t c i g t tt gt g m m i g ác i t t c c g ct i t i i c t g g m - Abstract: The first and crucial stage in audio visual speech recognition (AVSR) system is lip tracking It is the process of partitioning lip contour from facial video sequences Many efficient algorithms have been developed to achieve good and accurate segmentation Most of these have to be performed entirely by software because of their complex compulation In this paper, we present a novel hardware-based lip tracking model, implemented on DE2 FPGA (Field Programmable Gate Array) Board of Altera Our mathematical tool is the combination of K-Means clustering and shortest path Dijkstra algorithms The experimental results have proved that our proposed technique is well adapted to face with the presence of beard, teeth and even to lips with weak color contrast The pipeline design in our hardware structure considerably enhances the processing speed (more than 700 FPS) in comparison with software (FPS: Frames per second) Key words: Lip tracking; Lip segmentation; FPGA; K-Means clustering; Dijkstra; Pipeline