The application of automatic speech recognition to students new word pronunciation m a

VIETNAM NATIONAL UNIVERSITY – HOCHIMINH CITY UNIVERSITY OF SOCIAL SCIENCES AND HUMANITIES FACULTY OF ENGLISH LINGUISTICS AND LITERATURE THE APPLICAFTION OF AUTOMATIC SPEECH RECOGNITION TO STUDENTS’ NEW WORD PRONUNCIATION A thesis submitted to the Faculty of English Linguistics & Literature in partial fulfillment of the Master‟s degree in TESOL By PHẠM HƯNG THỊNH Supervised by NGUYỄN THÚY NGA, Ph.D HO CHI MINH CITY, OCTOBER 2021 ACKNOWLEDGEMENTS Firstly, I would like to express my deepest gratitude to my thesis supervisor, Dr Nguyễn Thúy Nga for her precious guidance, strong support, and helpful criticism and instructive comments on my work Without her helps and encouragements, this M.A thesis would not have been successfully accomplished Next, I want to say thank you to Assoc Prof Dr Tô Minh Thanh for her teaching of pronunciation knowledge which directly related to my thesis I am also grateful to other lecturers of the master programme in TESOL at the Faculty of English Linguistics and Literature of VNUHCM - University of Social Sciences and Humanities for their devoted guidance on my academic journey Then, I would like to thank Ms Ngô Thị Lan Hương – Director of English for New Generation Language Centre in Bien Hoa City and all of the participants who facilitated the process of accomplishing my thesis Last but not least, I would love to send my thanks to my beloved family, especially my wife, who absolutely believed and encouraged me in completing the programme i STATEMENT OF ORIGINALITY I hereby certify that this thesis entitled “THE APPLICAFTION OF AUTOMATIC SPEECH STUDENTS‟ NEW WORD RECOGNITION TO PRONUNCIATION” Submitted in terms of Statements of Requirements for Theses in Master‟s Programmes issued by the Higher Degree Committee, is my own work This thesis has not been submitted for the award of any degree or diploma in any other institution Ho Chi Minh City, 2021 PHẠM HƯNG THỊNH ii RETENTION OF USE I hereby state that I, Phạm Hưng Thịnh, being a candidate for the degree of Master of Arts in TESOL, accept the requirements of the university relating to the retention and use of Master‟s Thesis deposited in the University Library I agree that the original of my Master‟s Thesis deposited in the University Library should be accessible for the purposes of study and research, in accordance with the normal conditions established by the library for the care, loan and reproduction for theses Ho Chi Minh City, 2021 PHẠM HƯNG THỊNH iii TABLE OF CONTENTS ACKNOWLEDGEMENTS i STATEMENT OF ORIGINALITY ii RETENTION OF USE iii TABLE OF CONTENTS iv LIST OF ABBREVIATIONS viii LIST OF TABLES ix LIST OF FIGURES x ABSTRACT xi CHAPTER 1: INTRODUCTION 1.1 Background to the study 1.2 Statement of the problem 1.3 Aims of the study 1.4 Research questions 1.5 Rationale of the study 1.6 Scope of the research 1.7 Structure of the thesis 1.8 Summary of the chapter CHAPTER 2: LITERATURE REVIEW 2.1 Definition of terms 2.1.1 Pronunciation 2.1.2 Word 2.1.3 Phoneme (sound) iv 2.1.4 Consonant 2.2 The application of technology in language teaching and learning 11 2.2.1 Mobile Assisted Language Learning (MALL) 11 2.2.2 Automatic speech recognition (ASR) 12 2.2.3 ELSA Speak 13 2.3 Attitude 14 2.3.1 Affect 15 2.3.2 Behavioural intention 16 2.4 Young learners 17 2.5 Review of previous studies 18 2.6 Conceptual framework 28 2.7 Summary of the chapter 30 CHAPTER 3: METHODOLOGY 31 3.1 Research questions 31 3.2 Research design 31 3.3 Research site 36 3.4 Participants 36 3.4.1 Starters class (main class) 37 3.4.2 Movers class (point of reference class) 37 3.5 Research tools 38 3.5.1 Test 38 3.5.2 Questionnaire 45 3.5.3 Interview 49 3.6 Data collection procedure 50 v 3.7 Procedure of data analysis 51 3.8 Validity 53 3.9 Reliability 54 3.10 Summary of the chapter 55 CHAPTER 4: RESULTS AND DISCUSSION 56 4.1 Research question 1: the effects of ASR (ELSA Speak) on students‟ new word pronunciation 56 4.1.1 Perception 56 4.1.2 Production 60 4.2 Research question 2: students‟ attitudes on the application of ASR (ELSA Speak) in their pronunciation learning 63 4.2.1 Emotion 65 4.2.2 Behavioural intention 69 4.3 Discussion of results 76 4.4 Findings 78 4.5 Summary of the chapter 79 CHAPTER CONCLUSION 80 5.1 Conclusions 80 5.2 Suggestions 81 5.3 Limitations of the study 82 5.4 Recommendations for further study 83 5.5 Summary of the chapter 83 REFERENCES 84 APPENDICES 90 vi APPENDIX A 90 APPENDIX B 92 APPENDIX C 94 APPENDIX D 96 APPENDIX E 98 APPENDIX F 102 APPENDIX G 107 APPENDIX H 110 APPENDIX I 113 APPENDIX J 114 vii LIST OF ABBREVIATIONS A(B) Attitude towards a Behavior AI Artificial Intelligence A(O) Attitude towards an Object ASR Automatic Speech Recognition CALL Computer Assisted Language Learning CAPT Computer Assisted Pronunciation Training CEFR Common European Framework of Reference for Languages EFL English as a Foreign Language ESL English as a Second Language IT Information Technology IVI iFlytek Voice Input L2 Second Language MALL Mobile Assisted Language Learning TALL Technology Assisted Language Learning TAM Technology Acceptance Model TPB Theory of Planned Behavior TRA Theory of Reasoned Action viii LIST OF TABLES Table 2.1 Frequency of Common Problematic Final Sounds 25 Table 2.2 Summary of Previous Studies 26 Table 3.1 General View on Pretest and Posttest 40 Table 3.2 Format of a Pretest/Posttest 40 Table 3.3 Comparison between the two Questionnaires 49 Table 3.4 Interpretation Scale of Cohen‟s Kappa 53 Table 4.1 Result of Perception of Starters Class 57 Table 4.2 Result of Perception of Movers Class 59 Table 4.3 Result of Inter-Rater Reliability in Cohen‟s Kappa 61 Table 4.4 Result of Production of Starters Class (main class) 62 Table 4.5 Result of Production of Movers Class (point of reference class) 63 Table 4.6 Summary of the Results of Research Question 64 Table 4.7 Result of Question in the Questionnaire for two Classes 66 ix 2) Mức độ yêu thích bạn chức sau ELSA Speak? (Xin vui lòng đánh dấu (X) vào số điểm mà bạn cho phù hợp với chức năng, từ 1(khơng thích nhất) (thích nhất) Khơng thích thích Phát âm tốc độ bình thường      Thể độ xác điểm phần trăm      Xem người thực hành      Phát âm tốc độ chậm      Thể độ xác màu sắc      Cho mẫu cách phát âm âm từ      Thu âm phần phát âm bạn      3) Bạn cảm thấy việc phát âm âm /t/ cải thiện dùng ELSA Speak? A) tệ so với trước dùng ELSA Speak B) không cải thiện chút C) cải thiện chút D) cải thiện nhiều E) cải thiện nhiều 103 4) Bạn cảm thấy việc phát âm âm /d/ cải thiện dùng ELSA Speak? A) tệ so với trước dùng ELSA Speak B) không cải thiện chút C) cải thiện chút D) cải thiện nhiều E) cải thiện nhiều 5) Bạn cảm thấy việc phát âm âm đuôi /s/ cải thiện dùng ELSA Speak? A) tệ so với trước dùng ELSA Speak B) không cải thiện chút C) cải thiện chút D) cải thiện nhiều E) cải thiện nhiều 6) Bạn cảm thấy việc phát âm âm /z/ cải thiện dùng ELSA Speak? A) tệ so với trước dùng ELSA Speak B) không cải thiện chút C) cải thiện chút D) cải thiện nhiều E) cải thiện nhiều 7) Bạn cảm thấy việc phát âm âm /k/ cải thiện dùng ELSA Speak? A) tệ so với trước dùng ELSA Speak B) không cải thiện chút C) cải thiện chút D) cải thiện nhiều E) cải thiện nhiều 8) Theo bạn, âm đuôi khiến bạn khó phát âm sau luyện tập với ELSA Speak? (Bạn chọn nhiều câu trả lời sau đây) A) /t/ B) /d/ C) /s/ D) /z/ E) /k/ F) không âm 104 9) Bạn cảm nhận mức độ dễ sử dụng ELSA Speak? A) khó sử dụng B) khó sử dụng C) bình thường D) dễ sử dụng E) dễ sử dụng 10) Bạn nghĩ việc giáo viên tiếng Anh bạn sử dụng ELSA Speak để dạy bạn phát âm âm đuôi học từ lớp? B) không hứng thú B) khơng hứng thú C) bình thường D) hứng thú E) hứng thú 11) Bạn muốn giáo viên tiếng Anh bạn sử dụng ELSA Speak lần để dạy bạn phát âm âm đuôi học từ lớp? A) không B) C) thường D) thường xuyên E) luôn 12) Mức độ hứng thú bạn dùng ELSA Speak bên lớp học? A) không hứng thú B) không hứng thú C) bình thường D) hứng thú E) hứng thú 13) Bạn có dự định dùng ELSA Speak sau lớp học kết thúc khơng? Nếu có, bạn định sử dụng lần? B) B) C) thường D) thường xuyên E) luôn 105 Nếu khơng, xin vui lịng viết lý ……………………………………………………………………………… ……………………………………………………………………………… ……………………………………………………………………………… ……………………………………………………………………………… ……………………………………………………………………………… Xin Cảm ơn trả lời câu hỏi - 106 APPENDIX G INTERVIEW (ENGLISH VERSION) Hello! I would like to interview you about how you feel about working with ELSA Speak for your final sounds of new word pronunciation Your answers will be used for the research only Please answer some questions as follow: Please tell me your general opinion when using ELSA Speak as part of the pronunciation class Do you like it? Why? (or why not)? ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… Do you think ELSA Speak helps you in improving your final sounds of new word pronunciation? If yes, how does it help you? ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… If no, can you tell me what difficulties you may have when practicing with ELSA Speak? ………………………………………………………………………………………… ………………………………………………………………………………………… 107 ………………………………………………………………………………………… ………………………………………………………………………………………… In your opinion, what is the most difficult thing you have when using ELSA Speak to improve your final sounds of new word pronunciation? ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ……………………………………………………………………………………… Have you used ELSA Speak outside the classroom? ……………… ………………………………………………………………………… ………………………………………………………………………………………… What has motivated you to continue working with ELSA Speak or to stop using it? ………………………………………………………………………………… ………………………………………………………………………………… ………………………………………………………………………………… ………………………………………………………………………………… ………………………………………………………………………………… Do you intend to use ELSA Speak after the class? If yes, how you plan to use it after the class? ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… 108 If no, please tell me the reason why? ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… -That is the end of the interview, thank you for your attention - 109 APPENDIX H INTERVIEW (VIETNAMESE VERSION) CUỘC PHỎNG VẤN VỀ VIỆC SỬ DỤNG ELSA SPEAK ĐỂ LUYỆN TẬP PHÁT ÂM CÁC ÂM ĐUÔI KHI HỌC TỪ MỚI Xin chào! Tôi muốn vấn cảm nhận bạn việc luyện tập với ELSA Speak để tập phát âm âm đuôi học từ Câu trả lời bạn dùng cho mục đích nghiên cứu Xin vui lòng trả lời câu hỏi đây: Xin cho biết cảm nhận chung bạn sử dụng ELSA Speak công cụ lớp học phát âm Bạn có thích ứng dụng không? Tại sao? ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………… Bạn có nghĩ ELSA Speak giúp bạn cải thiện phần âm đuôi phát âm từ hay không? Nếu có, ứng dụng giúp bạn nào? ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… 110 Nếu khơng, bạn cho biết bạn gặp khó khăn luyện tập với ELSA Speak? ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ……………………… Theo bạn, điều khó khăn lớn sử dụng ELSA Speak để cải thiện phát âm âm đuôi học từ mới? ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ……………………………………………………………………………………… Bạn có sử dụng ELSA Speak bên ngồi lớp học khơng? ……………… ………………………………………………………………………… ………………………………………………………………………………………… Điều khiến bạn tiếp tục luyện tập với ELSA Speak ngừng sử dụng ứng dụng này? ………………………………………………………………………………… ………………………………………………………………………………… ………………………………………………………………………………… ………………………………………………………………………………… ………………………………………………………………………………… 111 Bạn có dự định sử dụng ELSA Speak sau lớp học kết thúc khơng? Nếu có bạn sử dụng ứng dụng nào? ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… Nếu khơng, xin vui lịng cho biết lý ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… ………………………………………………………………………………………… -Cuộc vấn đến kết thúc, xin chân thành cảm ơn bạn tham gia - 112 APPENDIX I LETTER OF CONSENT To whom it may concern, I, the undersigned, ………………………………………… agree that by signing this form I consent to the VNUHCM University of Social Sciences and Humanities releasing information pertaining to my time of study I understand that the verification issued by the university will include my full legal name at the time of study, the level of degree undertaken, the full course title, the mode of attendance (i.e full time or part time), the start date, and award date and classification achieved (if applicable) If I was permanently withdrawn from my studies this will also be shown in the final document Signature: Date: 113 APPENDIX J SAMPLE LESSON PLAN Teacher‟s name: Phạm Hưng Thịnh Time allotted: 30 minutes Teaching point: final consonant sound /s/ Class level: A1 Date of teaching: 28/07/2021 Lesson aims: introduce the articulation of the alveolar unvoiced sound /s/ for students and help them pronounce the sound accurately Skills: The lesson provides learners chances to practice listening, speaking, communication skills (esp production stage), etc Attitudes: Students are expected to be active, dynamic and diligent in attending class Methods: PPP Teaching aid: mobile phone, internet access, the application of ELSA Speak, white board, markers, laptop, HDMI, power point, Google Meet Reference: Baker, A (2015) Tree or three?: An elementary pronunciation course Cambridge: Cambridge University Press Procedure: 114 Stage (Time) Activities Aims Anticipated Teacher Students problem Presentation Signify Ss -Asks Ss to listen to -Listen to the Ss may not be : what the some words (house, words and find able to identify lead-in: target sound horse, bus, glass, out the common the target sound mins of the lesson horse, box) and sound in these is and which identify what sound words Solution: T position in they can hear in every +Expected repeats the the word it single word answer: the words again and sound /s/ pronounces the appears -Asks Ss to listen again and identify what position of the sound /s/ much -Listen to the louder and words again and stronger than the sound /s/ they can find out the other sounds in hear in each word: position of the each word the initial, the middle, sound the final +Expected answer: the final -Compliments Ss position performance and goes on to practice stage Practice: Provide Ss -Provides Ss with Practice There may be 10 mins with chances words in the list of pronouncing the not enough to practice new words (4) for the words several smartphone with pronouncing final sound /s/ times and get internet new words -Asks them to help from the connection with the help practice pronouncing modeling Solution: T 115 Note of ASR these words with the function of ASR brings several (ELSA application of ELSA (ELSA Speak) ones for Ss to Speak) Speak: if there is any practice and to +First: listen to the mispronounced save time model pronunciation sounds +Next: practice There may be no pronouncing the internet words a few times connection +Finally: practice the available at the mispronounced research site sound(s) (if any) Solution: T can with the help of prepare suggested modeling something to sound from ASR share ensure the (ELSA Speak) availability of internet connection during the lesson Some technical problems may occur Solution: T always stays in class and helps when necessary Production Find out -Asks Ss to Pronounce each 12 mins whether or pronounce the words word twice not working they practice and 116 with ASR write down the score (ELSA they get from ASR Speak) can (ELSA Speak) help Ss -Pays attention on the improve their final sound /s/ pronunciatio whether it is n of the pronounced sound /s/ accurately or not -Each word can be pronounced twice and the higher score will be taken Production: Provide Ss Asks Ss to practice Ss may not (homework) with more the other words in the afford to buy the mins chances to list at home or any copyright of work with time before the next ASR (ELSA and lesson Speak) to experience practice at ASR (ELSA home Speak) Solution: T provides them with copyright of the application when necessary 117