Survey research into an assessment of students’ speaking skill by teachers at equest academy

VIETNAM NATIONAL UNIVERSITY, HANOI UNIVERSITY OF LANGUAGES AND INTERNATIONAL STUDIES FACULTY OF POSTGRADUATE STUDIES ********************* NGUYỄN QUỲNH ANH SURVEY RESEARCH INTO AN ASSESSMENT OF STUDENTS’ SPEAKING SKILL BY TEACHERS AT EQUEST ACADEMY Nghiên cứu việc đánh giá kĩ nói Tiếng Anh học viên giáo viên học viện anh ngữ Equest M.A MINOR PROGRAMME THESIS Field : English Teaching Methodology Code : 60140111 HANOI – 2017 VIETNAM NATIONAL UNIVERSITY, HANOI UNIVERSITY OF LANGUAGES AND INTERNATIONAL STUDIES FACULTY OF POSTGRADUATE STUDIES ********************* NGUYỄN QUỲNH ANH SURVEY RESEARCH INTO AN ASSESSMENT OF STUDENTS’ SPEAKING SKILL BY TEACHERS AT EQUEST ACADEMY Nghiên cứu việc đánh giá kĩ nói Tiếng Anh học viên giáo viên học viện anh ngữ Equest M.A MINOR PROGRAMME THESIS Field : English Teaching Methodology Code : 60140111 Supervisor : Assoc Dr Ngơ Hữu Hồng HANOI - 2017 DECLARATION I declare that the materials in this thesis have not been submitted previously or concurrently in the whole or as part of requirements for a degree of ULIS relating to the retention and use of M.A Thesis deposited in the library I also certify that the work presented in the thesis is to the best of my knowledge and belief, original except as acknowledged in the text Any help that I have received during the preparation and completion of this thesis has been acknowledged In addition, I certify all information sources and literature used are indicated in the thesis Date: 2017 15 Signature: I ACKNOWLEDGEMENTS This research was accomplished with the help of many people First, I would like to express my heartfelt gratitude to my supervisor, Assoc., Dr Ngô Hữu Hoàng for his guidance, invaluable advice, and constant encouragement He has been my mentor academically and personally His constant encouragement has helped me complete this thesis My further gratitude goes to the English department chairs at ULIS Especially, Assoc Prof Dr Lê Hùng Tiến, Assoc Prof Dr.Lê Văn Canh, and Dr Huỳnh Anh Tuấn , who have shared their knowledge with me during my study I am grateful to all the research participants, including my teacher colleagues who helped arrange the field work for me Many thanks go to all my friends, Hiền, Ngân and Trang who gave invaluable advice and a lot of encouragement to me I would also like to express my appreciation and heartfelt gratitude to my parents who have always believed in me and supported my dreams I also thank my sisters: Thuỳ Linh and Quỳnh Mai for their cooperation all through Most of all, I would like to thank my husband, Quang Vũ, for his love, care, emotional and intellectual support, for his continuous encouragement, and bearing with me during all the tough times The completion of my master program would be impossible without him II ABSTRACT The present study investigates the teachers‟ classroom speaking assessment in EQuest Academy, a famous English center in Hanoi The data is collected from questionnaires and interviews where teachers were the only targeted respondents 10 teachers recently working in EQuest participated in the questionnaire and are interviewed The results have revealed that classroom speaking assessment currently conducted in EQuest Academy has broadly employed performance-based tasks and that somewhat informative feedback has been offered to students in the form of criterion descriptions plus marking scores, one which resulted in teachers having an overall pessimistic attitude towards the positive effects of such testing on teaching and learning It is evident from this study that there is need for improvements in order to facilitate better learning outcomes in the classroom Since EQuest teachers are not trained adequately the theory speaking assessment, there is less confidence in assessing students‟ speaking skill The study also finds that the speaking assessment tasks used by EQuest English teachers are those which gave the students less psychological burden; are timesaving and designed for the convenience of construction and administration and not demand the teacher to take the role of an interviewer III TABLE OF CONTENTS DECLARATION I ACKNOWLEDGEMENTS II ABSTRACT III TABLE OF CONTENTS IV PART A: INTRODUCTION I Rationale II Background to the research II.1 English education in EQuest Academy II.2 Characteristics of English assessment in EQuest Academy .2 III Research aims IV Research questions PART B: DEVELOPMENT Chapter One: Literature Review 1.1.Key term definitions 1.1.1 Test vs Assessment 1.1.2 Classroom speaking assessment 1.2 The advantages of classroom assessment 1.2.1 Academic advantages 1.2.2 Advantages for speaking assessment 1.3 Issues related to reliability in classroom assessment 1.4 Issues related to validity in classroom assessment 1.5 Teachers' perceptions 10 Chapter Two: Methodology 11 2.1 A qualitative approach 11 2.2 Steps in the selection of participants 12 2.2.1 Questionnaire participants 12 2.2.2 Interview informants 13 2.3 Data collection procedures 14 2.4.Data analysis 15 Chapter Three 18 IV Findings and Discussions 18 3.1 Findings 18 3.1.1 Teachers' perceptions of speaking assessment in EQuest 18 3.1.2 Positive effects of classroom speaking assessment on teaching and learning 19 3.1.3 Types of speaking assessment tasks used by EQuest teachers .20 3.1.4 Teachers' perceptions of the practical constraints in conducting communicative speaking assessment 24 3.1.4.1 Difficulties caused by the class 24 3.1.4.2 Difficulties caused by the students 25 3.1.4.3 Difficulties caused by the teachers 26 3.2 Discussion 27 PART C: Conclusion 30 I Recapitulation 30 II Implications 31 III Limitations of the study 32 IV Suggestions for further study 33 References 34 APPENDIX A: QUESTIONNAIRE I APPENDIX B: INTERVIEW QUESTIONS III APPENDIX C: PARTICIPANT CONSENT FORM AND PARTICIPANT INFORMATION SHEET V APPENDIX D: SUMMARY OF INTERVIEWEES’BACKGROUND INFORMATION VI V PART A: INTRODUCTION I Rationale In Vietnam there has long been discussion about how Vietnamese people speak English, and this discussion usually arouses strong feelings in people Like many other Asian countries, Vietnamese people begin their English education very early at school, yet they find themselves helpless when it comes to speaking English Words not come out Many Vietnamese students have the words, they either heard them or read them but they can't say them The reason might be that oral skills have not usually been emphasized in Vietnamese schools and oral skills are not tested in the matriculation exam However, speaking skills are increasingly important in work life, and many Vietnamese students have expressed the need for learning better oral skills and thought speaking to be the most important area of learning in English As a result, many Vietnamese take part in extra English classes in English centers like EQuest, RES, ILA and so on Obviously, there is a clear need for better oral skills, but the means how to achieve them are still developing My study focuses on the assessment of oral skills, and I wanted to emphasize English classrooms in EQuest Academy, not in any schools because of the following reasons Firstly, recently there are so many students learning English outside schools and most of the feedback and evaluation they receive come from their teacher during those lessons in English centers without being affected by national education system I wanted to investigate how teachers assess students‟ speaking skill in everyday classroom situations where time and equipment are limited Personally, I also find this topic interesting as I am also a teacher of English in EQuest Academy, a famous English educating center Secondly, in Vietnamese schools, there are few opportunities to evaluate students' speaking skills because speaking assessment is not administered in any formal exams including the high school entrance exam and English education puts a greater emphasis on passing the entrance exam By contrast, in EQuest Acadery, students‟ speaking ability is tested regularly Thirdly, assessing speaking in a normal classroom situation has some obvious problems such as limited time and the large class of around 20 people if the situation is not recorded? Creating equal test or evaluation situations during lessons is also challenging II Background to the research II.1 English education in EQuest Academy In EQuest, an English language program is officially offered for all students at differrent levels with a variety of English courses (pre-intermediate, intermediate, upper intermediate and advanced) The curriculum has put an increasing emphasis on enhancing students‟ oral communication skills However, there are few opportunities to evaluate students' speaking skills because speaking assessment is not administered in any formal exams including the high school entrance exam and final course examination Unlike with the curriculum focus, in practice, English education in almost school in Vietnam which puts a greater emphasis on passing the course exam EQuest Academy emphasis on enhancing oral communication skills, classroom assessment is widely practiced in EQuest classroom For many students in EQuest, classroom assessment is the only opportunity to have their speaking skills assessed when they take tests such as the Test of Spoken English (TSE), the Test of English as a Foreign Language (TOEFL), and the International English Language Testing System (IELTS) Despite the strong recommendation of assessment by classroom teachers, there is still a challenge which stems from the emphasis for a measurement driven orientation toward assessment In other words, even if the rationale for classroom assessment is to provide both students and teachers with information about their current level of speaking skills and how to improve their speaking skills on the basis of their real language performance, teachers are nevertheless under pressure from such a policy to reflect the results of classroom assessment as a certain portion or percentage of the students‟ final courses II.2 Characteristics of English assessment in EQuest Academy High stakes test situation In EQuest, most of students learn English for IELTS or TOEFL certificate to study oversea, so English assessment plays an important role in determining whether students move to the higher level This accounts for a high stakes test situation in class High stakes testing refers to tests upon which test-takers‟ futures or study plans In other words, test outcomes are likely to affect the students‟ future careers References Adamson, B., & Davison, C (2003) Innovation in English language teaching in Hong Kong primary schools: One step forwards, two steps sideways Prospect, 18, 27-41 Bachman, L and Palmer, A S (1984) Some comments on the terminology of language testing In: Rivera, C (ed.), Communicative Competence Approaches to Language proficiency Assessment: Research and Application Clevedon: Multilingual Matters, 34-43 Bachman, L F., & Palmer, A S (1996) Language testing in practice: Designing and developing useful language tests Oxford, [England]: Oxford University Press Bachman, L F (1990) Fundamental Considerations in Language Testing Oxford: Oxford University Press Black, P (2001) Formative assessment and curriculum consequences In D Scott (Ed.), Curriculum and assessment Westport, CT: Ablex Black, P., & Wiliam, D (1998) Assessment and Classroom Learning Assessment in Education 5(1), 7-74 Black, P & Wiliam, D (2004) The formative purpose: Assessment must first promote learning In M Wilson (Ed.), Towards coherence between classroom assessment and accountability (pp.20-50) Chicago: National Society for the Study of Education 34 Black, P., Harrison, C., Lee, C., Marshall, B and William, D (2003) Assessment for learning: Putting it into practice Buckingham: Open University Press Bogdan, R and Biklen, S K (1992) Qualitative research for education: An introduction to theory and methods London: Allyn and Bacon Bostwick, R M and Gakuen, K (1995) Evaluating Young EFL Learners: Problems and Solutions In Brown, A (1995) The effect of rater variables in the development of an occupation-specific language performance test Language Testing, 12(1), 1-15 Brown, H D (2001) Teaching by principles: An interactive approach to language pedagogy (2nd ed.) New York: Addison Wesley Longman, Inc Brown, H D (2004) Language assessment: Principles and classroom practices New York: Pearson/Longman Butler, R (1988) Enhancing and undermining intrinsic motivation: the effect of taskinvolving and ego-involving evaluation on interest and performance British Journal of Educational Psychology, 62, 934-943 Butler, Y (2009) How teachers observe and evaluate elementary school students‟ foreign language performance? A case study from South Korea TESOL quarterly 43(3), 417-444 Byon, A S (2005) Classroom Assessment Tools and Students' Affective Stances: KFL Classroom Settings Language and Education, 19(3), 173-193 Canale, M and Swain, M (1980) Theoretical bases of communicative approaches to second language teaching and testing Journal of Applied Linguistics, 1, 1: 1-47 Canale, M (1983) A communicative approach to language proficiency assessment in a minority setting In 35 Crooks, T (1988) The impact of classroom evaluation practices on students Review of Educational Research, 58 (4), 438-481 Cumming, J., & Maxwell, G (2004) Assessment in Australian schools: Current practice and trends Assessment in Education, 11, 89-108 Davies A., Brown A., Elder, C., Hill, K., Lumley T., & McNamara, T (1999) Dictionary of language testing Cambridge; New York: Cambridge University Press Davison, C., & Leung, C (2009) Current issues in English language teacher-based assessment TESOL quarterly, 43(3), 393-415 Davies, A (1983) The validity of Concurrent Validation In Hughes, A and Porter, D (eds.), Current Developments in Language Testing London: Department of Linguistic Science University Davies, A (1990) Principles of language testing Oxford: Basil Blackwell Denzin, N K (1989) The Research Act: A Theoretical Introduction to Sociological Methods Englewood Cliffs, NJ: Prentice-Hall Fulcher, G., & Davidson, F (2007) Language testing and assessment: an advanced resource book Abingdon; New York: Routledge Frymier, J (1987) Bureaucracy and the neutering of teachers Phi Delta Kappen 69, 9-14 Genesee, F., & Upshur, J A (1996) Classroom-based evaluation in second language education Cambridge, UK; New York: Cambridge University Press Harris, L (2007) Employing formative assessment in the classroom Improving Schools,10(3), 249-260 Huerta-Marcías, A (1995) Alternative assessment: Responses to commonly asked questions Tesol Journal, 5(1), 8-11 36 Hughes, A (2003) Testing for language teachers (2nd ed.) Cambridge; New York: Cambridge University Press Hughes, A (1989) Testing for Language Teachers Cambridge: Cambridge University Press Kohn, A (1993) Punished by rewards: The trouble with gold stars, incentive plans, A‟s praise, and other bribes Boston: Houghton Mifflin Krashen, S and Terrell T (1984) The Natural Approach Oxford: Pergamon Kumar, R (1996) Research Methodology: A step-by-step Guide for Beginners Melbourne: Longman Lee, W.K (2007) Assessment used in teaching English as a foreign language at elementary schools in Asia: Korea‟s case Paper presented at the 2007 Asia TEFL International Conference Kuala Lumpur, Malaysia Leung, C (2005) Classroom teacher assessment In E Hinkel (Ed.), Handbook of research in second language teaching and learning (pp.869-888) Mahwah, N.J.: L Erlbaum Associates Li, D (1998) "It's always More Difficult Than You Plan and Imagine": Teachers' Perceived Difficulties in Lincoln, Y S and Guba, E G (1985) Naturalistic inquiry Beverly Hills, CA: Sage Linn, R., Baker, E., & Dunbar, S (1991) Complex, performance-based assessment: Expectations and validation criteria Educational Research, 16, 15-21 Marshall, C., & Rossman, G B (2006) Designing qualitative research (4th ed.) Thousands Oaks, Calif.: Sage Publications 37 Maykut, P and Morehourse, R (1994) Beginning Qualitative Research London: The Falmer Press McDonough, J and McDonough, S (1997) Research Methods For English Language Teachers London: Arnold McNamara, T (1996) Measuring second language performance London; New York: Longman McNamara, T (1997) „Interaction‟ in second language performance assessment: Whose performance? Applied Linguistics, 18(4), 446-466 McNamara, T (2000) Language testing Oxford: Oxford University Press Mitchell, R., & Myles, F (2004) Second language learning theories (2nd ed.) London; New York: Arnold; Distributed in the United States of America by Oxford University Press Moon, T R & Callahan, C M (2001) Classroom performance assessment: What should it look like in a standards-based classroom? NASSP Bulletin, 85(622), 48Morrow, K E (1977) Techniques of evaluation for a notional syllabus London: University of Reading Centre for Applied Language Studies Nakamura, Y (1993) Measurement of Japanese college students' English Speaking ability in a classroom setting Unpublished doctoral dissertation, International Christian University, Tokyo Patton, M Q (1990) Qualitative evaluation and research methods Newbury Park, CA: SAGE Publications,Inc Pham Lan Anh (2008) An Investigation into English Classroom Assessment Practices in Three Primary Schools in Hanoi Hanoi: University of Languages and international studies Phillips, E (1992) The effects of language anxiety on students' oral test performance and attitudes The Modern Language Journal, 76(1), 14-26 38 Porter, D (1983) The Effect of Quantity of Context on the Ability to make Linguistic Predictions: a Flaw in a Measure of General Proficiency In Hughes, A and Porter, D (eds.), Current Developments in Language Testing London: Academic Press Punch, K F (1998) Introduction to Social Research London: Sage Publications Reay, D., & Wiliam D (1999) I will be a nothing: structure, agency and the construction of identity through assessment British Educational Research Journal, 25, 343-354 Savignon, S (1991) Communicative language teaching: State of the art TESOL Quarterly, 25, 261-277 Savignon, S J (1997) Communicative competence: Theory and classroom practice (2nd ed.) Sydney: The McGraw Hill Companies SBA Consultancy Team (2005) 2007 HKCE English language Examination: Introduction to the school-based assessment component (Training Package) Hong Kong SAR, China: Hong Kong Examination and Assessment Authority/Faculty of Education, The University of Hong Kong Spolsky, B (1975) Language testing - The Problem of validation In Palmer, L and Spolsky, B (eds.), Papers on language testing 1967-1974, 147-153 Washington, DC Spolsky, B (1985) Fourteen Years on - Later Thoughts on Overall Language Proficiency In Hughes, A and Porter (eds.), Current Developments in Language Testing London: Academic Press Stobart, G (2006) The validity of formative assessment In J Gardener (Ed.), Assessment and learning (pp.133-146) Thousand Oaks, CA: Sage Publications 39 Thomas, R M (2003) Blending qualitative & quantitative research methods in theses and dissertations Thousand Oaks, Calif.: Corwin Press Thorndike, E (1913) Educational psychology Volume 1: The origin nature of man New York: Columbia University Teachers College Underhill, N (1987) Testing spoken language: A handbook of oral testing techniques Cambridge; New York: Cambridge University Press Weir, C J (1990) Communicative Language Testing London: Prentice-Hall Weir, C J (1993) Understanding and developing language tests London: PrenticeHall Wiersma, W (1995) Research Methods in Education Boston: Allyn and Bacon 40 APPENDIX A: QUESTIONNAIRE Section 1 ① female I am a ② male ① 23-30 years old How old are you? old ④ 41-45 years old ② 31-35 years old ③ 36-40 years ⑤ above 45 years old How many years have you been teaching in EQuest Academy? ① less than year ② 1-2 years ③ 2-5 years ④ more than years Section No) Do you include speaking assessment in your classroom? ( Yes / → If you answer „No‟, please go to No → If you answer „Yes‟, please go to No What is your real purpose of assessment ? Please indicate in effect for what purpose you employ classroom speaking assessment, and approximately how much times you typically spend on them in your curriculum Time spent (hrs) Assessment of students for class placement Pre-topic planning Ongoing programming (lesson planning) Ongoing student assessment (e.g marking, feedback) Final evaluation of topic/unit of work Providing information to others (e.g parents, school) Following the policy of EQuest academy Others Methods of assessment: Please indicate 1) which of the following methods you use in your course; and 2) how many times you use it (or them) during a semester Methods of assessment observation of students in typical speaking activities during I regular classes marking of a specific test tasks peer assessment self assessment Others: ※ This is for those who choose the second option, ‘marking of a specific test tasks’ in No Please indicate the kinds of tasks/ activities that you use and how often you use these activities and please tell how many times you use it (or them) during a semester Frequency 1.Let the students pick up one or two questions Show and tell Self-introduction or family introduction Role play Rote memory of text dialog Picture description Information gap activities Please indicate the format of feedback that you use ( for open- ended question) ① only a score of marking ② criterion description plus score of marking ③ oral feedback given ④ written feedback given Thank you for your participation If you are willing to participate in the follow-up interview, please put a tick and let me know your contact details Yes, I can □ Contact details: (email) @ (phone) II APPENDIX B: INTERVIEW QUESTIONS How long have you worked in EQuest ? What is your language teaching approach? What are assessment methods? What is the language element focused on in the assessment? What you perceive the function of classroom-speaking assessment? Do you perceive any positive effects of classroom speaking assessment on teaching and learning? If you have any difficulty in conducting classroom-speaking assessment, what are they? III IV APPENDIX C: PARTICIPANT CONSENT FORM AND PARTICIPANT INFORMATION SHEET PARTICIPANT CONSENT FORM (QUESTIONNAIRE) I have read the accompanying letter explaining the project named “Survey research into an assessment of students' speaking skill by teachers at EQuest Academy” The project is being conducted by Nguyễn Quỳnh Anh, a Master student of English Teaching Methodology, and supervised by Assoc.Dr Ngơ Hữu Hồng from the University of Languages and International Studies I understand that:  The participation to this study is voluntary;  I will be asked to participate in a questionnaire survey on classroom-based speaking assessment  It will take about 10 minutes;  My confidentiality and privacy will be respected, future publications resulting from the study will use pseudonyms to ensure the anonymity of persons;  I may request a copy of any publications arising from the work;  I can withdraw my consent at any time without explanation In that case, my record will be destroyed, and the data will be removed from the data analysis;  I can contact Quỳnh Anh on quynhanhnguyen04091988@gmail.com or +84 1644 958825 to request further information about the project I agree to participate in the above mentioned research project conducted by Quỳnh Anh under the supervision of Dr, Ngơ Hữu Hồng Name _Signature Date V APPENDIX D: SUMMARY OF INTERVIEWEES’BACKGROUND INFORMATION Teacher Teaching experience (Year) 10 VI ...VIETNAM NATIONAL UNIVERSITY, HANOI UNIVERSITY OF LANGUAGES AND INTERNATIONAL STUDIES FACULTY OF POSTGRADUATE STUDIES ********************* NGUYỄN QUỲNH ANH SURVEY RESEARCH INTO AN ASSESSMENT OF STUDENTS’. .. suggests that Qualitative data analysis requires organization of information and data reduction Thus, the researcher is required to reorganize and select related information from disordered, unorganized... 28 preparation Teachers' perceptions of theory of speaking assessment This study also indicated that EQuest teachers were not equipped with an adequate theory of communicative speaking assessment