(Luận văn thạc sĩ) desgning an english oral achievement test for second year students at bac ninh physical education an sports university

VIETNAM NATIONAL UNIVERSITY, HANOI UNIVERSITY OF LANGUAGES AND INTERNATIONAL STUDIES FACULTY OF POST-GRADUATE STUDIES  DƯƠNG THỊ HÒA “DESIGNING AN ENGLISH ORAL ACHIEVEMENT TEST FOR SECOND YEAR STUDENTS AT BAC NINH PHYSICAL EDUCATION AND SPORTS UNIVERSITY” (THIẾT KẾ BÀI THI VẤN ĐÁP TIẾNG ANH CHO SINH VIÊN NĂM THỨ HAI TRƯỜNG ĐẠI HỌC THỂ DỤC THỂ THAO BẮC NINH) MINOR PROGRAMME THESIS FIELD: English Teaching Methodology CODE: 601410 HÀ NỘI - 2011 VIETNAM NATIONAL UNIVERSITY, HANOI UNIVERSITY OF LANGUAGES AND INTERNATIONAL STUDIES FACULTY OF POST-GRADUATE STUDIES  DƯƠNG THỊ HÒA “DESIGNING AN ENGLISH ORAL ACHIEVEMENT TEST FOR SECOND YEAR STUDENTS AT BAC NINH PHYSICAL EDUCATION AND SPORTS UNIVERSITY” (THIẾT KẾ BÀI THI VẤN ĐÁP TIẾNG ANH CHO SINH VIÊN NĂM THỨ HAI TRƯỜNG ĐẠI HỌC THỂ DỤC THỂ THAO BẮC NINH) MINOR PROGRAMME THESIS FIELD: English Teaching Methodology CODE: 601410 SUPERVISOR: Đỗ Bá Quý, MEd HÀ NỘI - 2011 v TABLE OF CONTENTS STATEMENT OF AUTHORSHIP………………………………………………… I ACKNOWLEDGEMENTS ii ABSTRACT iii LIST OF TABLES………………………………………………………………… iv TABLE OF CONTENTS…………………………………… ……… … v PART A INTRODUCTION Rationale of the study………………………………………………………… …… Aims of the study…………………………… …………………………… …… Research questions……………………………… ……………………………… … Scope of the study ………………………………………………………………… … Methodology…………………………………………………………………… Design of the study…………………………………………………………………… 3 3 PART B DEVELOPMENT Chapter Literature review 1.1 Language testing………………………………………………………………… … 1.2 The role of testing……………………………………………………………… … .5 1.2.1 Testing and teaching……… ……………………………………………… … 1.2.2 Purpose of language testing………………………………………………… .6 1.3 Achievement test…………………………………………………………………… 1.3.1 Definition………………………………………………………………… 1.3.2 Kinds of achievement tests………………………………………………… 1.4 Criteria of a good test……………………………………………………………… 1.4.1 Validity………………………………………………… …………… … 10 1.4.2 Reliability……………………………………………………………… … 11 1.4.3 Practicality……………………………………………………………… … 12 1.4.4 Discrimination…………………………………………………………… .12 1.5 Testing speaking skills……………………………………………………………… 12 1.5.1 What is a spoken test …………………………………………………… 12 1.5.2 What should be tested…………………………………………………… 13 1.5.2.1 Listening comprehension…………………………………………… … 13 1.5.2.2 Grammatical appropriacy…………………………………………… …14 1.5.2.3 Ease of speech and fluency……………………………………… … … 14 1.5.2.4 Content…………………………………………………………… …… 15 1.5.2.5 Conversational skill………………………………………………….… .15 vi CHAPTER Methodology 2.1 The current situation of English teaching and learning at BAC NINH UPES …… 16 2.2 Participants………………………………………………………………………… .16 2.2.1 The teachers…………………………………………… ……………… 16 2.2.2 The students…… …………………………………………………… 16 2.3.Overview the material used for second year students at BAC NINH UPES 2.4 Current testing situation at BAC NINH UPES……………………… ……… 17 19 2.5 Results and discussions 2.5.1 The subjects……………………………………………………………… 20 2.5.2 Instruments for collecting data………………………………………………21 2.5.3 Analysis of the collected data…………… ……………………… … … …21 2.5.3.1 Teachers’ survey questionnaire and interview … …… … 21 2.5.3.2 Students’survey questionnaire ……… …… … … … 22 2.5.4 Results……………………………………………… …… … 23 CHAPTER3 Towards designing an oral achievement test for second year students at BAC NINH UPES 3.1 Suggestions for improvement of the existing English oral achievement test… … 24 3.1.1 Small talk…………………………………………………………… … 25 3.1.2 Picture………………………………………………………………… 26 3.1.3 Oral interview…………………………………………………………… 27 3.2 Proposed construction for an oral test for second year students at BAC NINH UPES 3.2.1 Objectives……………………………………………………………… … 28 3.2.2 Table of specifications …………………………… ………………… … 28 3.3.2.1 Test skills……………………………………………………… …… 29 3.3.2.2 Test content……………………………………… ………………… 29 3.3.2.3 Test format………………………………………… ……………… … 29 3.3.2.4 Rubrics………………………………………………………………… 29 3.3.2.5 Marking……………………………………………… …… ……… 29 3.3.2.6 Detailed construction for the test……………………………… …… 29 3.3 Test administration and marking scheme……………………… …………… 29 3.3.1 Test administration……………………………………… …………… 30 3.3.2 Marking scheme………………………………………… …………… 30 3.3.2.1 Marking………………………………………………… …………… 30 3.3.2.2 Detailed marking scales……………………………………………… … 30 3.3.2.3 Testing procedures…………………………………………………… 32 3.3.2.4 The marking training program ……………………………………… 33 3.3.3 Conclusion……………………………………………………………… 35 vii PART C CONCLUSION Conclusions………………………………………………………………… … …36 Limitations and suggestions for further study…………………… ……… … 37 REFERENCES……………………………………………… …………………… 38 APPENDIX A QUESTIONNAIRES…… … …………………… ……………….I APPENDIX B THE CURRENT TEST …… ……………………… ………… IX APPENDIX C THE SAMPLE TEST…… …………………… …………… APPENDIX D THE ANSWER KEY FOR SAMPLE TEST……… APPENDIX E THE EXTRA SPEAKING MATERIALS……… X ……… XI ………… XII Part A Introduction Rationale for the study Language is not only a main medium of education, but also intrinsically involved in every school subject to such a degree that education should be viewed as a “ languaging” process The twentieth century has seen the rise of English as the most widely used international means of communication with different purposes Anyone no matter where he lives is likely to be aware of the fact that having knowledge of English helps him achieve the latest information on sience and technology and intergrade himself into the outside world In Vietnam, English has received widespread attention Bac Ninh Physical education and Sports University plays a very important role in training well qualified and experienced teachers of sports and coaches to satisfy the needs of the country The communicative approach to Language Teaching with the most effective and modern teaching techniques have been applied to develop students’ linguistic and communicative competence by the teachers from this university The teachers make full use of time to develop the four language skills during the course in an attemp to help their students communicate effectively have a successful communication in the target language However, teachers should not be confined to imparting teaching and learning with testing It is of special importance in educational system, which is highly competitive as testing not only acts as an indirect stimulus to learning but plays a crucial role in determining the success or failure of one’s own career In the World Yearbook of education 1969, Lauwerys and Seaton highlights: “Thus, testing is an important tool in educational light both the nature of language proficiency and language learning” In addition, testing also pushes up teaching and learning activities As Nga (1977) notes: Tests are assumed to be powerful determiners of what happens in classrooms and it is commonly claimed that they affect teaching and learning activities both directly and indirectly No one can deny the fact that testing is an important part in teaching and learning process, but has it been paid enough attention yet? Having taught English for students at Bac Ninh University of Physical education and sports for nearly 16 years, author of this study has designed tests of all four language skills, especially the speaking skills She has also administered and marked these tests Her teaching experience shows that there still remain some problems that need to be solved such as the test content, the gap between what is tested and what is taught, the reuse of tests from years to years, from class to class As a result, tests may lack of validity and realibility Since 2010 at Bac Ninh UPES students have been required to an oral achievement test at the end of each semester Having good English result in the first year enables them to have better result in their specialty Knowing the importance of speaking skill for students at UPES, teachers in the English group regard oral achievement test as a means to reinforce students’ knowledge and motivate their learning On the ground of the problem already mentioned, the author has decided to choose Designing an English Oral Achievement Test for Second Year students at Bac Ninh Physical Education and Sports University (Bac Ninh UPES) in an attemp to solve the testing problems here and share her testing experience with her colleages and those who are concerned with this area Aims of the study The study aims at examining the current testing situation and English tests at Bac Ninh UPES towards designing an English oral achievement test for second year students With the above- mentioned rationale, the specific aims of the study are: + Evaluating the current situation of English oral test in terms of its content, time allowance and marking scales + Investigating teachers’suggestions for improvement of the current testing situation in general and oral test in particular + Proposing a sample test as an illustration of a newly designed test based on the old one Research questions To gain the above aims of the study, the following questions are addressed: (1) What is the current English oral testing situation at Bac Ninh UPES? (2) What are the teachers’suggestions for improving the current English testing situation for the second year students at Bac Ninh UPES? (3) What test components and test contents are considered to be appropriate for the intended English oral achievement test? Scope of the study Because of limitation of the time, the author of the study does not cover testing issues for all the four skills, but only places emphasis on the third semester English oral achievement test for second year at Bac Ninh UPES It deals with the general ideas of language testing, of the current test and the design of the final oral achievement test for the second year students at Bac Ninh UPES Methodology The above-given questions are to be answered by means of: (1) Gathering reference materials; analyzing and synthetisizing the findings into principles, qualities and formats as the basis to evaluate the current testing situation at Bac Ninh UPES toward designing an English oral achievement test for second year students (2) Imploying questionnaires, interviews, opinion exchanges and experimental tests to collect data for the study Design of the study The study consists of three parts and each one presents a set of related issues: - The first part provides basic information such as rationale, aims, design, scope and methodology of the study - The second part, which is the main part, is sub divided into three chapters: + The first chapter “ Literature review”, which is the most theoretical one, looks at the background knowledge on language testing + The second chapter which discusses on methodology, presents the deep analysis of the setting including the questionnaires, direct interviews, and analysis of students’ needs for a new test It also describes data collection instruments, data collection procedure and data analysis + The third chapter is the most important one which touches upon the designing an English oral achievement test for second year students at Bac Ninh UPES based on the above – mentioned theoretical and practical study - And the final part, the author shed the mantle of reviewing the study and suggesting further research Part B Development Chapter Literature review Some literature review about language testing, the role of testing, achievement test and some criteria of a good test are presented in this chapter 1.1 Language testing It can be said that language tests are valuable tools for providing information concerning language teaching On the one hand, they provide evidence of the results of learning and instructing and the effectiveness of teaching On the other hand, they also provide information for both teachers and students to make decisions Teachers should determine what specific kinds learning materials or activities are suitable for their students basing on their strength and weakness or diagnosis of the amount of knowledge they have learnt and make sure that they are ready to move to another unit For these reasons, all language teaching should involve testing and it becomes one of the main aspects of methodology Many researchers have given out definitions of testing with different points of view Allen(1974: 313) provides the following definition of tests: A test is a measuring device which we use when we want to compare an individual with other individuals who belong to the same group The author emphasizes testing as an instrument to ensure that students have a sense of competition rather than to know how good their performance is and in which condition a test can take place According to Carroll (1968: 46), a psychological or educational test can be considered as a procedure designed to elicit behavior from which one can make inference about characteristics of an individual From this definition, it follows that a test is a measurement designed to elicit a particular behavior of each individual And what a test from other types of measurement, according to Bachman, (1990: 20) is that it is designed to obtain specific sample of behavior This distinction is believed to be of great importance because it reflects the primary justification replaced for the use of language tests and implicates how we design, develop and use them to their best use Thus, language tests can provide the means for more focus on the specific assure of interest Another interesting definition of testing is provided by Ibe (1981: 1) as follow: A sample of behavior under controlled of specified conditions and aimed towards providing a basis for performing judgement The term a sample of behavior used here is rather broad and it means something else rather than the traditional types of papers and pencils Read (1983) shares the same idea with Ibe in the sense that a sample of behaviors suggests language testing ceirtainly includes listening and speaking skills as well as reading and writing ones However, Heaton (1988:5) looks at testing in a different way In his opinion, tests are as a means of assessing the students’ performance and to motivate the students He looks at tests with positive eyes as many students are eager to take at the end of the semester to know how much knowledge they have One important thing is that he points out the relationship between testing and teaching In short, from the above descriptions, testing is an effective means of measuring and assessing students’ language knowledge and skill It is of great use to both language teaching and learning 1.2 The role of testing Unlike tests of other abilities or areas of knowledge where we frequently use language in the process of measuring something else, in language tests, we use language as a measurement of language ability in second language acquisition Similarly, language tests can be valuable sources of information about the effectiveness of learning and teaching 1.2.1 Testing and teaching A large number of examination and tests in the past tended to separate testing from teaching Heaton (1988: ) emphasizes that teaching and testing in some ways are so interwoven and independent that is very difficult to tease apart.” Both testing and teaching are so closely interrelated that it is virtually impossible to work in either field without being constantly concerned with the others” However, thanks to the steady change in the approaches to language teaching with a remarkable shift of emphasis from dicrete - point items to intergrative and communicative tests, testing, teaching and learning become more and more interrelated 37 REFERENCES Allen, J.P.B and Corden,Pit, S (1974) Techniques in applied Linguistics Oxford University Press Aik, K.C ( 1983) Continuous Prose Writing Test for Business studies students ( In) Guidelines: Periodical for Classroom Language teachers Classroom tests Crabbe, D.(Ed).Vol.5.Pp.72-75 Singapore: SEAMEO Regional Language Centre Bachman, L.F (1990) Fundamental Considerations in Language Testing Oxford University Press Brown, H.D ( 1994.a.) Teaching by principles- An Interactive Approach to Language Pedagogy Englewood Cliffs NJ: Prentice Hall Carmen, P.B.(1995) (In) Coming to Grips with Progress Testing Carroll, J.B (1968) The psychology of language testing ( In) A Davies (Ed) Language Testing symposium A Psycholinguistic Perspective London: Oxford University Press Finocchiaro, M & Sako, S ( 1983) Foreign Language Testing A Practical Approach NewYork: Regents Publishing Company, Inc Harrison, A ( 1991) A Language Testing Handbook Macmillan Publishers Heaton, J.B ( 1998) Writing English Language tests London: Longman 10 Henning, G ( 1987) A Guide to Language Testing Cambridge: Newbury House Publishers 11 Hughes, A ( 1990) Testing for Language Teachers Cambridge University Press 12 Ibe, M D (1981) Language test analysis beyond the validity and reliability criteria (In ) Papers on Language Testing Occasional papers Read J.A.S ( Ed) No 18.pp Singapore: SEAMEO Regional Language center 13 Lauwerys, J.A., and Seanton, D.G (1969) The World Year Book of Education 1969 London: Evans 14 Lee, W.K ( 1991) Task-based approach to oral communication testing of English as a foreign language’Ph.D thesis Seoul: Hanshin Publishing Co 15 Moore, K.D ( 1992) Classroom Teaching Skills USA: Mc Graw Hill, Inc 16 Morrow, K ( 1985) The evaluation of tests of communicative performance in Prospect, 112 38 17 Nga, N.P (1997) Wash back effects of the International English Language Testing System at the Vietnam National University, Hanoi Unpublished Ph.D thesis The university of Melbourne: Australia 18 North, B (1991) Standardization of continuous assessment grades in C.Alderman and B North ( des): Language testing in the 1990’s Modern English Publication & The British Council 19 Nunan,D (1988) The learner- centered curriculum Cambridge University Press 20 Read, J.A.S (1983) What is a Good Classroom Test? (In) Guidelines A Periodical for Classroom Language Teachers Classroom tests Crabbe, D (Ed) Volum No.1.Pp.1-7 Singapore: SEAMEO Regional Language Centre 21 Underhill, N (1987) Testing Spoken Language Cambridge: Cambridge University Press 22 Oller, J.W.Jr.(1979) Language tests at School London: Longman I APPENDIX A Survey questionnaire ( for students) This survey questionnaire is an attemp to some research on how to design an English oral achievement test for second year students at Bac Ninh UPES Your effort in completing this questionnaire would be highly appeciated and of great used to my study You can be positiive that you are not to be identified in any discussions of date Please tick or write your answers where necessary ( More than one option may be needed) How long have you been learning English? How important is English for your future career? a Very important b Quite important c Not very important d Not important at all What is the percentage of your accomplishment of a test? a 0% -20% b 20%- 50% c 50%-80% d 80%-100% What difficulty you meet when you the test? a Difficulty in understanding the test’s rubrics b New words and structures c Many different types of test items d Difficulty in pronunciation Are you interested in such tests as answering questions, translation and making up sentences? a Yes b No Do you like tests such as description of pictures? a yes b No II Do you think that the test should include time and the weightings of each part? a Yes b No Should teachers correct students’ work after they have done the test? a Yes b No Should the format of the current test be changed? a Yes b No 10 Please add some opinions about the current test Thank for your cooperation! III Survey questionnaire ( For English teachers at Bac Ninh UPES) This survey questionnaire is an attemp to some research on how to design an English oral achievement test for second year students at Bac Ninh UPES Your effort in completing this questionnaire would be highly appeciated and of great used to my study You can be positiive that you are not to be identified in any discussions of date Please tick or write your answers where necessary (More than one option may be needed) How long have you been teaching English? a Five years b From five to ten years c Over ten years d Over twenty years Do you think that an English oral achievement test at the end of the each semester is necessary for students at Bac Ninh UPES a Yes b No ………………………………………………………………………………… What you think of the content of the current English oral test for second year students at Bac Ninh UPES? a Very reasonable b Reasonable c Not very reasonable d Unreasonable How can you make a test on speaking skill? a using a complete test from a test book b making your own test c a and b d others In terms of marking scale of this test, in your opinion, it is very a Very reasonable b Reasonable c Not very reasonable d Unreasonable IV - If you choose c and d , please write down your reasons ……………………………………………………………………………………… ………………………………………………………………… In your opinion, time allowance for this test is a Very reasonable b Reasonable c Not very reasonable d Unreasonable In your opinion, should we change the construction of the current test in terms of its content, marking scale or time allowance a yes b No If you choose YES, please write down the reasons ……………………………………………………………………………………………… ……………………………………………………………………………………………… … What you consider the best items for measurement of your students’ speaking ability? a Translation (E-V) b Translation (V_E) c Small talk d Oral interview e Picture description f Making up sentences 10 Please give further comments or suggestions towards the improvement of the current test? ……………………………………………………………………………………………… ……………………………………………………………………………………………… ……………………………………………………… Thanks for your cooperation! V PHIẾU PHỎNG VẤN ( For students) This survey questionnaire is an attemp to some research on how to design an English oral achievement test for second year students at BacNinh UPES Your effort in completing this questionnaire would be highly appeciated and of great used to my study You can be positive that you are not to be identified in any discussions of date Please tick or write your answers where necessary (More than one option may be needed) How long have you been learning English? How important is English for your future career? a Very important b Quite important c Not very important d Not important at all What is the percentage of your accomplishment of a test? a.0% -20% b.0%- 50% c.0%-80% d.80%-100% What difficulty you meet when you the test? a Difficulty in understanding the test’s rubrics b New words and structures c Many different types of test items d Difficulty in pronunciation Are you interested in such tests as answering questions, translation and making up sentences? a Yes b No Do you like tests such as description of pictures? a yes b No Do you think that the test should include time and the weightings of each part? VI a Yes b No Should teachers correct students’work after they have done the test? a Yes b No Should the format of the current test be changed? a Yes b No 10 Please add some comments about the current test Thank for your cooperation! VII PHIẾU PHỎNG VẤN ( For English teachers at Bac Ninh UPES) This survey questionnaire is an attemp to some research on how to design an English oral achievement test for second year students at Bac Ninh UPES Your effort in completing this questionnaire would be highly appreciated and of great used to my study You can be positive that you are not to be identified in any discussions of date Please tick or write your answers where necessary (More than one option may be needed) How long have you been teaching English? a Five years b From five to ten years c Over ten years d Over twenty years Do you think that an English oral achievement test at the end of the each semester is necessary for students at Bac Ninh UPES a Yes b No ………………………………………………………………………………… What you think of the content of the current English oral test for second year students at Bac Ninh UPES? a Very reasonable b Reasonable c Not very reasonable d Unreasonable How can you make a test on speaking skill? a using a complete test from a test book b making your own test c a and b d others In terms of marking scale of this test, in your opinion, it is very a Very reasonable b Reasonable c Not very reasonable d Unreasonable VIII If you choose c and d , please write down your reasons……………………………………………………………………………… ……………………………………………………………………………… According to you, time allowance for this test is a Very reasonable b Reasonable c Not very reasonable d Unreasonable In your opinion, should we change the construction of the current test in terms of its content, marking scale or time allowance a Yes b No If you choose YES, please write down the reasons ……………………………………………………………………………………………… ……………………………………………………………………………………………… … What you consider the best items for measurement of your students’ speaking ability? a Translation (E-V) b Translation (V_E) c Small talk d Oral interview e Picture description f Making up sentences 10 Please give further comments or suggestions towards the improvement of the current test? ………………………………………………………………………… ………………………………………………………………………… ………………………………………………………………………… ……………………… Thanks for your cooperation! IX APPENDIX B THE CURRENT TEST I Read the text: (4 points) From the fifteenth to the nineteenth centuries, martial arts existed at two main levels; the popular level at festivals) and the royal level (specialized martial arts training and examinations) Common people organized popular martial arts activities both to provide entertainment and to perfect their martial spirit, discipline, efficiency, and self-defence skills Popular martial arts performances took place throughout the country, primarily at training centres and at annual traditional festivals The royal martial arts system also trained soldiers to fight invaders and protected the court The content was divided into three part: martial arts for the army, martial arts for study, and martial arts for examinations II Translation: (4 points) Translate “Common people ……….traditional festivals” into Vietnamese Translate: “Nội dung môn võ chia thành ba môn nhỏ” into English III Making sentences: (2 points) X APPENDIX C THE SAMPLE TEST I Introduce yourself to the examiners (3 points) II Describe this picture (10 points) III Be ready to have a small talk with the examiners (7 points) XI Appendix D ANSWER KEYS FOR THE SAMPLE TEST I Introduce yourself Hello, may I introduce something about myself I’m … I’m a student at football (voleyball, handball ) subject I’m glad to see you, my English is not good but I’m interested to talk about… II This is Le huynh Duc He comes from Hochiminh city He has been a footballer, but now he is a coach He loves football very much and started playing it very early He has won a lot of medals but he always learns to practise it He is married and has a happy family His fans are everywhere but he also a friendly man III Now , can you answer some questions: - Where does he come from? - Is he married? - How old is he now? - What you learn from him? - Where does he live? Does he live in Hanoi or in Hochiminh? XII Appendix e Extra SPEAKING MATERIALS XIII ... English Oral Achievement Test for Second Year students at Bac Ninh Physical Education and Sports University (Bac Ninh UPES) in an attemp to solve the testing problems here and share her testing... participants, the material and current testing situation used for second year students at Bac Ninh UPES and some data collection instruments 2.1 Setting: English teaching and learning at Bac Ninh. .. test for second year students of education department at Bac Ninh UPES 3.3.1 Objectives physical 28 This test is designed for third semester students of physical education department at Bac Ninh