VIETNAM NATIONAL UNIVERSITY, HANOI UNIVERSITY OF LANGUAGE AND INTERNATIONAL STUDIES FACULTY OF POST-GRADUATE STUDIES ******************* VŨ MAI DUYÊN THE DEVELOPMENT AND EVALUATION OF UTHENTIC SUPPLEMENTARY MATERIALS FOR FIRST-YEAR STUDENTS IN GENERAL ENGLISH COURSE AT THÁI BÌNH UNIVERSITY PHÁT TRIỂN VÀ ĐÁNH GIÁ TÀI LIỆU CHÂN THỰC BỔ TRỢ CHO SINH VIÊN NĂM THỨ NHẤT TRONG KHÓA HỌC TIẾNG ANH CƠ BẢN TẠI TRƯỜNG ĐẠI HỌC THÁI BÌNH M.A MINOR PROGRAMME THESIS Field: English Teaching Methodology Code: 60140111 Hanoi, 2015 VIETNAM NATIONAL UNIVERSITY, HANOI UNIVERSITY OF LANGUAGE AND INTERNATIONAL STUDIES FACULTY OF POST-GRADUATE STUDIES ******************* VŨ MAI DUYÊN THE DEVELOPMENT AND EVALUATION OF UTHENTIC SUPPLEMENTARY MATERIALS FOR FIRST-YEAR STUDENTS IN GENERAL ENGLISH COURSE AT THÁI BÌNH UNIVERSITY PHÁT TRIỂN VÀ ĐÁNH GIÁ TÀI LIỆU CHÂN THỰC BỔ TRỢ CHO SINH VIÊN NĂM THỨ NHẤT TRONG KHÓA HỌC TIẾNG ANH CƠ BẢN TẠI TRƯỜNG ĐẠI HỌC THÁI BÌNH M.A MINOR PROGRAMME THESIS Field: English Teaching Methodology Code: 60140111 Supervisor: Dương Thu Mai, PhD Hanoi, 2015 DECLARATION I certify that I am the sole author of this thesis All the material in this study which is not my own work has been identified and acknowledged This thesis has not been submitted for assessment in any other university or institution wholly or partially I also accept all the requirements of ULIS relating to the retention and use of M.A graduation thesis deposited in the library Vũ Mai Duyên i ACKNOWLEDGEMENTS I owe my deepest gratitude to my supportive supervisor, Duong Thu Mai, Ph.D, for her whole-hearted assistance, encouragement as well as the profound guidance she gave me while I was doing my research I would like to take this opportunity to express my thanks to all my teachers and lecturers in Faculty of Post-graduate Studies, University of Languages and International Studies, Vietnam National University, Hanoi for their valuable instruction and assistance throughout the realization of this thesis I am heartily thankful to the administrators, my colleagues, and first-year students at Thái Bình University for their willingness to participate in the research Without their help, this project could not be fulfilled Last but not least, I am indebted to my beloved family and friends who have unfailingly inspired me to complete this study Hanoi, September 2014 ii ABSTRACT This study attempts to develop and evaluate a set of authentic supplementary materials for students in a General English course at Thái Bình University.Approaches, principled frameworksand selection criteria are identified to serve as basic guideline for the process of developing materials The material evaluation proceeds using survey questionnaire and interview Quantitatively and qualitatively analytical results revealed that the developed materials appeared to bring about positive enhancement in students’ learning English.Bothstudents and teachers demonstrated highly supportive judgments toward the materials’ effectiveness in nearly all aspects but not much in writing skill Man-Whitney U test result indicatedsignificant relations between students’ evaluations and their English proficiency Based on the findings, the thesis provides pedagogic implications and suggestions for further research which would be of considerable interest to English language teachers, learners as well as material developers and evaluators iii LISTOF ABBREVIATIONS ASM set of Authentic Supplementary Materials C/F Credit / Fair (students) CLT Communicative Language Teaching ELT English Language Teaching ESP English for Specific Purposes G/vG Good, very Good (students) HOTS High-Order Thinking Skill LLT Language Teaching and Learning MoET (Vietnamese) Ministry of Education and Training SD Standard of Deviation SPSS Statistical Package for the Social Sciences TBU Thái Bình University ULIS University of Language and International Studies VNU Vietnam National University, Hanoi iv TABLE OF CONTENTS DECLARATION i ACKNOWLEDGEMENTS ii ABSTRACT iii LISTOF ABBREVIATIONS iv LIST OF FIGURES viii LIST OF TABLES viii PART A: INTRODUCTION 1 Rationale Aims of study and research questions Scope of the study Method of the study Design of the study PART B: DEVELOPMENT CHAPER I: LITERATURE REVIEW 1.1 Material Development in English Language Teaching 1.1.1 Materials in English language teaching 1.1.2 Process of Material Development in English language teaching 1.1.3 Process of Authentic Supplementary Material Development in ELT 1.2 Material Evaluation in English Language Teaching 12 1.2.1 Approaches to Material Evaluation 13 1.2.2 Principles for Material Evaluation 14 1.2.3 Material Evaluators 15 1.2.4 Criteria for Material Evaluation 16 1.2.5 Factors relating to Material Evaluations 19 1.2.6 Authentic Material Evaluation Framework in English language teaching 19 v 1.3 Review of related studies 21 1.4 Chapter summary 22 CHAPER II: METHODOLOGY 23 2.1 Context of the study 23 2.1.1 Thái Bình University context 23 2.1.2 General English Course 23 2.2 The study 24 2.2.1 The Development of the Authentic Supplementary Materials 24 2.2.2 The Evaluations of the ASM 29 2.3 Chapter summary 34 CHAPTER III: FINDINGS AND DISCUSSIONS 36 3.1 Strengths and weaknesses of the ASM (Research question 1) 36 3.1.1 Theoretical worth of materials 36 3.2.2 Practical Utilizing of the ASM 40 3.3 The impacts of the ASM (Research question 2) 42 3.3.1 Impactson linguistic and extra-linguistic skills 42 3.3.2 Impactson communicative competence 44 3.3 Differences between the evaluationsof thetwo groups(Research question 3) 46 3.3 Future use of the ASM 47 3.4 Chapter summary 47 PART C: CONCLUSIONS 48 Summary of the findings and discussion 48 1.1 The development of the ASM 48 1.2 The evaluation of the ASM 48 Conclusions 49 Recommendations 50 Limitations 50 vi Suggestions for further research 51 REFERENCES and BIBLIOGRAPHY 52 APPENDIX 1: SURVEY QUESTIONNAIRE FOR FIRST-YEAR STUDENTS I APPENDIX 2: RELIABILITY STATISTICS VII APPENDIX 3: Mean scores of evaluations on the ASM VIII APPENDIX 4: Results of Mann Whitney test on two groups’ evaluations IX APPENDIX 5: LEARNING STYLES XI vii LIST OF FIGURES Figure 1-1: Typical Forward design lesson plan Figure 1-2: Stages in the Backward design process Figure 1-3: A teacher’s path through the production of new or adapted materials Figure 2.2-1: Steps of developing materials 24 Figure 3.1-1: General appropriateness of the ASM 36 Figure 3.1-2: The appropriateness of the ASM’s content 38 Figure 3.1-3: Difficult level of the ASM’s content 38 Figure 3.1-4: The appropriateness of the ASM’s topics/themes 39 Figure 3.1-5: Practical Utilizing of the ASM 40 Figure 3.1-6: Classroom interactions 41 Figure 3.3-1: Impacts of the ASM on macro linguistic skills 42 Figure 3.3-2: Impacts of the ASM on extra-linguistic skills 43 Figure 3.3-3: Impacts of the ASM on linguistic competence 44 Figure 3.3-4: Impacts of the ASM on other components of communicative competence 45 Figure 3.4-1: Significant differences in the evaluations between two student groups 46 LIST OF TABLES Table 2.2-1: Forms of authentic materials in the ASM 26 Table 3.1-1: Students’ learning styles 39 Table 3.1-2:Means on Practical Utilizing 40 Table 3.3-1:Means on linguistic skills 42 Table 3.4-1: Future use of the ASM 47 viii Kumaravadivelu, B (1994) The postmethod condition: (E)merging strategies forsecond/foreign language teaching TESOL Quarterly, 28, 27–47 Lê Thị Hương Giang, (2010), Designing Reading Tasks Using Authentic Materials as Supplementary Reading Materials for The Teaching of Reading Skills on ESP Program to the Second Year Nurse Students at Namdinh University of Nursing, M.A Thesis, ULIS, VNU, Hanoi Lê Thị Thùy (2009), Developing supplementary reading and writing materials for nonEnglish Majored University Students: A need-based approach, M.A Thesis, ULIS, VNU, Hanoi Lê Văn Canh and Roger Barnard (2009), Curricular innovation behind closed classroom doors:A Vietnamese case study Research Publications in Prospect: An Australian Journal of TESOL2009 Volume 24 No 20-33 Little, D., S Devitt, and D Singleton.(1988), Authentic Texts in Foreign Language Teaching:Theory and Practice Dublin: Authentik Maley, A and Duff, A (1998), “Squaring the circle – reconciling materials as constraint with materials as empowerment”, in B Tomlinson (ed.)(1998), Materials Development in Language Teaching, CUP, pp 279-94 Martinez, G A (2002), Authentic Materials: An Overview Retrieved July 2014 from http://www3.telus.net/linguisticsissues/authenticmaterials.html McDonough, J and Shaw, C (1993), Materials and Methods in ELT A teacher’s Guide Oxford: Blackwell Publishers McGrath, I, (2002), Materials evaluation and design for language teaching Edinburgh University Press MoET, (2014), Thông tư Ban hành khung lực ngoại ngữ bậc dùng cho Việt Nam Moore, CJ and West, J, (1985) Enterprise Series Heinemann Publishers (Oxford) Ltd Morrow, K (1977).Authentic texts and ESP In S Holden (Ed.), English for Specific Purposes (pp 13-17) London: Modern English Publications Nguyễn, Thị Hằng Vinh, (2011), Developing supplementary materials to teach speaking skills for first year English Majors at Phuong Dong University, MA Thesis, ULIS, VNU, Hanoi Nunnally, J C.and Bernstein, I.H (1978), Psychometric Theory (2nd edn) New York: McGraw-Hill 54 Nunan, D, (1988), Syllabus Design, Oxford: OUP Nunan, D (1991) Language Teaching Methodology New York: Prentice Hall Pascual, A (2013), Strategies in Curriculum Evaluation Retrieved August 2014from http://prezi.com/uakzqkodmpkk/strategies-in-curriculum-evaluation-review/ Pennington.MC,and Richards.JC (1997), Re-orienting the teaching universe: the experience of five first-year English teachers in Hong Kong Language Teaching Research 1(2): 1490–178 Phạm Thị Thu Thủy, (2010), Using Videos as Supplementary Material in Teaching Listening Skill to Second-Year English Majors at Hanoi National University of Education, MA Thesis, ULIS, VNU, Hanoi Phạm Thị Thùy, (2007), Development of Supplementary Materials to Improve Reading Skills for the First Year English Majors at Military Science Academy M.A Thesis, ULIS, VNU, Hanoi Prabhu, N S (1990) There is no best method—Why? TESOL Quarterly, 24, 161–172 Prowse, P (1998), “How writers write: testimony from authors” in B Tomlinson (ed.) Materials Development in Language Teaching CUP pp 130-45 Rea-Dickins, P and Germaine, K.(1992), Evaluation, OUP Reynaldo A Santos, (1999), Cronbach's Alpha: A Tool for Assessing the Reliability of Scales Journal of Extension April 1999 // Volume 37 // Number // Tools of the Trade // 2TOT3 Retrieved August 2014 from http://www.joe.org/joe/1999april/tt3.php Richards, J.C (1995), Easier said than done: an insider’s account of a textbook project In A Hidalgo, D Hall and G Jacobs (eds) Getting Started: Materials Writers on Materials Writing Singapore: RELC 95-135 Richards, J.C (2001), Curriculum Development in Language Teaching Cambridge: Cambridge University Press Richards, J C (2013), Curriculum Approaches in Language Teaching: Forward, Central, and Backward Design RELC Journal 44(1) 5–33 DOI: 10.1177/0033688212473293 Roberts,R (2014).More than just a worksheet: how to write effective classroom materials Retrieved fromhttp://eltresourceful.files.wordpress.com/2014/04/more-than-just-aworksheet-handout-rachael-roberts.pdf 55 Robinson, P.C (1991), ESP today: A Practitioner’s Guide London: Prentice Hall Roseanne Rocha Tavares (2014),The Connection Between Reading and Writing: Theoretical Foundations And Some Techniques Laboratorio Clinico de Leitura – UFSC Retrieved 2014 from https://periodicos.ufsc.br/index.php/fragmentos/article/download/2131/4089 Samira Alijani, Mojtaba Maghsoudi and Davood Madani (2014), The Effect of Authentic vs Non-authentic Materials onIranian EFL Learners’ Listening Comprehension Ability International Journal of Applied Linguistics & English Literature.ISSN 2200-3592 (Print), ISSN 2200-3452 (Online).Vol No 3; May 2014 Sheldon, L (1988), Evaluating ELT Textbooks and Materials.ELT Journal, 42(4), 237246 Sweet, H (1899), The Practical Study of Languages.A Guide for Teachers and Learners.London, Oxford University Press Digital version http://www.unz.org/Pub/SweetHenry-1899?View=ReadIt retrieved August 2014 Tomlinson, B (1998), Materials Development in Language Teaching CUP Tomlinson, B, (2003), Developing Materials for Language Teaching Cromwell Press Tomlinson, B, (2005), The Future for ELT Materials in Asia Electronic Journal of Foreign Language Teaching2005, Vol 2, No 2, pp 5-13© Centre for Language Studies.National University of Singapore Tomlinson, B, (2008), English language learning materials: a critical review London: Continuum Tomlinson, B (2012), Materials development for language learning and teaching Cambridge Journals.Lang Teach (2012), 45.2, 143–179 Cambridge University Press 2012 doi:10.1017/S0261444811000528 Vygotsky,L, S (1978),Mind in society: The development of higher psychological processes Cambridge, MA: Harvard University Press Weir, C., and Roberts, J (1994) Evaluation in ELT Oxford: Blackwell Wiggins G, McTighe J (2006) Understanding by Design: A Framework for Effecting Curricular Development and Assessment Alexandria, VA Association for Supervision and Curriculum Development Willing, K (1988).Learning Styles in Adult Migrant Education Australia: NCRC Research Series 56 Wilson, N and McLean, S (1994) Questionnaire Design: A Practical Introduction Newton Abbey, Co Antrim: University of Ulster Press Woodward, T (2001), Planning Lessons and Courses Designing sequences of work for the language classroom CUP Zahra Zohoorian Vahid Baghban andAmbigapathy, Pandian (2001), A Review on the Effectiveness of Using Authentic Materials in ESP Courses, English for Specific Purposes World, Issue 31 Volume 10, 2011, 1-14 https://www.youtube.com/watch?v=9a9Lp-1n_ZU Retrieved August, 2014 (for SPSS) 57 APPENDICES APPENDIX 1: SURVEY QUESTIONNAIRE FOR FIRST-YEAR STUDENTS This survey questionnaire is designed for a research of developing and evaluating AUTHENTIC SUPPLEMENTARY MATERIALS for First-Year Students in General English Course at ThaiBinh University Your assistance in completing the survey is highly appreciated All the information provided is solely for the study purpose Participants can be confident that all the information achieved from this questionnaire would be dealt with anonymously Thank you very much for your corporation! Part 1: Choose numbers from to in the Scale Column to show your degree of AGREEMENT about the statements in the table below about the Authentic Supplementary Materials (ASM) used in General English Course, in which indicates the highest degree of agreement and indicates the lowest degree No Statements Scale A General appropriateness The ASM compare favourably with the objectives of the subject 12345 The ASM compare favourably with the course-book 12345 Learning activities are appropriate with your learning style 12345 The difficulty level of the content in ASM is appropriate to students 12345 Please specify: Far higher Higher Lower Far lower B Themes/Topics and Contents Themes and topics in the ASM are relevant to the students’ real life 12345 Themes and topics in ASM are update 12345 Contents in the ASM are real 12345 C Practical Utilizing 12345 The appearance (visuals, layout, typography etc.) of color-printed ASM is attractive Instructions in the ASM are clear 12345 10 Technical/technological equipment (Power Point Show – visual aids, CD,cassette….) is effectively utilized 11 Price fortechnical/ technological aids for students’ learning as well asdoing homeassignmentsis suitable to the students’ situational context I 12 Learning activities allow communicative interactions between teacher and students (Students receive feedback about linguistic competence and proficiency level.) 13 Learning activities allow communicative interactions between/among students D Learning activities 14 Learning activities integrate language skills 12345 15 Learning activities help students acquire and use listening skill 12345 16 Learning activities help students acquire and use speaking skill 12345 17 Learning activities help students acquire and use reading skill 12345 18 Learning activities help students acquire and use writing skill 12345 19 Learning activities help students acquire and use presentation skill 12345 20 Learning activities help students acquire and use team-work skill 12345 21 Learning activities promote students’ independence (students are responsible for the English learning) 22 Learning activitiesencourage students’ active involvement in the learning 12345 process 23 Learning activities stimulatethinking skills (remember, understand, apply, analyze, evaluate, create; critical thinking ; problem solving) E Benefits of Authentic Materials compared with inauthentic materials 24 Grammaris lively presented within real context 12345 25 ASM broaden students’vocabulary of popular topics 12345 26 ASM provide a differentaccents(native, non-native English, ) 12345 27 ASM provide a wide range of text types 12345 28 ASM expand students’ social-cultural knowledge 12345 29 ASM present natural genuine language use by real persons in real situations 12345 30 ASM expose students to meaningful real life experiences 12345 31 Realistic experiences help students memorize the content more easily 12345 32 ASM equips students with practice better learning as well as daily life strategies Part 2: Your general opinion about the ASM (Please tick the box of your choice) Good (use immediately) Fair (need improving) II Not good (abandon) Please express other opinions about the strengths and weaknesses of the ASM Strengths Weaknesses Part 3: Please provide some other information about your English Proficiency Result of the previous General English course Credit, Fair – C, D (< 7); Good – B (7,0-8,49); Very good, excellent (>= 8,50) Thank you very much for your corporation! III APPENDIX : Survey Questionnaire (Vietnamese version) CÂU HỎI ĐIỀU TRA VỀ TÀI LIỆU CHÂN THỰC BỔ TRỢ DÙNG TRONG KHÓA HỌC TIẾNG ANH CƠ BẢN Phiếu điều tra thiết kế nhằm thu thập thông tin đánh giá sinh viên tài liệu chân thực bổ trợ dùng khóa học tiếng Anh Việc trả lời bạn giúp nhiều việc đánh giá, chỉnh lý tài liệu Mọi thông tin cá nhân bạn không bị tiết lộ phần phân tích số liệu Xin chân thành cám ơn bạn tham gia trả lời câu hỏi Phần 1: Hãy chọn thang từ đến cột Mức độ để thể ý kiến bạn tiêu chí đưa bảng sau tài liệu chân thực bổ trợ sử dụng khóa học, ứng với mức độ đồng ý cao mức độ thấp TT Tiêu chí Mức độ A Độ phù hợp nói chung tài liệu Tài liệu phù hợp với mục tiêu môn học 12345 Tài liệu phù hợp với giáo trình 12345 Tài liệu phù hợp với nhiều phong cách học tập 12345 Kiến thức ngôn ngữ kỹ ngôn ngữ tài liệu cung cấp phù hợpvề độ khóso với trình độ sinh viên Nếu bạn cho kiến thức ngôn ngữ kỹ ngôn ngữ tài liệukhơng phù hợp vềđộ khó so với trình độ SV, xin trả lời tiếp tiêu chí 4A Quá cao so với trình độ SV Cao Thấp Quá thấp B Chủ đề Nội dung tài liệu Chủ đề nội dung gắn liền với thực tế sống SV 12345 Chủ đề nội dung tài liệu mang tính cập nhật 12345 Nội dung tài liệumang tính xác thực 12345 C Thực tiễn sử dụng tài liệu CHÂN THỰC 12345 Hình thứcthiết kế tài liệu in màu thu hút người sử dụng 12345 Hướng dẫn tài liệu cho hoạt động học tập rõ ràng 12345 10 Trangthiết bị kĩ thuật(Power Point Show, CD,cassette….) có tính hỗ trợ cao 12345 11 Chi phí cho trang thiết bị (kĩ thuật, cơng nghệ…) cần thiết phục vụ việc học làm tập sinh viên phù hợp với điều kiện thực tế IV 12 HĐHT tạo điều kiện cho giảng viên sinh viên giao tiếp hiệu (SV có hội nhận phản hồi từ giảng viên trình độ lực ngôn ngữ) 13 HĐHT tạo điều kiện cho sinh viên giao tiếp hiệu với 12345 D Hoạt động học tập (HĐHT) thiết kế dựa tài liệu CHÂN THỰC 14 HĐHT kết hợp kỹ ngôn ngữ 12345 15 HĐHT tạo hội cho sinh viên nắm bắt sử dụng kỹ nghe 12345 16 HĐHT tạo hội cho sinh viên nắm bắt sử dụng kỹ nói 12345 17 HĐHT tạo hội cho sinh viên nắm bắt sử dụng kỹ đọc 12345 18 HĐHT tạo hội cho sinh viên nắm bắt sử dụng kỹ viết 12345 19 HĐHT tạo hội cho sinh viên nắm bắt sử dụng kỹ thuyết trình 12345 20 HĐHT tạo hội cho sinh viên nắm bắt sử dụng kỹ làm việc nhóm 12345 21 HĐHT phát huy tính độc lập SV, SV chịu trách nhiệm với việc học 12345 22 HĐHT khuyến khích tham gia tích cực sinh viên 12345 23 HĐHT kích thích tư bậc cao (ghi nhớ, hiểu biết, ứng dụng, phân tích, đánh giá, sáng tạo; tư phê phán khả giải vấn đề) SV E Lợi ích tài liệu CHÂN THỰC 24 Kiến thức ngữ pháp đượcthể tài liệu cách sinh động 12345 25 Tài liệu mở rộng lượng từ vựng chủ đề quen thuộc cho SV 12345 26 Tài liệu cho phép sinh viên tiếp cận với nhiều loại ngôn ngữ Anh (tiếng Anh chuẩn người xứ, xứ, tiếng địa phương, ) 27 Tài liệu cho phép sinh viên tiếp cận với nhiều loại văn khác 12345 28 Tài liệu cung cấp cho SV kiến thức văn hóa- xã hội đa dạng, lạ 12345 29 Tài liệu cho phép sinh viên tiếp xúc với ngôn ngữ sử dụng người thật tình có thật 30 Tài liệu điều kiện cho SV trải nghiệm thực tế 12345 31 Trải nghiệm chân thực giúp SVghi nhớ kiến thức ngôn ngữ dễ dàng 12345 32 Tài liệu trang bị cho sinh viên chiến lược để sử dụng tiếng Anh cách hiệu học tập sống hàng ngày Phần 2: Xin đánh dấu vào ô tương ứng với ý kiến bạn hướng sử dụng tài liệu CHÂN THỰC BỔ TRỢ Tốt, tiếp tục sử dụng Đạt (cần chỉnh sửa) V Không đạt Ý kiến khác bạn Điểm mạnh Điểm yếu tài liệu chân thực bổ trợ Điểm mạnh Điểm yếu Phần 3: Xin cho biết số thông tin bạn! Kết học tập mơn tiếng Anh bạn trước tham gia khóa học TB, TB – C, D (5 -6,9); Khá – B (7,0-8,4) Giỏi – A (8,5-10) Một lần xin chân thành cám ơn bạn tham gia trả lời câu hỏi! VI APPENDIX 2: RELIABILITY STATISTICS Cronbach's Alpha N Items 804 Comparable with course’s objectives Corrected Cronbach's item-total Alpha Correlation if item deleted 591 768 Comparable with course-book 545 777 Suitable with students’ learning styles 500 785 361 815 584 610 770 765 content_real (authentic) 621 766 attractive_print 505 667 instruction_clear 422 692 tech_helpful 410 696 price_reasonable 441 687 teacher_sts interaction 518 664 sts_sts interaction 431 691 Grammar 341 780 Vocabulary 415 738 Accents 683 582 Text-types 715 562 integrate_skill 494 799 The ASM’s impacts on listening 553 782 linguistic skills speaking 735 723 reading 608 766 writing presentation 581 602 774 754 The ASM’s impacts on teamwork 610 750 extra-linguisticskills sts independence 531 776 active_involvement 583 759 High-order thinking skill 577 761 Strategies 408 824 The ASM’s impacts on Memorize easily 624 754 communicative Meaningful experiences 723 727 competence Real people/situations 723 727 Social cultural knowledge 513 790 Difficult level_appropriate The ASM’s general appropriateness theme_ relevant content_update 721 The ASM’s practical utilizing 738 The ASM’s impacts on linguistic knowledge 807 798 803 5 VII APPENDIX 3: Mean scores of evaluations on the ASM Items Mean SD Min Max 19 Content from real life (authentic) Presenting skill Instructions_clear 4.16 4.10 4.00 821 943 932 2 5 28 29 Social cultural knowledge Real persons/situations Experiences_meaningful Teamwork 3.99 3.97 3.95 3.95 964 818 817 994 2 5 5 Themes/Topics_relevant Tech_helpful 3.93 3.93 962 982 1 5 Vocabulary Content_update Text-types_various Accents_ various Reading skill Comparable with objectives Integrate_skills Listening skill Teacher_student interact Attractive_print Speaking skill Price_reasonable 3.90 3.90 3.90 3.90 3.89 3.89 843 911 942 964 915 926 1 1 1 5 5 5 3.88 3.88 3.88 3.88 3.86 3.83 900 924 952 993 980 948 1 5 5 5 30 20 10 25 27 26 17 14 15 12 16 11 course 22 23 31 32 24 21 Comparable with course-book Sts_active involvement High-order thinking skill Memorize easily Strategies 3.81 3.78 3.77 3.70 3.68 935 1.082 989 922 958 1 1 5 5 Grammar Sts independence 3.64 3.61 934 1.043 1 5 Appropriate to sts’ learning styles Content_difficult 3.59 3.53 951 1.109 1 5 18 13 Writing skill 3.40 985 Sts_sts interactions 3.34 1.070 Grand mean 3,83 Note: Min: – lowest degree of agreement; – low degree; – normal, – high Max: – highest degree of agreement ; SD – Standard of Deviation VIII APPENDIX 4: Results of Mann Whitney test on two groups’ evaluations Statistic Values z p Items Mean rank 31-Good/very 70- Good Credit/Fair 60.73 46.69 60.18 46.15 59.73 47.14 57.10 46.91 56.77 47.68 56.53 48.55 56.34 48.64 56.02 47.38 56.00 46.63 55.70 47.52 55.52 49.00 Presentation Writing skill -2.365 018 -2.353 019 Grammar -2.113 035 -1.716 086 -1.518 129 -1.336 182 -1.275 202 -1.444 149 -1.593 111 -1.366 172 -1.097 273 Content_difficult -1.716 086 54.88 44.82 Theme_relevant Memorize easily Comp_w_coursebook -.928 -.892 353 372 54.85 49.29 54.71 49.36 -.868 -.766 385 444 54.63 49.39 54.19 49.59 -.879 379 54.11 48.88 -.973 -.668 330 504 53.97 48.19 52.71 48.76 -.396 692 52.65 50.27 2 7 Price_reasonable Sts independence High-order thinking skill Speaking skill Text-types_various Integrate_skills Accents_various Reading skill Tech_helpful Instruction_clear Attractive_print Social_cultural Strategies IX Comparable_w_objectives Teacher_sts interact Listening skill Teamwork Real_E/people/situation Appropriate to sts’learning styles -.355 -.274 723 784 52.47 50.35 52.15 50.49 -.217 828 51.39 50.10 -.070 944 51.29 50.87 -.055 956 51.23 50.90 -.012 991 51.05 50.98 Experiences_meaningful Content_update Sts_sts interactions Content_authentic Active_involvement 2 Vocabulary Note: critical z > 1.96 ; critical p < 0.05 -.059 953 50.76 51.11 -.307 -.407 759 684 49.73 51.56 49.29 51.76 -.838 -.632 402 527 47.56 52.52 46.40 50.11 -1.216 224 46.10 53.17 X APPENDIX 5: LEARNING STYLES The four categories of learning styles listed below were first described by Knowles (1982),however, the questionnaire and theory based on that categories were developed by Willing (1988) and Nunan (1991) (1) Concrete learners demonstrate interest in information that has immediate value They would like to see real-life applications for what they are learning They probably learn best through performing practical tasks with verbal, visual, physical experiences and entertained activities (2) Authority-oriented learners are responsible, dependable These “compulsive note-takers express their likes and needs for new contents presented in clear and ordered sequence They prefer what they are doing to be clearly explained They perhaps will not react well to the negotiation of syllabus (3) Communicative learners need personal feedback and interactions; they like to be able to see social usefulness of what they are learning They like to learn by watching, listening, hearing and talking to friends or native speakers outside class They may learn well from discussion and group activities (4) Analytical learners prefer a systematic presentation of new learning materials, they long for logical problem-solving activities These independent learners are more likely to enjoy studying grammar, and reading books, working well by themselves (finding their own mistakes, working out the problems and developing principles) XI