VIETNAM NATIONAL UNIVERSITY, HANOI UNIVERSITY OF LANGUAGES AND INTERNATIONAL STUDIES FACULTY OF POSTGRADUATE STUDIES ********************* LÊ THỊ NỤ NON-ENGLISH MAJOR STUDENTS’ PERCEPTIONS AND ATTITUDES TOWARDS THE USE OF THE TOEIC LISTENING AND READING TEST AS A GRADUATION REQUIREMENT (Nhận thức thái độ sinh viên không chuyên tiếng Anh việc sử dụng kiểm tra TOEIC hai kỹ nghe đọc hiểu làm điều kiện tốt nghiệp) M.A MINOR THESIS (Type I) Field: English Teaching Methodology Code: 8140231.01 Hanoi – 2019 VIETNAM NATIONAL UNIVERSITY, HANOI UNIVERSITY OF LANGUAGES AND INTERNATIONAL STUDIES FACULTY OF POSTGRADUATE STUDIES ********************* LÊ THỊ NỤ NON-ENGLISH MAJOR STUDENTS’ PERCEPTIONS AND ATTITUDES TOWARDS THE USE OF THE TOEIC LISTENING AND READING TEST AS A GRADUATION REQUIREMENT (Nhận thức thái độ sinh viên không chuyên tiếng Anh việc sử dụng kiểm tra TOEIC hai kỹ nghe đọc hiểu làm điều kiện tốt nghiệp) M.A MINOR THESIS (Type I) Field : English Teaching Methodology Code : 8140231.01 Supervisor : Prof Dr Nguyễn Hòa Hanoi – 2019 DECLARATION I hereby certify the thesis entitled “non-English major students’ perceptions and attitudes towards the use of the TOEIC Listening and Reading Test as a graduation requirement” is the result of my own research in fulfillment of the requirements for the degree of Master of Arts at Faculty of Postgraduate Studies, University of Languages and International Studies, Vietnam National University, Hanoi This thesis has not, wholly or partially, been submitted for an award at any other universities or higher education institutions Hanoi, 20 July 2019 Le Thi Nu i ACKNOWLEDGEMENTS First and foremost, I would like to express my most sincere gratitude to my supervisor, Prof Dr Nguyen Hoa, for his inspiring me to this research If it had not been for his invaluable guidance or insightful comments, my thesis would not have been accomplished My special thanks also go to all the professors and lecturers of Faculty of Postgraduate Studies at University of Languages and International Studies, Vietnam National University, Hanoi for their valuable lectures, which have laid the foundation for this thesis I am deeply appreciative to the participants of this study for their immense contribution by sharing their experiences and opinions I also thank the director and employees of the center where the research took place Finally, I am indebted to my friends, my colleagues and my family who have encouraged me in numerous ways to complete this study ii ABSTRACT This mixed methods study investigated non-English major students’ perceptions of and attitudes towards the use of the TOEIC Listening and Reading Test as a graduation requirement in some Vietnam‟s HE institutions Data were collected from 197 participants through survey questionnaires and eight semistructured interviews at a TOEIC preparation center in Hanoi The findings revealed that students generally hold positive attitudes towards the use of the TOEIC scores to determine their graduation eligibility and believe that preparing to take the test has a positive impact on their English language proficiency and future employment prospects The TOEIC test scores are also perceived favorably by the respondents as having relatively high levels of reliability and validity; however, the cut-off scores set by some universities might be too low to motivate their students to study English harder The results further indicated that test-takers with better listening and reading skills as measured by the TOEIC tests have a significantly stronger preference for the requirement of an adequate level of speaking and writing proficiency before graduation, provided that tertiary-level English curricula could help students master the four English language skills The study not only contributes to our understanding of students as the key stakeholders who define the context of the test use but also provides empirical evidence to support the use of the TOEIC test as a high-stakes standardized test for university exit requirement in Vietnam Keywords: Perceptions, attitudes, high-stakes tests, English language proficiency, TOEIC, test impact, higher education in Vietnam, graduation requirement iii TABLE OF CONTENTS DECLARATION ACKNOWLEDGEMENTS ABSTRACT TABLE OF CONTENTS LIST OF ABBREVIATIONS LIST OF TABLES CHAPTER I: INTRODUCTION Background of the study 1.1 Social context 1.2 Educational context Rationale of the study Aim of the study and research questions Methodology and scope of the study Significance of the study Structure of the thesis CHAPTER II: LITERATURE REVIEW High-stakes tests Reliability and Validity of standardized tests 2.1 Reliability 2.2 Validity Different reactions to high-stakes standardized testing 3.1 Positive reactions 3.2 Negative reactions Setting standards of high-stakes testing Preparing students for high-stakes standardized testing Perceptions and Attitudes towards high-stakes standardized testing 6.1 Definitions of Perception and Attitude iv 6.2 Importance of test-takers‟ perceptions and attitudes towar standardized testing TOEIC as a high-stakes standardized test in Vietnam 7.1 What is TOEIC? 7.2 Use of the TOEIC test as a graduation requirement in V institutions Previous studies on the use of TOEIC as an exit requirement in Vietnam Summary CHAPTER III: METHODOLOGY Research design Research site Participants 3.1 Survey participants 3.2 Interview participants Data collection methods 4.1 Questionnaires 4.2 Interviews Data analysis procedures 5.1 Quantitative data analysis 5.2 Qualitative data analysis CHAPTER IV: RESULTS AND DISCUSSION Research Question 1: What are students‟ perceptions of the English requirement policy for graduation? 31 1.1 Results from surveys 31 1.2 Results from interviews 33 Research Question 2: What are test-takers‟ perceptions of the appropriateness and effectiveness of the TOEIC as an exit test? 35 2.1 Results from surveys 35 2.2 Results from interviews 39 v CHAPTER V: CONCLUSION 44 Recapitulation 44 Implications of the study 45 Limitations of the study 46 REFERENCES 47 APPENDICES I APPENDIX 1: SURVEY QUESTIONNAIRE I APPENDIX 2: INTERVIEW QUESTIONS VII APPENDIX 3: SAMPLE TEST FOR TOEIC L/R IX vi LIST OF ABBREVIATIONS EFL English as a Foreign Language ELP English Language Proficiency ETS Educational Testing Service, USA HE Higher Education MOET Ministry of Education and Training, Vietnam TOEIC Test of English for International Communication vii LIST OF TABLES Table 1: Demographic information of participants 23 Table 2: Structure of survey questionnaire 25 Table 3: Students‟ opinions about the exit English requirement policy 32 Table 4: Students‟ opinions about the exit English requirement policy by their ELP 32 Table 5: Interviewees‟ perceptions of the exit English requirement policy 33 Table 6: Survey respondents‟ perceptions of the TOEIC as an exit test 36 Table 7: Survey respondents‟ perceptions of the use of the TOEIC as an exit test by their ELP 38 Table 8: Interviewees‟ perceptions of the TOEIC as an exit requirement .40 viii Part 2: Survey Contents Please state whether you agree or disagree with the following statements by  putting a tick ( ) in the appropriate column (1) Totally disagree, (2) Disagree, (3) Neutral, (4) Agree, (5) Totally agree No A Perceptions of the English requirement policy for graduati It is necessary students to pass a certain score in an ELP test befo graduation Passing students have I study English harder when my university adopts the exit English requirement policy I would university even if there were no English graduatio requirements I would still be motivated to prepare to take standardized even if there were no English graduation requirements B Appropriateness and Effectiveness of the use of TOEIC as English test Preparing for the TOEIC helps ELP English sufficient for me to take English exit test My university often organizes TOEIC preparation classes for students before exit English exams Required TOEIC cut-off score is achievable without 10 difficulty TOEIC scores accurately reflect my ELP If I have a high-score TOEIC certificate, I will feel 11 12 more confident to apply for a job after graduation TOEIC speaking and writing tests should be required for graduation If there were no English exit requirements, I would 13 still be motivated to prepare for and take the TOEIC tests III BẢNG CÂU HỎI KHẢO SÁT Về việc áp dụng chuẩn đầu TOEIC trường Đại học Xin chào bạn! Tên Lê Thị Nụ, học viên cao học trường Đại học Ngoại ngữ - Đại học quốc gia Hà Nội Hiện tiến hành khảo sát ý kiến bạn sinh viên không chuyên tiếng Anh việc áp dụng chuẩn đầu TOEIC trường Đại học Các bạn vui lịng bớt chút thời gian giúp tơi trả lời trung thực câu hỏi Tôi xin cam đoan bảo mật tồn thơng tin khảo sát sử dụng vào mục đích nghiên cứu Trân trọng cảm ơn! Phần 1: Thông tin chung đối tượng khảo sát  Vui lịng điền thơng tin vào trống đánh dấu ( ) vào lựa chọn phù hợp Họ tên Giới tính Sinh viên năm thứ mấy? Trường Chuyên ngành Hình thức thi TOEIC chuẩn đầu Điểm TOEIC đầu theo yêu cầu trường Số lần thi TOEIC chức Điểm TOEIC cao IV đạt Phần 2: Nội dung khảo sát Vui lòng cho biết mức độ đồng ý bạn phát biểu cách đánh  dấu ( ) vào ô số phù hợp: (1) Rất phản đối, (2) Phản đối, (3) Khơng có ý kiến, (4) Đồng ý, (5) Rất đồng ý STT Ý kiến A Sự cần thiết phải áp chuẩn đầu tiếng Anh cho sinh viên Các trường Đại học cần yêu cầu sinh viên đ chuẩn định kỳ thi đánh giá n tiếng Anh trước tốt nghiệp Đạt chuẩn tiếng Anh đầu Đại học đảm cho sinh viên có lực tiếng Anh tối thiể làm Việc áp dụng chuẩn đầu tiếng Anh đại học s đẩy sinh viên học tiếng Anh chăm Tơi tích cực học tiếng Anh Đại học ng trường không yêu cầu chuẩn đầu Anh Tôi tham gia kỳ thi đánh giá năn tiếng Anh tiêu chuẩn quốc tế cho dù trường không yêu cầu chuẩn đầu tiếng An B Sự phù hợp Hiệu việc áp dụng chuẩn đầu TOEIC Quá trình luyện thi TOEIC giúp cải thiện tiếng Anh thân Chương trình học tiếng Anh khóa Đ đủ để thi lấy chứng TOEIC đầu Trường Đại học thường tổ chức V luyện thi TOEIC cho sinh viên trước thi đầu Tơi thấy khơng khó để thi đạt điểm chuẩn TOEIC 10 đầu nhà trường yêu cầu Điểm TOEIC đạt đánh giá khả tiếng Anh Nếu sở hữu chứng TOEIC điểm cao 11 cảm thấy tự tin xin việc sau tốt nghiệp Nên bổ sung thêm kỹ nói viết TOEIC vào 12 yêu cầu đầu tiếng Anh cho sinh viên thay kiểm tra kỹ nghe đọc hiểu 13 Tôi thi lấy chứng TOEIC trường Đại học không yêu cầu chuẩn đầu TOEIC VI APPENDIX 2: INTERVIEW QUESTIONS What types of English certificates are accepted as a graduation requirement for your major at your university? Why is the exit English requirement policy necessary/ unnecessary? To what extent does the policy have effect on your ELP? How are you motivated to learn English by the policy? What you know about the TOEIC test before attending TOEIC preparation courses at this center? In case you have several options of standardized English language proficiency tests for graduation, why you choose the TOEIC test? Why you think the cut-off score is appropriate/ inappropriate? Could you give me some comments on the TOEIC test design? In addition to the graduation condition, are there any other purposes for your taking the TOEIC test? 10 Why you think your TOEIC score exactly/inexactly reflects your ELP? VII BẢNG CÂU HỎI PHỎNG VẤN Những chứng tiếng Anh trường đại học bạn chấp nhận đạt chuẩn tiếng Anh đầu ra? Tại việc áp dụng chuẩn tiếng Anh đầu đại học lại cần thiết/ không cần thiết? Việc áp chuẩn đầu tiếng Anh ảnh hưởng đến khả tiếng Anh bạn? Việc phải đạt đầu tiếng Anh ảnh hưởng đến động lực học tiếng Anh bạn? Bạn biết TOEIC trước tham gia luyện thi trung tâm? Trong trường hợp bạn quyền lựa chọn thi chứng tiếng Anh quốc tế khác làm điều kiện tốt nghiệp, bạn lại chọn thi TOEIC? Tại bạn nghĩ mức điểm chuẩn TOEIC nhà trường yêu cầu phù hợp/ chưa phù hợp? Bạn đánh giá chung kiểm tra TOEIC nào? Ngồi mục đích để trường, bạn sử dụng chứng TOEIC đề làm khơng? 10 Tại bạn nghĩ điểm TOEIC đạt đánh giá (hoặc không đúng) khả tiếng Anh thân? VIII APPENDIX 3: SAMPLE TEST FOR TOEIC L/R Listening Test: Part 1-4 (100 questions) Part 1: Picture Description (10 pictures) Example: Four statements: Part 2: Question and Response (30 questions) IX Part 3: 10 short conversations (30 questions) Example Part 4: 10 short talks ( 30 questions) X Example Reading Test: Part 5-7 (100 questions) Part : 40 questions Example: XI Part 6: 12 questions Example: Part 7: 48 questions XII Example: XIII ... study ii ABSTRACT This mixed methods study investigated non- English major students’ perceptions of and attitudes towards the use of the TOEIC Listening and Reading Test as a graduation requirement. .. perceptions and attitudes towar standardized testing TOEIC as a high-stakes standardized test in Vietnam 7.1 What is TOEIC? 7.2 Use of the TOEIC test as a graduation requirement. .. students for high-stakes standardized testing, students’ perceptions of and attitudes towards high-stakes standardized tests, and the TOEIC as a high-stakes standardized test in Vietnam Also, some previous