Book contents
- Validity Argument in Language Testing
- The Cambridge Applied Linguistics Series
- Validity Argument in Language Testing
- Copyright page
- Contents
- Figures
- Tables
- Contributors
- Series Editor’s Preface
- 1 Introduction to Validity Argument in Language Testing and Assessment
- Part I Basic Concepts and Uses of Validity Argument in Language Testing and Assessment
- Part II Investigating Score Interpretations
- Part III Investigating Score Uses and Consequences
- 10 Justifying the Interpretation and Use of an ESL Writing Final Examination
- 11 An Argument for Use of a Test of Productive Grammatical Ability for Placement into Writing Classes
- 12 Investigating the Consequences of an ESL Placement Test
- Part IV Conclusion
- Index
- References
12 - Investigating the Consequences of an ESL Placement Test
from Part III - Investigating Score Uses and Consequences
Published online by Cambridge University Press: 14 January 2021
By
Book contents
- Validity Argument in Language Testing
- The Cambridge Applied Linguistics Series
- Validity Argument in Language Testing
- Copyright page
- Contents
- Figures
- Tables
- Contributors
- Series Editor’s Preface
- 1 Introduction to Validity Argument in Language Testing and Assessment
- Part I Basic Concepts and Uses of Validity Argument in Language Testing and Assessment
- Part II Investigating Score Interpretations
- Part III Investigating Score Uses and Consequences
- 10 Justifying the Interpretation and Use of an ESL Writing Final Examination
- 11 An Argument for Use of a Test of Productive Grammatical Ability for Placement into Writing Classes
- 12 Investigating the Consequences of an ESL Placement Test
- Part IV Conclusion
- Index
- References
Summary
Following the argument-based approach to validity, this chapter focuses on the inference about the positive consequences of an academic ESL placement test (EPT) score use on major stakeholders: ESL instructors and ESL students at a university. The assumptions underlying this inference are that the decisions about ESL course placement are justifiable and comprehensible to test stakeholders, that the decisions are beneficial for ESL learners’ improvement of academic English proficiency, and that the decisions are beneficial for ESL learners’ academic achievement at the university. The assumptions were examined using mixed methods that included interviews, pre- and post-course analyses of students’ performances in ESL classes, and an analysis of the predictive power of the EPT results on students’ academic achievement. The results indicated the positive perceptions of the EPT placement decisions as reported by most of the ESL students and instructors, but variation in the degree of improvement was identified in the ESL courses. ESL students’ performance on the EPT predicted their first-year academic achievement at the university to some degree, highlighting the importance of English proficiency in ESL students’ academic success and the potential impact of the EPT placement decisions on students’ English language learning and overall academic performance.
Keywords
- Type
- Chapter
- Information
- Validity Argument in Language TestingCase Studies of Validation Research, pp. 294 - 316Publisher: Cambridge University PressPrint publication year: 2021
References
Blais, J.-G., & Laurier, M. D. (1995). The dimensionality of a placement test from several analytical perspectives. Language Testing, 12(1), 72–98. https://doi.org/10.1177/026553229501200105Google Scholar
Bradshaw, J. (1990). Test-takers’ reactions to a placement test. Language Testing, 7(1), 13–30. https://doi.org/10.1177/026553229000700103Google Scholar
Brown, J. D. (1989). Improving ESL placement tests using two perspectives. TESOL Quarterly, 23(1), 65–83. https://doi.org/10.2307/3587508CrossRefGoogle Scholar
Chapelle, C. A., Enright, M. K., & Jamieson, J. (2008). Building a validity argument for the Test of English as a Foreign Language. New York and London: Routledge.Google Scholar
Cho, Y., & Bridgeman, B. (2012). Relationship of TOEFL IBT scores to academic performance: Some evidence from American universities. Language Testing, 29(3), 421–442. https://doi.org/10.1177/0265532211430368CrossRefGoogle Scholar
Clark, M. (2004). By the numbers: The rationale for Rasch analysis in placement testing. Second Language Studies, 22(2), 61–90.Google Scholar
Creswell, J. W., & Plano Clark, V. L. (2007). Designing and conducting mixed methods research. Thousand Oaks, CA: Sage Publications.Google Scholar
Fox, J. D. (2009). Moderating top-down policy impact and supporting EAP curricular renewal: Exploring the potential of diagnostic assessment. Journal of English for Academic Purposes, 8(1), 26–42. https://doi.org/10.1016/j.jeap.2008.12.004Google Scholar
Fulcher, G. (1997). An English language placement test: Issues in reliability and validity. Language Testing, 14(2), 113–139. https://doi.org/10.1177/026553229701400201CrossRefGoogle Scholar
Graham, J. G. (1987). English language proficiency and the prediction of academic success. TESOL Quarterly, 21(3), 505–521. https://doi.org/10.2307/3586500CrossRefGoogle Scholar
Green, A. B., & Weir, C. J. (2004). Can placement tests inform instructional decisions? Language Testing, 21(4), 467–494. https://doi.org/10.1191/0265532204lt293oaCrossRefGoogle Scholar
Isbell, D., Nelly, M., & Arvizu, G. (2014). Is equating reasonable for small-scale language testing programs? In The 36th Language Testing Research Colloquium. Amsterdam, The Netherlands: VU University.Google Scholar
Kane, M. T. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000Google Scholar
Kunnan, A. J. (1990). DIF in native language and gender groups in an ESL placement test. TESOL Quarterly, 24(4), 741–746. https://doi.org/10.2307/3587128CrossRefGoogle Scholar
Kunnan, A. J. (1992). An investigation of a criterion-referenced test using G-theory, and factor and cluster analyses. Language Testing, 9(1), 30–49. https://doi.org/10.1177/026553229200900104Google Scholar
Lee, Y.-J., & Greene, J. (2007). The predictive validity of an ESL placement test: A mixed methods approach. Journal of Mixed Methods Research, 1(4), 366–389. https://doi.org/10.1177/1558689807306148CrossRefGoogle Scholar
Li, Z. (2015). An argument-based validation study of the English Placement Test (EPT) – Focusing on the inferences of extrapolation and ramification. Iowa State University. Retrieved from http://search.proquest.com/docview/1733954827CrossRefGoogle Scholar
Midgley, C., Maehr, M. L., Hruda, L. Z., Anderman, E. M., Anderman, L., Freeman, K. E., … Urdan, T. (2000). Manual for the patterns of adaptive learning scales. Ann Arbor, MI: University of Michigan.Google Scholar
Nakamura, Y. (2007). A Rasch-based analysis of an in-house English placement test. In Newfields, T., Gledall, I., Wanner, P., & Kawate-Mierzejewska, M. (Eds.), Second language acquisition – Theory and pedagogy: Proceedings of the 6th annual JALT Pan-SIG conference (pp. 97–109). Sendai, Japan: Tohoku Bunka Gakuen University. Retrieved from http://jalt.org/pansig/2007/HTML/Nakamura.htmGoogle Scholar
Phakiti, A., Hirsh, D., & Woodrow, L. (2013). It’s not only English: Effects of other individual factors on English language learning and academic learning of ESL international students in Australia. Journal of Research in International Education, 12(3), 239–258. https://doi.org/10.1177/1475240913513520Google Scholar
Pintrich, P. R., Smith, D. A. F., Garcia, T., & McKeachie, W. J. (1993). Reliability and predictive validity of the motivated strategies for learning questionnaire (Mslq). Educational and Psychological Measurement, 53(3), 801–813. https://doi.org/10.1177/0013164493053003024Google Scholar
Plakans, L., & Burke, M. (2013). The decision-making process in language program placement: Test and nontest factors interacting in context. Language Assessment Quarterly, 10(2), 115–134. https://doi.org/10.1080/15434303.2011.627598CrossRefGoogle Scholar
Saldaña, J. (2009). The coding manual for qualitative researchers. Thousand Oaks, CA: Sage.Google Scholar
Wang, J., & Wang, X. (2012). Structural equation modeling. Applications using Mplus. West Sussex: Wiley.CrossRefGoogle Scholar