Validity Argument in Language Testing: Case Studies of Validation Research

by Carol A. Chapelle (Editor), Erik Voss (Editor)

Overview

Language tests play pivotal roles in education, research on learning, and gate-keeping decisions. The central concern for language testing professionals is how to investigate whether or not tests are appropriate for their intended purposes. This book introduces an argument-based validity framework to help with the design of research that investigates the validity of language test interpretation and use. The book presents the principal concepts and technical terms, then shows how they can be implemented successfully in practice through a variety of validation studies. It also demonstrates how argument-based validity intersects with technology in language testing research and highlights the use of validity argument for identifying research questions and interpreting the results of validation research. Use of the framework helps researchers in language testing to communicate clearly and consistently about technical issues with each other and with researchers of other types of tests.

Product Details

ISBN-13:	9781108602389
Publisher:	Cambridge University Press
Publication date:	01/21/2021
Series:	Cambridge Applied Linguistics
Sold by:	Barnes & Noble
Format:	eBook
File size:	17 MB
Note:	This product may take a few minutes to download.

About the Author

Carol A. Chapelle is Distinguished Professor in the Department of English, Iowa State University. She received the 2012 Cambridge-International Language Testing Association Lifetime Achievement Award and the 2015 Distinguished Scholarship and Service Award from the American Association for Applied Linguistics. She is co-editor of the Cambridge Applied Linguistics series and is founding editor of the Encyclopedia of Applied Linguistics.
Erik Voss is Lecturer in Applied Linguistics & TESOL at Teachers College, Columbia University. He is a member of the International Language Testing Association's (ILTA) executive board and has co-authored the book, Flipping Academic English Language Learning: Experiences from an American University (2019).

Table of Contents

1. Introduction to Validity Argument in Language Testing and Assessment Carol A. Chapelle, Erik Voss; 2. Understanding Argument-based Validity in Language Testing Carol A. Chapelle, Hye-won Lee; 3. A Systematic Review of Argument-based Validation Studies in the Field of Language Testing (2000–2018) Ahmet Dursun, Zhi Li; 4. Domain Definition Inference for a Virtual Interactive Aviation English Test (VIAET) for Military Air Traffic Controllers Moonyoung Park; 5. Support for the Evaluation Inference: Investigating Conditions for Rating Responses on a Test of Academic Oral Language Hyejin Yang; 6. Generalization Inference for a Computer-mediated Graphic-prompt Writing Test for ESL Placement YunDeok Choi; 7. The Telephone Standard Speaking Test: an Outside Evaluator's Investigation of a Rebuttal to the Generalization Inference Rie Koizumi; 8. The Explanation Inference for a Test of Academic English Collocational Ability Erik Voss; 9. Extrapolation of the Meaning of Grades on Writing Tasks in an ESL Writing Class to Success on Tasks in University Courses Jooyoung Lee; 10. Justifying the Interpretation and Use of an ESL Writing Final Examination Heesung Jun; 11. An Argument for Use of a Test of Productive Grammatical Ability for Placement into Writing Classes Yoo-Ree Chung; 12. Investigating the Consequences of an ESL Placement Test Zhi Li; 13. Validation Research and its Limits Carol A. Chapelle, Erik Voss.

Editorial Reviews

‘Most research building on the framework of validity arguments has been driven by large-scale standardized testing practices. Carol and Erik invite us to listen in the case narratives of validity arguments from classrooms, local institutions, and technology-rich assessment platforms.’ Eunice Jang, Professor, Ontario Institute for Studies in Education, University of Toronto

‘This book is both tightly focused on the principles of argument-based language test validation and yet wide-ranging in its attention to different contexts in which validation is undertaken, including the use of technology in test development, delivery, and scoring. After a cogent introduction to the theory of validity argument, each chapter focuses on one or two aspects of the procedure so that by the end, readers have a clear understanding of this complex but highly effective approach to language test validation. Danny Douglas, Professor Emeritus, Applied Linguistics, Iowa State University

‘Most research building on the framework of validity arguments has been driven by large-scale standardized testing practices. Carol and Erik invite us to listen in the case narratives of validity arguments from classrooms, local institutions, and technology-rich assessment platforms.’ Eunice Jang, Professor, Ontario Institute for Studies in Education, University of Toronto

‘Validity Argument in Language Testing is a much-needed resource for researchers, graduate students, and practitioners learning the intricacies of the argument-based approach to validation in language testing. The highly experienced editors have drawn together a successful combination of theoretical grounding and example studies focusing on various aspects of the approach. The book will be a valuable resource for many generations of language assessors.’ Ute Knoch, Director of the Language Testing Research Centre and Associate Professor in Language Assessment, University of Melbourne

‘This volume provides important insights into the utility of an argument-based approach to validity. Case studies representing a range of tests, contexts and validation methods provide fertile ground to explore the benefits, and limits, of an argument-based approach. This collection will appeal to anyone keen to learn about the application of validity theory in concrete language testing situations.’ Luke Harding, Professor in English Language and Linguistics, Lancaster University

From the Publisher