Handbook on Measurement, Assessment, and Evaluation in Higher Education / Edition 2

by Charles Secolsky, D. Brian Denison

Overview

In this valuable resource, well-known scholars present a detailed understanding of contemporary theories and practices in the fields of measurement, assessment, and evaluation, with guidance on how to apply these ideas for the benefit of students and institutions. Bringing together terminology, analytical perspectives, and methodological advances, this second edition facilitates informed decision-making while connecting the latest thinking in these methodological areas with actual practice in higher education. This research handbook provides higher education administrators, student affairs personnel, institutional researchers, and faculty with an integrated volume of theory, method, and application.

Product Details

ISBN-13:	9781138892149
Publisher:	Taylor & Francis
Publication date:	08/10/2017
Edition description:	Revised
Pages:	762
Product dimensions:	7.00(w) x 10.00(h) x (d)

About the Author

Charles Secolsky is on the faculty at Rockland Community College and County College of Morris, USA.

D. Brian Denison is Institutional Research Analyst in the Director of Studies’ Office for Champlain Regional College, Quebec, Canada.

Table of Contents

List of Figures

List of Tables

Foreword

Edward J. Yaw

Preface: Improving Institutional Decision-Making through Educational Measurement, Assessment, and Evaluation

Charles Secolsky and D. Brian Denison

Acknowledgements

Part I Measurement, Assessment, and Evaluation in Higher Education: Past, Present, and Future

Introduction to Part I

1. The Failure of Higher Education to Follow the Standards It has Established in Methodology and Evaluation

Michael Scriven

2. On Measurement in Educational Assessment

Robert J. Mislevy

Part II Assessment and Evaluation in Higher Education

Introduction to Part II

3. Assessing the Quality of a University, Particularly Its Teaching

Robert E. Stake, Gloria Contreras, and Isabel Arbesú

4. Validity Issues in Measuring Student Success

Dwight L. Smith III

5. Course-Embedded Assessment: Aligning Pedagogical Practices to Enhance Student Learning

Kathryne Drezek McConnell and Peter E. Doolittle

6. Implementing Undergraduate Student Learning Outcomes Assessment at the Program and Institutional Levels

Thomas Judd and Bruce Keith

7. The Perennial Challenges of Accountability

James C. Palmer

8. Talking About Data: The Faculty Discourse on Practice, Student Learning, and Evaluative Processes

William H. Rickards

9. Benchmarking in Community Colleges

Lou A. Guthrie and Jeffrey A. Seybert

10. Mixed-Methods Specialists in Action: Linking Mixed-Methods Research to Learning and Classroom Assessment

Delwyn L. Harnisch, John W. Creswell, and Timothy C. Guetterman

Part III Theoretical Foundations of Educational Measurement

Introduction to Part III

11. The Validation of Tests in Higher Education

Kurt F. Geisinger, Leslie R. Hawley, and Carina McCormick

12. Reliability

Bruce Thompson and Tammi Vacha-Haase

13. Using Classical Test Theory in Higher Education

David A. G. Berg, Elizabeth Schaughency, Jacques van der Meer, and Jeffrey K. Smith

14. Item Response Theory in Measurement, Assessment, and Evaluation for Higher Education

Steven J. Osterlind and Ze Wang

15. Generalizability Theory in Assessment Contexts

Noreen M. Webb, Richard J. Shavelson, and Jeffrey T. Steedle

Part IV Testing and Assessment: Implications for Decision-Making

Introduction to Part IV

16. Scaling, Norming, and Equating

Michael J. Kolen and Amy B. Hendrickson

17. Setting and Validating Cut Scores for Tests

Mary J. Pitoniak and Deanna L. Morgan

18. College Placement Testing of Entering Students

Deanna L. Morgan

19. Admissions Testing in College and Graduate Education

Rebecca Zwick

20. Closing the Accommodation Gap: New Thinking on Accessibility and Accommodations for Secondary and Postsecondary Students with Disabilities

Manju Banerjee and Martha L. Thurlow

Part V Test Construction and Development

Introduction to Part V

21. Evidence-Centered Design and Postsecondary Assessment

Geneva D. Haertel and Reina Fujii

22. Building Content and Statistical Test Specifications

Tawnya Knupp and Deborah J. Harris

23. Item Analysis for Classroom Assessments in Higher Education

Jerome C. Clauser and Ronald K. Hambleton

24. Computer-Based Testing in Higher Education

Robert P. Dolan and Kelly S. Burling

Part VI Statistical Approaches in Higher Education Measurement, Assessment, and Evaluation

Introduction to Part VI

25. Issues in the Analysis of Change

D. Betsy McCoach and Karen Rambo-Hernandez

26. Multilevel Linear Modeling in Higher Education Contexts

Ying Lu, Sharon L. Weinberg, and Marc A. Scott

27. Statistical Modeling in Educational Research

Ze Wang and Steven J. Osterlind

28. An Introduction to Bayesian Statistics with Applications for Higher Education Assessment

Guili Zhang

Part VII Approaches to Evaluation in Higher Education

Introduction to Part VII

Thomas E. Grayson

29. Program Evaluation, Performance Measures, and Evaluability Assessment in Higher Education

Thomas E. Grayson

30. Naturalistic Evaluation

David A. Erlandson

31. Responsive Evaluation

Kelly E. Godfrey and Doreen B. Finkelstein

32. Case Studies

Edith J. Cisneros-Cohernour

33. Survey Use in Academic Contexts: Considerations and Guidelines

Daphna Harel and Ellen Wentland

34. Empowerment Evaluation: Linking Theories, Principles, and Concepts to Practical Steps

David M. Fetterman

Part VIII Approaches to Assessment in Higher Education

Introduction to Part VIII

35. Rubric Development

Linda Suskie

36. New Learning About Learning: An Introduction to ePortfolio Assessment

Susan Kahn

37. The Role of Faculty Grading Processes in Program and General-Education Assessment

Barbara E. Walvoord

38. Postsecondary Writing Assessment

Peggy O’Neill and Sandra Murphy

39. Testing and Evaluation of English-Language Learners in Higher Education

Young Yee Kim, James Hart, Jamal Abedi, and Alan Vanneman

40. Evaluation and Assessment in an Online Setting: The Case of Asynchronous Online Discussion

Amir Hedayati Mehdiabadi and Wenhao David Huang

Part IX Issues in Assessment and Evaluation in Higher Education

Introduction to Part IX

41. Cognitive Flexibility Theory and the Assessment of 21st-Century Skills

Rand J. Spiro, Hannah A. Klautke, Cui Cheng, and Aric Gaunt

42. Reporting Assessment Results in Higher Education

April L. Zenisky and Jerold S. Laguilles

43. Presenting Learning Outcomes Assessment Results to Foster Use

Staci J. Provezis and Natasha A. Jankowski

44. Revisiting Reliability and Validity in Higher Education Research and Program Evaluation

Margaret D. LeCompte and Dorothy E. Aguilera-Black Bear

45. Assessment of Learning Outcomes in Higher Education: International Comparisons and Perspectives

Olga Zlatkin‐Troitschanskaia, Richard J. Shavelson, and Hans Anand Pant

46. Ethical Assessment and Institutional Advancement: Connecting Good Practice with the Need to Move Campuses Forward

Ashley Finley

About the Contributors

What People are Saying About This

From the Publisher

"The Handbook on Measurement, Assessment and Evaluation in Higher Education is coming out at a precarious and important moment in the history of American higher education—and, as a result, will become a critical resource to higher education leaders and assessment and teaching and learning practitioners. The fields of assessment, evaluation, and educational measurement continue to mature and, as a result, if used wisely, can dramatically improve educational outcomes. At the same time, higher education institutions are under enormous pressure from outside constituents to demonstrate their value to their students and to taxpayers and members of the public. The analysis and advice offered in this handbook will be extremely valuable as educational leaders work to respond to calls for greater accountability and work to improve their institution’s ability to use assessment data to improve programs."

-Debra Humphreys, Vice President for Communications and Public Affairs, Association of American Colleges and Universities

"This Handbook provides a comprehensive and practical synthesis of the methods used to measure and improve higher education at every level. Pressures for accountability and accreditation have forced colleges and universities to devote greater analytical attention to measuring goal attainment, evaluating academic programs and student services, and assessing student learning outcomes. Drawing upon an impressive array of contributors from diverse disciplinary perspectives, Secolsky and Denison have assembled chapters that, in the aggregate, represent the best of what we know about measuring, assessing, and evaluating our institutions, programs, and students. Thus, the volume deserves frequent reference and space on the book shelf of every researcher, campus administrator, faculty member, and higher education policy maker."

-J. Fredericks Volkwein, Professor Emeritus of Education, Pennsylvania State University

"This is a timely and important book. At a moment in our history when public problems are commonly reduced to oversimplifications that make them harder, not easier, to resolve, this brave new text by Secolsky and Denison presents — in a highly accessible way — the full complement of factors in higher education that need to be considered in evaluating student learning outcomes. The authors have produced an intelligent, complete, authoritative, realistic and useful piece of work that may well be a model for evaluating complex social issues generally."

-Eleanor Chelimsky, Former Director of Program Evaluation, U.S. Government Accountability Office

"A working knowledge of measuring collegiate learning and evaluating academic effectiveness is as indispensable for today’s university administrator as reading a budget. For the scholar of English literature or the chemist thrust into the role of Dean, accreditation site visitor, or assessment committee chair, this volume delivers the basics of this vast field in a manner that is easy to grasp and apply. Keep it handy."

-Peter Ewell, Vice President of the National Center For Higher Education Management Systems

Editorial Reviews

"This updated edition of the Handbook on Measurement, Assessment, and Evaluation in Higher Education draws on a veritable ‘Who’s Who’ of experts in higher education assessment and evaluation to explain everything from terminology to technique. This comprehensive volume will be a constant desk companion of mine in the decades to come."
—Peter T. Ewell, President Emeritus, National Center for Higher Education Management Systems (NCHEMS) and Senior Fellow, National Institute for Learning Outcomes Assessment (NILOA), USA

"This is the most extensive collection of research on measurement, evaluation, and assessment in higher education available. Covering a broad range of theoretical and practical topics addressed by the most knowledgeable professionals in the field, this book is essential reading for anyone working in higher education who is interested in making evidence based decisions that will benefit students and institutions."
—Linda Cook, past President, National Council on Measurement in Education, USA

"This handbook is a must-have for faculty, staff, and administrators who lead assessment efforts or are involved with faculty development on their campus. The editors have brought together stellar contributors who, together, balance the practical, theoretical, and technical aspects of measurement, evaluation, and learning assessment in ways that are immediately useful."
—Monica Stitt-Bergh, President, Association for the Assessment of Learning in Higher Education, USA

From the Publisher