Computerized Adaptive and Multistage Testing with R

Computerized Adaptive and Multistage Testing with R PDF

Author: David Magis

Publisher: Springer

Published: 2017-11-23

Total Pages: 171

ISBN-13: 3319692186

DOWNLOAD EBOOK →

The goal of this guide and manual is to provide a practical and brief overview of the theory on computerized adaptive testing (CAT) and multistage testing (MST) and to illustrate the methodologies and applications using R open source language and several data examples. Implementation relies on the R packages catR and mstR that have been already or are being developed by the first author (with the team) and that include some of the newest research algorithms on the topic. The book covers many topics along with the R-code: the basics of R, theoretical overview of CAT and MST, CAT designs, CAT assembly methodologies, CAT simulations, catR package, CAT applications, MST designs, IRT-based MST methodologies, tree-based MST methodologies, mstR package, and MST applications. CAT has been used in many large-scale assessments over recent decades, and MST has become very popular in recent years. R open source language also has become one of the most useful tools for applications in almost all fields, including business and education. Though very useful and popular, R is a difficult language to learn, with a steep learning curve. Given the obvious need for but with the complex implementation of CAT and MST, it is very difficult for users to simulate or implement CAT and MST. Until this manual, there has been no book for users to design and use CAT and MST easily and without expense; i.e., by using the free R software. All examples and illustrations are generated using predefined scripts in R language, available for free download from the book's website.

Computerized Multistage Testing

Computerized Multistage Testing PDF

Author: Duanli Yan

Publisher: CRC Press

Published: 2016-04-19

Total Pages: 532

ISBN-13: 146650580X

DOWNLOAD EBOOK →

Unlike other forms of adaptive testing, multistage testing (MST) is highly suitable for testing educational achievement because it can be adapted to educational surveys and student testing. This volume provides the first unified source of information on the design, psychometrics, implementation, and operational use of MST. It shows how to apply theoretical statistical tools to testing in novel and useful ways. It also explains how to explicitly tie the assumptions made by each model to observable (or at least inferable) data conditions.

Computerized Adaptive Testing: Theory and Practice

Computerized Adaptive Testing: Theory and Practice PDF

Author: Wim J. van der Linden

Publisher: Springer Science & Business Media

Published: 2000-07-31

Total Pages: 327

ISBN-13: 0792364252

DOWNLOAD EBOOK →

This book offers a comprehensive introduction to the latest developments in the theory and practice of CAT. It can be used both as a basic reference and a valuable resource on test theory. It covers such topics as item selection and ability estimation, item pool development and maintenance, item calibration and model fit, and testlet-based adaptive testing, as well as the operational aspects of existing large-scale CAT programs.

Elements of Adaptive Testing

Elements of Adaptive Testing PDF

Author: Wim J. van der Linden

Publisher: Springer Science & Business Media

Published: 2010-03-10

Total Pages: 433

ISBN-13: 0387854614

DOWNLOAD EBOOK →

The arrival of the computer in educational and psychological testing has led to the current popularity of adaptive testing---a testing format in which the computer uses statistical information about the test items to automatically adapt their selection to a real-time update of the test taker’s ability estimate. This book covers such key features of adaptive testing as item selection and ability estimation, adaptive testing with multidimensional abilities, sequencing adaptive test batteries, multistage adaptive testing, item-pool design and maintenance, estimation of item and item-family parameters, item and person fit, as well as adaptive mastery and classification testing. It also shows how these features are used in the daily operations of several large-scale adaptive testing programs.

Theoretical and Practical Advances in Computer-based Educational Measurement

Theoretical and Practical Advances in Computer-based Educational Measurement PDF

Author: Bernard P. Veldkamp

Publisher: Springer

Published: 2019-07-05

Total Pages: 399

ISBN-13: 3030184803

DOWNLOAD EBOOK →

This open access book presents a large number of innovations in the world of operational testing. It brings together different but related areas and provides insight in their possibilities, their advantages and drawbacks. The book not only addresses improvements in the quality of educational measurement, innovations in (inter)national large scale assessments, but also several advances in psychometrics and improvements in computerized adaptive testing, and it also offers examples on the impact of new technology in assessment. Due to its nature, the book will appeal to a broad audience within the educational measurement community. It contributes to both theoretical knowledge and also pays attention to practical implementation of innovations in testing technology.

Multidimensional Item Response Theory

Multidimensional Item Response Theory PDF

Author: M.D. Reckase

Publisher: Springer Science & Business Media

Published: 2009-07-07

Total Pages: 355

ISBN-13: 0387899766

DOWNLOAD EBOOK →

First thorough treatment of multidimensional item response theory Description of methods is supported by numerous practical examples Describes procedures for multidimensional computerized adaptive testing

Practical Considerations in Computer-Based Testing

Practical Considerations in Computer-Based Testing PDF

Author: Cynthia G. Parshall

Publisher: Springer Science & Business Media

Published: 2012-12-06

Total Pages: 233

ISBN-13: 1461300835

DOWNLOAD EBOOK →

This book introduces computer-based testing, addressing both nontechnical and technical considerations. The material is oriented toward practitioners and graduate students. The practical emphasis will be useful to measurement professionals who are or will be responsible for implementing a computerized testing program. The instructional information is also designed to be suitable for a one-semester graduate course in computerized testing in an educational measurement or quantitative methods program. While certain theoretical concepts are addressed, the focus of the book is on the applied nature of computerized testing. For this reason, the materials include such features as example applications, figures, and plots to illustrate critical points in the discussions. A wide range ofnontechnical issues need to be considered in implementing a computer-based testing program. Separate chapters are provided on test administration and development issues, examinee issues, software issues, and innovative item types. Test administration and delivery issues include the location of exam administration, selection of hardware and software, security considerations, scheduling of administration frequency and time limits, cost implications, and program support as well as approaches for addressing reliability, validity, comparability, and data analysis. Examinee issues include the influence ofexaminees' reactions to adaptive testing, the effect ofcomputer based task constraints, and the impact of examinees' prior computer experience. Software issues include usability studies and software evaluation as tools in selecting and developing appropriate software, based on the test program needs.

Linear Models for Optimal Test Design

Linear Models for Optimal Test Design PDF

Author: Wim J. van der Linden

Publisher: Springer Science & Business Media

Published: 2006-01-01

Total Pages: 421

ISBN-13: 0387290540

DOWNLOAD EBOOK →

Wim van der Linden was just given a lifetime achievement award by the National Council on Measurement in Education. There is no one more prominent in the area of educational testing. There are hundreds of computer-based credentialing exams in areas such as accounting, real estate, nursing, and securities, as well as the well-known admissions exams for college, graduate school, medical school, and law school - there is great need on the theory of testing. This book presents the statistical theory and practice behind constructing good tests e.g., how is the first test item selected, how are the next items selected, and when do you have enough items.

Integrating Timing Considerations to Improve Testing Practices

Integrating Timing Considerations to Improve Testing Practices PDF

Author: Melissa J. Margolis

Publisher: Routledge

Published: 2020-06-03

Total Pages: 288

ISBN-13: 1351064762

DOWNLOAD EBOOK →

Integrating Timing Considerations to Improve Testing Practices synthesizes a wealth of theory and research on time issues in assessment into actionable advice for test development, administration, and scoring. One of the major advantages of computer-based testing is the capability to passively record test-taking metadata—including how examinees use time and how time affects testing outcomes. This has opened many questions for testing administrators. Is there a trade-off between speed and accuracy in test taking? What considerations should influence equitable decisions about extended-time accommodations? How can test administrators use timing data to balance the costs and resulting validity of tests administered at commercial testing centers? In this comprehensive volume, experts in the field discuss the impact of timing considerations, constraints, and policies on valid score interpretations; administrative accommodations, test construction, and examinees’ experiences and behaviors; and how to implement the findings into practice. These 12 chapters provide invaluable resources for testing professionals to better understand the inextricable links between effective time allocation and the purposes of high-stakes testing.

Computerized Adaptive Testing

Computerized Adaptive Testing PDF

Author: David J. Weiss

Publisher: Guilford Publications

Published: 2024-04-29

Total Pages: 388

ISBN-13: 1462554520

DOWNLOAD EBOOK →

Used worldwide in assessment and professional certification contexts, computerized adaptive testing (CAT) offers a powerful means to measure individual differences or make classifications. This authoritative work from CAT pioneer David J. Weiss and Alper Şahin provides a complete how-to guide for planning and implementing an effective CAT to create a test unique to each person in real time. The book reviews the history of CAT and the basics of item response theory used in CAT. It walks the reader through developing an item bank, pretesting and linking items, selecting required CAT options, and using simulations to design a CAT. Available software for CAT delivery is described, including links to free and commercial options. Engaging multidisciplinary examples illustrate applications of CAT for measuring ability, achievement, proficiency, personality, attitudes, perceptions, patients’ reports of their symptoms, and academic or clinical progress.