Generalizability Theory

Generalizability Theory PDF

Author: Robert L. Brennan

Publisher: Springer Science & Business Media

Published: 2013-11-11

Total Pages: 543

ISBN-13: 1475734565

DOWNLOAD EBOOK →

Generalizability theory offers an extensive conceptual framework and a powerful set of statistical procedures for characterizing and quantifying the fallibility of measurements. Robert Brennan, the author, has written the most comprehensive and up-to-date treatment of generalizability theory. The book provides a synthesis of those parts of the statistical literature that are directly applicable to generalizability theory. The principal intended audience is measurement practitioners and graduate students in the behavioral and social sciences, although a few examples and references are provided from other fields. Readers will benefit from some familiarity with classical test theory and analysis of variance, but the treatment of most topics does not presume specific background.

Generalizability Theory

Generalizability Theory PDF

Author: Richard J. Shavelson

Publisher: SAGE

Published: 1991-07-23

Total Pages: 156

ISBN-13: 9780803937451

DOWNLOAD EBOOK →

Accessible to any professional or researcher who has a basic understanding of analysis of variance, Shavelson and Webb offer an intuitive development of generalizability theory, a technique for estimating the relative magnitudes of various components of error variation and for indicating the most efficient strategy for achieving desired measurement precision. Covering a variety of topics such as generalizability studies with nested facets and with fixed facets, measurement error and generalizability coefficients, and decision studies with same and with different designs, the text includes exercises so the reader may practice the application of each chapter's material. By using detailed illustrations and examples, Shavelson and Webb clearly describe the logic underlying major concepts in generalizability theory to enable readers to apply these methods when investigating the consistency of their own measurements.

Applying Generalizability Theory using EduG

Applying Generalizability Theory using EduG PDF

Author: Jean Cardinet

Publisher: Taylor & Francis

Published: 2011-03-04

Total Pages: 235

ISBN-13: 1135240337

DOWNLOAD EBOOK →

Intended to help improve measurement and data collection methods in the behavioral, social, and medical sciences, this book demonstrates an expanded and accessible use of Generalizability Theory (G theory). G theory conceptually models the way in which the reliability of measurement is ascertained. Sources of score variation are identified as potential contributors to measurement error and taken into account accordingly. The authors demonstrate the powerful potential of G theory by showing how to improve the quality of any kind of measurement, regardless of the discipline. Readers will appreciate the conversational style used to present a comprehensive review of G theory and its application using the freeware EduG. To maximize understanding the authors illustrate all fundamental principles with concrete examples from different fields and contexts. Annotated applications lead students through the main concepts of G theory, while illustrating both the use of EduG and interpretation of its output. Formulas are avoided wherever possible. Exercises with data sets available on the Psychology Press website allow readers to carry out their own analyses to reinforce understanding. Brief overviews of analysis of variance, estimation, and the statistical error model are provided for review. The procedures involved in carrying out a generalizability study using EduG follow, as well as guidance in the interpretation of results. Real-world applications of G theory to the assessment of depression, managerial ability, attitudes, and writing and mathematical skills are then presented. Next, annotated exercises provide an opportunity for readers to use EduG and interpret its results. The book concludes with a review of the development of G theory and possible new directions of application. Finally, for those with a strong statistical background, the appendixes provide the formulas used by EduG. Ideal as a supplement for courses on measurement theory and/or generalizability theory taught in departments of psychology, education, medicine, and the social sciences, this text will also appeal to researchers from a variety of fields interested in learning how to apply G theory to their studies.

Applying Generalizability Theory using EduG

Applying Generalizability Theory using EduG PDF

Author: Jean Cardinet

Publisher: Routledge

Published: 2011-03-04

Total Pages: 228

ISBN-13: 1135240329

DOWNLOAD EBOOK →

Intended to help improve measurement and data collection methods in the behavioral, social, and medical sciences, this book demonstrates an expanded and accessible use of Generalizability Theory (G theory). G theory conceptually models the way in which the reliability of measurement is ascertained. Sources of score variation are identified as potential contributors to measurement error and taken into account accordingly. The authors demonstrate the powerful potential of G theory by showing how to improve the quality of any kind of measurement, regardless of the discipline. Readers will appreciate the conversational style used to present a comprehensive review of G theory and its application using the freeware EduG. To maximize understanding the authors illustrate all fundamental principles with concrete examples from different fields and contexts. Annotated applications lead students through the main concepts of G theory, while illustrating both the use of EduG and interpretation of its output. Formulas are avoided wherever possible. Exercises with data sets available on the Psychology Press website allow readers to carry out their own analyses to reinforce understanding. Brief overviews of analysis of variance, estimation, and the statistical error model are provided for review. The procedures involved in carrying out a generalizability study using EduG follow, as well as guidance in the interpretation of results. Real-world applications of G theory to the assessment of depression, managerial ability, attitudes, and writing and mathematical skills are then presented. Next, annotated exercises provide an opportunity for readers to use EduG and interpret its results. The book concludes with a review of the development of G theory and possible new directions of application. Finally, for those with a strong statistical background, the appendixes provide the formulas used by EduG. Ideal as a supplement for courses on measurement theory and/or generalizability theory taught in departments of psychology, education, medicine, and the social sciences, this text will also appeal to researchers from a variety of fields interested in learning how to apply G theory to their studies.

Scoring Performance Assessments Based on Judgements

Scoring Performance Assessments Based on Judgements PDF

Author: Christopher Wing-Tat Chiu

Publisher: Springer Science & Business Media

Published: 2013-03-14

Total Pages: 194

ISBN-13: 9401006504

DOWNLOAD EBOOK →

Scoring Performance Assessments Based on Judgements focuses on the applications of Generalizability Theory to Performance Assessment. The author developed an objective method to examine the dependability of the scoring of large-scale performance assessments by humans. This book presents principles in identifying common missing data patterns inherent in assessment designs. These principles can be used to guide the design of assessment procedures including those used in large-scale testing programs, observations, and structured interviews.

Principles of Test Theories

Principles of Test Theories PDF

Author: Hoi K. Suen

Publisher: Routledge

Published: 2012-11-12

Total Pages: 245

ISBN-13: 1136463178

DOWNLOAD EBOOK →

Based on a tremendous increase in the development of psychometric theories in the past decade -- ranging from techniques for criterion-referenced testing to behavioral assessment, generalizability, and item response theory -- this book offers a summary of core issues. In so doing, it provides a comprehensive survey of reliability, validity, and item analysis from the perspectives of classical true-score model, generalizability theory, item response theory, criterion-referenced testing, and behavioral assessment. Related theoretical issues such as item bias, equating, and cut-score determination are also discussed. This is an excellent text for courses in statistics, research methods, behavioral medicine and cognitive science as well as educational, school, experimental, counseling/social, clinical, developmental, and personality psychology.

Measurement Theory and Applications for the Social Sciences

Measurement Theory and Applications for the Social Sciences PDF

Author: Deborah L. Bandalos

Publisher: Guilford Publications

Published: 2018-01-31

Total Pages: 686

ISBN-13: 1462532136

DOWNLOAD EBOOK →

Which types of validity evidence should be considered when determining whether a scale is appropriate for a given measurement situation? What about reliability evidence? Using clear explanations illustrated by examples from across the social and behavioral sciences, this engaging text prepares students to make effective decisions about the selection, administration, scoring, interpretation, and development of measurement instruments. Coverage includes the essential measurement topics of scale development, item writing and analysis, and reliability and validity, as well as more advanced topics such as exploratory and confirmatory factor analysis, item response theory, diagnostic classification models, test bias and fairness, standard setting, and equating. End-of-chapter exercises (with answers) emphasize both computations and conceptual understanding to encourage readers to think critically about the material. ÿ

Introduction to Psychometric Theory

Introduction to Psychometric Theory PDF

Author: Tenko Raykov

Publisher: Routledge

Published: 2011-01-07

Total Pages: 352

ISBN-13: 1136900020

DOWNLOAD EBOOK →

This new text provides a state-of the-art introduction to educational and psychological testing and measurement theory that reflects many intellectual developments of the past two decades. The book introduces psychometric theory using a latent variable modeling (LVM) framework and emphasizes interval estimation throughout, so as to better prepare readers for studying more advanced topics later in their careers. Featuring numerous examples, it presents an applied approach to conducting testing and measurement in the behavioral, social, and educational sciences. Readers will find numerous tips on how to use test theory in today’s actual testing situations. To reflect the growing use of statistical software in psychometrics, the authors introduce the use of Mplus after the first few chapters. IBM SPSS, SAS, and R are also featured in several chapters. Software codes and associated outputs are reviewed throughout to enhance comprehension. Essentially all of the data used in the book are available on the website. In addition instructors will find helpful PowerPoint lecture slides and questions and problems for each chapter. The authors rely on LVM when discussing fundamental concepts such as exploratory and confirmatory factor analysis, test theory, generalizability theory, reliability and validity, interval estimation, nonlinear factor analysis, generalized linear modeling, and item response theory. The varied applications make this book a valuable tool for those in the behavioral, social, educational, and biomedical disciplines, as well as in business, economics, and marketing. A brief introduction to R is also provided. Intended as a text for advanced undergraduate and/or graduate courses in psychometrics, testing and measurement, measurement theory, psychological testing, and/or educational and/or psychological measurement taught in departments of psychology, education, human development, epidemiology, business, and marketing, it will also appeal to researchers in these disciplines. Prerequisites include an introduction to statistics with exposure to regression analysis and ANOVA. Familiarity with SPSS, SAS, STATA, or R is also beneficial. As a whole, the book provides an invaluable introduction to measurement and test theory to those with limited or no familiarity with the mathematical and statistical procedures involved in measurement and testing.