Target Estimation and Adjustment Weighting for Survey Nonresponse and Sampling Bias

Target Estimation and Adjustment Weighting for Survey Nonresponse and Sampling Bias PDF

Author: Devin Caughey

Publisher: Cambridge University Press

Published: 2020-10-22

Total Pages: 98

ISBN-13: 1108889700

DOWNLOAD EBOOK →

We elaborate a general workflow of weighting-based survey inference, decomposing it into two main tasks. The first is the estimation of population targets from one or more sources of auxiliary information. The second is the construction of weights that calibrate the survey sample to the population targets. We emphasize that these tasks are predicated on models of the measurement, sampling, and nonresponse process whose assumptions cannot be fully tested. After describing this workflow in abstract terms, we then describe in detail how it can be applied to the analysis of historical and contemporary opinion polls. We also discuss extensions of the basic workflow, particularly inference for causal quantities and multilevel regression and poststratification.

Estimation in Surveys with Nonresponse

Estimation in Surveys with Nonresponse PDF

Author: Carl-Erik Särndal

Publisher: John Wiley & Sons

Published: 2005-08-05

Total Pages: 212

ISBN-13: 0470011343

DOWNLOAD EBOOK →

Around the world a multitude of surveys are conducted every day, on a variety of subjects, and consequently surveys have become an accepted part of modern life. However, in recent years survey estimates have been increasingly affected by rising trends in nonresponse, with loss of accuracy as an undesirable result. Whilst it is possible to reduce nonresponse to some degree, it cannot be completely eliminated. Estimation techniques that account systematically for nonresponse and at the same time succeed in delivering acceptable accuracy are much needed. Estimation in Surveys with Nonresponse provides an overview of these techniques, presenting the view of nonresponse as a normal (albeit undesirable) feature of a sample survey, one whose potentially harmful effects are to be minimised. Builds in the nonresponse feature of survey data collection as an integral part of the theory, both for point estimation and for variance estimation. Promotes weighting through calibration as a new and powerful technique for surveys with nonresponse. Highlights the analysis of nonresponse bias in estimates and methods to minimize this bias. Includes computational tools to help identify the best variables for calibration. Discusses the use of imputation as a complement to weighting by calibration. Contains guidelines for dealing with frame imperfections and coverage errors. Features worked examples throughout the text, using real data. The accessible style of Estimation in Surveys with Nonresponse will make this an invaluable tool for survey methodologists in national statistics agencies and private survey agencies. Researchers, teachers, and students of statistics, social sciences and economics will benefit from the clear presentation and numerous examples.

Nonresponse in Social Science Surveys

Nonresponse in Social Science Surveys PDF

Author: National Research Council

Publisher: National Academies Press

Published: 2013-10-26

Total Pages: 167

ISBN-13: 0309272475

DOWNLOAD EBOOK →

For many household surveys in the United States, responses rates have been steadily declining for at least the past two decades. A similar decline in survey response can be observed in all wealthy countries. Efforts to raise response rates have used such strategies as monetary incentives or repeated attempts to contact sample members and obtain completed interviews, but these strategies increase the costs of surveys. This review addresses the core issues regarding survey nonresponse. It considers why response rates are declining and what that means for the accuracy of survey results. These trends are of particular concern for the social science community, which is heavily invested in obtaining information from household surveys. The evidence to date makes it apparent that current trends in nonresponse, if not arrested, threaten to undermine the potential of household surveys to elicit information that assists in understanding social and economic issues. The trends also threaten to weaken the validity of inferences drawn from estimates based on those surveys. High nonresponse rates create the potential or risk for bias in estimates and affect survey design, data collection, estimation, and analysis. The survey community is painfully aware of these trends and has responded aggressively to these threats. The interview modes employed by surveys in the public and private sectors have proliferated as new technologies and methods have emerged and matured. To the traditional trio of mail, telephone, and face-to-face surveys have been added interactive voice response (IVR), audio computer-assisted self-interviewing (ACASI), web surveys, and a number of hybrid methods. Similarly, a growing research agenda has emerged in the past decade or so focused on seeking solutions to various aspects of the problem of survey nonresponse; the potential solutions that have been considered range from better training and deployment of interviewers to more use of incentives, better use of the information collected in the data collection, and increased use of auxiliary information from other sources in survey design and data collection. Nonresponse in Social Science Surveys: A Research Agenda also documents the increased use of information collected in the survey process in nonresponse adjustment.

Survey Nonresponse

Survey Nonresponse PDF

Author: Robert M. Groves

Publisher: Wiley-Interscience

Published: 2002

Total Pages: 528

ISBN-13:

DOWNLOAD EBOOK →

This volume offers coverage of research in the field of survey nonresponse, the primary threat to the statistical integrity of surveys. This book was written in conjunction with the International Conference on Survey Nonresponse, October 1999.

Survey Weights

Survey Weights PDF

Author: Richard Valliant

Publisher:

Published: 2018

Total Pages: 183

ISBN-13: 9781597182607

DOWNLOAD EBOOK →

Survey Weights: A Step-by-Step Guide to Calculation is the first guide geared toward Stata users that systematically covers the major steps taken in creating survey weights. These weights are used to project a sample to some larger population and can be computed for either probability or nonprobability samples. Sample designs can range from simple, single-stage samples to more complex, multistage samples, each of which may use specialized steps in weighting to account for selection probabilities, nonresponse, inaccurate coverage of a population by a sample, and auxiliary data to improve precision and compensate for coverage errors. The authors provide many examples with Stata code.

Encyclopedia of Survey Research Methods

Encyclopedia of Survey Research Methods PDF

Author: Paul J. Lavrakas

Publisher: SAGE Publications

Published: 2008-09-12

Total Pages: 1073

ISBN-13: 150631788X

DOWNLOAD EBOOK →

To the uninformed, surveys appear to be an easy type of research to design and conduct, but when students and professionals delve deeper, they encounter the vast complexities that the range and practice of survey methods present. To complicate matters, technology has rapidly affected the way surveys can be conducted; today, surveys are conducted via cell phone, the Internet, email, interactive voice response, and other technology-based modes. Thus, students, researchers, and professionals need both a comprehensive understanding of these complexities and a revised set of tools to meet the challenges. In conjunction with top survey researchers around the world and with Nielsen Media Research serving as the corporate sponsor, the Encyclopedia of Survey Research Methods presents state-of-the-art information and methodological examples from the field of survey research. Although there are other "how-to" guides and references texts on survey research, none is as comprehensive as this Encyclopedia, and none presents the material in such a focused and approachable manner. With more than 600 entries, this resource uses a Total Survey Error perspective that considers all aspects of possible survey error from a cost-benefit standpoint. Key Features Covers all major facets of survey research methodology, from selecting the sample design and the sampling frame, designing and pretesting the questionnaire, data collection, and data coding, to the thorny issues surrounding diminishing response rates, confidentiality, privacy, informed consent and other ethical issues, data weighting, and data analyses Presents a Reader′s Guide to organize entries around themes or specific topics and easily guide users to areas of interest Offers cross-referenced terms, a brief listing of Further Readings, and stable Web site URLs following most entries The Encyclopedia of Survey Research Methods is specifically written to appeal to beginning, intermediate, and advanced students, practitioners, researchers, consultants, and consumers of survey-based information.

Studies of Welfare Populations

Studies of Welfare Populations PDF

Author: National Research Council

Publisher: National Academies Press

Published: 2002-01-20

Total Pages: 538

ISBN-13: 0309076234

DOWNLOAD EBOOK →

This volume, a companion to Evaluating Welfare Reform in an Era of Transition, is a collection of papers on data collection issues for welfare and low-income populations. The papers on survey issues cover methods for designing surveys taking into account nonresponse in advance, obtaining high response rates in telephone surveys, obtaining high response rates in in-person surveys, the effects of incentive payments, methods for adjusting for missing data in surveys of low-income populations, and measurement error issues in surveys, with a special focus on recall error. The papers on administrative data cover the issues of matching and cleaning, access and confidentiality, problems in measuring employment and income, and the availability of data on children. The papers on welfare leavers and welfare dynamics cover a comparison of existing welfare leaver studies, data from the state of Wisconsin on welfare leavers, and data from the National Longitudinal Survey of Youth used to construct measures of heterogeneity in the welfare population based on the recipient's own welfare experience. A final paper discusses qualitative data.

Practical Tools for Designing and Weighting Survey Samples

Practical Tools for Designing and Weighting Survey Samples PDF

Author: Richard Valliant

Publisher: Springer Science & Business Media

Published: 2013-05-16

Total Pages: 678

ISBN-13: 1461464498

DOWNLOAD EBOOK →

Survey sampling is fundamentally an applied field. The goal in this book is to put an array of tools at the fingertips of practitioners by explaining approaches long used by survey statisticians, illustrating how existing software can be used to solve survey problems, and developing some specialized software where needed. This book serves at least three audiences: (1) Students seeking a more in-depth understanding of applied sampling either through a second semester-long course or by way of a supplementary reference; (2) Survey statisticians searching for practical guidance on how to apply concepts learned in theoretical or applied sampling courses; and (3) Social scientists and other survey practitioners who desire insight into the statistical thinking and steps taken to design, select, and weight random survey samples. Several survey data sets are used to illustrate how to design samples, to make estimates from complex surveys for use in optimizing the sample allocation, and to calculate weights. Realistic survey projects are used to demonstrate the challenges and provide a context for the solutions. The book covers several topics that either are not included or are dealt with in a limited way in other texts. These areas include: sample size computations for multistage designs; power calculations related to surveys; mathematical programming for sample allocation in a multi-criteria optimization setting; nuts and bolts of area probability sampling; multiphase designs; quality control of survey operations; and statistical software for survey sampling and estimation. An associated R package, PracTools, contains a number of specialized functions for sample size and other calculations. The data sets used in the book are also available in PracTools, so that the reader may replicate the examples or perform further analyses.

Practical Tools for Designing and Weighting Survey Samples

Practical Tools for Designing and Weighting Survey Samples PDF

Author: Richard Valliant

Publisher: Springer

Published: 2018-10-12

Total Pages: 776

ISBN-13: 3319936328

DOWNLOAD EBOOK →

The goal of this book is to put an array of tools at the fingertips of students, practitioners, and researchers by explaining approaches long used by survey statisticians, illustrating how existing software can be used to solve survey problems, and developing some specialized software where needed. This volume serves at least three audiences: (1) students of applied sampling techniques; 2) practicing survey statisticians applying concepts learned in theoretical or applied sampling courses; and (3) social scientists and other survey practitioners who design, select, and weight survey samples. The text thoroughly covers fundamental aspects of survey sampling, such as sample size calculation (with examples for both single- and multi-stage sample design) and weight computation, accompanied by software examples to facilitate implementation. Features include step-by-step instructions for calculating survey weights, extensive real-world examples and applications, and representative programming code in R, SAS, and other packages. Since the publication of the first edition in 2013, there have been important developments in making inferences from nonprobability samples, in address-based sampling (ABS), and in the application of machine learning techniques for survey estimation. New to this revised and expanded edition: • Details on new functions in the PracTools package • Additional machine learning methods to form weighting classes • New coverage of nonlinear optimization algorithms for sample allocation • Reflecting effects of multiple weighting steps (nonresponse and calibration) on standard errors • A new chapter on nonprobability sampling • Additional examples, exercises, and updated references throughout Richard Valliant, PhD, is Research Professor Emeritus at the Institute for Social Research at the University of Michigan and at the Joint Program in Survey Methodology at the University of Maryland. He is a Fellow of the American Statistical Association, an elected member of the International Statistical Institute, and has been an Associate Editor of the Journal of the American Statistical Association, Journal of Official Statistics, and Survey Methodology. Jill A. Dever, PhD, is Senior Research Statistician at RTI International in Washington, DC. She is a Fellow of the American Statistical Association, Associate Editor for Survey Methodology and the Journal of Official Statistics, and an Assistant Research Professor in the Joint Program in Survey Methodology at the University of Maryland. She has served on several panels for the National Academy of Sciences and as a task force member for the American Association of Public Opinion Research’s report on nonprobability sampling. Frauke Kreuter, PhD, is Professor and Director of the Joint Program in Survey Methodology at the University of Maryland, Professor of Statistics and Methodology at the University of Mannheim, and Head of the Statistical Methods Research Department at the Institute for Employment Research (IAB) in Nürnberg, Germany. She is a Fellow of the American Statistical Association and has been Associate Editor of the Journal of the Royal Statistical Society, Journal of Official Statistics, Sociological Methods and Research, Survey Research Methods, Public Opinion Quarterly, American Sociological Review, and the Stata Journal. She is founder of the International Program for Survey and Data Science and co-founder of the Coleridge Initiative.

Applied Survey Methods

Applied Survey Methods PDF

Author: Jelke Bethlehem

Publisher: John Wiley & Sons

Published: 2009-05-20

Total Pages: 394

ISBN-13: 0470494980

DOWNLOAD EBOOK →

A complete, hands-on guide to the use of statistical methods for obtaining reliable and practical survey research Applied Survey Methods provides a comprehensive outline of the complete survey process, from design to publication. Filling a gap in the current literature, this one-of-a-kind book describes both the theory and practical applications of survey research with an emphasis on the statistical aspects of survey methods. The book begins with a brief historic overview of survey research methods followed by a discussion that details the needed first steps for carrying out a survey, including the definition of a target population, the selection of a sampling frame, and the outline of a questionnaire with several examples that include common errors to avoid in the wording of questions. Throughout the book, the author provides an accessible discussion on the methodological problems that are associated with the survey process, outlining real data and examples while also providing insight on the future of survey research. Chapter coverage explores the various aspects of the survey process and the accompanying numerical techniques, including: Simple and composite sampling designs Estimators Data collection and editing The quality of results The non-response problem Weighting adjustments and methods Disclosure control The final chapter addresses the growing popularity of Web surveys, and the associated methodological problems are discussed, including solutions to common pitfalls. Exercises are provided throughout with selected answers included at the end of the book, while a related Web site features additional solutions to exercises and a downloadable demo version of the Blaise system of computer-assisted interviewing. Access to the freely available SimSam software is also available on the related Web site and provides readers with the tools needed to simulate samples from finite populations as well as visualize the effects of sample size, non-response, and the use of different estimation procedures. Applied Survey Methods is an excellent book for courses on survey research and non-response in surveys at the upper-undergraduate and graduate levels. It is also a useful reference for practicing statisticians and survey methodologists who work in both government and private research sectors.