Log-Linear Models, Extensions, and Applications

Log-Linear Models, Extensions, and Applications PDF

Author: Aleksandr Aravkin

Publisher: MIT Press

Published: 2018-12-25

Total Pages: 215

ISBN-13: 0262351617

DOWNLOAD EBOOK →

Advances in training models with log-linear structures, with topics including variable selection, the geometry of neural nets, and applications. Log-linear models play a key role in modern big data and machine learning applications. From simple binary classification models through partition functions, conditional random fields, and neural nets, log-linear structure is closely related to performance in certain applications and influences fitting techniques used to train models. This volume covers recent advances in training models with log-linear structures, covering the underlying geometry, optimization techniques, and multiple applications. The first chapter shows readers the inner workings of machine learning, providing insights into the geometry of log-linear and neural net models. The other chapters range from introductory material to optimization techniques to involved use cases. The book, which grew out of a NIPS workshop, is suitable for graduate students doing research in machine learning, in particular deep learning, variable selection, and applications to speech recognition. The contributors come from academia and industry, allowing readers to view the field from both perspectives. Contributors Aleksandr Aravkin, Avishy Carmi, Guillermo A. Cecchi, Anna Choromanska, Li Deng, Xinwei Deng, Jean Honorio, Tony Jebara, Huijing Jiang, Dimitri Kanevsky, Brian Kingsbury, Fabrice Lambert, Aurélie C. Lozano, Daniel Moskovich, Yuriy S. Polyakov, Bhuvana Ramabhadran, Irina Rish, Dimitris Samaras, Tara N. Sainath, Hagen Soltau, Serge F. Timashev, Ewout van den Berg

Log-Linear Models and Logistic Regression

Log-Linear Models and Logistic Regression PDF

Author: Ronald Christensen

Publisher: Springer Science & Business Media

Published: 2006-04-06

Total Pages: 498

ISBN-13: 0387226249

DOWNLOAD EBOOK →

The primary focus here is on log-linear models for contingency tables, but in this second edition, greater emphasis has been placed on logistic regression. The book explores topics such as logistic discrimination and generalised linear models, and builds upon the relationships between these basic models for continuous data and the analogous log-linear and logistic regression models for discrete data. It also carefully examines the differences in model interpretations and evaluations that occur due to the discrete nature of the data. Sample commands are given for analyses in SAS, BMFP, and GLIM, while numerous data sets from fields as diverse as engineering, education, sociology, and medicine are used to illustrate procedures and provide exercises. Throughoutthe book, the treatment is designed for students with prior knowledge of analysis of variance and regression.

Generalized Linear Models and Extensions, Second Edition

Generalized Linear Models and Extensions, Second Edition PDF

Author: James W. Hardin

Publisher: Stata Press

Published: 2007

Total Pages: 413

ISBN-13: 1597180149

DOWNLOAD EBOOK →

Deftly balancing theory and application, this book stands out in its coverage of the derivation of the GLM families and their foremost links. This edition has new sections on discrete response models, including zero-truncated, zero-inflated, censored, and hurdle count models, as well as heterogeneous negative binomial, and more.

Regression Analysis and Linear Models

Regression Analysis and Linear Models PDF

Author: Richard B. Darlington

Publisher: Guilford Publications

Published: 2016-08-22

Total Pages: 689

ISBN-13: 1462527981

DOWNLOAD EBOOK →

Emphasizing conceptual understanding over mathematics, this user-friendly text introduces linear regression analysis to students and researchers across the social, behavioral, consumer, and health sciences. Coverage includes model construction and estimation, quantification and measurement of multivariate and partial associations, statistical control, group comparisons, moderation analysis, mediation and path analysis, and regression diagnostics, among other important topics. Engaging worked-through examples demonstrate each technique, accompanied by helpful advice and cautions. The use of SPSS, SAS, and STATA is emphasized, with an appendix on regression analysis using R. The companion website (www.afhayes.com) provides datasets for the book's examples as well as the RLM macro for SPSS and SAS. Pedagogical Features: *Chapters include SPSS, SAS, or STATA code pertinent to the analyses described, with each distinctively formatted for easy identification. *An appendix documents the RLM macro, which facilitates computations for estimating and probing interactions, dominance analysis, heteroscedasticity-consistent standard errors, and linear spline regression, among other analyses. *Students are guided to practice what they learn in each chapter using datasets provided online. *Addresses topics not usually covered, such as ways to measure a variable’s importance, coding systems for representing categorical variables, causation, and myths about testing interaction.

Log-Linear Models

Log-Linear Models PDF

Author: Ronald Christensen

Publisher:

Published: 1990

Total Pages: 0

ISBN-13: 9781475741131

DOWNLOAD EBOOK →

This book examines log-linear models for contingency tables. It uses previous knowledge of analysis of variance and regression to motivate and explicate the use of log-linear models. It is a textbook primarily directed at advanced Masters degree students in statistics but can be used at both higher and lower levels. Outlines for introductory, intermediate and advanced courses are given in the preface. All the fundamental statistics for analyzing data using log-linear models is given.

Foundations of Linear and Generalized Linear Models

Foundations of Linear and Generalized Linear Models PDF

Author: Alan Agresti

Publisher: John Wiley & Sons

Published: 2015-02-23

Total Pages: 471

ISBN-13: 1118730038

DOWNLOAD EBOOK →

A valuable overview of the most important ideas and results in statistical modeling Written by a highly-experienced author, Foundations of Linear and Generalized Linear Models is a clear and comprehensive guide to the key concepts and results of linearstatistical models. The book presents a broad, in-depth overview of the most commonly usedstatistical models by discussing the theory underlying the models, R software applications,and examples with crafted models to elucidate key ideas and promote practical modelbuilding. The book begins by illustrating the fundamentals of linear models, such as how the model-fitting projects the data onto a model vector subspace and how orthogonal decompositions of the data yield information about the effects of explanatory variables. Subsequently, the book covers the most popular generalized linear models, which include binomial and multinomial logistic regression for categorical data, and Poisson and negative binomial loglinear models for count data. Focusing on the theoretical underpinnings of these models, Foundations ofLinear and Generalized Linear Models also features: An introduction to quasi-likelihood methods that require weaker distributional assumptions, such as generalized estimating equation methods An overview of linear mixed models and generalized linear mixed models with random effects for clustered correlated data, Bayesian modeling, and extensions to handle problematic cases such as high dimensional problems Numerous examples that use R software for all text data analyses More than 400 exercises for readers to practice and extend the theory, methods, and data analysis A supplementary website with datasets for the examples and exercises An invaluable textbook for upper-undergraduate and graduate-level students in statistics and biostatistics courses, Foundations of Linear and Generalized Linear Models is also an excellent reference for practicing statisticians and biostatisticians, as well as anyone who is interested in learning about the most important statistical models for analyzing data.

Statistical Regression and Classification

Statistical Regression and Classification PDF

Author: Norman Matloff

Publisher: CRC Press

Published: 2017-09-19

Total Pages: 516

ISBN-13: 1351645897

DOWNLOAD EBOOK →

Statistical Regression and Classification: From Linear Models to Machine Learning takes an innovative look at the traditional statistical regression course, presenting a contemporary treatment in line with today's applications and users. The text takes a modern look at regression: * A thorough treatment of classical linear and generalized linear models, supplemented with introductory material on machine learning methods. * Since classification is the focus of many contemporary applications, the book covers this topic in detail, especially the multiclass case. * In view of the voluminous nature of many modern datasets, there is a chapter on Big Data. * Has special Mathematical and Computational Complements sections at ends of chapters, and exercises are partitioned into Data, Math and Complements problems. * Instructors can tailor coverage for specific audiences such as majors in Statistics, Computer Science, or Economics. * More than 75 examples using real data. The book treats classical regression methods in an innovative, contemporary manner. Though some statistical learning methods are introduced, the primary methodology used is linear and generalized linear parametric models, covering both the Description and Prediction goals of regression methods. The author is just as interested in Description applications of regression, such as measuring the gender wage gap in Silicon Valley, as in forecasting tomorrow's demand for bike rentals. An entire chapter is devoted to measuring such effects, including discussion of Simpson's Paradox, multiple inference, and causation issues. Similarly, there is an entire chapter of parametric model fit, making use of both residual analysis and assessment via nonparametric analysis. Norman Matloff is a professor of computer science at the University of California, Davis, and was a founder of the Statistics Department at that institution. His current research focus is on recommender systems, and applications of regression methods to small area estimation and bias reduction in observational studies. He is on the editorial boards of the Journal of Statistical Computation and the R Journal. An award-winning teacher, he is the author of The Art of R Programming and Parallel Computation in Data Science: With Examples in R, C++ and CUDA.

Interpretable Machine Learning

Interpretable Machine Learning PDF

Author: Christoph Molnar

Publisher: Lulu.com

Published: 2020

Total Pages: 320

ISBN-13: 0244768528

DOWNLOAD EBOOK →

This book is about making machine learning models and their decisions interpretable. After exploring the concepts of interpretability, you will learn about simple, interpretable models such as decision trees, decision rules and linear regression. Later chapters focus on general model-agnostic methods for interpreting black box models like feature importance and accumulated local effects and explaining individual predictions with Shapley values and LIME. All interpretation methods are explained in depth and discussed critically. How do they work under the hood? What are their strengths and weaknesses? How can their outputs be interpreted? This book will enable you to select and correctly apply the interpretation method that is most suitable for your machine learning project.

Log-Linear Models for Event Histories

Log-Linear Models for Event Histories PDF

Author: Jeroen K. Vermunt

Publisher: SAGE Publications, Incorporated

Published: 1997-05-13

Total Pages: 368

ISBN-13:

DOWNLOAD EBOOK →

Event history analysisùa method for explaining why some people are more likely to experience a particular event, transition, or change than other peopleùhas been useful in the social sciences for studying the processes of social change. One of the main difficulties, however, in using this technique is that often information is (partially) missing on some of the relevant variables. Author Jeroen K. Vermunt presents a general approach to these missing data problems in event history analysis that is based on the similarities between log-linear, hazard, and event history models. The book begins with a discussion of log-linear, log-rate, and modified path models and methods for obtaining maximum likelihood estimates of the parameters of these models. Vermunt then shows how to incorporate variables with missing information in log-linear models for non-response. In addition, he covers such topics as the main types of hazard models; censoring; the use of time-varying covariates; models for competing risks; multivariate hazard models; and a general approach for dealing with missing data problems, including unobserved heterogeneity, measurement error in the dependent variable, measurement error in the covariate, partially missing information on the dependent variable, and partially observed covariate values.

Linear Models in Statistics

Linear Models in Statistics PDF

Author: Alvin C. Rencher

Publisher: John Wiley & Sons

Published: 2008-01-07

Total Pages: 690

ISBN-13: 0470192607

DOWNLOAD EBOOK →

The essential introduction to the theory and application of linear models—now in a valuable new edition Since most advanced statistical tools are generalizations of the linear model, it is neces-sary to first master the linear model in order to move forward to more advanced concepts. The linear model remains the main tool of the applied statistician and is central to the training of any statistician regardless of whether the focus is applied or theoretical. This completely revised and updated new edition successfully develops the basic theory of linear models for regression, analysis of variance, analysis of covariance, and linear mixed models. Recent advances in the methodology related to linear mixed models, generalized linear models, and the Bayesian linear model are also addressed. Linear Models in Statistics, Second Edition includes full coverage of advanced topics, such as mixed and generalized linear models, Bayesian linear models, two-way models with empty cells, geometry of least squares, vector-matrix calculus, simultaneous inference, and logistic and nonlinear regression. Algebraic, geometrical, frequentist, and Bayesian approaches to both the inference of linear models and the analysis of variance are also illustrated. Through the expansion of relevant material and the inclusion of the latest technological developments in the field, this book provides readers with the theoretical foundation to correctly interpret computer software output as well as effectively use, customize, and understand linear models. This modern Second Edition features: New chapters on Bayesian linear models as well as random and mixed linear models Expanded discussion of two-way models with empty cells Additional sections on the geometry of least squares Updated coverage of simultaneous inference The book is complemented with easy-to-read proofs, real data sets, and an extensive bibliography. A thorough review of the requisite matrix algebra has been addedfor transitional purposes, and numerous theoretical and applied problems have been incorporated with selected answers provided at the end of the book. A related Web site includes additional data sets and SAS® code for all numerical examples. Linear Model in Statistics, Second Edition is a must-have book for courses in statistics, biostatistics, and mathematics at the upper-undergraduate and graduate levels. It is also an invaluable reference for researchers who need to gain a better understanding of regression and analysis of variance.