Validation of Measures Designed to Maximize 21st-Century Army NCO Performance

Validation of Measures Designed to Maximize 21st-Century Army NCO Performance PDF

Author:

Publisher:

Published: 2004

Total Pages: 223

ISBN-13:

DOWNLOAD EBOOK →

The NCO21 research program was undertaken to help the U.S. Army plan for the impact of future demands on the noncommissioned officer (NCO) corps. The performance requirements and associated knowledges, skills, and aptitudes (KSAs) expected of future successful NCOs were used as a basis for developing tools that could be incorporated into an NCO performance management system geared to 21st-century job demands. This report documents the concurrent criterion-related validation of the predictor measures. The predictor measures include the Armed Services Vocational Aptitude Battery (ASVAB), Assessment of Individual Motivation (AIM), and Biographical Information Questionnaire (BIQ), which are already used in the Army for other purposes. A written Situational Judgment Test (SJT), the Experience and Activities Record (ExAct), Personnel File Form (PFF21), and a semi-structured interview were developed for this project. Two types of rating scale instruments were developed for gathering criterion data. The Observed Performance Rating Scales ask supervisors to rate how well Soldiers perform in their current jobs and the Expected Future Performance Rating Scales have them predict how their Soldiers would perform in future conditions. All of the predictors yielded one or more scores that were significantly correlated with the performance ratings. The SJT, interview, and some scores from the AIM and BIQ showed the most incremental validity over the current system. In this concurrent validation, the predictors were more highly correlated with performance at the ES level compared to the E6 level.

Validation of Measures Designed to Maximize 21st-Century Army NCO Performance

Validation of Measures Designed to Maximize 21st-Century Army NCO Performance PDF

Author: Deirdre J. Knapp

Publisher:

Published: 2004-05-01

Total Pages: 223

ISBN-13: 9781423516446

DOWNLOAD EBOOK →

The NCO21 research program was undertaken to help the U.S. Army plan for the impact of future demands on the noncommissioned officer (NCO) corps. The performance requirements and associated knowledges, skills, and aptitudes (KSAs) expected of future successful NCOs were used as a basis for developing tools that could be incorporated into an NCO performance management system geared to 21st-century job demands. This report documents the concurrent criterion-related validation of the predictor measures. The predictor measures include the Armed Services Vocational Aptitude Battery (ASVAB), Assessment of Individual Motivation (AIM), and Biographical Information Questionnaire (BIQ), which are already used in the Army for other purposes. A written Situational Judgment Test (SJT), the Experience and Activities Record (ExAct), Personnel File Form (PFF21) , and a semi-structured interview were developed for this project. Two types of rating scale instruments were developed for gathering criterion data. The Observed Performance Rating Scales ask supervisors to rate how well Soldiers perform in their current jobs and the Expected Future Performance Rating Scales have them predict how their Soldiers would perform in future conditions. All of the predictors yielded one or more scores that were significantly correlated with the performance ratings. The SJT, interview, and some scores from the AIM and BIQ showed the most incremental validity over the current system. In this concurrent validation, the predictors were more highly correlated with performance at the ES level compared to the E6 level.

Validation of Measures Designed to Maximize 21st-century Army NCO Performance

Validation of Measures Designed to Maximize 21st-century Army NCO Performance PDF

Author: Deirdre J. Knapp

Publisher:

Published: 2004

Total Pages: 238

ISBN-13:

DOWNLOAD EBOOK →

"The NCO21 research program was undertaken to help the U.S. Army plan for the impact of future demands on the noncommissioned officer (NCO) corps. The performance requirements and associated knowledges, skills, and aptitudes (KSAs) expected of future successful NCOs were used as a basis for developing tools that could be incorporated into an NCO performance management system geared to 21st-century job demands. This report documents the concurrent criterion-related validation of the predictor measures. The predictor measures include the Armed Services Vocational Aptitude Battery (ASVAB), Assessment of Individual Motivation (AIM), and Biographical Information Questionnaire (BIQ), which are already used in the Army for other purposes. A written Situational Judgment Test (SJT), the Experience and Activities Record (ExAct), Personnel File Form (PFF21), and a semi-structured interview were developed for this project. Two types of rating scale instruments were developed for gathering criterion data. The Observed Performance Rating Scales ask supervisors to rate how well Soldiers perform in their current jobs and the Expected Future Performance Rating Scales have them predict how their Soldiers would perform in future conditions. All of the predictors yielded one or more scores that were significantly correlated with the performance ratings. The SJT, interview, and some scores from the AIM and BIQ showed the most incremental validity over the current system. In this concurrent validation, the predictors were more highly correlated with performance at the ES level compared to the E6 level."--DTIC.

Validating Future Force Performance Measures (Army Class)

Validating Future Force Performance Measures (Army Class) PDF

Author: Karen O. Moriarty

Publisher:

Published: 2009

Total Pages: 146

ISBN-13:

DOWNLOAD EBOOK →

To meet the challenges facing the Army, the Army needs predictor measures that will enhance entry-level Soldier selection and classification. One of the purposes of the Army Research Institute for Behavioral and Social Sciences (ARI's) Army Class project is to provide the Army with recommendations on which predictor measures, in particular measures of non-cognitive attributes (e.g., interests, values, and temperament), demonstrate the greatest potential to inform entry-level Soldier selection and classification decisions. The present report documents the development of criterion measures to assist in these analyses. A second purpose of the Army Class project is to develop and pilot job knowledge tests (JKTs) that can be used to aid reclassification decisions. If Soldiers are shown to possess critical knowledge, skills, and attributes (KSAs) for their new jobs, this could reduce training requirements and increase force readiness. This report documents the development of reclassification JKT test items.

Validating Future Force Performance Measures (Army Class)

Validating Future Force Performance Measures (Army Class) PDF

Author:

Publisher:

Published: 2009

Total Pages: 92

ISBN-13:

DOWNLOAD EBOOK →

The Army needs the best personnel to meet the emerging demands of the 21st century. Accordingly, the Army is seeking recommendations on new experimental predictor measures that could enhance entry-level Soldier selection and classification decisions, in particular, measures of non-cognitive attributes (e.g., interests, values, temperament). The U.S. Army Research Institute for the Behavioral and Social Sciences (ARI) is conducting a longitudinal criterion-related validation research effort to collect data to inform these recommendations. Data on experimental predictors were collected from about 11,000 Soldiers. Training criterion data were collected for differing subsets of the predictor sample in the first of three planned criterion measurement points. Soldiers were drawn from two samples: (a) job-specific samples targeting six entry-level Military Occupational Specialties (MOS) and (b) an Army-wide sample with no MOS-specific requirements. In the analyses reported here, the value of the experimental predictor measures to enhance new Soldier selection was examined. Overall, many of the experimental predictors significantly incremented the Armed Forces Qualification Test (AFQT) in predicting Soldier performance and retention during training. In addition, the experimental predictors generally exhibited smaller subgroup mean differences (by gender, race, and ethnicity) than the AFQT.

Performance Measurement

Performance Measurement PDF

Author: Winston Bennett

Publisher: Psychology Press

Published: 2014-02-04

Total Pages: 436

ISBN-13: 1317824539

DOWNLOAD EBOOK →

Over the course of the past few years, teaching, research, and practice has underscored the importance of performance measurement and criterion development as topics of great interest, considerable debate, and some misunderstanding. It has also become clear that the field needs to address a compendium of research, applications, and issues. Performance Measurement: Current Perspectives and Future Challenges brings together internationally recognized leaders in the field and each examines the subject matter in a way that has never been done--focusing on the dynamic nature of work and the tremendous demands being placed on assessment and measurement as core organizational activities. It also uniquely uses their expertise to provide critical pointers to not only the practical implications of work in the field, but also to the new and continuing issues to be addressed and research to be conducted. The book will be useful to both scientists and practitioners.