The Test Validation & Analysis Program (TVAP) includes two Excel
Workbooks that are designed to be used by personnel professionals to
aid in developing and validating written tests that address
professional standards, the Uniform Guidelines on Employee Selection
Procedures (1978), and relevant court cases. The Workbooks include
macros, surveys, and formulas that address the standards applied in
Contreras v. City of Los Angeles (656 F.2d 1267. 9th Cir. 1981) and
U.S. v. South Carolina (434 US 1026, 1978). The Test Validation &
Analysis Program includes:
˙50-page Instruction Manual including directions, references,
appendices (including a Manual for writing better test items and
conducting effective Angoff Panels).
˙Test Item Survey that can be completed by subject-matter
gather validation evidence for written tests (14 questions are
that are designed to address testing standards, the Uniform
and concepts derived from test litigation).
˙Test Item Survey Workbook (Excel workbook with over 10
sheets) that can be used to input data from the Test Item Survey,
tabulate the results, and screen test items for addressing
test validation criteria.
˙Test Analysis Workbook which is used for inputting item
setting a "critical score," conducting rater reliability and rater
reliability analyses (and "outlier" raters), importing test score
conducting item analysis (including point-biserial, item
differential item functioning analyses to analyze test item bias),
test-level analyses (including Cronbach's Alpha, Kuder Richardson
KR-21 reliability, mean, standard deviation, classical standard
measurement, and conditional standard error of measurement),
a modified Angoff cutoff score using the procedure followed in the
U.S. v. South Carolina case, and analyzing the cutoffs for adverse
impact using the Fisher Exact (with mid-P correction) statistic and
practical significance tests.