Iteman™ 4 is
a software program designed to provide detailed item
and test analysis reports using classical test
theory (CTT). The purpose of these reports is to
help testing programs evaluate the quality of test
items, and tests as a whole, by examining their
psychometric characteristics. Output is RTF format,
allowing you to type/paste in item texts and
comments and deliver a comprehensive report to
stakeholders or content experts.
Iteman™ 4 (currently version 4.2) is distinguished by its user-friendly interface that makes it easy to run the program, even if you are not an expert in psychometrics. Teachers, school administrators, certification managers, training coordinators, and instructional designers can all use Iteman™ 4 to produce professional psychometric reports. A number of large testing companies use Iteman™ 4 to produce reports for clients, charging up to $4,000 each time - you can now produce these reports yourself for a fraction of the cost! Click here to see an example report as a PDF.
Output is full-featured reports in Word, not ASCII or many separate images you have to cut and paste
Extensive graphics: quantile plots for each item, SEM, frequency distributions, bivariate plots
Differential item functioning (DIF)
Multiple reliability indices
Mastery analysis: SEM at cutpoint, classification consistency
Ideal for NCCA reports
The most complete item analysis system available
What's New in Iteman™ 4
The most important advantage is the addition of graphics. It is now possible to produce an item quantile plot for each item.
Iteman™ 4 is able to handle pretest (trial or unscored) items, items that are not included in the final score but where statistics are still desired.
More statistics are calculated, including the alpha (KR-20) reliability coefficient with each item deleted, and subgroup P (proportion correct) statistics.
Instead of simple ASCII text files, the output is now rich text file (RTF) format laid out as a formal report, and also in a comma-separated value (CSV) format that is able to be manipulated (sorted, highlighted, etc.) in spreadsheet software. It additionally produces a CSV file of examinee scores and subscores.
Scaled scoring can be applied, so that Iteman 4 can be used to score sets of examinees in more testing programs and provide scores on any linearly transformed scale.
Items can be analyzed relative to an external score rather than the total score on a test.
The maximum number of items that can be analyzed has been increased to 10,000, with no limit on the number of examinees.
A “batch” type of capability, using a “multiple runs file” has been added to allow you to run multiple data sets without having to use the graphic user interface for each run.
Iteman 4 can analyze both dichotomous (correct/incorrect) and polytomous (ratign scale or partial credit) data, including tests that are a mix of both item types.