Test Construction

DOE-HDBK-1205-97

Table 1 further shows that Objectives I.3, II.2, and II.4 do not appear in this test. This is

because they were covered in previous tests, will be covered in later tests, or can be tested

in conjunction with other objectives. All learning objectives must be tested at some point

during the training (but not necessarily on the final examination) or consideration should be

given to their importance to the overall objective of the specific subject area. That is, if it is

not considered important enough to be tested, it most likely is not important enough to be

included in the training program.

The completed test specifications (test outline or sample plan) provide the test developer

with a list of learning objectives upon which to base test questions.

4.3 Test Construction

The actual test is constructed following test design and test item development. Test

construction requires the test developer to establish the test layout, assemble the test

items, prepare the answer key, and write test directions. Test construction must be

completed before implementing the training program.

Test developers should construct tests to some predetermined standardized appearance.

The layout and source for this appearance is not as important as maintaining consistency

for all of the facility's tests. This consistency of appearance has several advantages. One

advantage is minimizing trainee stress by providing a layout trainees are familiar with; test

day is an inappropriate time for introduction of a new test format or layout. Another

advantage is improved reliability. Inherent reliability is based on the consistency or

dependability of test results. Trainees should be tested in a similar manner from test to

test. This involves similar test lengths, consistent grading and scoring, use of the same

construction guidelines, consistent coverage of topics, familiar test item formats, etc.

Facilities should have procedures in place that establish the format and layout of their

training program tests. Tests are assembled using the following general guidelines.

Select the appropriate test items based on the test specifications.

Prepare the test key when the test is constructed.