Table 1 further shows that Objectives I.3, II.2, and II.4 do not appear in this test. This is
because they were covered in previous tests, will be covered in later tests, or can be tested
in conjunction with other objectives. All learning objectives must be tested at some point
during the training (but not necessarily on the final examination) or consideration should be
given to their importance to the overall objective of the specific subject area. That is, if it is
not considered important enough to be tested, it most likely is not important enough to be
included in the training program.
The completed test specifications (test outline or sample plan) provide the test developer
with a list of learning objectives upon which to base test questions.
4.3 Test Construction
The actual test is constructed following test design and test item development. Test
construction requires the test developer to establish the test layout, assemble the test
items, prepare the answer key, and write test directions. Test construction must be
completed before implementing the training program.
Test developers should construct tests to some predetermined standardized appearance.
The layout and source for this appearance is not as important as maintaining consistency
for all of the facility's tests. This consistency of appearance has several advantages. One
advantage is minimizing trainee stress by providing a layout trainees are familiar with; test
day is an inappropriate time for introduction of a new test format or layout. Another
advantage is improved reliability. Inherent reliability is based on the consistency or
dependability of test results. Trainees should be tested in a similar manner from test to
test. This involves similar test lengths, consistent grading and scoring, use of the same
construction guidelines, consistent coverage of topics, familiar test item formats, etc.
Facilities should have procedures in place that establish the format and layout of their
training program tests. Tests are assembled using the following general guidelines.
Select the appropriate test items based on the test specifications.
Prepare the test key when the test is constructed.