Multiple-Choice Test Item Writing Procedure cont'd

DOE-HDBK-1204-97

Negative stems should be avoided because they are unnecessarily difficult to interpret.

Negatively stated stems can also lead to double negatives. It is more important to test what

something is than what it is not. If a negative stem is necessary, highlight the negative word

(e.g., not, never, least).

It is very tempting to write negatively stated test items, since they can be constructed by

picking three true statements out of the reference material and changing a fourth statement

to make it false. However, studies have shown that trainees do not do as well on negatively

stated test items, either because they overlook the negative word or because negatively

stated test items require trainees to pick an answer or characteristic that is not true, which

can be somewhat confusing. In addition, these test items tend to emphasize negative

learning. For example, consider the following stem of a multiple-choice test item:

Test item:

During 100% power operation, the feedwater dump valve opens inadvertently.

The condensate pumps will not do which of the following?

This stem can be made to read positively as follows:

Test item:

During 100% power operation, the feedwater dump valve opens inadvertently.

The condensate pumps will:

(a)

Increase flow to maintain feedwater flow rate.

(b)

Trip due to a runout condition.

(c)

Have no response.

(d)

Trip due to low suction pressure.