Essay-Format Test Item Writing Procedure cont'd

DOE-HDBK-1204-97

Word the test item so the trainees know the limits of the tasks, their purposes,

and can answer them in the time allotted.

Ask questions that are relatively specific or focused, and which require relatively

brief responses.

If additional guidance for a particular test item is necessary beyond that shown

in the general instruction, make a clear and concise statement.

The subject matter experts should also agree on the relevance or importance of

a particular test item to course completion, as well as the correct response.

Develop the test item grading criteria. Identify the key responses expected from

the trainee. Identify each necessary response (e.g., by underlining key words,

phrases, or steps, or by circling important parts of graphs or diagrams).

Determine the percentage value to be allocated for each test item subpart

(based on their relative importance).

Check the test item against the grading criteria:

Does the test item clearly request what is considered important in the

grading criteria?

Is the time necessary to answer the test item proportional to the

importance of the test time? (Critical objectives justify more time if

required.)

Do trivial details (e.g., an extended calculation) take too much time to

address?

How could the test item and/or the grading criteria be revised to be more

consistent?

Ensure that the sequence of requirements is in a logical order.

Ensure that all the data (stimulus material) needed by the trainee is provided

and clearly displayed together.

Avoid test items that can be answered by a single word or short phrase.

Avoid negative statements in test items; they may lead to double negatives that

are difficult to interpret.

State clearly whether exact answers or estimates (precise figures or sketches)

are required.

Ensure that the point value for each test item or part of a test item is stated.

Write the test item on a form such as that shown in Appendix A -- Test Item

Development Form.