Essay-Format Test Item Writing Procedure

DOE-HDBK-1204-97

10. ESSAY-FORMAT TEST ITEM WRITING PROCEDURE

The layout of the test item and the clarity of the wording are crucial for the trainee to

understand what is required when essay-format questions are used. Generally the words

"how" and "why" are the best, followed by "what" and "when," although the latter two can

more easily lead to a single word or very short answers.

Trainees find particular difficulty with interpretation of words such as "discuss," "compare,"

and "explain." The level of the answer expected is important in determining whether a more

specific statement is useful.

The test item developer should follow a systematic method such as the following:

Define the behavior the trainee is expected to exhibit or describe the process to

be exhibited before beginning to write the essay-format test item.

Allow adequate time for developing the test item, model answer, and grading

criteria. Essay-format test items usually require several revisions during the

development process. Consider stating the anticipated answering time for the

test item.

Referring to the learning objectives, select a topic from which the test item is

structured. Ask only for important relevant information.

Ensure the test item is within the educational maturity level of the trainees.

Determine the level of learning expected in response to a test item on this topic

from the learning objective. Use the words "discuss," "explain," or "compare"

only when deliberately aiming at higher cognitive levels.

Define the problem explicitly -- an essay-format test item is of no use if the

trainee cannot comprehend the test item. It must be open to only one

interpretation so all trainees address the same topic.

Ask test items that require the trainee to demonstrate the ability to use essential

knowledge and do so in situations that are new or novel for the trainee, rather

than simply recalling information.

Limit the problem -- the scope of a content area should not be too large.

Remember that trainees will take longer to answer the test item than the

developer.