Development of Written Test Items

DOE-HDBK-1204-97

3. DEVELOPMENT OF WRITTEN TEST ITEMS

Guidance on the construction of each test item format is provided in the following chapters.

However, there are basic principles that apply across all test item formats.

Ensure that the concept is relevant to the ability to perform the job

State the test item concisely

Choose the higher cognitive level

Make sure the test item matches the learning objective

Omit unnecessarily difficult or irrelevant test items

Limit the test item to only one concept or topic

Avoid copying text directly from reference materials

Avoid backwards logic test items

Place the easier test items at the beginning of each section

The test item should discriminate between those who have mastered the

objective and those who have not.

Ensure that the concept being measured has a direct relationship to the ability to perform

the job. The construction of the test item should clearly reflect the enabling objective. Word

the test item so that it would be considered valid and reasonable to other SMEs using the

same reference materials.

State the test item as concisely as possible, but provide all necessary information. The test

item should be clear, grammatically correct, and free of clues to the correct answer. It

should be written at a reading level appropriate for the trainee. Often the individuals who

develop a test item assume that certain conditions are inherent in the question when, in fact,

they are not. It is important to have others review your test items to ensure that all

necessary information is included, and that all excess information is deleted. You should

ask yourself: Will the trainees clearly know what they are expected to do? Do they have all

the information they need to answer the test item? Does answering the test item depend on

certain assumptions that must be stated?

When there is a choice between two cognitive levels, write your test item to reflect the

higher level. Learning objectives and test items should be written to reflect the level of