Content Validity

DOE-HDBK-1205-97

Ensuring that learning objectives for both knowledge and skills are based on task

requirements

Identifying type of performance dictated by objectives (cognitive, psychomotor,

affective)

Ensuring action verbs used in objectives measure what they were intended to

measure

Designing test specifications to ensure that objectives are covered adequately

Discussing the test with SMEs, supervisors, and training specialists

Piloting the test or sample test items with SMEs and trainees

Comparing test results to actual job performance

Ensuring that the test and test items are changed to be consistent with revised

job requirements

Content Validity

Content validity is the simplest method to assess whether a test is valid. Establish content

validity by comparing the test items to the learning objectives. No statistical calculations are

used to establish content validity. If subject matter experts agree that the test items

measure their respective learning objectives, the test can be considered valid. The

usefulness of content validity is subject to the quality of the analysis and the subsequent

learning objectives as well as the thoroughness of the SME review of the test items.

Concurrent Validity

Concurrent validity of a test is when one test compares favorably with another, already

validated test. If there is already a valid measure (i.e., nationally recognized entrance exam)

of what is to be tested, determine the degree of association between the results of the

preestablished test and the test to be validated. To the extent that they are related, there is

an established level of concurrent validity. A statistical analysis is required to establish a

level of concurrent validity. Information on statistical analysis to determine concurrent

validity can be found in several commercially available textbooks on statistics.