Questionnaire Format cont'd

DOE-HDBK-1078-94

Questionnaires distributed without addressing these topics usually have very

poor results. Questionnaires can also be completed in an interview. If

interviews are used they should be held in a controlled environment, free of

noise or disruption. Responses should be recorded. The following guidance

may be used when developing a questionnaire.

Define the purpose of the questionnaire. This can be done by asking the

following questions: "What do we want to find out?", "Why do we want

to find that out?", "When do we need the information?", "How can we

best get the information we need?", "Where should we gather

information?", and "Who is the information for and from whom should

we collect the information?"

Select evaluation questions to be used in the questionnaire. There are

generally three sources for these questions. These include managers and

users of the information to be collected; previously collected data,

interviews, and fieldwork with people in the environment; and other

questionnaires that have been used for similar purposes.

Determine the types of questions required. Generally, three types are

used.

Performance Questions - This type of question usually asks

what has actually been performed. These questions are aimed at

descriptions of actual experiences, activities, or actions and

corresponding performance that would have been observable had

the evaluator been present to observe the actions;

Opinion Questions - This type of question can help identify

problem causes and suggest possible solutions. These questions

are aimed at finding out what people think about something.

Opinion questions reflect people's goals, intentions, desires, and

values; and

Knowledge Questions - These questions assess what factual

information the person has. The assumption is that certain facts

are prerequisites for effective performance.

Focus each question on a specific point. Provide cues or a point of

reference to help the respondent. For example, "What problems have

you had in calibrating the transmitter since you were trained?", or "Based

on what you know about the new modification procedures, what should

be changed in this course?", or "In your opinion, should the fundamentals

section of operator training be resequenced in the course?"