The subject component(s) or system(s) may have to be configured to comply
with the evaluation instrument (a JPM or equivalent), and necessitate
obtaining permission to change component or system status.
The operational evaluation is used to verify that a trainee has gained the skill and
knowledge to safely operate the components or systems that are related to the position or
the job. The operational evaluation is usually performed at the end of qualification. The
preparations are similar to the performance demonstration except that all tasks that are
performed for the particular qualification are subject to examination. Operational
evaluations should include a representative sampling of critical tasks that cover the range
of duties applicable to the job.
Qualifications to Conduct
The facility should develop a procedure that specifies the requirements for qualification as
an examiner of performance demonstrations or operational evaluations. The basic
qualification requirements should be similar. However, the operational evaluation is a
broad-based examination and requires knowledge of all components, systems, and system
interrelationships in the area of the trainee's qualification.
The process for conducting these examinations is contained in the DOE Guide to Good
Practices for On-the-Job Training. The performance demonstrations are conducted based
on the requirements of the qualification standard. For each task the evaluation instrument
should specify the method of performance/accomplishment as: "P" (perform), "S"
(simulate), "O" (observe and discuss), or "D" (discuss).
The operational evaluation should be conducted in accordance with the facility procedure.
The operational evaluation is conducted as a walkthrough with the trainee performing tasks
chosen by the evaluator. An operational evaluation may be performed by using several
JPMs (or equivalent) that represent a cross-section of qualification requirements.
Questions to be asked during the operational evaluation should be developed in advance.