Guidelines for Evaluating, Implementing, and/or Comparing Prioritization Systems

DOE-DP-STD-3023-98

8.4 Acceptability. The RBP system should be able to function within existing institutions,

operations, and processes. Of particular importance is whether the system is consistent with

the attitudes and perceptions of decision makers and stakeholders as interested or affected

parties and that it is clear and understandable to the users and stakeholders.

8.5 Practicality. The RBP system should be employed in a pragmatic, decision-making

environment. Important considerations include the level of expertise required to develop and

use the system, the availability and quality of data needed as system inputs, the personnel

needed, and the time and costs involved in applying the system. The RBP system should

demonstrate the usefulness of the system in action, rather than its theoretical elegance or

rigor.

8.6 Effectiveness. The RBP system should be able to produce results useful for decision

making. The key consideration is whether the results support discrimination among potential

alternatives. Other considerations include whether the results support important tasks or

decisions, the scope of applicability, whether insights and conclusions may be generalized to

other problem areas, and whether the RBP system complements related systems (i.e.,

Activity Data Sheets, Construction Project Data Sheets, Working Capital Fund, and the

Strategic Management System) employed by the user.

8.7 Defensibility. The purposes, inputs, design, assumptions, models, and outputs of an

RBP system should be consistent with formal theory and be readily documented and available

for review.

8.8 Quantification of Cost and Benefits. Presentation of monetized benefits and costs is

preferred where acceptable estimates are possible. When monetized, benefits and costs

should be expressed in discounted constant (i.e., not inflated) dollars. Reference (k) provides

additional information on monetization. Where monetization is not possible for certain

elements of the benefits or costs that are essential to consider, other quantitative and

qualitative characterizations of these elements should be provided.

9. GUIDELINES FOR EVALUATING, IMPLEMENTING, AND/OR COMPARING

PRIORITIZATION SYSTEMS

The guidelines described in this section provide additional detail to judge whether an RBP system

meets the specific characteristics described in section 8. In addition, this section provides further

detail on issues that should be considered when developing, implementing, or comparing RBP

systems.

The guidelines provided in this section are grouped according to the characteristic with which

they are most strongly associated. The guidelines may apply to more than one characteristic; this

should be kept in mind during the actual use of the information presented here.

9.1 Guidelines Primarily Associated with Logical Soundness.

9.1.1

Guideline 1.1-- Verify Decision Objectives. To the maximum extent practical, the set

of decision objectives should be:

a. comprehensive,

b. relevant,

c. mutually exclusive,

d. independent, and

e. minimal in number.