Decision-making paradox

The decision-making paradox relates to decision-making and it was first identified by Triantaphyllou and Mann in 1989.[1] It was further elaborated in the book by Triantaphyllou on multi-criteria decision-making.[2] Since then it has been recognized in the related literature as a fundamental paradox in multi-criteria decision analysis (MCDA) / multi-criteria decision making (MCDM), and decision analysis, in general.[3][4][5][6][7][8] This paradox is related to the quest for determining reliable decision-making methods.

Description of the paradox

The realization for this paradox comes from the rather straightforward observation that there are numerous decision-making methods (both normative and descriptive) each one of which claims to be the "best" one. Furthermore, often these methods may yield different results when they are fed with exactly the same decision problem and data.

Finding the best decision-making method leads to the formulation of a decision problem itself for which the alternatives are the decision making methods themselves. Naturally, one needs to know the best method a-priori in order to select the best method from the available ones.

In the study reported in [1] and [2] an interesting investigation was undertaken. Since in the beginning it was assumed that the best method is not known, the problem of selecting the best method was solved by successively using different methods. The methods used in that study were the weighted sum model (WSM), the weighted product model (WPM), and two variants of the analytic hierarchy process (AHP). It was found that when a method was used, say method X (which is one of the previous four methods), the conclusion was that another method was best (say, method Y). When method Y was used, then another method, say method Z, was suggested as being the best one, and so on.

Two evaluative criteria were used to formulate the previous decision-making problem (actually, an MCDM problem). The first criterion was based on the premise that a method which claims to be accurate in multi-dimensional problems (for which different units of measurement are used to describe the alternatives), should also be accurate in single-dimensional problems. For such problems, the weighted sum model (WSM) is the widely accepted approach, thus their results were compared with the ones derived from the WSM. The second evaluative criterion was based on the following situation. Suppose some alternatives are evaluated and one of them is returned as the best alternative (say alternative A). Next, a non-optimal alternative (say alternative B) is replaced by a worse one. Under normal conditions one should expect that the same alternative as before (i.e., alternative A) is the best alternative again. This is also known in the related literature as a ranking reversal.[2] However, this may not happen with some of the methods tested in those experiments. For weights of these two evaluative criteria, all possible combinations were considered such that their sum was always equal to 1.00.

Methods that have been verified to exhibit this paradox

The following is a partial list of multi-criteria decision-making methods which have been confirmed to exhibit this paradox:,[1] [2]

Looking into the future

Other methods have not been tested yet but it is very likely they may exhibit the same phenomenon. Such methods include the following:

What is the best decision making method has always been a highly contested subject. There is always an ongoing debate on this subject. At the same time, a plethora of competing methods exists. A key role in this quest is played by the study of rank reversals in decision making.

As stated earlier, it is not uncommon such methods to yield different results when they are presented with exactly the same data. Thus, this decision making paradox is likely to persist for many years to come.

References

  1. ↑ 1.0 1.1 1.2 Triantaphyllou, E.; S.H. Mann (1989). "An Examination of the Effectiveness of Multi-Dimensional Decision-Making Methods: A Decision-Making Paradox". International Journal of Decision Support Systems (5): 303–312. doi:10.1016/0167-9236(89)90037-7. Retrieved 2010-06-25.
  2. ↑ 2.0 2.1 2.2 2.3 Triantaphyllou, E. (2000). Multi-Criteria Decision Making: A Comparative Study. Dordrecht, The Netherlands: Kluwer Academic Publishers (now Springer). p. 320. ISBN 0-7923-6607-7.
  3. ↑ Bernroider, E.W.N.; V. Stix (2006). "On The Applicability of Data Envelopment Analysis for Multiple Attribute Decision Making in the Context of Information Systems Appraisals". Data Envelopment Analysis for Multiple Attribute Decision Making, Communications of the IIMA 107 6 (2): 107–118.
  4. ↑ Caterino, N.; I. Iervolino; G. Manfredi; E. Cosenza (2009). "A Comparative Analysis of Multi-Criteria Decision-Making Methods for Seismic Structural Retrofitting". Computer-Aided Civil and Infrastructure Engineering 24: 1–14. doi:10.1111/j.1467-8667.2009.00599.x.
  5. ↑ Fitz-Gerald, A.; M. Tracy (2008). "Developing a Decision-Making Model for Security Sector Development in Uncertain Situations". Journal of Security Sector Management: 1–37.
  6. ↑ Bernroider, E.W.N.; S J. Mitlöhner. "Social Choice Aggregation Methods for Multiple Attribute Business Information System Selection". Vienna University of Economics and Business Administration, Augasse 2–6, 1090 Vienna, Austria.
  7. ↑ Mysiak, J. "Development of transferable multicriteria decision tools for water resource management". UFZ Centre for Environmental Research, Permoserstraße 15; 04318 Leipzig, Germany: 1–6.
  8. ↑ Falessi, D.; Tutor: Prof. Giovanni Cantone, Coordinatore: Prof. Daniel P. Bovet. "A Toolbox for Software Architecture Design (a Doctoral Dissertation)". Universita Degli Studi Di Roma Tor Vergata, Rome, Italy, Facoltà di Ingegneria, Dottorato di Ricerca in Informatica e Ingegneria, dell’Automazione, XX Ciclo: 1–203.