A critical survey of performance indices for multi-objective optimisation
- 1 January 2003
- proceedings article
- Published by Institute of Electrical and Electronics Engineers (IEEE)
- Vol. 2, 878-885
- https://doi.org/10.1109/cec.2003.1299759
Abstract
A large number of methods for solving multiobjective optimisation (MOO) problems have been developed. To compare these methods rigorously, or to measure the performance of a particular MOO algorithm quantitatively, a variety of performance indices (PIs) have been proposed. We provide an overview of the various PIs and attempts to categorise them into a certain number of classes according to their properties. Comparative studies have been conducted using a group of artificial solution sets and a group of solution sets obtained by various MOO solvers to show the advantages and disadvantages of the PIs. The comparative studies show that many PIs may be misleading in that they fail to truly reflect the quality of solution sets. Thus, it may not be a good practice to evaluate the performance of MOO solvers based on PIs only. © 2003 IEEEKeywords
This publication has 18 references indexed in Scilit:
- An Information-Theoretic Entropy Metric for Assessing Multi-Objective Optimization Solution Set QualityJournal of Mechanical Design, 2003
- Performance assessment of multiobjective optimizers: an analysis and reviewIEEE Transactions on Evolutionary Computation, 2003
- A fast and elitist multiobjective genetic algorithm: NSGA-IIIEEE Transactions on Evolutionary Computation, 2002
- Comparison of Multiobjective Evolutionary Algorithms: Empirical ResultsEvolutionary Computation, 2000
- Metrics for Quality Assessment of a Multiobjective Design Optimization Solution SetJournal of Mechanical Design, 2000
- A Fast Elitist Non-dominated Sorting Genetic Algorithm for Multi-objective Optimization: NSGA-IILecture Notes in Computer Science, 2000
- Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approachIEEE Transactions on Evolutionary Computation, 1999
- Multiobjective optimization using evolutionary algorithms — A comparative case studyLecture Notes in Computer Science, 1998
- On the performance assessment and comparison of stochastic multiobjective optimizersLecture Notes in Computer Science, 1996
- Muiltiobjective Optimization Using Nondominated Sorting in Genetic AlgorithmsEvolutionary Computation, 1994