Parallel global optimization with the particle swarm algorithm
- 18 October 2004
- journal article
- research article
- Published by Wiley in International Journal for Numerical Methods in Engineering
- Vol. 61 (13), 2296-2315
- https://doi.org/10.1002/nme.1149
Abstract
Present day engineering optimization problems often impose large computational demands, resulting in long solution times even on a modern high‐end processor. To obtain enhanced computational throughput and global search capability, we detail the coarse‐grained parallelization of an increasingly popular global search method, the particle swarm optimization (PSO) algorithm. Parallel PSO performance was evaluated using two categories of optimization problems possessing multiple local minima—large‐scale analytical test problems with computationally cheap function evaluations and medium‐scale biomechanical system identification problems with computationally expensive function evaluations. For load‐balanced analytical test problems formulated using 128 design variables, speedup was close to ideal and parallel efficiency above 95% for up to 32 nodes on a Beowulf cluster. In contrast, for load‐imbalanced biomechanical system identification problems with 12 design variables, speedup plateaued and parallel efficiency decreased almost linearly with increasing number of nodes. The primary factor affecting parallel performance was the synchronization requirement of the parallel algorithm, which dictated that each iteration must wait for completion of the slowest fitness evaluation. When the analytical problems were solved using a fixed number of swarm iterations, a single population of 128 particles produced a better convergence rate than did multiple independent runs performed using sub‐populations (8 runs with 16 particles, 4 runs with 32 particles, or 2 runs with 64 particles). These results suggest that (1) parallel PSO exhibits excellent parallel performance under load‐balanced conditions, (2) an asynchronous implementation would be valuable for real‐life problems subject to load imbalance, and (3) larger population sizes should be considered when multiple processors are available. Copyright © 2004 John Wiley & Sons, Ltd.Keywords
This publication has 17 references indexed in Scilit:
- Comparing inertia weights and constriction factors in particle swarm optimizationPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Multidisciplinary Optimization of a Transport Aircraft Wing Using Particle Swarm OptimizationPublished by American Institute of Aeronautics and Astronautics (AIAA) ,2002
- Parameter selection in particle swarm optimizationPublished by Springer Nature ,1998
- A solidification procedure to facilitate kinematic analyses based on video system dataJournal of Biomechanics, 1995
- Application of High-Performance Computing to Numerical Simulation of Human MovementJournal of Biomechanical Engineering, 1995
- In vivo determination of the anatomical axes of the ankle joint complex: An optimization approachJournal of Biomechanics, 1994
- Determining the movements of the skeleton using well-configured markersJournal of Biomechanics, 1993
- Minimizing multimodal functions of continuous variables with the “simulated annealing” algorithm—Corrigenda for this article is available hereACM Transactions on Mathematical Software, 1987
- Generalized descent for global optimizationJournal of Optimization Theory and Applications, 1981
- Rigid body motion calculated from spatial co-ordinates of markersJournal of Biomechanics, 1980