Limiting factors of join performance on parallel processors
- 7 January 2003
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
The effectiveness of parallel processing of relational join operations is examined. The skew in the distribution of join attribute values and the stochastic nature of the task processing times are identified as the major factors that can affect the effective utilization of parallelism. When many small processors are used in the parallel architecture, the skew can result in some processors becoming sources of bottleneck while other processors are being under utilized. Even in the absence of skew, the variations in the processing times of the parallel tasks belonging to a query can lead to high task synchronization delay and impact the maximum speedup achievable through parallel execution. Analytic expressions for join execution time are developed for different task time distributions with or without skew.Keywords
This publication has 12 references indexed in Scilit:
- Effect of Skew on Join Performance in Parallel ArchitecturesPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2005
- Join processing in database systems with large main memoriesACM Transactions on Database Systems, 1986
- Sorting and Join Algorithms for Multiprocessor Database MachinesPublished by Springer Nature ,1986
- Performance Evaluation of a Database System in Multiple Backend ConfigurationsPublished by Springer Nature ,1985
- The Equi-Join Operation on a Multiprocessor Database Machine: Algorithms and the Evaluation of their PerformancePublished by Springer Nature ,1985
- Parallel Operation of Magnetic Disk Storage Devices: Synchronized Disk InterleavingPublished by Springer Nature ,1985
- The Genesis of a Database ComputerComputer, 1984
- Join and Semijoin Algorithms for a Multiprocessor Database MachineACM Transactions on Database Systems, 1984
- Estimating record selectivitiesInformation Systems, 1983
- Performance Modeling of the DBMAC ArchitecturePublished by Springer Nature ,1983