I/O requirements of scientific applications: an evolutionary view
- 1 January 1996
- conference paper
- Published by Institute of Electrical and Electronics Engineers (IEEE)
Abstract
The modest I/O configurations and file system limitations of many current high-performance systems preclude solution of problems with large I/O needs. I/O hardware and file system parallelism is the key to achieving high performance. We analyze the I/O behavior of several versions of two scientific applications on the Intel Paragon XP/S. The versions involve incremental application code enhancements across multiple releases of the operating system. Studying the evolution of I/O access patterns underscores the interplay between application access patterns and file system features. Our results show that both small and large request sizes are common, that at present, application developers must manually aggregate small requests to obtain high disk transfer rates, that concurrent file accesses are frequent, and that appropriate matching of the application access pattern and the file system access mode can significantly increase application I/O performance. Based on these results, we describe a set of file system design principles.Keywords
This publication has 11 references indexed in Scilit:
- Scalable performance analysis: the Pablo performance analysis environmentPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- I/O, performance analysis, and performance data immersionPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Dynamic I/O characterization of I/O intensive scientific applicationsPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Dynamic file-access characteristics of a production parallel scientific workloadPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Characterizing parallel file-access patterns on a large-scale multiprocessorPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2002
- Unstructured Spectral Element Methods for Simulation of Turbulent FlowsJournal of Computational Physics, 1995
- PPFSPublished by Association for Computing Machinery (ACM) ,1995
- Parallel computation of electron molecule collisionsIEEE Computational Science and Engineering, 1995
- A static analysis of I/O characteristics of scientific applications in a production workloadPublished by Association for Computing Machinery (ACM) ,1993
- Input/output behavior of supercomputing applicationsPublished by Association for Computing Machinery (ACM) ,1991