VI-HPS Tutorial: IEEE Cluster 2010
Heraklion, Crete, Greece
24 September 2010
Practical parallel application performance engineering using innovative tools
Presenters:
Level: Introductory 60% Intermediate 25% Advanced 15%
Abstract: This tutorial presents state-of-the-art tools for engineering performant parallel applications on computer clusters with MPI and/or OpenMP. The suite of tools developed by the Virtual Institute for High Productivity Supercomputing (VI-HPS) are introduced, including Scalasca, Vampir and Periscope. The tools support automated and manually-customizable measurement and analyses with hardware counter metrics as well as communication and synchronization overheads. A series of hands-on exercises are included which participants are encouraged to follow on their notebook computers using a provided Live-DVD with a bootable typical HPC cluster Linux environment. This will offer practical experience using the tools and help prepare participants to apply modern methods for locating and diagnosing performance bottlenecks in real-world parallel applications up to the largest scales.
Goals
This full-day tutorial will:
- give an overview of the VI-HPS programming tools suite
- explain the functionality of individual tools, and how to use them effectively
- offer hands-on experience using the tools with a LiveDVD
Participants are expected to use their own notebook computers for the tutorial using a Live-DVD provided by us for hands-on exercises: it may be possible to arrange alternatives for those who don't have access to an x86-compatible notebook computer with DVD drive, if the organizers are informed in advance.
VI-HPS Tools
- MARMOT is a free correctness checking tool for MPI programs developed by TUD-ZIH and HLRS.
- PAPI is a free library interfacing to hardware performance counters developed by UTK-ICL, used by Periscope, Scalasca, VampirTrace, and multiple other tools.
- Periscope is a prototype automatic performance analysis tool using a distributed online search for performance bottlenecks being developed by TUM.
- Scalasca is an open-source toolset developed by JSC that can be used to analyze the performance behaviour of parallel applications and automatically identify inefficiencies.
- Vampir is a commercial framework and graphical analysis tool developed by TUD-ZIH to display and analyze trace files.
- VampirTrace is an open-source library for generating event trace files which can be analyzed and visualized by Vampir.
Hardware and Software Platforms
The VI-HPS tools support and are installed on a wide variety of HPC platforms, including:
- IBM BlueGene/P (JSC Jugene): PowerPC 450 quad-core processors, BG-Linux compute kernel, IBM BG-MPI library, IBM BG-XL compilers
- Sun/Bull Nehalem cluster (JSC Juropa/HPC-FF): Intel Xeon X5570 quad-core processors, SLES Linux, ParaStation MPI, Intel compilers
- IBM p5-575 cluster (JSC JUMP): Power6 dual-core processors, AIX OS, IBM POE MPI, IBM XL compilers
- SGI Altix 4700 (LRZ HLRB-II): Itanium2 dual-core processors, SGI Linux, SGI MPT, Intel compilers
- SGI Altix ICE (LRZ ICE1): Xeon quad-core processors, SGI Linux, SGI MPT (and MVAPICH2 & Intel MPI), Intel/GNU/PGI compilers
- IBM p5-575 cluster (RZG VIP): Power6 dual-core processors, AIX OS, IBM POE MPI, IBM XL compilers
- IBM BlueGene/P (RZG Genius): PowerPC 450 quad-core processors, BG-Linux compute kernel, IBM BG-MPI library, IBM BG-XL compilers
- SGI Altix 4700 (ZIH): Itanium2 dual-core processors, SGI Linux, SGI MPT, Intel compilers
- SGI Altix ICE (HLRN): Xeon quad-core processors, SGI Linux, SGI MPT (and MVAPICH2 & Intel MPI), Intel/GNU/PGI compilers
- Intel Xeon cluster (RWTH): Xeon quad-core processors, Scientific Linux OS, Intel MPI, Intel compilers
After completing the tutorial, participants will be prepared to use the VI-HPS tools to analyze and tune their own application codes.
Further information and registration
Tutorial participation is included with registration for IEEE Cluster 2010, which must be done on the
conference website.