Virtual Institute — High Productivity Supercomputing

ADMIRE

EuroHPC (2021-2024)

Adaptive Multi-Tier Intelligent Data Manager for Exascale

The growing need to process and access large volumes of heterogeneous data sets is one of the main drivers for building exascale HPC systems. The advent of data-intensive applications, combined with the steep growth of data sets, started questioning the traditional compute-centric view of HPC. The flat storage hierarchies found in classic HPC architectures no longer satisfy the performance requirements of the growing share of data-processing applications. At the same time, this shift towards data-centric computing is accompanied by a disruptive change of the underlying storage technology with the potential to remove this bottleneck. Emerging multi-tier storage hierarchies with fast non-volatile memory can significantly lower the pressure on the back-end file system. But maximizing performance still requires careful control and adapted file systems to avoid congestion and balance compute and storage performance. Developing such control mechanisms with a selection of applications, co-designed to take advantage of these new features, is the goal of ADMIRE. As part of ADMIRE, project members use and extend performance tools from the VI-HPS suite, including Extra-P and TAU.

Partners

Links

Funding

The ADMIRE project receives funding from the EuroHPC Joint Undertaking (JU), which is supported by the European Union’s Horizon 2020 research and innovation programme and Germany, France, Italy, Poland, Spain, and Sweden.

EU flag Euro HPC logo Horizon 2020 Logo