Optimizing I/O for an Exascale Implicit Kinetic Plasma Simulation using the Rabbit Storage System
Ian Lumsden, Hariharan Devarajan, Izzet Yildirim, Stefano Markidis, Andong Hu, Ivy Peng, Luca Pennati, Dewi Yokelson, Stephanie Brink, Olga Pearce, Tom Scogland, Bronis R. de Supinski, Gian Luca Delzanno, Anthony Kougkas, Xian-He Sun, Michela Taufer
5th Workshop on Re-envisioning Extreme-Scale I/O for Emerging Hybrid HPC Workloads (REX-IO), at IEEE Cluster ’25 · September 2025
I/O optimization for an exascale implicit kinetic plasma simulation on LLNL’s Rabbit near-node NVMe storage.
Abstract
Exascale computing revolutionizes scientific research by facilitating large-scale simulations and data analysis. As applications generate massive, heterogeneous data streams, the I/O subsystem increasingly dominates runtime, limiting scalability and time-to-solution. Emerging storage accelerators such as the Rabbit system offer a promising path forward. Rabbit provides dynamically configurable hybrid storage, combining high-bandwidth, node-local NVMe (e.g., XFS) with shared, distributed file systems (e.g., Lustre), to match diverse I/O patterns more efficiently. In this work, we evaluate Rabbit's capability to mitigate I/O bottlenecks using iPIC3D, a representative implicit Particle-in-Cell (PIC) code for exascale scientific workloads. We perform a detailed characterization of the key phases of I/O (restart, field, and moment) and identify the dominant access patterns in these phases. We then benchmark these patterns using IOR in Rabbit hybrid storage configurations, identifying the ideal performance achievable for each access pattern under node-local and distributed storage modes. We use phase-aware mapping of these patterns to Rabbit storage systems, achieving a 4.85 times improvement in I/O throughput, reducing the I/O share of runtime from 38% to 11% and delivering an end-to-end speedup of 1.45 times. These results outline the importance of hardware-software co-design and highlight Rabbit as a scalable, data-intensive storage solution.
@inproceedings{lumsden2025optimizing,
title = {{Optimizing I/O for an Exascale Implicit Kinetic Plasma Simulation using the Rabbit Storage System}},
author = {Lumsden, Ian and Devarajan, Hariharan and Yildirim, Izzet and Markidis, Stefano and Hu, Andong and Peng, Ivy and Pennati, Luca and Yokelson, Dewi and Brink, Stephanie and Pearce, Olga and Scogland, Tom and de Supinski, Bronis R. and Delzanno, Gian Luca and Kougkas, Anthony and Sun, Xian-He and Taufer, Michela},
booktitle = {2025 IEEE International Conference on Cluster Computing Workshops (CLUSTER Workshops)},
pages = {1--6},
publisher = {IEEE},
year = {2025},
month = sep,
doi = {10.1109/CLUSTERWorkshops65972.2025.11164212},
}
AgentStage: Exploiting LLM Thinking for Data Staging in Scientific Agents
eScience ’26 · Conference paper · First author
optimize
Uses an agent’s thinking time to stage data from cold storage into a tiered node-local cache (memory, then NVMe) before the agent asks for it.
A Multifaceted Approach to Automated I/O Bottleneck Detection for HPC Workloads
SC ’22 · Poster · First author
diagnose
DigIO, a tool that finds I/O bottlenecks automatically from a multifaceted view of a workload’s traces; the precursor to WisIO.
Correct Is Not I/O Efficient: Characterizing I/O Behavior of LLM Agents on Scientific Data
GCASR ’26 · Poster · First author
observe
Characterizes the I/O behavior of LLM agents working on scientific data: an agent can reach a correct answer while doing far more I/O than the task needs.
DFTracer: An Analysis-Friendly Data Flow Tracer for AI-Driven Workflows
SC ’24 · Conference paper · Co-author
observe
An analysis-friendly data-flow tracer for AI-driven workflows, developed at LLNL.
GDSight: Per-Operation Cross-Layer Attribution for GPUDirect Storage
PDSW ’26, at SC ’26 (accepted) · Workshop paper · First author
observe+analyze
Per-operation, cross-layer attribution for GPUDirect Storage: where a single GPU read spends its time, from the application down to the device.
Exploring the Impacts of Multiple I/O Metrics in Identifying I/O Bottlenecks
SC ’23 · Poster · First author
diagnose
Shows that I/O time, bandwidth, and IOPS each expose different bottlenecks in HACC, Montage, and CM1.
IOMax: Maximizing Out-of-Core I/O Analysis Performance on HPC Systems
PDSW ’23, at SC ’23 · Workshop paper · First author
analyze
Makes out-of-core analysis of very large I/O traces fast on HPC systems.
Performance Analysis of Containerized OrangeFS in HPC Environment
SC ’21 · Poster · First author
analyze
Compares five container runtimes hosting the OrangeFS parallel file system; Singularity came closest to bare metal.
ORION: Observability Framework for Hybrid Workflow-Centric I/O Monitoring in HPC Systems
ProTools ’26, at SC ’26 (accepted) · Workshop paper · Co-author
observe
An observability framework for hybrid, workflow-centric I/O monitoring on HPC systems. I co-authored it.
Optimizing I/O for an Exascale Implicit Kinetic Plasma Simulation using the Rabbit Storage System
REX-IO ’25, at IEEE Cluster ’25 · Workshop paper · Co-author
optimize
I/O optimization for an exascale implicit kinetic plasma simulation on LLNL’s Rabbit near-node NVMe storage.
Recorder: Comprehensive Parallel I/O Tracing and Analysis
Preprint, under review · Journal paper · Co-author
observe
Comprehensive parallel I/O tracing and analysis across HPC I/O libraries.
StageOnce: Speculative Cross-Job Data Staging for LLM Agent Fleets
SC ’26 (accepted) · Poster · First author
optimize
Speculative cross-job data staging for fleets of LLM agents.
ToolFuse: Provenance-Aware In-Flight Coalescing of Redundant Agent Tool Calls
SC ’26 (accepted) · Poster · First author
optimize
Provenance-aware, in-flight coalescing of redundant agent tool calls.
WisIO: Automated I/O Bottleneck Detection with Multi-Perspective Views for HPC Workflows
ICS ’25 · Conference paper · First author
analyze+diagnose
Automated I/O bottleneck detection for HPC workflows, using correlated views of the same trace from several perspectives.