Notes
Short write-ups on agents, storage, and research. New notes are also sent to subscribers on Substack.
Short write-ups on agents, storage, and research. New notes are also sent to subscribers on Substack.
Uses an agent’s thinking time to stage data from cold storage into a tiered node-local cache (memory, then NVMe) before the agent asks for it.
DigIO, a tool that finds I/O bottlenecks automatically from a multifaceted view of a workload’s traces; the precursor to WisIO.
Characterizes the I/O behavior of LLM agents working on scientific data: an agent can reach a correct answer while doing far more I/O than the task needs.
An analysis-friendly data-flow tracer for AI-driven workflows, developed at LLNL.
Per-operation, cross-layer attribution for GPUDirect Storage: where a single GPU read spends its time, from the application down to the device.
Shows that I/O time, bandwidth, and IOPS each expose different bottlenecks in HACC, Montage, and CM1.
Makes out-of-core analysis of very large I/O traces fast on HPC systems.
Compares five container runtimes hosting the OrangeFS parallel file system; Singularity came closest to bare metal.
An observability framework for hybrid, workflow-centric I/O monitoring on HPC systems. I co-authored it.
I/O optimization for an exascale implicit kinetic plasma simulation on LLNL’s Rabbit near-node NVMe storage.
Comprehensive parallel I/O tracing and analysis across HPC I/O libraries.
Speculative cross-job data staging for fleets of LLM agents.
Provenance-aware, in-flight coalescing of redundant agent tool calls.
Automated I/O bottleneck detection for HPC workflows, using correlated views of the same trace from several perspectives.