ToolFuse: Provenance-Aware In-Flight Coalescing of Redundant Agent Tool Calls

Provenance-aware, in-flight coalescing of redundant agent tool calls.

Abstract only until it is presented at SC ’26.

Scientific workflows increasingly run as fleets of LLM agents analysing immutable datasets. Independent agents can issue equivalent expensive read-only tool calls simultaneously, before a completed-result cache has anything to reuse. ToolFuse addresses this cold-wave gap by coalescing active calls at a gateway between agents and tool handlers. Its contribution is a provenance-aware execution identity that establishes equivalence from versioned dependencies and execution context, rather than arguments alone. Under contention on an exclusive HPC node, 16 equivalent requests become one execution, reducing CPU time by 11.79× and makespan by 2.36×. Peak memory growth falls from 6.44 GiB to 0.53 GiB. Trace replay shows that sharing depends on call duration and arrival timing. For cheap calls, coalescing remains inactive with negligible overhead.