AI agents are pushing storage into the runtime loop, reshaping the role of SSDs, HBM and memory tiers
A MarsBit report argues that AI agents are changing storage from a passive persistence layer into part of the execution path itself. As agents continuously observe, reason, call tools, write back results and preserve state, the value of storage is no longer limited to saving data after a task is complete. The report says SSDs are beginning to take on functions tied to model weights, KV cache spillover, indexing, encryption, compression, lifecycle control and long-term memory, pointing to a broader shift toward programmable, functional SSDs.
The piece lays out how this transition could play out on both devices and in the cloud. On the edge, SSDs may become the long-lived state layer for personal agents, holding local models, adapters, vector indexes, personal memory and tool traces. In cloud deployments, storage nodes could move closer to the inference path, handling shared prefixes, KV data, adapters, vector search and governance. The report cites Mooncake and NVIDIA CMX as examples of systems where storage is already participating in token production rather than merely holding cold data.
It also argues that the rise of agent systems does not diminish HBM. Instead, HBM, HBF, DRAM/CXL and SSDs are likely to be re-tiered by speed, mutability, capacity, cost and governance needs. Existing AI SSD efforts from Phison, Longsys, Maxio and partners are presented as early industrial samples of this shift, where the focus is moving from faster disks for AI workloads to a reallocation of responsibilities across runtime, memory hierarchy, controllers and flash.
