Deep learning(DL) models have different access requirements from the data store when compared to typical workloads for which existing storage systems are built. Also the data scale required for training these models range in petabytes. Hence having a storage system customized for this use case is essential & Nvidia has developed AIStore, an open sourced solution to tackle this problem. As part of this post, we will go through the paper describing the architecture for AIStore along with custom...
