As AI continues to transform industries and inspire new applications, the Sales Director of Africa at Western Digital, Ghassan Azzi, has said that it fundamentally relies on the utilisation and generation of data.
In his recent Thought Leadership piece, ‘The AI Data Cycle: Understanding the Optimal Storage Mix for AI Workloads at Scale’ Azzi said the AI industry is building a massive infrastructure to train AI models and offer AI services (inference).
Azzi said this infrastructure has significant implications for data storage, emphasizing that storage technology plays a crucial role in the cost and power efficiency of various stages.
He said: “As AI systems process and analyze data, they create new data, which is often stored due to its usefulness or entertainment value. This leads to a virtuous cycle where increased data generation fuels expanded data storage, further fueling data generation.
“Enterprise data centre planners need to understand the dynamic interplay between AI and data storage. Azzi outlines the storage priorities for AI workloads at scale across six stages, highlighting how storage component manufacturers, like Western Digital, are adjusting their product roadmaps to maximize performance and minimize total cost of ownership (TCO).
“In the initial stage, raw data is collected and stored securely and efficiently from various sources. The quality and diversity of collected data are critical, setting the foundation for everything that follows. Capacity enterprise hard disk drives (eHDDs) are preferred for bulk data storage, offering the highest capacity per drive and the lowest cost per bit.
“During data preparation and ingestion, data is processed, cleaned, and transformed for model training. To support this, data centre owners are implementing upgraded storage infrastructure such as fast data lakes. All-flash storage systems incorporating high-capacity enterprise solid state drives (eSSDs) are being deployed to augment HDD-based repositories or within new all-flash storage tiers.
“AI model training involves iterative training of AI models to make accurate predictions based on the training data. This stage relies heavily on high-performance supercomputers, with training efficiency depending on maximizing GPU utilization. High-bandwidth flash storage near training servers, such as high-performance and low-latency compute-optimized eSSDs, is crucial for this process.
“Inference and prompting entail creating user-friendly interfaces for AI models, including APIs, dashboards, and tools that combine context-specific data with end-user prompts. AI models are integrated into existing internet and client applications, enhancing them without replacing current systems.
“This integration drives the need for upgraded storage systems with additional eHDD and eSSD capacity. Larger, higher performance client SSDs (cSSDs) for PCs and laptops, and higher capacity embedded flash devices for mobile phones, IoT systems, and automotive applications, are also necessary.”
Azzi emphasizes that this continuous loop of data generation and consumption is accelerating the demand for performance-driven and scalable storage technologies.
“Ed Burns, research director at IDC, notes that the implications for storage are significant as access to data influences the speed, efficiency, and accuracy of AI models, particularly as larger and higher-quality data sets become more prevalent.
“As AI technologies become embedded across various industries, storage component providers are increasingly tailoring their products to meet the needs of each stage in the AI Data Cycle.
“The ongoing innovation in storage technology is crucial for managing large AI data sets and ensuring the efficient re-factoring of complex data, driving further advancements in AI,” he said.
