The AI Storage Revolution: Pure Storage's New Innovations in AI and Machine Learning

Pure Storage Inc. is revolutionizing artificial intelligence this week with a suite of announcements aimed at simplifying AI training and inferencing, and leveraging machine learning to help customers tackle storage challenges.

Introduction to Pure Storage’s AI Innovations

Pure Storage Inc. is playing its artificial intelligence hand this week with a clutch of announcements aimed at simplifying AI training and inferencing as well as applying machine learning to help customers better unravel storage conundrums.

Evergreen//One: Purpose-Built AI Storage as-a-Service

The new Evergreen//One offering for AI is billed as the first purpose-built AI storage as-a-service. It provides guaranteed storage performance for graphics processing units (GPUs) in training, inferencing, and high-performance computing workloads. The new service level agreement eliminates the need for planning or overbuying by allowing customers to pay only for throughput performance, the company said.

“It’s a consumption model where customers can dynamically set their pipes and provision throughput for optimal GPU efficiency as their training and inference changes,” said Prakash Darji, general manager of Pure Storage’s digital experience business unit.

Addressing Variability in Data Throughput

The service addresses the variability of data throughput and bandwidth needs inherent in model training and inferencing, Darji said. “You’ll see up to 50 terabytes in your training environment with millions of parameters, which require high bandwidth,” he said. “Inference is more of a large data set, with lower throughput requirements. You have very different storage infrastructure needs for training versus inference.”

Pay-Per-Consumption Model for Flexibility

Customers can reserve more bandwidth than they need in the short term and only pay for what they use. “It’s built on the cloud consumption economics of pay-per-consumption and a reserve,” Darji said. “You get more predictability, more flexibility and ensure that the most expensive asset in your data center — the GPU — is fully utilized.”

Automated Anomaly Detection

New anomaly detection features apply machine learning to discover threats such as ransomware attacks, malicious behavior, and denial-of-service attacks by looking for performance anomalies. The expanded service uses multiple machine learning models that analyze a user’s historical data to look for unusual patterns. Customers can identify the last known good snapshot copy for recovery.

Pure Fusion: Storage-as-Code Enhancement

Pure Storage has also upgraded its Pure Fusion storage-as-code offering to consolidate and optimize storage pools on the fly across structured and unstructured data, on-premises, and in the cloud. The feature uses machine learning to improve over time. It is now embedded into the Purity operating environment and will be available across the entire Pure Storage platform to all global customers.

Generative AI Copilot for Storage

Also new is a generative AI copilot for storage. It uses knowledge gleaned from tens of thousands of customers to guide storage teams as they investigate performance and management issues. The feature uses multiple background large language models and collects telemetry from a user’s existing storage footprint.

“We collect almost 25 petabytes of telemetry per year,” Darji said. “That goes into the training base and our knowledge bases as well as the customers’ commands and user behavior.” The feature has limited capabilities to retrieve data in real time from the Pure1 management plane, and the company expects to improve real-time diagnosis over time.

“This is a rapidly evolving space,” Darji said. “We’re introducing this in a tech preview because we may refactor it and rewrite it 10 times over the next year based on the evolution of technology.”

Custom Disaster Recovery

The company is also introducing new services and service level agreements this week. The Enhanced Cyber Recovery and Resilience SLA is expanding to include disaster recovery scenarios. Under the agreement, customers get a customized recovery plan, clean storage infrastructure shipped to them by Pure Storage, onsite installation, and additional professional services for data transfer. That allows them to recover quickly from snapshots and retain compromised equipment for forensics, Darji said.

Security Assessment Offering

A new security assessment offering provides visibility into security risks across a fleet of storage arrays based on intelligence aggregated from more than 10,000 customer installations. The assessment provides numerical scores and best practices that align with National Institute Of Standards And Technology 2.0 standards, regulatory compliance recommendations, remediation of potential security anomalies, and rapid restoration.

AI-Powered Anomaly Detection Enhancement

A new AI-powered anomaly detection enhancement discovers threats such as ransomware attacks, unusual activity, malicious behavior, and denial-of-service attacks by looking at performance anomalies. This expands on previously available ransomware detection based on data reduction anomalies.

The expanded detection is built on multiple machine-learning models that identify unusual anomalous behavior. The models analyze customer environments with historical data for anomalous patterns based on heuristics of performance as well as user context on how storage is used. Leveraging this capability, customers can identify the last known good snapshot copy to mitigate the operational impact by quickly identifying recovery point targets to restore data, reducing risk and guesswork.

Analogy:

ust as a master chef uses precise ingredients and techniques to create a culinary masterpiece, Pure Storage's new AI-driven solutions combine cutting-edge technology and strategic innovation to deliver unparalleled performance and efficiency in AI training and storage management. Just like the chef who adapts to the changing demands of each dish, Pure Storage offers dynamic and flexible solutions tailored to the evolving needs of AI workloads, ensuring optimal results every time.

Stats:

Pure Storage's Evergreen//One offering allows customers to dynamically set their pipes and provision throughput for optimal GPU efficiency, catering to up to 50 terabytes in training environments with millions of parameters.

Pure Storage collects nearly 25 petabytes of telemetry data per year to enhance its AI-powered solutions, guiding storage teams in performance and management issue investigations.

FAQ Section

Q1: What is Evergreen//One, and why is it significant? Evergreen//One is Pure Storage’s new AI storage as-a-service offering. It guarantees storage performance for GPUs in training, inferencing, and high-performance computing workloads, allowing customers to pay only for the throughput performance they use.

Q2: How does the pay-per-consumption model benefit customers? The pay-per-consumption model allows customers to reserve more bandwidth than they need in the short term and only pay for what they use. This model provides more predictability, flexibility, and ensures optimal GPU utilization.

Q3: What are the new features of Pure Fusion? The upgraded Pure Fusion storage-as-code offering consolidates and optimizes storage pools on the fly across structured and unstructured data, both on-premises and in the cloud. It uses machine learning to continuously improve and is now embedded into the Purity operating environment.

Q4: How does the generative AI copilot for storage work? The generative AI copilot uses knowledge from tens of thousands of customers to guide storage teams in investigating performance and management issues. It leverages multiple large language models and collects telemetry data to provide real-time insights and recommendations.

‍