VAST Data introduces data computing platform, the VAST Data Platform, as the foundation of AI-assisted discovery

TL;DR:

  • VAST Data introduces the groundbreaking VAST Data Platform, a unified data computing solution for AI-driven discovery.
  • The platform bridges the gap between event-driven and data-driven architectures, enabling real-time access and processing of global data.
  • AI-driven discovery unlocks potential solutions to major challenges, from disease treatment to climate change.
  • VAST’s Disaggregated Shared-Everything (DASE) architecture lays the data foundation for deep learning and continuous data enrichment.
  • The platform accelerates generative AI training workflows with on-the-fly transformations, benefiting highly regulated industries.
  • The VAST DataStore provides scalable storage for unstructured data, making flash infrastructure suitable for archive applications.
  • VAST DataBase combines database, data warehouse, and data lake features for dynamic data analysis.
  • The VAST DataEngine and Global DataSpace complete the platform, extending access and processing capabilities globally.

Main AI News:

In a groundbreaking move, VAST Data has launched its cutting-edge data computing platform, poised to serve as the bedrock for AI-assisted discovery. Dubbed the VAST Data Platform, this revolutionary offering unites storage, database, and virtualized compute engine services in a highly scalable system tailored for the future of AI.

At the heart of the VAST Data Platform lies a bold vision – to encompass the vast volumes of global data generated and processed in real-time. From unstructured data like video, imagery, and free text to data streams and instrument data, the platform’s all-encompassing approach aims to bridge the gap between event-driven and data-driven architectures. By enabling seamless access and real-time processing of data in any private or major public cloud data center, the platform embeds queryable semantic layers into the data, fostering a profound understanding of natural data and facilitating continuous and recursive data computing with every interaction.

Breaking Free from Conventional Limits to Propel AI into New Horizons

While Generative AI and Large Language Models (LLMs) have provided a glimpse into AI’s potential, they have remained confined to mundane tasks such as business reporting and reciting known information. VAST Data recognizes that the true promise of AI lies in machines’ ability to emulate the process of discovery – capturing, synthesizing, and learning from data. Now, this extraordinary level of specialization can be achieved within days, rather than decades, thanks to VAST’s trailblazing strides in AI-driven discovery.

The impact of AI-driven discovery will be profound, revolutionizing our quest to address monumental challenges such as disease treatment, climate change mitigation, innovative agricultural approaches, and groundbreaking advances in science and mathematics. Existing data platforms have already garnered popularity among global enterprises, simplifying infrastructure deployment for business intelligence and reporting applications. However, as the demand for deep-learning applications surges, the need for next-generation AI infrastructure becomes imperative.

Unlocking the Potential of DASE: The Heart of VAST Data Platform

At the core of VAST’s innovative approach is its Disaggregated Shared-Everything (DASE) distributed systems architecture, designed from the outset to prioritize natural data, rich metadata, functions, and triggers. By removing the tradeoffs between performance, capacity, scale, simplicity, and resilience, DASE lays a solid data foundation for deep learning, empowering enterprises to train models on their entire data landscape. The system also empowers customers to integrate logic continuously, allowing machines to enrich and comprehend data from the natural world on a recursive basis.

Accelerating Training Workflows with VAST Data’s Cutting-Edge Offerings

VAST’s latest announcements outline a clear path for accelerating training workflows, a crucial factor for large enterprises. By enabling transformer-type functions on objects stored within their platform, VAST facilitates the swift implementation of generative AI. For instance, random distortions applied to a set of training images can now be seamlessly transformed on-the-fly, eliminating the need for time-consuming preprocessing and excessive storage consumption.

The developments from VAST Data hold the key to a new era of generative AI within enterprises that demand high fidelity, rapid retraining response, and complex modeling. Industries subject to strict regulations stand to reap significant benefits, with analysts leveraging VAST’s capabilities to generate detailed models with unrivaled efficiency. Real-time generation and alteration of graphical elements also bolster the creative workflow, fostering a more dynamic and interactive design process.

Unified Global DataStore, DataBase, And AI Computing Engine

The VAST DataStore emerges as a scalable storage architecture for unstructured data, doing away with cumbersome storage tiering. With a focus on capturing and serving data from the natural world, VAST’s DataStore lays a robust foundation for AI computing architectures, including NVIDIA DGX SuperPOD AI supercomputers and big-data and HPC platforms. The efficiency of the exabyte-scale DataStore brings flash infrastructure within the realm of archive applications, a pivotal step in enabling deep learning for enterprise customers seeking to train models on their proprietary data assets.

VAST DataBase: Blending Structure with Unstructured Natural Data

To address the challenge of unstructured data, VAST introduces VAST DataBase, a groundbreaking system that seamlessly blends database, data warehouse, and data lake characteristics into a unified database management system. This distributed database allows rapid data capture and lightning-fast queries at any scale, surmounting the limitations of real-time analytics and ushering in a new era of dynamic data analysis from event stream to archive.

The Power of VAST DataEngine and Global DataSpace

Completing the comprehensive VAST Data Platform strategy is the VAST DataSpace, a global namespace that empowers every location to store, retrieve, and process data with utmost efficiency and strict consistency. This global reach extends to on-premises data centers, edge environments, and leading public cloud platforms, including AWS, Microsoft Azure, and Google Cloud.

The VAST Data Platform, comprising the VAST DataStore, DataBase, and DataSpace, is now available, poised to revolutionize data-driven discovery and power the AI advancements of tomorrow. With the impending release of the VAST DataEngine in 2024, the future of AI-driven discovery has never been brighter.

Conclusion:

The unveiling of the VAST Data Platform marks a significant milestone in AI-driven discovery. By unifying storage, database, and virtualized compute engine services, VAST Data empowers enterprises to unlock the true potential of AI. The platform’s ability to handle vast volumes of global data, enable real-time processing, and accelerate generative AI workflows paves the way for innovative solutions to major challenges. With industries set to benefit significantly from the platform’s capabilities, VAST Data is poised to make a significant impact in the market and drive the future of AI-driven applications.

Source