TL;DR:
- 6Estates, a Singapore-based Enterprise AI solution provider, introduces the first deployment of NVIDIA DGX BasePOD with DGX H100 systems in Southeast Asia.
- This strategic move aims to accelerate AI innovation and facilitate digital transformation across the region.
- The deployment ceremony featured prominent figures from the industry and academia.
- 6Estates, a member of NVIDIA Inception, specializes in domain-specific large language model (LLM)-backed solutions for enterprises.
- The DGX BasePOD leverages NVIDIA’s full-stack data center platform, optimizing computing, storage, networking, software, and infrastructure for maximum performance.
- 6Estates plans to utilize this technology for custom Model Solutions and access to NVIDIA AI Enterprise software.
- The cluster will also support existing AI solutions, including Intelligent Document Processing.
- NVIDIA DGX H100 systems offer enhanced performance for AI training and inference.
- 6Estates is set to develop domain-specific LLMs for clients in finance and medical domains.
- The deployment signifies a significant step towards advancing AI capabilities in Southeast Asia.
Main AI News:
In a groundbreaking move, 6Estates Pte Ltd, a Singapore-based Enterprise AI solution provider, has unveiled the inaugural deployment of the NVIDIA DGX™ BasePOD featuring NVIDIA DGX H100 systems in Southeast Asia. This pivotal endeavor marks a significant stride towards accelerating AI innovation and ushering in the era of digital transformation across the region.
6Estates, stemming from prestigious institutions like the National University of Singapore and Tsinghua University, has made substantial strides in delivering domain-specific large language model (LLM)-backed solutions tailored for enterprises. Notably, the company has cemented its position as a member of NVIDIA Inception, an exclusive program dedicated to fostering cutting-edge startups revolutionizing industries through technological advancements.
At the core of this endeavor is the DGX BasePOD, a pinnacle of technological prowess that harnesses NVIDIA’s full-stack data center platform. This platform encompasses industry-leading computing, storage, networking, software, and infrastructure management—all meticulously optimized to synergize and deliver unparalleled performance at scale.
6Estates’ strategic vision for the NVIDIA DGX BasePOD centers around its innovative Model Solutions offering, empowering enterprises with customized, domain-specific LLMs and applications. Additionally, the company gains access to NVIDIA AI Enterprise software, ensuring secure, stable, and fully supported production AI. The software layer, known as NVIDIA AI Enterprise, presents a formidable arsenal of over 100 frameworks, pretrained models, and development tools to expedite data science initiatives and streamline the deployment of production-ready generative AI, computer vision, speech AI, and more.
Furthermore, this cutting-edge cluster is set to bolster 6Estates’ existing AI solutions, most notably its Intelligent Document Processing platform. This platform, a game-changer in the realm of automation, excels in processing and analyzing unstructured, template-free documents while automating end-to-end workflows for lenders and trade companies.
Dr. Luan Huanbo, Founder and CEO of 6Estates, expresses unwavering optimism about the transformative potential of Generative AI. “There is immense potential for Generative AI to transform how businesses operate—spanning from how they execute internal processes to how they understand and serve their customer base. We are seeing incredible demand from customers looking to implement LLM solutions that are highly tailored and with the highest assurance of security, and we are excited to bring this to life for enterprises in the region,” he stated.
The heart of this technological leap lies in the NVIDIA DGX H100 systems, serving as the building blocks of the world’s most advanced and powerful AI computing platform. Each system is equipped with eight NVIDIA H100 Tensor Core GPUs, boasting the revolutionary Transformer Engine, second-generation secure Multi-Instance GPU capabilities, and fourth-generation NVIDIA NVLink connectivity. With DGX H100 systems, 6Estates achieves up to a staggering 4x increase in GPT-3 AI training speed and up to 30x higher speed for AI inference when compared to the previous generation.
Leveraging the might of NVIDIA DGX H100, 6Estates is primed to significantly reduce model training times, enabling the rapid delivery of Model Solutions services to enterprise customers. This development marks a monumental leap in the journey toward democratizing AI.
6Estates’ NVIDIA DGX BasePOD cluster, bolstered by NVIDIA DGX H100 systems, stands poised to revolutionize domain-specific LLM training and on-premise deployments for its discerning clientele.
Dr. Luan Huanbo reiterates the pivotal role of NVIDIA DGX H100, stating, “Supporting large enterprises that need to process and understand substantial amounts of customer data to develop a truly transformational LLM requires significant compute resources—NVIDIA DGX H100 provides access to the industry-leading performance needed to do so.“
In concurrence, Dennis Ang, Senior Director of Enterprise Business for the ASEAN and ANZ Regions at NVIDIA, underscores the potential of Generative AI to drive growth and innovation across industries, stating, “Generative AI is helping businesses across industries create new opportunities and better serve customers. 6Estates’ deployment of NVIDIA DGX AI supercomputing can help organizations across Southeast Asia drive growth through the development of advanced AI services and solutions.”
Notably, 6Estates has embarked on the development of domain-specific LLMs for a diverse clientele. This includes a notable project in the finance domain, with a commercial company aiming to train models ranging from 70B to 130B in size. Another compelling initiative is in the medical domain, where a research institution seeks to train models of 7B, 13B, and 65B in size. The advantages of domain-specific LLMs are multifaceted, promising enhanced automation, deeper customer insights, streamlined workflows, precise forecasting, and more across various sectors.
6Estates is poised to equip companies with custom-tailored, on-premise AI capabilities, along with AI-enabled Intelligent Document Processing and end-to-end workflow automation. As the company paves the way for AI-driven transformations, Southeast Asia stands at the cusp of a new era defined by innovation and technological excellence.
Conclusion:
The deployment of the NVIDIA DGX BasePOD with DGX H100 systems by 6Estates in Southeast Asia marks a pivotal moment in the region’s AI landscape. This move underscores the growing demand for cutting-edge AI solutions tailored to specific industries. As 6Estates empowers enterprises with custom AI models and applications, the market can anticipate a surge in AI-driven innovations across sectors like finance and healthcare. This technological leap positions Southeast Asia at the forefront of AI transformation, offering new opportunities for businesses to enhance efficiency, gain deeper insights, and provide superior customer experiences.
