JD.com introduces ChatRhino, a 100-billion-parameter large language model tailored for industries

TL;DR:

  • JD.com introduces ChatRhino, a 100-billion-parameter large language model tailored for industries.
  • The model combines generalized data with intelligent supply chain data to offer targeted solutions.
  • JD.com establishes a comprehensive LLM toolchain, including an AI development platform, vector database, and more.
  • The model’s industry coverage and generalization capabilities provide advantages for real-world applications.
  • Training tool kits enable rapid model deployment and optimization for industry-specific needs.
  • Examples showcased include healthcare, finance, and e-commerce applications, increasing efficiency and reducing costs.
  • JD.com’s investment in cloud computing infrastructure supports the performance of large language models.
  • Upgraded multi-scenario solutions enhance service capabilities and drive industry innovation.

Main AI News:

JD.com, a leading e-commerce company, made a remarkable announcement at the 2023 JDDiscovery tech summit, introducing ChatRhino (Yanxi in Chinese), its advanced large language model (LLM). This cutting-edge AI model, developed by JD.com, combines 70% generalized data with 30% native intelligent supply chain data to offer targeted solutions for real industry challenges across various sectors, including retail, logistics, finance, health, and city. With a staggering 100-billion-parameter capacity, ChatRhino sets a new benchmark in the realm of large language models, building upon the success of JD.com’s previous models, K-PLUG and Vega.

In addition to the groundbreaking ChatRhino LLM, JD.com has also established a comprehensive LLM toolchain, empowering businesses to leverage the full potential of AI. The toolchain includes the MaaS platform “ChatRhino AI Developing and Computing Platform,” the vector database “Vearch,” the upgraded hybrid multicloud OS “Cloud Ship,” the high-performance storage platform “Cloud Ocean,” and the hardware and software integrated virtualization engine “Jing Gang.” Furthermore, JD.com announced the upgrade of the Youjia DaaS platform and ChatRhino Intelligent Service platform, enhancing their commitment to technological advancements and industry empowerment.

Sandy Xu, the CEO of JD.com, emphasized the alignment of JD’s large model evolution with their core values, stating, “Our pursuit of cost, efficiency, and experience are deeply ingrained in JD’s business philosophy, serving as the first principles of retail. Moreover, our commitment to trustworthiness, inclusiveness, and breakthrough signifies our dedication to leveraging technology to benefit industries and society as a whole.” This relentless pursuit of technological innovation drives JD.com to continuously explore and implement new solutions that address the diverse needs of industries.

ChatRhino, armed with JD.com’s extensive industry coverage, excels in real-world applications. The model accumulates tens of billions of high-quality interactive data and industry-specific knowledge derived from JD.com’s various industry scenarios every year. Its exceptional industry generalization capabilities ensure secure usage for clients both on-cloud and off-cloud, enhancing its versatility and practicality.

Peng Cao, the Chair of JD.com’s Technology Committee and President of JD Cloud, highlighted the symbiotic relationship between the digital intelligent supply chain and large models, stating, “The digital intelligent supply chain trains industrial large models, while large models leverage supply chains to go deep into industries.” This integration of AI and supply chain expertise fuels the development of innovative solutions that cater to industry-specific challenges.

To facilitate the deployment of ChatRhino in real-world business scenarios, Dr. Xiaodong He, Director of JD Explore Academy and President of JD Technology’s Intelligent Services and Products Division, outlined a three-step approach. Firstly, JD.com has built a generative large model based on its diverse business operations. Secondly, the model undergoes enhancement and iteration through highly complex industrial scenarios, resulting in robust services for industry use by the end of the year. Finally, in early 2024, the model’s capabilities will be fully accessible for serious commercial applications, marking a significant milestone in JD.com’s AI journey.

JD.com’s ChatRhino AI Developing and Computing Platform offers comprehensive training toolkits tailored to clients’ large models and industry-specific application development. With over 100 training and inference optimization tools, the platform streamlines the transformation of generative models into specialized ones, eliminating the need for lengthy and resource-intensive procedures. During the tech summit, JD.com showcased rapid model deployment examples, demonstrating how a generative model can be converted into a healthcare industry-specific model within minutes, significantly reducing time and resource requirements.

Furthermore, JD Health’s Jingyi Qianxun Large Model, based on ChatRhino, employs rapid migration and learning of various medical and health scenarios to automatically deploy products and solutions. This breakthrough technology serves as a robust foundation for telemedicine services, providing efficient and accurate healthcare solutions.

The summit also highlighted an AI marketing operation platform within the financial sector, showcasing how simple conversations can generate comprehensive marketing campaigns, including operational strategies, personnel arrangement, campaign page setup, marketing copy generation, and digital delivery. Previously, these tasks required coordination among multiple teams, but now they can be accomplished by a single person, significantly increasing marketing production efficiency while reducing human-computer interactions. This innovative approach has the potential to reshape the marketing landscape.

In the e-commerce domain, JD Cloud’s AIGC content marketing platform leverages ChatRhino to swiftly produce diverse e-commerce visuals, captivating marketing posters, and detailed product images using just one product image. This revolutionary advancement caters to the demands of rapid store setup, product promotion, and other marketing requirements. With production costs reduced by 90% and the time required slashed from seven days to half a day, businesses can accelerate their marketing initiatives and drive growth.

JD.com’s commitment to empowering industries goes beyond large models. The Vearch vector database, integrated with the ChatRhino AI developing and computing platform, serves as a bridge for AI models to utilize data effectively. With support for high-performance retrieval from tens of billions of data sources, Vearch offers rapid access with reduced latency and increased availability. This vector database has already benefited over 100 large and medium-sized enterprise users and significantly reduced inference costs.

To support the infrastructure requirements of its large language models, JD.com has made substantial investments in cloud computing. The establishment of Tianqin α, China’s first large-scale computing cluster based on the SuperPOD architecture, located in Chongqing, has revolutionized computational support for technological innovation. With a remarkable 6.2 times acceleration in inference speed and a 90% reduction in inference costs, Tianqin α has become an essential pillar of JD.com’s computational infrastructure.

JD.com’s upgraded multi-scenario solutions are revolutionizing industries at the forefront of digitalization. Retail, finance, cities, and logistics sectors have witnessed the transformative power of intelligent solutions, enabled by large language models. JD Logistics’ Jinghui Intelligent Supply Chain Data Management Platform, powered by ChatRhino, has significantly enhanced performance in sales forecasting, inventory management, and replenishment. This innovative platform enables users to identify supply chain issues swiftly through its interactive supply chain control tower, offering practical solutions and driving operational efficiency.

Conclusion:

JD.com’s introduction of ChatRhino and its comprehensive LLM toolchain demonstrates the company’s commitment to technological advancements and industry empowerment. With the ability to offer targeted solutions for various sectors, JD.com aims to revolutionize industries such as retail, logistics, finance, health, and the city. The rapid deployment of specialized models and the reduction of costs and time required for tasks like marketing campaigns and healthcare solutions have the potential to significantly impact the market. By leveraging large language models and integrating them with supply chain expertise, JD.com positions itself as a key player in driving transformative change and delivering high-quality solutions across industries.

Source