MLC LLM: Bringing ChatGPT to Your Fingertips Even Without Internet Connectivity

TL;DR:

  • ChatGPT is a cloud-based AI chatbot that requires internet connectivity.
  • MLC LLM is an open-source project that repurposes ChatGPT to work natively on smartphones.
  • The app is bulky and cannot be downloaded from the App Store; users must use TestFlight to access it.
  • MLC LLM has a familiar interface that resembles iMessage, with blue text for input and grey for the bot’s response.
  • The app’s performance is sluggish, with some queries taking over 5 minutes to receive a response.
  • MLC LLM serves as a demonstration of the future of Language Learning Models, with the possibility of chatbots pre-installed on smartphones.

Main AI News:

The advent of ChatGPT has revolutionized the way we approach tedious tasks, freeing up valuable time to concentrate on more pressing matters. However, due to its cloud-based nature, an uninterrupted internet connection is mandatory for its operation.

But what if we could use ChatGPT on our smartphones without requiring internet access? Enter MLC LLM, an open-source project from MLC AI that has successfully repurposed ChatGPT to function on phones. The app is bulky, with a size of 4GB, and cannot be downloaded directly from the App Store. Instead, users must resort to TestFlight, a service for distributing beta versions of apps developed by developers.

While it can be used on other platforms like Windows, Linux, and even web browsers, the setup process is complicated. Once installed on your iPhone, the app greets you with an interface reminiscent of iMessage, with blue text indicating your input and grey for the bot’s response. Typing your query and sending it to the chatbot using the send button is simple enough, and a Reset button is conveniently located at the top-left corner should you need to start over.

The only drawback to using MLC LLM is its sluggish performance. Users have reported waiting over 5 minutes for responses to straightforward queries. However, this is an acceptable trade-off for using an AI as powerful as ChatGPT on a tiny device like a phone.

Despite its limitations, MLC LLM serves as a testament to the future of Language Learning Models. With advancements in technology, and smartphones growing more powerful by the day, it may not be long before every phone is equipped with a built-in chatbot.

Conlcusion:

The development of MLC LLM, an open-source project that enables ChatGPT to work natively on smartphones, has significant implications for the market. The app’s ability to provide an AI chatbot without requiring internet connectivity has the potential to disrupt the industry and may encourage other developers to explore similar solutions. While MLC LLM’s sluggish performance is a concern, the development of Language Learning Models has tremendous potential for the future of AI, and it may not be long before every smartphone comes with a built-in chatbot. Businesses must keep a close eye on these developments and be ready to adapt to the rapidly evolving market.

Source