MLC Chat 17+

Name: MLC Chat
Rating: 4.9 (11 reviews)
Author: Tianqi Chen

Chat with Open Language Models

Tianqi Chen

Designed for iPad

- 4.9 • 11 Ratings

- Free

Description

Large language models locally in phone

MLC Chat lets users chat with open language models locally on ipads and iphones. After a model is downloaded to the app, everything runs locally without server support, and it works without internet connections do not record any information.

Because the models run locally, it only works for the devices with sufficient VRAM depending on the models being used.

MLC Chat is part of open source project MLC LLM, with allows any language model to be deployed natively on a diverse set of hardware backends and native applications. MLC Chat is a runtime that runs different open model architectures on your phone. The app is intended for non-commercial purposes. It allows you to run open-language models downloaded from the internet. Each model can be subject to its respective licenses.

27 Sept 2024

Version 1.6

This version include llama 3.2 3b

4.9 out of 5

11 Ratings

Simple but functional

Does what it promises, very enjoyable!

Crashes on iPad Pro 4th Gen, iPadOs 17.7

I’ve heard good things about this app. And I’d really love to try these carefully selected smallLLMs, unfortunately the App crashes on my machines, an iPad Pro 4th Generation. There is a blank window with some text, a startup message “System initialize…” then the screen disappears. This happen with all language models I’ve downloaded. Waiting for the next version.

High potential

Please add the MoE Mixtral 8x7B soon. Keep up the great work.

The developer, Tianqi Chen, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy.