MLC Chat 17+
Chat with Open Language Models
Tianqi Chen
Designed for iPad
-
- Free
Screenshots
Description
Running Large language models locally on your phone
MLC Chat lets users chat with open language models locally on ipads and iphones. After a model is downloaded to the app, everything runs locally without server support, and it works without internet connections do not record any information.
Because the models run locally, it only works for the devices with sufficient VRAM depending on the models being used.
MLC Chat is part of open source project MLC LLM, with allows any language model to be deployed natively on a diverse set of hardware backends and native applications. MLC Chat is a runtime that runs different open model architectures on your phone. The app is intended for non-commercial purposes. It allows you to run open-language models downloaded from the internet. Each model can be subject to its respective licenses.
What’s New
Version 1.2
This version add mistral support
Ratings and Reviews
DL ?
Download button dissapeared
Dommage
Dommage que cette appli ne soit pas adaptée à l’iPhone SE3 (pas assez de VRam)et dommage que le développeur ne l’indique pas explicitement en description. J’espère que cela fonctionnera sur le prochain iPhone SE.
Amazing performance
I love how fast the LLMs in this app are. Is this because of the chosen quantization? I usually use q8 on my desktop computer, and it take minutes to generate a text.
Anyway. I wish it was possible to run Dolphin Mixtral (because I heavily dislike the alignment of regular Mistral), and LLaVA (because local image recognition directly from a smartphone would be amazing).
Keep up the good work!
App Privacy
The developer, Tianqi Chen, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy.
Data Not Collected
The developer does not collect any data from this app.
Privacy practices may vary based on, for example, the features you use or your age. Learn More
Information
- Provider
- Tianqi Chen has not identified itself as a trader for this app. If you are a consumer in the European Economic Area, consumer rights do not apply to agreements between you and the provider.
- Size
- 3.3 GB
- Category
- Productivity
- Compatibility
-
- iPhone
- Requires iOS 16.0 or later.
- iPad
- Requires iPadOS 16.0 or later.
- Mac
- Requires macOS 13.0 or later and a Mac with Apple M1 chip or later.
- Apple Vision
- Requires visionOS 1.0 or later.
- Languages
-
English
- Age Rating
- 17+ Infrequent/Mild Cartoon or Fantasy Violence Infrequent/Mild Realistic Violence
- Copyright
- © 2023 MLC AI
- Price
- Free