Offline Chat: Private AI 12+
On-Device LLM with RAG
Opus Noma LLC
Designed for iPad
-
- £4.99
Screenshots
Description
Introducing Offline Chat, the next-generation AI ChatBot that runs entirely on your device without the Internet. You can use it anywhere, and your data stays private and secure.
In addition to asking general questions, you can also load your private documents and ask questions about their content. It's a great way to conduct research using sensitive material. Currently we support PDF and plain text files.
We provide 3 models: Tiny, Small and Medium. A larger model gives better answers, but it runs slower and requires more capable devices. "Tiny" runs on almost all devices. "Small" requires iPhone 14 and 15 Pros and "Medium" needs Macs and high-end iPads.
While Offline Chat might not match the prowess of top-tier online models due to inherent memory and processing constraints, it stands out as an engaging and versatile tool. It's perfect for sparking creativity and assisting in various tasks such as writing, though it's advisable to verify facts independently.
For the technically oriented, "Tiny" model is based on Microsoft Phi 2, and "Small" and "Medium" models are based on Mistral 7B 0.2, quantized to 3-bits and 4-bits respectively.
What’s New
Version 1.2.0
Welcome to the bleeding edge! Introducing the on-device document chat: You can now load private documents and ask questions about their content. PDF and plain text files are supported. This feature works quite well on a Mac or a high end iPad. An iPhone? Perhaps. You be the judge, but keep in mind that no other app can do this.
Please email us at info@opusnoma.com with your feedback. And leave us a kind review.
Ratings and Reviews
Works great!
So cool to run an LLM on your iPhone with no internet connection. I flipped on airplane mode and used it on iPhone 15 pro max. It’s fast for something running local. Device gets a bit warm, but otherwise great
Downloading other models not working
Tried to contact the dev but the support link on the app page leads to a site that doesn’t work.
Have tried multiple times to download the small (Mistral 7B) model which when opening the app I was notified my phone (iPhone 13 Pro) can support and should have more parameters and give more complex answers.
The download completes but as soon as I close the model settings page, the download is deleted and the Small model is still greyed out.
I have a 1TB model with 700 GB free space available. Assume this is just a bug so just making the dev aware.
Cool idea super slow
I have an iPhone 14 Pro and it runs so slow it is not usable. Love the idea and the work that has gone into the app but it is not yet ready for prime time.
App Privacy
The developer, Opus Noma LLC, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy.
Data Not Collected
The developer does not collect any data from this app.
Privacy practices may vary based on, for example, the features you use or your age. Learn More
Information
- Provider
- Opus Noma LLC
- Size
- 1.7 GB
- Category
- Business
- Compatibility
-
- iPhone
- Requires iOS 17.0 or later.
- iPad
- Requires iPadOS 17.0 or later.
- Mac
- Requires macOS 14.0 or later and a Mac with Apple M1 chip or later.
- Languages
-
English
- Age Rating
- 12+ Infrequent/Mild Mature/Suggestive Themes Infrequent/Mild Medical/Treatment Information
- Copyright
- © 2024 Opus Noma LLC
- Price
- £4.99
Supports
-
Family Sharing
Up to six family members can use this app with Family Sharing enabled.