Offline Chat: Private AI 12+

Name: Offline Chat: Private AI
Price: 4.99 USD
Rating: 4 (20 reviews)
Author: Opus Noma LLC

Opus Noma LLC

Conçu pour iPad

- 4,0 • 20 notes

- 4,99 $US

Description

Introducing Offline Chat, the next-generation AI ChatBot that runs entirely on your device without the Internet. You can use it anywhere, and your data stays private and secure.

In addition to asking general questions, you can also load your private documents and ask questions about their content. It's a great way to conduct research using sensitive material. Currently we support PDF and plain text files.

We provide 3 models: Tiny, Small and Medium. A larger model gives better answers, but it runs slower and requires more capable devices. "Tiny" runs on almost all devices. "Small" requires iPhone 14 and 15 Pros and "Medium" needs Macs and high-end iPads.

While Offline Chat might not match the prowess of top-tier online models due to inherent memory and processing constraints, it stands out as an engaging and versatile tool. It's perfect for sparking creativity and assisting in various tasks such as writing, though it's advisable to verify facts independently.

For the technically oriented, "Tiny" model is based on Microsoft Phi 2, and "Small" and "Medium" models are based on Mistral 7B 0.2, quantized to 3-bits and 4-bits respectively.

5 mars 2024

Version 1.2.0

Welcome to the bleeding edge! Introducing the on-device document chat: You can now load private documents and ask questions about their content. PDF and plain text files are supported. This feature works quite well on a Mac or a high end iPad. An iPhone? Perhaps. You be the judge, but keep in mind that no other app can do this.

Please email us at info@opusnoma.com with your feedback. And leave us a kind review.

4,0 sur 5

20 notes

Almost there

Really clean interface. Running Mistral 7B on device is awesome. Though, I’d love to see an option to customize the system prompt, at least.

Stop trying to outsmart AI

Oh where to start with the AI hype cycle here. RAG integration is great in theory but seems poorly implemented. The big problem with this and other LLM middleware is inserting system instructions that are not documented and can’t be edited: “I'm here to help answer questions and provide information to the best of my ability. My system instructions are to always assist with care, respect, and truth. I will respond with utmost utility while ensuring that the information provided is secure and accurate. I will avoid harmful, unethical, prejudiced, or negative content and instead promote fairness and positivity in all of my responses.” Positivity? Truth? The truth is that’s short-sighted censorship and a fail in my book.

Brilliant app - runs smooth

Brilliant app. 🧠This is an incredible tool that will allow for use without concerns of privacy leaks. I use it for my small business with less concern of GPT eventually selling or leaking company details. Highly recommend offline chat. 🔥🔥🔥

Le développeur Opus Noma LLC a indiqué que le traitement des données tel que décrit ci‑dessous pouvait figurer parmi les pratiques de l’app en matière de confidentialité. Pour en savoir plus, consultez la politique de confidentialité du développeur.

Données non collectées

Le développeur ne collecte aucune donnée avec cette app.

Les pratiques en matière de confidentialité peuvent varier, notamment en fonction des fonctionnalités que vous utilisez ou de votre âge. En savoir plus