Private LLM - Local AI Chatbot 17+

Secure Private AI Chatbot

Numen Technologies Limited

    • $12.99

Description

Discover Private LLM, your secure, private AI assistant for iPhone, iPad, and macOS. Designed to boost your productivity and creativity while ensuring your privacy, Private LLM is a one-time purchase offering a universe of AI capabilities without subscriptions. Our chatbot utilizes cutting-edge on-device AI to keep your interactions confidential and completely offline, compatible with all your Apple devices.

Why Choose Private LLM?

- Diverse AI Models at Your Command: Select from a wide array of open-source LLM model families such as Google Gemma 2B, Mixtral 8x7B, Mistral 7B, Llama 2 (7B, 13B, and 33B), CodeLlama 13B, Solar 10.7B, and Phi 2 3B. Customize your AI experience for creative brainstorming, coding assistance, or daily inquiries.

- Seamless Siri & Shortcuts Integration: Enhance your AI interactions with Siri commands and customizable Shortcuts, making your digital assistant more integrated and accessible within your Apple ecosystem.

- Customizable System Prompts: Fine-tune your AI's responses and interactions to your liking with customizable system prompts, catering to your specific needs and preferences.

- Complete Privacy and Security: Private LLM confines your conversations to your device, providing unparalleled privacy. Our on-device AI enables powerful computing without data compromise or the need for an internet connection.

- Family Sharing & Offline Functionality: A one-time purchase that supports Family Sharing. Download models as needed and enjoy full AI assistant functionality, even offline.

- System Wide Grammar Correction and Summarization: Offering grammar correction, summarization, text shortening, and rephrasing within any app on your Mac.

Private LLM is more than a chatbot; it's an all-encompassing AI companion that respects your privacy while offering versatile, on-demand assistance. Whether for creative writing, solving complex programming issues, or general inquiries, Private LLM adapts to your needs, ensuring your data remains secure and on your device. Embark on a journey with Private LLM today and elevate your productivity and creative projects with the most private AI assistant for macOS and iOS devices.

Leveraging state-of-the-art Omniquant quantized models, Private LLM is a native Mac app that surpasses others with superior text generation, faster performance, and deeper integration compared to apps using generic baseline RTN quantized models like Ollama and LMStudio.

Supported Model Families:

- Google Gemma Based Models
- Mixtral 8x7B Based Models
- Llama 33B Based Models
- Llama 2 13B Based Models
- CodeLlama 13B Based Models
- Llama 2 7B Based Models
- Solar 10.7B Based Models
- Phi 2 3B Based Models
- Mistral 7B Based Models
- StableLM 3B Based Models
- Yi 6B Based Models
- Yi 34B Based Models

For a full list of supported models, including detailed specifications, please visit our website.

Optimized for Apple Silicon Macs with the Apple M1 chip or later, Private LLM for macOS delivers the best performance. Users on older Intel Macs without eGPUs may experience reduced performance.

What’s New

Version 1.8.4

- New 4-bit OmniQuant quantized downloadable model: Gemma 1.1 2B IT (Downloadable on all compatible Macs, also available on the iOS version of the app).
- New 4-bit OmniQuant quantized downloadable model: Dolphin 2.6 Mixtral 8x7B (Downloadable on Apple Silicon Macs with 32GB or more RAM).
- New 4-bit OmniQuant quantized downloadable model: Nous Hermes 2 Mixtral 8x7B DPO (Downloadable on Apple Silicon Macs with 32GB or more RAM).
- Minor bug fixes and improvements.

If you have any feedback or questions, we'd love to hear from you! Numen Technologies offers free tech support; you can email: support@numen.ie, message us on our Discord, or Tweet at us @private_llm. If you find Private LLM to be useful, we'd appreciate a review on the App Store. Your review will help other people find Private LLM.

Ratings and Reviews

4.5 out of 5
2 Ratings

2 Ratings

dtlnx ,

Great app.

Would love to be able to download different models. If not from an in app catalogue, perhaps putting in a url from hugging face?

Otherwise pretty neat.

Kuutana ,

Reasonable Expectations

The developer has given easy access to a usable information source, disconnected from the tentacles of big tech. This is to be applauded. But expectations are important here. You can't compare a solo effort with that of an organization with billion-dollar funding. Just contextualize this with pre-ChatGPT tech and you may find this a tool to have (in situations where yes.. you are disconnected from the internet or you don't want big tech operators to hoover your brain for free). Docs on if or how to do do supervised instruction of the model would be welcome or how to tweak this. Read the vendor warnings. These are known industry limitations of this type of offering.

Devlist ,

Basic but it works

Pros:
-simple interface
-If you are looking to run language models on your own device this does the job
-lots of models you can choice from
-you can run llama-3 8B on an iPhone with 6GB of ram (wow)

Cons:
-occasional performance problems which are fixed with a restart
-as of now the app is very barebones in features especially for those looking to tinker
-very aggressive quants mean a drop in output quality but this is due to hardware restrictions from the limited amount of RAM available on mobile devices
-some interesting models are unavailable to download

Overall I recommend this app, just don’t expect the same quality, speed or features of an online monthly subscription llm app like ChatGPT. Looking forward to future updates from the developers!

App Privacy

The developer, Numen Technologies Limited, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer's privacy policy.

Data Not Collected

The developer does not collect any data from this app.

Privacy practices may vary, for example, based on the features you use or your age. Learn More

Supports

  • Family Sharing

    Up to six family members can use this app with Family Sharing enabled.

You Might Also Like

YourChat
Productivity
MLC Chat
Productivity
Vanessa LLM
Productivity
Local Brain
Productivity
Patagonia AI - Private LLM
Productivity
LLM: Answering Machine
Productivity