Private LLM - Local AI Chatbot 17+

Secure Private AI Chatbot

Numen Technologies Limited

    • 9,99 €

Description

Discover Private LLM, your secure, private AI assistant for iPhone, iPad, and macOS. Designed to boost your productivity and creativity while ensuring your privacy, Private LLM is a one-time purchase offering a universe of AI capabilities without subscriptions. Our chatbot utilizes cutting-edge on-device AI to keep your interactions confidential and completely offline, compatible with all your Apple devices.

Why Choose Private LLM?

- Diverse AI Models at Your Command: Select from a wide array of open-source LLM model families such as Google Gemma 2B, Mixtral 8x7B, Mistral 7B, Llama 2 (7B, 13B, and 33B), CodeLlama 13B, Solar 10.7B, and Phi 2 3B. Customize your AI experience for creative brainstorming, coding assistance, or daily inquiries.

- Seamless Siri & Shortcuts Integration: Enhance your AI interactions with Siri commands and customizable Shortcuts, making your digital assistant more integrated and accessible within your Apple ecosystem.

- Customizable System Prompts: Fine-tune your AI's responses and interactions to your liking with customizable system prompts, catering to your specific needs and preferences.

- Complete Privacy and Security: Private LLM confines your conversations to your device, providing unparalleled privacy. Our on-device AI enables powerful computing without data compromise or the need for an internet connection.

- Family Sharing & Offline Functionality: A one-time purchase that supports Family Sharing. Download models as needed and enjoy full AI assistant functionality, even offline.

- System Wide Grammar Correction and Summarization: Offering grammar correction, summarization, text shortening, and rephrasing within any app on your Mac.

Private LLM is more than a chatbot; it's an all-encompassing AI companion that respects your privacy while offering versatile, on-demand assistance. Whether for creative writing, solving complex programming issues, or general inquiries, Private LLM adapts to your needs, ensuring your data remains secure and on your device. Embark on a journey with Private LLM today and elevate your productivity and creative projects with the most private AI assistant for macOS and iOS devices.

Leveraging state-of-the-art Omniquant quantized models, Private LLM is a native Mac app that surpasses others with superior text generation, faster performance, and deeper integration compared to apps using generic baseline RTN quantized models like Ollama and LMStudio.

Supported Model Families:

- Google Gemma Based Models
- Mixtral 8x7B Based Models
- Llama 33B Based Models
- Llama 2 13B Based Models
- CodeLlama 13B Based Models
- Llama 2 7B Based Models
- Solar 10.7B Based Models
- Phi 2 3B Based Models
- Mistral 7B Based Models
- StableLM 3B Based Models
- Yi 6B Based Models
- Yi 34B Based Models

For a full list of supported models, including detailed specifications, please visit our website.

Optimized for Apple Silicon Macs with the Apple M1 chip or later, Private LLM for macOS delivers the best performance. Users on older Intel Macs without eGPUs may experience reduced performance.

What’s New

Version 1.8.6

- Support for downloading a 4-bit OmniQuant quantized version of the Meta-Llama-3-70B-Instruct model on Apple Silicon Macs with 48GB or more RAM.
- Support for downloading a 4-bit OmniQuant quantized version of the new Phi-3-Mini based kappa-3-phi-abliterated model on all Macs.
- Stability improvements and bug fixes.

Ratings and Reviews

3.0 out of 5
2 Ratings

2 Ratings

Slice313 ,

Nice

The developer is very active and is currently adding many improvements.

Developer Response ,

Thanks for your feedback! Please email us or message us on Twitter or Discord if there are any specific features or models that you'd like to have in our app.

Govorkaya ,

Too slow

Well maybe it's my 8GB mac, but this LLM is writing one word every 15 seconds, it's impossible to use.

Developer Response ,

LLM inference is quite memory intensive, but the 7B parameter model needs about 4.5GB of memory and works well on 8GB Macs. If it’s taking 15 seconds per word, it’s very likely that you have background apps that’s consuming most of the already scarce memory on your 8GB Mac and macOS is resorting to using swap memory, which is an order of magnitude slower than RAM. Please check for memory hungry apps using the Memory tab on Activity Monitor and close them before using Private LLM. Also, we aspire to delight our users with the app’s user experience, and if that’s not the case for any reason, please feel free to avail a refund by visiting reportaproblem.apple.com.

womo ,

Unusable

In its current iteration, it's simply unusuable. I get mostly nonsensical strings of seemingly associated text (not even proper sentences). For example:

<human> What is your name?
<bot> My name is Sora. And yes indeed - there were many times where even though they had no reason not do something else than stay home from school/work because their parents would say "it'll only take half hour" (or whatever) while actually taking more time then expected anyway....

Developer Response ,

Our app has evolved a lot since you left this review. We now have a bigger 7B parameter model by default and also an option to download WizardLM 13B parameter model for users using Apple Silicon Macs with 13GB of RAM or more. Would you be open to trying our app again?

App Privacy

The developer, Numen Technologies Limited, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy.

Data Not Collected

The developer does not collect any data from this app.

Privacy practices may vary based on, for example, the features you use or your age. Learn More

Supports

  • Family Sharing

    Up to six family members can use this app with Family Sharing enabled.

You Might Also Like

YourChat
Productivity
Local Brain
Productivity
MLC Chat
Productivity
Private LLM - Offline AI
Productivity
Vanessa LLM
Productivity
LLM: Answering Machine
Productivity