Private LLM - Local AI Chatbot 17+

Numen Technologies Limited

    • 9,99 €

Descrizione

Discover Private LLM, your secure, private AI assistant for iPhone, iPad, and macOS. Designed to boost your productivity and creativity while ensuring your privacy, Private LLM is a one-time purchase offering a universe of AI capabilities without subscriptions. Our chatbot utilizes cutting-edge on-device AI to keep your interactions confidential and completely offline, compatible with all your Apple devices.

Why Choose Private LLM?

- Diverse AI Models at Your Command: Select from a wide array of open-source LLM model families such as Google Gemma 2B, Mixtral 8x7B, Mistral 7B, Llama 2 (7B, 13B, and 33B), CodeLlama 13B, Solar 10.7B, and Phi 2 3B. Customize your AI experience for creative brainstorming, coding assistance, or daily inquiries.

- Seamless Siri & Shortcuts Integration: Enhance your AI interactions with Siri commands and customizable Shortcuts, making your digital assistant more integrated and accessible within your Apple ecosystem.

- Customizable System Prompts: Fine-tune your AI's responses and interactions to your liking with customizable system prompts, catering to your specific needs and preferences.

- Complete Privacy and Security: Private LLM confines your conversations to your device, providing unparalleled privacy. Our on-device AI enables powerful computing without data compromise or the need for an internet connection.

- Family Sharing & Offline Functionality: A one-time purchase that supports Family Sharing. Download models as needed and enjoy full AI assistant functionality, even offline.

- System Wide Grammar Correction and Summarization: Offering grammar correction, summarization, text shortening, and rephrasing within any app on your Mac.

Private LLM is more than a chatbot; it's an all-encompassing AI companion that respects your privacy while offering versatile, on-demand assistance. Whether for creative writing, solving complex programming issues, or general inquiries, Private LLM adapts to your needs, ensuring your data remains secure and on your device. Embark on a journey with Private LLM today and elevate your productivity and creative projects with the most private AI assistant for macOS and iOS devices.

Leveraging state-of-the-art Omniquant quantized models, Private LLM is a native Mac app that surpasses others with superior text generation, faster performance, and deeper integration compared to apps using generic baseline RTN quantized models like Ollama and LMStudio.

Supported Model Families:

- Google Gemma Based Models
- Mixtral 8x7B Based Models
- Llama 33B Based Models
- Llama 2 13B Based Models
- CodeLlama 13B Based Models
- Llama 2 7B Based Models
- Solar 10.7B Based Models
- Phi 2 3B Based Models
- Mistral 7B Based Models
- StableLM 3B Based Models
- Yi 6B Based Models
- Yi 34B Based Models

For a full list of supported models, including detailed specifications, please visit our website.

Optimized for Apple Silicon Macs with the Apple M1 chip or later, Private LLM for macOS delivers the best performance. Users on older Intel Macs without eGPUs may experience reduced performance.

Novità

Versione 1.8.6

- Support for downloading a 4-bit OmniQuant quantized version of the Meta-Llama-3-70B-Instruct model on Apple Silicon Macs with 48GB or more RAM.
- Support for downloading a 4-bit OmniQuant quantized version of the new Phi-3-Mini based kappa-3-phi-abliterated model on all Macs.
- Stability improvements and bug fixes.

Valutazioni e recensioni

4,3 su 5
3 valutazioni

3 valutazioni

Sinoviale ,

Mi piace tantissimo.

Appena riuscirò a far essere le risposte meno casuali sarò ancora più felice 💓

Risposta dello sviluppatore ,

Grazie per la recensione! Abbiamo già il modello 13B sul nostro app macOS (scaricabile gratuitamente in quanto hai l'app iOS). Potrebbe essere introdotto il modello 13B su iPhone 15 Pro e Pro Max, poiché hanno 8GB di RAM. Stiamo aspettando di ottenere i dispositivi per poterli testare. Ti preghiamo di non esitare a contattarci via email a support@numen.ie se hai altre feedback o domande. PS: Questo messaggio è stato tradotto dall'inglese dal modello 13B sul nostro app macOS.

dbenji83 ,

Missing Shortcuts repository and extensions

I purchased also for the idea of having a repository for shortcuts and extensions to lunch the Private LLM directly from Finder or inside a document. It's incomplete without that functionality. It would be nice to have the following "extensions" directly in Finder:
- analyze the document
- summerize document
- chat with the document
and inside the file
- translate
- summerize the text
- rephase
- elaborate

Last but not least it would be nice to add the DocsGPT model and the possibility of dragging an drop one or more document directly in the Private LLM app.

Risposta dello sviluppatore ,

Thanks for the review! We don't ship any shortcuts with the app, but you can download popular user contributed shortcuts from our website (privatellm.app). Also, we have macOS services for bulletizing text, grammar correction, rephrasing and shortening text. You can right click on editable text within any app and access them from the services sub-menu. Additionally, users can also assign keyboard shortcuts to these services from System Settings -> Keyboard -> Keyboard Shortcuts -> Services -> Text. Also, users can add their own services for translation, or anything else they'd like to wish for by creating a macOS Shortcut that uses Private LLM and checking the checkbox within the Shortcuts app to make it accessible from the Services menu. Finally, We're working on implementing Retrieval augmented generation (RAG). As you know, given our commitment to privacy, we need to implement completely on-device and there are some technical challenges that need to be overcome before we can ship that feature. If you have any feature requests, please feel free to email us (support@numen.ie) or DM us on Twitter (@private_llm) or join our Discord.

Privacy dell’app

Lo sviluppatore, Numen Technologies Limited, ha indicato che le procedure per la tutela della privacy dell’app potrebbero includere il trattamento dei dati descritto di seguito. Per ulteriori informazioni, consulta l’informativa sulla privacy dello sviluppatore.

Dati non raccolti

Lo sviluppatore non raccoglie alcun dato da quest’app.

Le procedure per la tutela della privacy possono variare, per esempio, in base alle funzioni che usi o alla tua età. Ulteriori informazioni

Supporto

  • In famiglia

    Se “In famiglia” è stato attivato, fino a sei membri della famiglia potranno usare l’app.

Ti potrebbe piacere

YourChat
Produttività
Local Brain
Produttività
MLC Chat
Produttività
Vanessa LLM
Produttività
Private LLM - Offline AI
Produttività
Patagonia AI - Private LLM
Produttività