Private LLM - Local AI Chat

Name: Private LLM - Local AI Chat
Price: 5.99 EUR
Rating: 3.9 (17 reviews)
Author: Numen Technologies Limited

Utility

5,99 €

17 valutazioni
Età

13+
Anni
Categoria

Utility
Sviluppatore

Numen Technologies Limited
Lingua

EN
Inglese
Dimensioni

1,4
GB

Discover the Ultimate Privacy-Focused AI Assistant on iOS: Private LLM Unlock a new realm of productivity and creativity on your iPhone and iPad with Private LLM, the premier AI assistant designed with your privacy in mind. Available for a one-time purchase, it offers a range of AI capabilities without needing a subscription. Experience advanced on-device AI that keeps your interactions confidential and offline. Why Private LLM is Your Go-To AI Companion: - Exclusive AI Model Selection: Choose from a diverse set of open-source LLM models optimized for performance and perplexity on iOS with state of the art OmniQuant quantization: including models from Llama 2, Llama 3.2, Llama 3.1, Google Gemma 2, Gemma 3, Microsoft Phi-3, Mistral 7B, Qwen 2.5, Qwen 3, StableLM 3B and many more. Whether you need help with creative brainstorming, coding, or daily questions, customize your AI experience to meet your unique needs. - Integrated with Siri & Shortcuts: Enhance your AI interactions with Siri commands and customizable Shortcuts. Private LLM seamlessly fits within your Apple ecosystem, making your digital assistant more accessible. - Customizable Interactions: Tailor your AI's responses and interactions with customizable system prompts to match your preferences and needs. - Uncompromised Privacy and Security: With Private LLM, your conversations stay confidential and on your device. Our advanced on-device AI performs robust computing without risking data compromise or needing an internet connection. - Family Sharing & Offline Capabilities: Benefit from a one-time purchase that includes Family Sharing. Download models as needed and enjoy the full functionality of your AI assistant, even without internet access. Supported LLM Model families: - DeepSeek R1 Distill based models - Phi 4 based models - Qwen 3 based models (Qwen3-4B-Instruct-2507) - Qwen 2.5 based models (0.5B, 1.5B, 3B and 7B) - Qwen 2.5 Coder based Models (0.5B, 1.5B, 3B, 7B and 14B) - Llama 3.1 8B based models - Llama 3.2 1B and 3B based models - Google Gemma 2 2B and 9B based models - Google Gemma 3 1B based models - Mistral 7B based models - Yi 6B based models For a full list of supported models, including detailed specifications, please visit privatellm.app/models. Private LLM is not just a chatbot; it's a comprehensive AI companion designed to respect your privacy while providing versatile, on-demand assistance. Whether you're enhancing your creative writing, tackling complex programming challenges, or just seeking answers, Private LLM adapts to meet your needs while keeping your data secure. Start your journey with Private LLM today and elevate your productivity and creative projects with the most private AI assistant for iOS devices. Private LLM is a better alternative to generic llama.cpp and MLX wrappers apps like Enchanted, Ollama, LLM Farm, LM Studio, Locally AI, RecurseChat, etc on three fronts: 1. Private LLM uses a faster and highly-optimized mlc-llm based inference engine. 2. Models in Private LLM are quantized using the state of the art quantization algorithms like OmniQuant, while competing apps use naive round-to-nearest quantization. 3. Private LLM is a fully native app built using C++, Metal and Swift with deep integrations with iOS and iPadOS, while many of the competing apps are bloated and non-native Electron or Flutter based apps. Please note that Private LLM only supports inference with text based LLMs. Model support varies by device capabilities.

Valutazioni e recensioni

3,9

su 5

17 valutazioni

Missing Shortcuts repository and extensions
17/03/2024

dbenji83
I purchased also for the idea of having a repository for shortcuts and extensions to lunch the Private LLM directly from Finder or inside a document. It's incomplete without that functionality. It would be nice to have the following "extensions" directly in Finder:- analyze the document- summerize document- chat with the documentand inside the file- translate- summerize the text- rephase- elaborateLast but not least it would be nice to add the DocsGPT model and the possibility of dragging an drop one or more document directly in the Private LLM app.

Risposta dello sviluppatore
Thanks for the review! We don't ship any shortcuts with the app, but you can download popular user contributed shortcuts from our website (privatellm.app). Also, we have macOS services for bulletizing text, grammar correction, rephrasing and shortening text. You can right click on editable text within any app and access them from the services sub-menu. Additionally, users can also assign keyboard shortcuts to these services from System Settings -> Keyboard -> Keyboard Shortcuts -> Services -> Text. Also, users can add their own services for translation, or anything else they'd like to wish for by creating a macOS Shortcut that uses Private LLM and checking the checkbox within the Shortcuts app to make it accessible from the Services menu. Finally, We're working on implementing Retrieval augmented generation (RAG). As you know, given our commitment to privacy, we need to implement completely on-device and there are some technical challenges that need to be overcome before we can ship that feature. If you have any feature requests, please feel free to email us (support@numen.ie) or DM us on Twitter (@private_llm) or join our Discord.
Missing Shortcuts repository and extensions
17/03/2024

dbenji83

I purchased also for the idea of having a repository for shortcuts and extensions to lunch the Private LLM directly from Finder or inside a document. It's incomplete without that functionality. It would be nice to have the following "extensions" directly in Finder:- analyze the document- summerize document- chat with the documentand inside the file- translate- summerize the text- rephase- elaborateLast but not least it would be nice to add the DocsGPT model and the possibility of dragging an drop one or more document directly in the Private LLM app.
Risposta dello sviluppatore 19/03/2024
Thanks for the review! We don't ship any shortcuts with the app, but you can download popular user contributed shortcuts from our website (privatellm.app). Also, we have macOS services for bulletizing text, grammar correction, rephrasing and shortening text. You can right click on editable text within any app and access them from the services sub-menu. Additionally, users can also assign keyboard shortcuts to these services from System Settings -> Keyboard -> Keyboard Shortcuts -> Services -> Text. Also, users can add their own services for translation, or anything else they'd like to wish for by creating a macOS Shortcut that uses Private LLM and checking the checkbox within the Shortcuts app to make it accessible from the Services menu. Finally, We're working on implementing Retrieval augmented generation (RAG). As you know, given our commitment to privacy, we need to implement completely on-device and there are some technical challenges that need to be overcome before we can ship that feature. If you have any feature requests, please feel free to email us (support@numen.ie) or DM us on Twitter (@private_llm) or join our Discord.
Unfortunately, useless. No RAG, no unpublished models. Good only for newbies.
31/12/2024

shaice
I use LMStudio, anythingLLM, Ollama and open web ui on daily basis. I have a M3MAX/64GB and unfortunately this software doesn’t have anything of useful: 1) if you need more control on models and parameters, use LMStudio; 2) if you need something to analyze your own documents use Dot (it’s free); 3) if you need something to transcribe use Whisper; 4) if you need something to Upscale images use Upscaly; 5) If you need to create images use DiffusionBee. Unfortunately this chatbot is completely useless since you have to stick to their models and nothing else. And the models are freely available on Hugginface via LMStudio or Ollama. So it is 6 bucks wasted. Sorry devs, but someone has to say this. This app is useful only if you don’t want to read anything online to make it completely for free.

Risposta dello sviluppatore
Dear shaice, it looks like you aren't following your own advice to do some reading online. Please go to Youtube, Google, or any other search engine, and search for "LM Studio vs Private LLM", "Ollama vs Private LLM", etc. While you're at it, you might also want to go read the FAQ on our website (privatellm.app/faq). What you'll learn, might change your mind. If not, go to reportaproblem.apple.com and request a refund. One more thing: two of the three VC funded llama.cpp wrappers that you're shilling are bloated electron.js apps (LMStudio, anythingLLM), the third does not have a UI (Ollama). Private LLM is a fully native SwiftUI app, with deep macOS and iOS integrations. Also, none of the apps you're shilling run on iOS and iPadOS, Private LLM does.
Unfortunately, useless. No RAG, no unpublished models. Good only for newbies.
31/12/2024

shaice

I use LMStudio, anythingLLM, Ollama and open web ui on daily basis. I have a M3MAX/64GB and unfortunately this software doesn’t have anything of useful: 1) if you need more control on models and parameters, use LMStudio; 2) if you need something to analyze your own documents use Dot (it’s free); 3) if you need something to transcribe use Whisper; 4) if you need something to Upscale images use Upscaly; 5) If you need to create images use DiffusionBee. Unfortunately this chatbot is completely useless since you have to stick to their models and nothing else. And the models are freely available on Hugginface via LMStudio or Ollama. So it is 6 bucks wasted. Sorry devs, but someone has to say this. This app is useful only if you don’t want to read anything online to make it completely for free.
Risposta dello sviluppatore 2 gen
Dear shaice, it looks like you aren't following your own advice to do some reading online. Please go to Youtube, Google, or any other search engine, and search for "LM Studio vs Private LLM", "Ollama vs Private LLM", etc. While you're at it, you might also want to go read the FAQ on our website (privatellm.app/faq). What you'll learn, might change your mind. If not, go to reportaproblem.apple.com and request a refund. One more thing: two of the three VC funded llama.cpp wrappers that you're shilling are bloated electron.js apps (LMStudio, anythingLLM), the third does not have a UI (Ollama). Private LLM is a fully native SwiftUI app, with deep macOS and iOS integrations. Also, none of the apps you're shilling run on iOS and iPadOS, Private LLM does.
Dare la possibilità di caricare un modello personale
25/05/2024

Sinoviale
Your application is paid, but it should allow users to upload their own personal model via file. I use Llama3, 4Q, which works everywhere, while your model does not function correctly as it responds without understanding. You have only provided Llama3, 3Q. We request that you add a feature to select and upload a GGUF file that we have already downloaded.

Risposta dello sviluppatore
One of the reasons why our app is far better than other GGUF based apps is because we quantize models with the state of the art OmniQuant algorithm. It takes many hours of NVIDIA GPU time to quantize each model with OmniQuant, while it only takes a few minutes of CPU time to RTN quantize GGUF models. But the resulting OmniQuant quantized models are superior to RTN quantized models, in terms of perplexity. You'll find more details about this on our website (privatellm.app). If you have any requests for models, please write to us and we'll quantize and include the option to download it in an upcoming release.
Dare la possibilità di caricare un modello personale
25/05/2024

Sinoviale

Your application is paid, but it should allow users to upload their own personal model via file. I use Llama3, 4Q, which works everywhere, while your model does not function correctly as it responds without understanding. You have only provided Llama3, 3Q. We request that you add a feature to select and upload a GGUF file that we have already downloaded.
Risposta dello sviluppatore 31/05/2024
One of the reasons why our app is far better than other GGUF based apps is because we quantize models with the state of the art OmniQuant algorithm. It takes many hours of NVIDIA GPU time to quantize each model with OmniQuant, while it only takes a few minutes of CPU time to RTN quantize GGUF models. But the resulting OmniQuant quantized models are superior to RTN quantized models, in terms of perplexity. You'll find more details about this on our website (privatellm.app). If you have any requests for models, please write to us and we'll quantize and include the option to download it in an upcoming release.
Good but nothing exceptional
30 mag

mar_1986
Bought 1 month ago, some nice custom tailored models but since then no updates and no new models. Others free app alternative has more functions and new models added almost daily

Risposta dello sviluppatore
If you're happy with inferior quants and slower performance, there are indeed plenty of freemium clones of this app on the App Store.
Good but nothing exceptional
30 mag

mar_1986

Bought 1 month ago, some nice custom tailored models but since then no updates and no new models. Others free app alternative has more functions and new models added almost daily
Risposta dello sviluppatore 15 giu
If you're happy with inferior quants and slower performance, there are indeed plenty of freemium clones of this app on the App Store.