Patagonia AI - Private LLM ١٧+

I will preface this review with stating this is is free and collects zero user data so any ideas I have could be improved with future update.

The overall interface is really good. It’s super simple with nothing more than what is needed for chatting with a llm on device. It follow design notes of even the open ai ChatGPT app with suggested prompts and a clean input and well formatted chat dialog interfaces.

The icon and name and branding are just simple clean and great all around.

The speech to text feature is nice and stable. It doesn’t detect when you stop speaking but I’d argue that’s more accessible for if you pause to think mid way through your question.

The simple use of color is also nice.

Now for the areas to improve.
The app description claims that it is a fully open source project but I cannot find an app by this branding anywhere online on public code hosting sites like GitHub or Gitlab. Also the app listing website or app support go to a website that has no contact information or even a mention of this app at all. It’s an outdated manifest predicting what advancements apple may roll out in 2022. It’s 2024, at least follow apples guidelines and provide some contact information on your support website so end users can get ahold of the developer if needed.

This brings up concerns of the credibility of the developer claiming no data collected and claiming the app is completely open source. Maybe the description meant the llm model used on devices is open source? I’m not sure I’ll ever know which.

Other areas for improvement would be a text to speech option for the llm responses so you could optionally hear the response. iOS has a great built in TTS frameworks that work offline too.

The main issue with this app in its current form is just how slow it is at typing the response from the LLM. I know some LLMs are slower that others on an iPhone but I have other offline LLM apps that run circles around how slow this app is at relaying the response. I’m not sure why it’s so slow? Maybe a artificial delay introduces from a poorly written animation? Or the model included in the app is not as optimized as some of the other open source models used in other apps.

I was kind of thinking of making a pull request to at least add TTS and maybe fix the slow response output but without a public git repo I simply cannot help.

Hopefully you can fix these concerns in a future update even if you keep your source code private. That’s fine too. It’s so close to being a 5 star app.

Wow!! What a review!!

Thank you for taking the time to provide such detailed feedback! Your insights are incredibly valuable to us. Regarding the app's open-source status, the underlying Large Language Model (LLM) is indeed open source, utilizing LLama2. While the app itself is not yet open source, I'm actively working on publishing it on GitHub very soon. Improving the performance of the output is a top priority, and I'm currently focusing on addressing this challenge. Your feedback on this review is greatly appreciated, and I'll ensure it receives the attention it deserves.

I want to clarify that the app is indeed free and collects zero user data. It doesn't store any data locally, so every time you close it everything is erased. I'm glad you appreciate the overall interface and find it simple and clean. Your suggestion for a text-to-speech option for LLM responses is noted, and I'll explore integrating that feature.

For running on an iPhone this app works wonders being able to converse with artificial intelligence without the Internet is really some special. I’m really happy that these developers decided to make this more accessible and share this app for free I would 100% recommend downloading this app one of the coolest technologies I’ve ever seen and I hope, they keep improving it. Thank you for creating something truly amazing!!

Wow, thank you for such an amazing review! We're thrilled to hear that you're loving the experience of interacting with AI on your iPhone, even without an internet connection. Making technology accessible and user-friendly is our goal, and your recommendation means the world to us. We're committed to continuous improvement, so stay tuned for even more exciting updates! Thanks again for your support and enthusiasm!

This AI is able to answer things quickly and well and at the same time doesn’t have the caveat of storing all of your queries or gathering your data. So far the answers have been high-quality and thorough without the need to connect online, which is impressive.

Thank you so much for your kind words! We're thrilled to hear that you're enjoying the app and finding it helpful. Your satisfaction is our top priority, and we're committed to providing high-quality, privacy-conscious AI assistance. If you ever have any questions or need assistance, feel free to reach out. Happy to help!