On-Device AI: Offline & Secure 16+

Voice to text & LLM AI Chat

Zijie Deng

    • 4.3 • 22 Ratings
    • Free
    • Offers In-App Purchases

Description

Complete AI platform: Live transcription, natural text-to-speech, document analysis, chat, web search & collaborative AI agents - entirely offline & private

Transform speech to text and text to speech with natural AI voices, all offline and private. Record meetings for transcripts, generate professional audio from any text, and create sophisticated AI teams where specialized agents collaborate on complex tasks. Work with top AI models like Llama, Gemma, Phi, Qwen, DeepSeek, plus choose between Apple's built-in voices or advanced Kokoro TTS. Analyze documents, translate languages, and boost productivity while keeping all your data securely on your device.

100% OFFLINE & PRIVATE
- Process data securely on your device - no cloud servers, no third parties
- Chat with AI models and teams without sending data anywhere
- Maintain complete control of your personal information and workflows

COLLABORATIVE AI TEAMS
- Create sophisticated AI teams where specialized agents work together on complex tasks
- Built-in templates for business strategy, academic research, and creative projects
- Deploy Market Analyst + Strategic Planner + Risk Assessor agents for business planning
- Configure custom multi-agent workflows with decision-making processes
- Perfect for complex problems benefiting from multiple AI perspectives

COMPLETE VOICE & SPEECH SUITE
- Instantly record and transcribe meetings, lectures, or notes
- Generate natural, professional-quality speech from any text using Apple voices or Kokoro TTS
- Experience human-like AI responses with expressive voice delivery
- Create audio content, accessibility solutions, or voice-over materials on-demand
- Get AI-generated summaries with natural voice narration
- Effortlessly translate and convert between speech and text

APPLE ECOSYSTEM INTEGRATION
- Connect iPhone, iPad, to Mac for hardware acceleration
- Access AI instantly from Mac's menu bar without switching apps
- Use customizable hotkeys to trigger AI conversations while working
- Use Siri and Shortcuts to trigger AI commands quickly
- Optimized for Apple Silicon with enhanced cross-platform workflows

SMART DOCUMENT ANALYSIS
- Automatically extract insights from PDFs and images
- Summarize reports, articles, or research papers with one tap
- Convert scanned documents into actionable tasks
- Quickly grasp key points from research materials or business documents

CONNECTED KNOWLEDGE BASE
- Import PDFs, text files to build a personalized knowledge base for your AI teams
- Enter any URL and instantly analyze online content without leaving the app
- Capture or import images with text and extract content via OCR for AI analysis
- Reference your information privately across collaborations

BUILT-IN ONLINE SEARCH
- Transform raw search results into clear, concise summaries
- Generate multiple queries automatically
- Track search progress in real time
- All AI processing happens on your device, even while searching the web
- Stay updated on news, facts, and information while maintaining privacy

PERSONALIZED AI EXPERIENCE
- Switch between specialized AI roles instantly (Academic, Writer, Developer)
- Custom-configure models and agent workflows for specific projects
- Optimize performance for your device capabilities
- Design your perfect AI assistant team for any situation

CONTINUOUS IMPROVEMENTS
- Ongoing optimization for faster AI responses
- New models and capabilities added frequently
- Optimized for latest Apple hardware and software
- Enhanced multi-agent collaboration features and templates

Designed for Everyone
Whether you're developing business strategies with AI teams, researching topics, creating content, or staying informed through web searches - On-Device AI offers powerful tools to elevate your experience while keeping your data completely private.

DEVICE REQUIREMENTS
For optimal performance, this app works best on devices with larger than 6GB RAM such as: iPhone 14 / iPad mini (7th) / iPad Air (5th), iPad Pro (3rd), iPad (11th), and newer device.

EULA: https://www.apple.com/legal/internet-services/itunes/dev/stdeula/

What’s New

Version 1.29.0


Cloud Provider Integration

- Connect to OpenAI, Anthropic, Google Gemini, Groq, OpenRouter, LM Studio, or Ollama for access to powerful cloud models like GPT-4, Claude, and Gemini
- Seamlessly switch between on-device and cloud models within the same conversation for optimal performance and privacy balance
- Business Use: Access latest GPT-4 for complex analysis while keeping sensitive data local on your device
- Flexible Workflows: Use cloud models for heavy reasoning tasks and local models for quick responses or offline scenarios

Enhanced Session Management

- Remove individual attached documents from conversations with a simple tap on the close button
- Clean up document references without affecting previous conversation responses
- Research Projects: Dynamically manage your knowledge base by removing outdated PDFs or irrelevant images mid-session
- Document Review: Add multiple files for comparison, then remove unnecessary ones to focus AI analysis on relevant materials

Improved Inference Stability

- Resolved memory management issues when switching between local and cloud models for smoother transitions
- Enhanced error handling and recovery during model loading and inference processes
- Multi-Model Workflows: Switch between local models and cloud APIs without performance degradation
- Extended Sessions: More stable operation during long conversations with frequent model switching

UI Refinements & Bug Fixes

- Fixed display issues in model picker and settings interfaces for better user experience
- Improved visual feedback and state indicators throughout the application
- Streamlined Settings: Cleaner interface for managing both local and cloud model configurations
- Better Discovery: Enhanced UI makes it easier to explore and configure cloud provider options

Experience the perfect balance between privacy and power. Connect to cutting-edge cloud models when you need maximum capability, while keeping your sensitive data secure with local processing. Version 1.29.0 delivers the most flexible and stable AI experience yet, with seamless cloud integration and refined session management.

Ratings and Reviews

4.3 out of 5
22 Ratings

22 Ratings

beats1393 ,

Best local AI on iPhone

I honestly can’t fathom how this app is free. It’s like stumbling upon a treasure chest in a sea of paid apps that don’t even offer a fraction of these features. The fact that you can run AI models locally, with this much precision and functionality, is mind-blowing. Meanwhile, so many “premium” apps charge a hefty price for far less.

Now, about the negative reviews—let’s address the elephant in the room. If your 6GB iPhone can’t handle an 8B model, that’s not the app’s fault; it’s basic tech knowledge. Calling the app a “scam” because of hardware limitations is akin to blaming a sports car for not fitting in a bicycle lane. Let’s be real: you wouldn’t try to cram a piano into a shoebox, so why attempt to run a high-performance model on a device not equipped for it?

This app is a gem, and any criticism rooted in misunderstanding is just noise. It’s evident that the developers behind this masterpiece know their stuff, and the fact that it’s accessible to everyone at no cost deserves applause. If you’re into cutting-edge AI and have the right hardware, this app is a game-changer. Don’t sleep on it!

sjm49 ,

Upgrading my review to 5 stars...

UPDATE: The Developer's prompt response below took care of the problem after I unplugged my iPad from the charging brick, while running the app, my device no longer overheated. I really like this app and appreciate the rapid response support. Having access to LLMs offline (when wi-fi connectivity isn't available) is a much appreciated gift. Thanks🙏🏼 ............................. ORIGINAL REVIEW: How can I use this app on my ipad pro (12.9" m1 fifth gen 16mb device with 1TB memory) but without it overheating my device??? For example, I just ran a simple search and analysis of cutlery "super-steels" and my device screen promptly heated up to the touch. No other apps I have used elicit this speedy and high a temperature increase. I am concerned that continuing to use it will damage my iPad. Developer, please discuss and identify how to fix this problem. Please note that I downloaded only one of the two LLMs recommended by the app for this iPad's capabilities.

Developer Response ,

Thank you for your feedback! Since the AI models run locally on your device for privacy, intensive processing does generate heat, especially during long tasks. This is particularly noticeable when your device is connected to power during use.

Immediate suggestions:
1) Disconnect from power cable during AI processing when possible
2) Take breaks between longer tasks to let device cool down

I'm going to adding a thread control setting that will let you adjust processing threads. Lower thread count = less heat but slower processing. Higher thread count = faster but more heat. You'll be able to choose the balance that works for your needs.

Thanks for helping make the app better!

MemeMaster's Play ,

Shortcuts compatibility is awesome!

The ability to make a shortcut that allows for running an LLM in the background is great. Do you believe that there are any extra features you can add for shortcut compatibility? For example: - Defining a system prompt - Continuing a conversation - Defining a preset conversation (to be used as synthetic context) then generating a response to the defined conversation ... all in Shortcuts :D There are just a few problems, however. I've come to find that a message may just stop generating out of the blue, and that in Shortcuts, generated responses from the same query are always the same. Aside from these minor issues, thank you so much for implementing this feature, I can see many practical shortcut workflows coming up in the near future, and maybe you could even put together a community of Shortcut users where they show off cool little applets and masterpieces through the power of prompt engineering!

App Privacy

The developer, Zijie Deng, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy.

Data Not Collected

The developer does not collect any data from this app.

Privacy practices may vary, for example, based on the features you use or your age. Learn More

More By This Developer

You Might Also Like

Private LLM - Local AI Chat
Utilities
xChat AI - Offline Chatbot
Utilities
LLM Local Client
Utilities
Apollo - Powered by Liquid
Utilities
PrivAI - Private AI GPT Chat
Utilities
fullmoon: local intelligence
Utilities