Local LLM: MITHRIL

Local AI Models On-Device

Free · Designed for iPad

Run quantized large language models directly on your iPhone. No cloud, no internet required. Run quantized large language models directly on your iPhone. No cloud, no internet required. Access state-of-the-art quantized AI models optimized for mobile hardware. Download GGUF-format models that compress billion-parameter networks into mobile-friendly sizes while maintaining performance. COMPLETE MODEL SUITE • Llama 3.2 1B/3B (Meta) - Q4/Q8 quantization • Gemma 3 270M/2B/9B (Google) - IQ4_NL optimization • Qwen 2.5 0.5B-7B (Alibaba) - Multiple quantization levels • LLaVA 1.5/1.6 (Vision) - Multimodal image understanding • Direct integration with Hugging Face model repository TECHNICAL FEATURES • GGML/llama.cpp inference engine • Metal GPU acceleration on Apple Silicon • Dynamic context window management (2K-8K tokens) • Retrieval-Augmented Generation (RAG) with embeddings • Real-time streaming with token/second metrics • SQLite conversation storage with vector search SYSTEM REQUIREMENTS Models run efficiently when file size ≤ available RAM. Recommended minimum 6GB RAM for larger models. iPhone 15 Pro/Pro Max optimal. iOS26 for Apple foundation model. Zero telemetry. Zero data transmission. Pure local AI computing.

Ratings & Reviews

  • 5.0
    out of 5
    3 Ratings

-fixed ability to voice chat with Apple Foundation Model -smoothed onboarding for voice chat- now if no models are downloaded yet a modal will pop up and prompt you to download one of the 3 whisper models instead of automatically downloading them all -if content block is hit with foundation model in voice chat, a modal will popup and explain that Apple limits content then give option to start new chat or switch to open source model

Version 1.6.2

The developer, DEPLOY FORWARD LLC, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy .

  • Data Not Collected

    The developer does not collect any data from this app.

    Privacy practices may vary, for example, based on the features you use or your age. Learn More

    Accessibility

    The developer has not yet indicated which accessibility features this app supports. Learn More

    Information

    • Seller
      • DEPLOY FORWARD LLC
    • Size
      • 54.4 MB
    • Category
      • Productivity
    • Compatibility
      Requires iOS 15.1 or later.
      • iPhone
        Requires iOS 15.1 or later.
      • iPad
        Requires iPadOS 15.1 or later.
      • iPod touch
        Requires iOS 15.1 or later.
      • Mac
        Requires macOS 15.1 or later and a Mac with Apple M1 chip or later.
      • Apple Vision
        Requires visionOS 1.0 or later.
    • Languages
      • English
    • Age Rating
      13+
      • 13+
      • Learn More
      • Infrequent
        Profanity or Crude Humor
        Horror/Fear Themes
        Medical Treatment information
        Alcohol, Tobacco, Drug Use or References

        Contains
        Messaging and Chat
        User-Generated Content
        Health or Wellness Topics
    • Copyright
      • © 2025 Deploy Forward LLC / MITHRIL & Josh Berns
  • Privacy Policy

    • More by DEPLOY FORWARD LLC

    You Might Also Like