Local LLM: MITHRIL

Name: Local LLM: MITHRIL
Rating: 4.4 (14 reviews)
Author: DEPLOY FORWARD LLC

Local AI Models On-Device

Free · Designed for iPad. Not verified for macOS.

14 Ratings
Age Rating

13+
Years
Category

Productivity
Developer

DEPLOY FORWARD LLC
Language

EN
English
Size

54.4
MB

Run quantized large language models directly on your iPhone. No cloud, no internet required. Run quantized large language models directly on your iPhone. No cloud, no internet required. Access state-of-the-art quantized AI models optimized for mobile hardware. Download GGUF-format models that compress billion-parameter networks into mobile-friendly sizes while maintaining performance. COMPLETE MODEL SUITE • Llama 3.2 1B/3B (Meta) - Q4/Q8 quantization • Gemma 3 270M/2B/9B (Google) - IQ4_NL optimization • Qwen 2.5 0.5B-7B (Alibaba) - Multiple quantization levels • LLaVA 1.5/1.6 (Vision) - Multimodal image understanding • Direct integration with Hugging Face model repository TECHNICAL FEATURES • GGML/llama.cpp inference engine • Metal GPU acceleration on Apple Silicon • Dynamic context window management (2K-8K tokens) • Retrieval-Augmented Generation (RAG) with embeddings • Real-time streaming with token/second metrics • SQLite conversation storage with vector search SYSTEM REQUIREMENTS Models run efficiently when file size ≤ available RAM. Recommended minimum 6GB RAM for larger models. iPhone 15 Pro/Pro Max optimal. iOS26 for Apple foundation model. Zero telemetry. Zero data transmission. Pure local AI computing.

Ratings & Reviews

4.4

out of 5

14 Ratings

Works as described so far
Jan 3
Dallin Bastian
I’ve just started using the app and it’s working as described. There is one critical feature missing. It must have a way to quickly copy the generated text. Each request and response needs to be able to be copied easily. Preferably with a button or a shortcut. I will update my rating to 5 stars a fast as possible when this feature is added. If there is a stretch goal for this app I would like to be able to use text2image models as well. Great job, and keep up the great work.
Works as described so far
Jan 3
Dallin Bastian

I’ve just started using the app and it’s working as described. There is one critical feature missing. It must have a way to quickly copy the generated text. Each request and response needs to be able to be copied easily. Preferably with a button or a shortcut. I will update my rating to 5 stars a fast as possible when this feature is added. If there is a stretch goal for this app I would like to be able to use text2image models as well. Great job, and keep up the great work.
bug in iPhone xs
Jan 15
izuski23Xx
Bug Report: Model Persistence and Startup Errors (iPhone XS)App Version: Mithril (Local LLM) Device: iPhone XS iOS Version: [ ios 18.3.2]Issue SummaryI am experiencing two main issues regarding model management and app startup:Redundant Download Prompt: After successfully importing and downloading a custom model, the app prompts me to download it again every time I select it.ExecuTorch Error: Every time the app opens, an "ExecuTorch error" appears, even though the model is already present on the device.Steps to ReproduceImport a custom model and complete the download process.Select the model for use.Observe the prompt asking to download the model again. (Current workaround: I close/force-quit the app to bypass this).Re-open the app and observe the "ExecuTorch error" notification upon startup.Expected BehaviorThe app should recognize that the model is already stored locally and load it immediately without re-triggering the download prompt.The app should launch without ExecuTorch errors if the model files are valid and present.Additional NotesDespite the error messages, the model does eventually work if I bypass the prompts.I am using an iPhone XS, so there may be specific optimizations or memory constraints related to older A12 Bionic hardware that are triggering these flags.
bug in iPhone xs
Jan 15
izuski23Xx

Bug Report: Model Persistence and Startup Errors (iPhone XS)App Version: Mithril (Local LLM) Device: iPhone XS iOS Version: [ ios 18.3.2]Issue SummaryI am experiencing two main issues regarding model management and app startup:Redundant Download Prompt: After successfully importing and downloading a custom model, the app prompts me to download it again every time I select it.ExecuTorch Error: Every time the app opens, an "ExecuTorch error" appears, even though the model is already present on the device.Steps to ReproduceImport a custom model and complete the download process.Select the model for use.Observe the prompt asking to download the model again. (Current workaround: I close/force-quit the app to bypass this).Re-open the app and observe the "ExecuTorch error" notification upon startup.Expected BehaviorThe app should recognize that the model is already stored locally and load it immediately without re-triggering the download prompt.The app should launch without ExecuTorch errors if the model files are valid and present.Additional NotesDespite the error messages, the model does eventually work if I bypass the prompts.I am using an iPhone XS, so there may be specific optimizations or memory constraints related to older A12 Bionic hardware that are triggering these flags.
Good but
Feb 20
JasonGwarrior
Needs a bit more stuff, like allowing to edit the system prompt. The rog feature is really good.
Good but
Feb 20
JasonGwarrior

Needs a bit more stuff, like allowing to edit the system prompt. The rog feature is really good.
Perfect for local models
12/15/2025
the_real_Oo
This works better then I would expect on a phone. Would love to be able to host an openai style service on it with it.
Perfect for local models
12/15/2025
the_real_Oo

This works better then I would expect on a phone. Would love to be able to host an openai style service on it with it.

-fixed ability to voice chat with Apple Foundation Model -smoothed onboarding for voice chat- now if no models are downloaded yet a modal will pop up and prompt you to download one of the 3 whisper models instead of automatically downloading them all -if content block is hit with foundation model in voice chat, a modal will popup and explain that Apple limits content then give option to start new chat or switch to open source model

Version 1.6.2 10/13/2025

Data Not Collected

The developer does not collect any data from this app.

Privacy practices may vary, for example, based on the features you use or your age. Learn More

Accessibility

Information

Seller: DEPLOY FORWARD LLC
Size: 54.4 MB
Category: Productivity
Compatibility: Requires iOS 15.1 or later.

iPhone
Requires iOS 15.1 or later.

iPad
Requires iPadOS 15.1 or later.

iPod touch
Requires iOS 15.1 or later.

Mac
Requires macOS 15.1 or later and a Mac with Apple M1 chip or later.

Apple Vision
Requires visionOS 1.0 or later.
Languages: English
Age Rating: 13+

13+

Learn More

Infrequent
Profanity or Crude Humor
Horror/Fear Themes
Medical Treatment information
Alcohol, Tobacco, Drug Use or References

Contains
Messaging and Chat
User-Generated Content
Health or Wellness Topics

Privacy Policy

More by DEPLOY FORWARD LLC

View

infipedia

Infinite wiki 100% local
View

FPV Drone Operator Manual

build/fix component manual

You Might Also Like

View

NoemaAI

Offline AI with Datasets
View

LLM Pigeon

Your private AI chatbot
View

Control - LLM Interface

Private, Local AI
View

MLX Studio: Local AI Chat

Private On-Device AI Assistant
View

MobileLLM

Run LLM on your device
View

BonzAI - Local AI Agent

Your personal & private AI
View

Privacy AI: Powerful chatbot

Hub for local and remote AI
View

AI Offline LLM Chat: Lapis

Productivity
View

OneLLM : Private & Online LLM

Supports Local LLM Vision Chat
View

morai: Private AI

Runs Fully On-Device.

Local LLM: MITHRIL

Ratings & Reviews

Works as described so far

bug in iPhone xs

Good but

Perfect for local models

What’s New

App Privacy

Data Not Collected

Accessibility

Information

More by DEPLOY FORWARD LLC

infipedia

FPV Drone Operator Manual

You Might Also Like

NoemaAI

LLM Pigeon

Control - LLM Interface

MLX Studio: Local AI Chat

MobileLLM

BonzAI - Local AI Agent

Privacy AI: Powerful chatbot

AI Offline LLM Chat: Lapis

OneLLM : Private & Online LLM

morai: Private AI