Local Inference OnDevice Agent
Offline AI chat. No cloud.
Free · Designed for iPad. Not verified for macOS.
Your AI. Your phone. Nobody else's business.
LocalInference runs powerful open AI models entirely on your device. Your conversations never leave your phone — no account, no cloud, no analytics, no tracking. Ever.
PRIVATE BY ARCHITECTURE, NOT BY PROMISE
• Everything runs on-device; works fully offline after a one-time model download
• Zero data collection — we couldn't read your chats if we wanted to
• API keys (optional) stored in the secure keychain, sent only to the provider you chose
A REAL ASSISTANT, NOT JUST A CHATBOT
• Tools: calculator, web search, date & time, webpage reading
• Contacts & calendar integration — every write action asks you first
• Ask about photos with vision models
• Reads answers aloud with on-device voices
BUILT FOR TINKERERS
• 16 curated models from 0.5B to 8B — Qwen3, Llama, Gemma, DeepSeek R1, Phi, SmolVLM
• Only models that fit your device's memory are offered
• Live tok/s, time-to-first-token, and token counts per response
• Thinking models show their reasoning in collapsible blocks
• Bring your own keys: Anthropic, OpenAI, Google — or any OpenAI-compatible server (llama.cpp, LM Studio, Ollama) on your own network
Built with Llama. Gemma models provided under the Gemma Terms of Use.
Ratings & Reviews
Stability and fixes.
• Much lighter on memory. On phones with less RAM the app was loading the model at the largest possible context window, which left the system paging it in and out and could make the phone feel like it had frozen. It now sizes the model to what your device can actually hold — around 200 MB less memory in use, and far less swapping.
• The app now genuinely frees the model when you switch away, instead of holding it in the background.
• Photos work properly. You can send a picture without typing a caption, retrying a photo question keeps the photo, and attaching one no longer silently turns tools off.
• Tools tell you why they failed instead of just saying "failed", and tools that need the internet are hidden when you're offline rather than timing out.
• Chats can be renamed — press and hold a chat in the list.
• Answers you stop early can now be copied and read aloud.
• A reply interrupted by the app closing is no longer lost; you can retry it.
• The top bar now blends into the background instead of sitting on it as a flat slab.
• Web search results are no longer matched to the wrong page.
• Attached images are cleaned up properly instead of taking up space forever.
The developer, Sameer Shanbhag, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy .
Data Not Collected
The developer does not collect any data from this app.
Accessibility
The developer has not yet indicated which accessibility features this app supports. Learn More
Information
- Seller
- Sameer Shanbhag
- Size
- 54.6 MB
- Category
- Productivity
- Compatibility
Requires iOS 16.4 or later.
- iPhone
Requires iOS 16.4 or later. - iPad
Requires iPadOS 16.4 or later. - Mac
Requires macOS 12.0 or later and a Mac with Apple M1 chip or later. - Apple Vision
Requires visionOS 1.0 or later.
- iPhone
- Languages
- English
- Age Rating
16+
- 16+
- Infrequent
Profanity or Crude Humor
Mature or Suggestive Themes
Contains
Unrestricted Web Access
- Copyright
- © 2026 Sameer Shanbhag
