LLMTray
AI on Your Hardware, No Cloud
Only for Mac
Free · In‑App Purchases
Mac
Run AI models right on your computer: chat, draw, make songs, read web pages and show your screen. Serve an OpenAI-compatible API to your apps. Private, offline-ready!
LLMTray runs AI models on your hardware. Chat, draw pictures, make songs and give your apps an OpenAI-compatible API, all on Apple silicon, with no account and no cloud.
LESS DATA CENTER. MORE YOUR OWN HARDWARE.
Your hardware is already a capable AI machine. LLMTray puts it to work: the models run right here, so your prompts, files and results never leave it, and nothing waits in a server queue.
CHAT WITH OPEN MODELS
• Pick a model that fits your hardware: a guided setup suggests the right size for your memory.
• Download more MLX models from Hugging Face in Settings.
• Models that see read your images; models that reason show their thought process.
• Tabs, history, search, temporary chats and automatic compaction of long chats.
YOUR FILES, WITH SOURCES
• Projects group chats with their own instructions and documents.
• Drop PDFs, Word, Markdown and text files into a project: the model searches them and cites the pages it used.
• Pin a short reference so every answer in the project sees it.
IMAGES AND SONGS, MADE ON YOUR HARDWARE
• Ask for a picture in the chat: it is drawn right on your hardware.
• Edit an image by attaching it and saying what to change.
• Make a song with vocals and lyrics, or an instrumental, from a short description.
• Creator mode lets you adjust the prompt, size and model before anything is made.
TOOLS THAT STAY UNDER YOUR CONTROL
• Built-in tools for date and time, a calculator, and, only if you turn them on, web search, news, Wikipedia, weather and more.
• Let a chat tidy a folder you allow: it proposes new folders, moves and renames, and nothing changes until you approve. Undo takes it back.
CONNECT YOUR CODING AGENTS AND APPS
• LLMTray serves an OpenAI-compatible API on your hardware (localhost). Point any app or coding agent that speaks the coding API at it.
• Each model gets a short alias; apps can switch models by name.
• Network access for other devices is off unless you turn it on.
MADE FAST
• Per-model profiles for sampling, KV cache quantization and speculative decoding.
• A built-in benchmark measures your hardware and can tune the server for it.
NOTHING YOU DIDN'T ASK FOR
• Every heavy feature is off until you turn it on, and nothing is downloaded before you choose it.
• No account, no ads, no tracking. Anonymous usage statistics are optional and can be turned off in Settings.
Ratings & Reviews
- This app hasn’t received enough ratings or reviews to display an overview.
A big update: memory, tools, documents, voice and a much better server.
MEMORY
• LLMTray can remember what matters between chats: your preferences, projects and how you like answers. Everything stays on this device; see, edit or forget any note in Settings › Memory.
SEE AND READ
• Show the model a window or your whole screen and ask about it.
• The model can read a web page you point it to.
• Spoken messages: talk to models that understand speech.
• Paste an image straight into the chat with ⌘V.
DOCUMENTS AND TOOLS
• Make PDF documents with charts, tables and formulas right from the chat, then change any section later.
• Connect tool servers (MCP) by URL, with sign-in for web services.
• Thinking effort picker: Off, Low, Medium or High.
SERVER
• Several apps and coding agents can use one model at the same time.
• OpenAI Responses API and Anthropic Messages API, alongside the OpenAI-compatible endpoints.
• Optional API key.
• Usage statistics per model, client and day, kept only on this device.
• A new server log with search, filters and colors.
MODELS
• Faster answers with speculative decoding on supported models.
• New model families, including LFM3.
• Experimental: run large mixture-of-experts models that don't fit in memory by keeping part of them on disk.
• The system's built-in on-device model can be used as a chat model, where available.
And many fixes: steadier menu bar icon, chat search across long chats, clearer download and setup steps.
The developer, IPSupport LLC, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy .
Data Not Linked to You
The following data may be collected but it is not linked to your identity:
- Purchases
- Location
- Contact Info
- User Content
- Identifiers
- Usage Data
- Diagnostics
Accessibility
The developer has not yet indicated which accessibility features this app supports. Learn More
Information
- Seller
- IPSupport LLC
- Size
- 97.2 MB
- Category
- Developer Tools
- Compatibility
Requires macOS 14.0 or later and a Mac with Apple M1 chip or later.
- Mac
Requires macOS 14.0 or later and a Mac with Apple M1 chip or later.
- Mac
- Languages
English and 18 more
- English, Arabic, French, German, Hebrew, Hindi, Indonesian, Italian, Japanese, Korean, Polish, Portuguese, Russian, Simplified Chinese, Spanish, Traditional Chinese, Turkish, Ukrainian, Vietnamese
- Age Rating
18+
- 18+
- Infrequent
Cartoon or Fantasy Violence
Realistic Violence
Profanity or Crude Humor
Mature or Suggestive Themes
Horror/Fear Themes
Medical Treatment information
Alcohol, Tobacco, Drug Use or References
Sexual Content or Nudity
Guns or Other Weapons
- In-App Purchases
Yes
- Founding Supporter $149.99
- Pro Supporter $24.99
- Coffee $4.99
- Copyright
- © IPSupport LLC
