LLMTray

AI on Your Hardware, No Cloud

Only for Mac

Free · In‑App Purchases

Mac

Run AI models right on your computer: chat, draw, make songs, read web pages and show your screen. Serve an OpenAI-compatible API to your apps. Private, offline-ready! LLMTray runs AI models on your hardware. Chat, draw pictures, make songs and give your apps an OpenAI-compatible API, all on Apple silicon, with no account and no cloud. LESS DATA CENTER. MORE YOUR OWN HARDWARE. Your hardware is already a capable AI machine. LLMTray puts it to work: the models run right here, so your prompts, files and results never leave it, and nothing waits in a server queue. CHAT WITH OPEN MODELS • Pick a model that fits your hardware: a guided setup suggests the right size for your memory. • Download more MLX models from Hugging Face in Settings. • Models that see read your images; models that reason show their thought process. • Tabs, history, search, temporary chats and automatic compaction of long chats. YOUR FILES, WITH SOURCES • Projects group chats with their own instructions and documents. • Drop PDFs, Word, Markdown and text files into a project: the model searches them and cites the pages it used. • Pin a short reference so every answer in the project sees it. IMAGES AND SONGS, MADE ON YOUR HARDWARE • Ask for a picture in the chat: it is drawn right on your hardware. • Edit an image by attaching it and saying what to change. • Make a song with vocals and lyrics, or an instrumental, from a short description. • Creator mode lets you adjust the prompt, size and model before anything is made. TOOLS THAT STAY UNDER YOUR CONTROL • Built-in tools for date and time, a calculator, and, only if you turn them on, web search, news, Wikipedia, weather and more. • Let a chat tidy a folder you allow: it proposes new folders, moves and renames, and nothing changes until you approve. Undo takes it back. CONNECT YOUR CODING AGENTS AND APPS • LLMTray serves an OpenAI-compatible API on your hardware (localhost). Point any app or coding agent that speaks the coding API at it. • Each model gets a short alias; apps can switch models by name. • Network access for other devices is off unless you turn it on. MADE FAST • Per-model profiles for sampling, KV cache quantization and speculative decoding. • A built-in benchmark measures your hardware and can tune the server for it. NOTHING YOU DIDN'T ASK FOR • Every heavy feature is off until you turn it on, and nothing is downloaded before you choose it. • No account, no ads, no tracking. Anonymous usage statistics are optional and can be turned off in Settings.

  • This app hasn’t received enough ratings or reviews to display an overview.

A big update: memory, tools, documents, voice and a much better server. MEMORY • LLMTray can remember what matters between chats: your preferences, projects and how you like answers. Everything stays on this device; see, edit or forget any note in Settings › Memory. SEE AND READ • Show the model a window or your whole screen and ask about it. • The model can read a web page you point it to. • Spoken messages: talk to models that understand speech. • Paste an image straight into the chat with ⌘V. DOCUMENTS AND TOOLS • Make PDF documents with charts, tables and formulas right from the chat, then change any section later. • Connect tool servers (MCP) by URL, with sign-in for web services. • Thinking effort picker: Off, Low, Medium or High. SERVER • Several apps and coding agents can use one model at the same time. • OpenAI Responses API and Anthropic Messages API, alongside the OpenAI-compatible endpoints. • Optional API key. • Usage statistics per model, client and day, kept only on this device. • A new server log with search, filters and colors. MODELS • Faster answers with speculative decoding on supported models. • New model families, including LFM3. • Experimental: run large mixture-of-experts models that don't fit in memory by keeping part of them on disk. • The system's built-in on-device model can be used as a chat model, where available. And many fixes: steadier menu bar icon, chat search across long chats, clearer download and setup steps.

The developer, IPSupport LLC, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy .

  • Data Not Linked to You

    The following data may be collected but it is not linked to your identity:

    • Purchases
    • Location
    • Contact Info
    • User Content
    • Identifiers
    • Usage Data
    • Diagnostics

Privacy practices may vary, for example, based on the features you use or your age. Learn More

The developer has not yet indicated which accessibility features this app supports. Learn More

Seller
IPSupport LLC
Size
97.2 MB
Category
Developer Tools
Compatibility
Requires macOS 14.0 or later and a Mac with Apple M1 chip or later.
  • Mac
    Requires macOS 14.0 or later and a Mac with Apple M1 chip or later.
Languages
English and 18 more
  • English, Arabic, French, German, Hebrew, Hindi, Indonesian, Italian, Japanese, Korean, Polish, Portuguese, Russian, Simplified Chinese, Spanish, Traditional Chinese, Turkish, Ukrainian, Vietnamese
Age Rating
18+
  • 18+
  • Infrequent
    Cartoon or Fantasy Violence
    Realistic Violence
    Profanity or Crude Humor
    Mature or Suggestive Themes
    Horror/Fear Themes
    Medical Treatment information
    Alcohol, Tobacco, Drug Use or References
    Sexual Content or Nudity
    Guns or Other Weapons
In-App Purchases
Yes
  • Founding Supporter $149.99
  • Pro Supporter $24.99
  • Coffee $4.99
Copyright
© IPSupport LLC