Open Otter

软件开发工具

仅适用于 Mac

¥38.00

Mac

Open Otter — Local AI Workstation for macOS Open Otter transforms your Mac into a powerful AI workstation. Run large language models locally with full Apple Silicon GPU acceleration — your data never leaves your device. LOCAL LLM INFERENCE Run state-of-the-art language models natively on your Mac using the MLX framework. Enjoy fast, streaming text generation with no internet connection required. Support for a wide range of open-source models including Llama, Qwen, Mistral, Gemma, and more. OPENAI-COMPATIBLE API SERVER Open Otter includes a built-in HTTP server that exposes the standard /v1/chat/completions endpoint. Drop it into any workflow that uses the OpenAI API — development tools, scripts, and third-party apps work seamlessly with your local models. DISTRIBUTED INFERENCE CLUSTER Connect multiple Macs on your local network to run larger models that exceed a single machine's memory. Automatic peer discovery via Bonjour, leader election, and intelligent shard placement let you scale inference across devices with zero configuration. REAL-TIME MONITORING A built-in dashboard tracks GPU utilization, memory pressure, power draw, thermal state, and inference metrics (tokens per second, time to first token). Know exactly how your hardware is performing at a glance. MODEL MANAGEMENT Browse and download models from HuggingFace, hf-mirror, and ModelScope directly within the app. Manage your local model library, view model metadata, and switch between models instantly. PERFORMANCE OPTIMIZATION - SSD-backed KV cache persists context across sessions, dramatically speeding up repeated and long conversations - Benchmarking tools to measure and compare model performance on your hardware - Efficient memory management with LRU cache eviction VECTOR DATABASE & DATASETS Built-in vector database and dataset management tools support retrieval-augmented generation (RAG) workflows entirely on-device. Index your documents and enhance model responses with local knowledge — privately. DESIGNED FOR macOS - Native SwiftUI interface with full dark mode support - Menu bar extra for quick access to server controls and resource overview - Runs on macOS 15 and later, optimized for Apple Silicon (M1/M2/M3/M4) PRIVACY BY DESIGN No accounts. No telemetry. No cloud processing. Every computation happens on your hardware. Your conversations, documents, and data remain entirely under your control. Whether you're a developer building AI-powered applications, a researcher experimenting with open models, or anyone who values privacy — Open Otter gives you a complete, self-contained AI environment right on your Mac.

  • 此 App 尚未收到足够的评分或评论,无法显示整体评分。

开发者“杰 何”已表明该 App 的隐私规范可能包括下述数据处理方式。更多相关信息,请参阅 开发者隐私政策 。

  • 未收集数据

    开发者不会从此 App 中收集任何数据。

    隐私规范可能因你使用的功能或你的年龄等因素而异。 进一步了解

    开发者尚未表明此 App 支持哪些辅助功能。 进一步了解

    提供者
    杰 何
    大小
    10.6 MB
    类别
    软件开发工具
    兼容性
    设备需装有 macOS 15.0 或更高版本。
    • Mac
      设备需装有 macOS 15.0 或更高版本。
    语言
    简体中文和另外2种
    • 简体中文、繁体中文、英语
    年龄分级
    4+
    版权
    © 2026 Jie He