MLX Benchmarks

Measure device LLM performance

Free

Run the same standard LLM benchmark as everyone else and see how your Mac, iPhone or iPad ranks: generation speed, prefill speed and time to first token, all on device. MLX Benchmark measures how fast large language models run on your iPhone and iPad, entirely on device, with Apple's open-source MLX framework. STANDARD BENCHMARK Every device runs the same test: a fixed 512-token prompt, then exactly 128 tokens generated with greedy decoding. One warm-up run and three measured runs, with medians reported. Because the input and settings never change, your results are directly comparable with any other device. COMMUNITY Share your standard runs anonymously and compare your device with everyone else's: • Device ranking: median generation speed, prefill speed or time to first token for each model • Models on a device: how speed changes with model size, next to the memory-bandwidth estimate for that device • Comparison: your run next to the community medians of other devices DETAILED MEASUREMENTS • Generation and prefill speed, in tokens per second • Time to first token, tokenization and model load time • Per-token latency as a timeline and a distribution, with P50, P95, P99 and jitter • Memory: model weights, KV cache and activations, and the peak against the memory iOS lets the app use • Thermal state and Low Power Mode, so throttled runs are easy to spot MODELS Browse a catalog of open models supported by MLX, such as Qwen and Llama in 4-bit. Each model is downloaded on its first run; see what is stored on your device and delete what you no longer need. CUSTOM RUNS Try your own prompt, generation length and number of iterations. Custom results stay on your device. PRIVACY No account and no tracking. Only standard runs are shared, and only while sharing is on: device model and hardware (core counts, memory), the model tested, app and OS version, and the measured metrics. Nothing that identifies you.

  • This app has not received enough ratings or reviews to display an overview.

MLX Benchmark 1.1 is a major update. • Standard benchmark: the same 512-token prompt and 128 generated tokens on every device, so results are directly comparable. • Community: share your runs anonymously and see how your device ranks for each model. • New charts: device ranking, speed by model size, per-token latency, memory usage and side-by-side comparison with other devices. • Models tab: browse the catalog, see what's stored on your device and free up space. • Device details: model, CPU cores and memory. • Redesigned layouts for iPad and iPhone Duo. • Custom runs with your own prompt and settings are still there.

The developer, Costantino Pistagna, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy .

  • Data Not Collected

    The developer does not collect any data from this app.

    Privacy practices may vary based, for example, on the features you use or your age. Learn More

    The developer has not yet indicated which accessibility features this app supports. Learn More

    Size
    25 MB
    Category
    Utilities
    Compatibility
    Requires iOS 18.6 or later.
    • iPhone
      Requires iOS 18.6 or later.
    • iPad
      Requires iPadOS 18.6 or later.
    • Mac
      Requires macOS 15.6 or later.
    Languages
    English and Italian
    Age Rating
    4+
    Provider
    Costantino Pistagna
    • Costantino Pistagna has not identified itself as a trader for this app. If you are a consumer in the European Economic Area, consumer rights do not apply to agreements between you and the provider.
    Copyright
    © 2026 - Sofapps - All rights reserved.