MLX Benchmarks
Measure device LLM performance
Free
Run the same standard LLM benchmark as everyone else and see how your Mac, iPhone or iPad ranks: generation speed, prefill speed and time to first token, all on device.
MLX Benchmark measures how fast large language models run on your iPhone and iPad, entirely on device, with Apple's open-source MLX framework.
STANDARD BENCHMARK
Every device runs the same test: a fixed 512-token prompt, then exactly 128 tokens generated with greedy decoding. One warm-up run and three measured runs, with medians reported. Because the input and settings never change, your results are directly comparable with any other device.
COMMUNITY
Share your standard runs anonymously and compare your device with everyone else's:
• Device ranking: median generation speed, prefill speed or time to first token for each model
• Models on a device: how speed changes with model size, next to the memory-bandwidth estimate for that device
• Comparison: your run next to the community medians of other devices
DETAILED MEASUREMENTS
• Generation and prefill speed, in tokens per second
• Time to first token, tokenization and model load time
• Per-token latency as a timeline and a distribution, with P50, P95, P99 and jitter
• Memory: model weights, KV cache and activations, and the peak against the memory iOS lets the app use
• Thermal state and Low Power Mode, so throttled runs are easy to spot
MODELS
Browse a catalog of open models supported by MLX, such as Qwen and Llama in 4-bit. Each model is downloaded on its first run; see what is stored on your device and delete what you no longer need.
CUSTOM RUNS
Try your own prompt, generation length and number of iterations. Custom results stay on your device.
PRIVACY
No account and no tracking. Only standard runs are shared, and only while sharing is on: device model and hardware (core counts, memory), the model tested, app and OS version, and the measured metrics. Nothing that identifies you.
Ratings & Reviews
- This app has not received enough ratings or reviews to display an overview.
MLX Benchmark 1.1 is a major update.
• Standard benchmark: the same 512-token prompt and 128 generated tokens on every device, so results are directly comparable.
• Community: share your runs anonymously and see how your device ranks for each model.
• New charts: device ranking, speed by model size, per-token latency, memory usage and side-by-side comparison with other devices.
• Models tab: browse the catalog, see what's stored on your device and free up space.
• Device details: model, CPU cores and memory.
• Redesigned layouts for iPad and iPhone Duo.
• Custom runs with your own prompt and settings are still there.
The developer, Costantino Pistagna, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy .
Data Not Collected
The developer does not collect any data from this app.
Accessibility
The developer has not yet indicated which accessibility features this app supports. Learn More
Information
- Size
- 25 MB
- Category
- Utilities
- Compatibility
Requires iOS 18.6 or later.
- iPhone
Requires iOS 18.6 or later. - iPad
Requires iPadOS 18.6 or later. - Mac
Requires macOS 15.6 or later.
- iPhone
- Languages
- English and Italian
- Age Rating
4+
- 4+
- Provider
Costantino Pistagna
- Costantino Pistagna has not identified itself as a trader for this app. If you are a consumer in the European Economic Area, consumer rights do not apply to agreements between you and the provider.
- Copyright
- © 2026 - Sofapps - All rights reserved.
