ExploreRL
On-Device RL Training
Free
Train, visualize, and experiment with Reinforcement Learning algorithms entirely on-device with ExploreRL.
Built with MLX, ExploreRL provides an interactive sandbox to test various environments and algorithms with different hyperparameters to observe how RL agents learn through trial and error.
LEARN BY DOING
Train agents on classic adapted environments and observe learning in real time. Watch values grow, track reward curves, and develop intuition for how different algorithms and hyperparameters affect performance. Read and learn about reinforcement learning concepts in the documentation.
ALGORITHMS
Four common implementations:
- Q-Learning
- SARSA
- Deep Q-Network (DQN) for discrete action spaces
- Soft Actor-Critic (SAC) for continuous control
INCLUDED ENVIRONMENTS
Adapted from classic standards:
Toy Text: Frozen Lake, Blackjack, Taxi, Cliff Walking
Classic Control: CartPole, Mountain Car, Mountain Car Continuous, Acrobot, Pendulum
Box2D: Lunar Lander, Lunar Lander Continuous, Car Racing, Car Racing Discrete
FEATURES
- Environment-specific settings
- Real-time training metrics and reward visualization
- Configurable hyperparameters: learning rate, discount factor, epsilon decay, batch size
- Agent library with save, load, duplicate, and export functionality
- Evaluation mode to test trained agents without further training
- Educational documentation covering RL concepts, neural networks, and algorithms
- Custom seed for reproducibility
Note: Training performance will vary by device. Devices with newer hardware and more memory will have a better experience.
Ratings & Reviews
Quality of life changes:
- fix several UI issues
- fix various bugs
- better device info in settings
- add option to train different environments at once
- fix import/export lag
- quick open saved agent files
- ability to rename saved sessions
The developer, Justin Daludado, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy .
Data Not Collected
The developer does not collect any data from this app.
Accessibility
The developer has not yet indicated which accessibility features this app supports. Learn More
Information
- Seller
- Justin Daludado
- Size
- 22.9 MB
- Category
- Developer Tools
- Compatibility
Requires iOS 18.0 or later.
- iPhone
Requires iOS 18.0 or later. - iPad
Requires iPadOS 18.0 or later. - Mac
Requires macOS 15.0 or later and a Mac with Apple M1 chip or later.
- Languages
- English
- Age Rating
4+
- 4+
- Copyright
- © Justin Daludado