LLM Farm 4+
Run LLM
Artem Savkin
Designed for iPad
-
- Free
Screenshots
Description
LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.
# Features
* Various inferences
* Various sampling methods
* Metal
* Model setting templates
# Inferences
* LLaMA
* GPTNeoX
* Replit
* GPT2 + Cerebras
* Starcoder(Santacoder)
* RWKV
* Falcon
* MPT
* Bloom
* StableLM-3b-4e1t
* Qwen
* Gemma
* Phi
* Mamba
* Others
# Multimodal
* LLaVA 1.5 models
* Obsidian
* Bunny
* MobileVLM 1.7B/3B models
Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.
Sampling methods
* Temperature (temp, tok-k, top-p)
* Locally Typical Sampling
* Mirostat
* Greedy
* Grammar
What’s New
Version 1.4.3
## Changes
* llama.cpp updated to b4562
* Added support MiniCPM-1B, Minicpm-omni, Deepseek-R1-Qwen distill, PhiMoE, DeepSeek V3 models
* Added supprot Minerva 7B, Deepseek MoE v1 & GigaChat models, Qwen2VL, Falcon3 models
* Added support InfiniAI Megrez 3b, OLMo, QRWKV6, Llama-3_1-Nemotron models
* Ask question to PDF document content from shortcut, see shortcut example in documentation.
* Max RAG answer count option
* Metal improvements
* Fixed duplication of documents in the index
* Fixed keyboard overlapping of settings items
* Some metal fixes and improvements
* Some other fixes
Ratings and Reviews
Good idea but download not working
Good app from what I can see… but to download model, the progression stuck at 22% or random small number. It’s frustrating to keep trying to download and it still wont work.
App Privacy
The developer, Artem Savkin, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy.
Data Not Collected
The developer does not collect any data from this app.
Privacy practices may vary based on, for example, the features you use or your age. Learn More
Information
- Provider
- Artem Savkin
- Size
- 528.1 MB
- Category
- Developer Tools
- Compatibility
-
- iPhone
- Requires iOS 16.4 or later.
- iPad
- Requires iPadOS 16.4 or later.
- Mac
- Requires macOS 13.3 or later and a Mac with Apple M1 chip or later.
- Apple Vision
- Requires visionOS 1.0 or later.
- Languages
-
English
- Age Rating
- 4+
- Copyright
- © Artem Savkin
- Price
- Free