LLM Farm 4+
Run LLM
Artem Savkin
Designed for iPad
-
- Free
Screenshots
Description
LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.
# Features
* Various inferences
* Various sampling methods
* Metal
* Model setting templates
# Inferences
* LLaMA
* GPTNeoX
* Replit
* GPT2 + Cerebras
* Starcoder(Santacoder)
* RWKV
* Falcon
* MPT
* Bloom
* StableLM-3b-4e1t
* Qwen
* Gemma
* Phi
* Mamba
* Others
# Multimodal
* LLaVA 1.5 models
* Obsidian
* Bunny
* MobileVLM 1.7B/3B models
Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.
Sampling methods
* Temperature (temp, tok-k, top-p)
* Locally Typical Sampling
* Mirostat
* Greedy
* Grammar
What’s New
Version 1.4.3
## Changes
* llama.cpp updated to b4562
* Added support MiniCPM-1B, Minicpm-omni, Deepseek-R1-Qwen distill, PhiMoE, DeepSeek V3 models
* Added supprot Minerva 7B, Deepseek MoE v1 & GigaChat models, Qwen2VL, Falcon3 models
* Added support InfiniAI Megrez 3b, OLMo, QRWKV6, Llama-3_1-Nemotron models
* Ask question to PDF document content from shortcut, see shortcut example in documentation.
* Max RAG answer count option
* Metal improvements
* Fixed duplication of documents in the index
* Fixed keyboard overlapping of settings items
* Some metal fixes and improvements
* Some other fixes
Ratings and Reviews
Very neat but needs some QOL improvements.
The fact that I can run an LLM on my iPad is insane. The fact that this is free is also insane. I imagine this app took a ton of work to create, so hat’s off. The one thing that I find irritating however is that you cannot edit responses (either the LLM’s or your own) and you can’t reroll a response, which is something that is pretty important especially with heavily quantized models that sometimes don’t “get it” the first time around. Also an indicator of the current context size would be nice. There’s also some controls that are unexplained like what looks like a refresh button that turns in to a checkmark. I have no idea what that does. Keep up the great work though!
Good! But i have some suggestions
I think it's overall pretty good! However, I'm not a fan of the animal icons for every conversation. I believe using regular icons or even having the option to have no icon at all would attract more users to the app. Additionally, it would be great to have a "new conversation" button in the menu instead of creating a duplicate conversation each time which just made the title become longer and longer Also, maybe using AI to generate titles like ChatGPT does is great. Lastly, it would be awesome if the markdown format could be displayed during the generation process instead of after it's done. that would be awesome 👍 Anyway, thank you very much for this app!
Developer Response ,
Thank you for your feedback. This is very important to me. I am currently working on fixing the bugs. In the future I will add the possibility to use other icons.
Looks promising
This app looks pretty promising, but it’s a little bit daunting to someone who’s not as familiar with setting up LLMs. For example, how do you download the LLMs and where do you go to get them? Which alarms are likely to work? It might be a good idea to include specific LLMs that have been tested on which devices. Some sort of tutorial or instructions would be really useful.
Developer Response ,
Thanks for the feedback. I try to make the application more understandable and user-friendly as I refine it, but the main focus is on functionality.
App Privacy
The developer, Artem Savkin, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy.
Data Not Collected
The developer does not collect any data from this app.
Privacy practices may vary, for example, based on the features you use or your age. Learn More
Information
- Seller
- Artem Savkin
- Size
- 528.1 MB
- Category
- Developer Tools
- Compatibility
-
- iPhone
- Requires iOS 16.4 or later.
- iPad
- Requires iPadOS 16.4 or later.
- Mac
- Requires macOS 13.3 or later and a Mac with Apple M1 chip or later.
- Apple Vision
- Requires visionOS 1.0 or later.
- Languages
-
English
- Age Rating
- 4+
- Copyright
- © Artem Savkin
- Price
- Free