LLM Farm 4+
Run LLM
Artem Savkin
Designed for iPad
-
- Free
Screenshots
Description
LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.
# Features
* Various inferences
* Various sampling methods
* Metal
* Model setting templates
# Inferences
* LLaMA
* GPTNeoX
* Replit
* GPT2 + Cerebras
* Starcoder(Santacoder)
* RWKV
* Falcon
* MPT
* Bloom
* StableLM-3b-4e1t
* Qwen
* Gemma
* Phi
* Mamba
* Others
# Multimodal
* LLaVA 1.5 models
* Obsidian
* Bunny
* MobileVLM 1.7B/3B models
Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.
Sampling methods
* Temperature (temp, tok-k, top-p)
* Tail Free Sampling (TFS)
* Locally Typical Sampling
* Mirostat
* Greedy
* Grammar
What’s New
Version 1.3.9
Changes:
* llama.cpp updated to b3837
* Added support for llama 3.2, 3.1, RWKV, MiniCPM(2.5, 2.6, 3), Chameleon models
* Added Metal support for Mamba
* Added Llama 3.2 download links (working with LLaMa3 Instruct template)
* Added Phi 3.5 download links (working with Phi 3 template)
* Added Bunny template and download link
* Some metal improvements
* Fixed some errors for gemma2, DeepSeek-V2, ChatGLM4, llama 3.1, T5, TriLMs, BitNet models
* Fixed some other errors
Ratings and Reviews
Отлично
Приветствую. Спасибо за такое хорошее приложение. Все отлично, видно что проделано много работы. Но есть небольшая просьба: было бы отлично добавить возможность копировать запрос к модели и ответ от модели. Так как сейчас нет возможности выделить текст из ответа или из собственного запроса 🙃
Developer Response ,
Спасибо за отзыв! На github некоторые пользователи отмечали такую проблему. По идее при долгом нажатии на сообщение, должен появиться диалог копирования, но видимо у некоторых пользователей этого не происходит. Я работаю над решением проблемы.
Good application
Interesting application. Sometimes it crashes, but it fulfills its task. I use it to generate prompts for stable diffusion.
Developer Response ,
Thank you for your feedback, it means a lot to me.
App Privacy
The developer, Artem Savkin, indicated that the app’s privacy practices may include handling of data as described below. For more information, see the developer’s privacy policy.
Data Not Collected
The developer does not collect any data from this app.
Privacy practices may vary based on, for example, the features you use or your age. Learn More
Information
- Provider
- Artem Savkin
- Size
- 349.5 MB
- Category
- Developer Tools
- Compatibility
-
- iPhone
- Requires iOS 16.0 or later.
- iPad
- Requires iPadOS 16.0 or later.
- Mac
- Requires macOS 13.0 or later and a Mac with Apple M1 chip or later.
- Apple Vision
- Requires visionOS 1.0 or later.
- Languages
-
English
- Age Rating
- 4+
- Copyright
- © Artem Savkin
- Price
- Free