簡介

LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

# Features
* Various inferences
* Various sampling methods
* Metal
* Model setting templates
* LoRA adapters support
* LoRA FineTune and Export

# Inferences
* LLaMA
* GPTNeoX
* Replit
* GPT2 + Cerebras
* Starcoder(Santacoder)
* RWKV (20B tokenizer)
* Falcon
* MPT
* Bloom
* StableLM-3b-4e1t
* Qwen
* Gemma
* Phi
* Mamba
* Others

# Multimodal
* LLaVA 1.5 models
* Obsidian
* MobileVLM 1.7B/3B models

Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

Sampling methods
* Temperature (temp, tok-k, top-p)
* Tail Free Sampling (TFS)
* Locally Typical Sampling
* Mirostat
* Greedy
* Grammar (dont work with GGJTv3)

新內容

版本 1.2.0

Changes:
* Added shortcuts support
* llama.cpp updated to b2864
* Some llama-3, Command-R fixes
* Added llama3 instruct template
* Fixed a bug that could cause the application to crash if the system prompt format is incorrect
* Fix memory bug in grammar parser
* Fixed some other bugs

App 隱私權

開發者「Artem Savkin」指出 App 的隱私權實務可能包含下方描述的資料處理。如需更多資訊,請參閱開發者的隱私權政策

不收集資料

開發者不會從這個 App 收集任何資料。

隱私權實務可能因你使用的功能或你的年齡等因素而有所不同。進一步瞭解

你可能也會喜歡

Enchanted LLM
開發者工具
AWS IoT Sensors
開發者工具
ChatOnMac.com — AI Chat Bots
開發者工具
Jellycuts
開發者工具
Server: Host Files Locally
開發者工具
Device Info Tool
開發者工具