LLM Farm 4+

Name: LLM Farm
Rating: 5 (1 reviews)
Author: Artem Savkin

Artem Savkin

Разработано для iPad

- 5,0 • 1 оценка

- Бесплатно

Описание

LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

# Features
* Various inferences
* Various sampling methods
* Metal
* Model setting templates
* LoRA adapters support
* LoRA FineTune and Export

# Inferences
* LLaMA
* GPTNeoX
* Replit
* GPT2 + Cerebras
* Starcoder(Santacoder)
* RWKV (20B tokenizer)
* Falcon
* MPT
* Bloom
* StableLM-3b-4e1t
* Qwen
* Gemma
* Phi
* Mamba
* Others

# Multimodal
* LLaVA 1.5 models
* Obsidian
* MobileVLM 1.7B/3B models

Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

Sampling methods
* Temperature (temp, tok-k, top-p)
* Tail Free Sampling (TFS)
* Locally Typical Sampling
* Mirostat
* Greedy
* Grammar (dont work with GGJTv3)

5 мая 2024 г.

Версия 1.1.1

Changes:
* llama.cpp updated to b2717
* Phi3, Mamba(CPU only), Gemma, StarCoder2, GritLM, Command-R, MobileVLM_V2, qwen2moe models
* IQ1_S, IQ2_S, IQ2_M, IQ3_S, IQ4_NL, IQ4_XS quntization support
* Performance improvements
* Fixed crash when EOS option is on
* Fixed image orientation
* Added warning about creating a chat without a selected model

5,0 из 5

1 оценка

Good application

Interesting application. Sometimes it crashes, but it fulfills its task. I use it to generate prompts for stable diffusion.

Thank you for your feedback, it means a lot to me.

Разработчик Artem Savkin указал, что в соответствии с политикой конфиденциальности приложения данные могут обрабатываться так, как описано ниже. Подробные сведения доступны в политике конфиденциальности разработчика.