LLM Farm 4+

Artem Savkin

Dirancang untuk iPad

    • Gratis

Jepretan Layar

Deskripsi

LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

# Features
* Various inferences
* Various sampling methods
* Metal
* Model setting templates
* LoRA adapters support
* LoRA FineTune and Export

# Inferences
* LLaMA
* GPTNeoX
* Replit
* GPT2 + Cerebras
* Starcoder(Santacoder)
* RWKV (20B tokenizer)
* Falcon
* MPT
* Bloom
* StableLM-3b-4e1t
* Qwen
* Gemma
* Phi
* Mamba
* Others

# Multimodal
* LLaVA 1.5 models
* Obsidian
* MobileVLM 1.7B/3B models

Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

Sampling methods
* Temperature (temp, tok-k, top-p)
* Tail Free Sampling (TFS)
* Locally Typical Sampling
* Mirostat
* Greedy
* Grammar (dont work with GGJTv3)

Yang Baru

Versi 1.3.0

Changes:
* LLaMA.cpp updated to b3190
* Added support for DeepseekV2, GPTNeoX (Pythia and others)
* Added support for Markdown formatting
* Added support for using history in Shortcuts
* Added Flash Attention support
* Added NPredict option
* Save/Load context state. Now it is possible to continue the dialog with the model even after the program is reopened.
* Chat settings such as sampling are now applied without reloading the chat.
* Skip tokens option. Allows you to specify tokens that will not be displayed in the results. May be useful for phi3 and qwen.
* Metal and CPU inference improvements
* Sampling and eval improvements
* Some fixes for phi-3 and MiniCPM
* Fixed some errors
* Added Qwen template

Privasi App

Pengembang, Artem Savkin, menunjukkan bahwa praktik privasi app dapat menyertakan penanganan data sebagaimana yang dijelaskan di bawah. Untuk informasi lebih lanjut, lihat kebijakan privasi pengembang.

Data Tidak Dikumpulkan

Pengembang tidak akan mengumpulkan data apa pun dari app ini.

Praktik privasi mungkin bervariasi, misalnya, praktik privasi berdasarkan fitur yang digunakan atau usia Anda. Pelajari Lebih Lanjut

Anda Juga Mungkin Menyukai

Enchanted LLM
Alat Pengembang
ChatOnMac.com — AI Chat Bots
Alat Pengembang
Jellycuts
Alat Pengembang
AWS IoT Sensors
Alat Pengembang
Server: Host Files Locally
Alat Pengembang
Prompt 3
Alat Pengembang