LLM Farm 4+

Name: LLM Farm
Rating: 4.7 (6 reviews)
Author: Artem Savkin

Artem Savkin

iPad対応

- 4.7 • 6件の評価

- 無料

説明

LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

# Features
* Various inferences
* Various sampling methods
* Metal
* Model setting templates

# Inferences
* LLaMA
* GPTNeoX
* Replit
* GPT2 + Cerebras
* Starcoder(Santacoder)
* RWKV
* Falcon
* MPT
* Bloom
* StableLM-3b-4e1t
* Qwen
* Gemma
* Phi
* Mamba
* Others

# Multimodal
* LLaVA 1.5 models
* Obsidian
* Bunny
* MobileVLM 1.7B/3B models

Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

Sampling methods
* Temperature (temp, tok-k, top-p)
* Locally Typical Sampling
* Mirostat
* Greedy
* Grammar

2025年1月31日

バージョン 1.4.3

## Changes
* llama.cpp updated to b4562
* Added support MiniCPM-1B, Minicpm-omni, Deepseek-R1-Qwen distill, PhiMoE, DeepSeek V3 models
* Added supprot Minerva 7B, Deepseek MoE v1 & GigaChat models, Qwen2VL, Falcon3 models
* Added support InfiniAI Megrez 3b, OLMo, QRWKV6, Llama-3_1-Nemotron models
* Ask question to PDF document content from shortcut, see shortcut example in documentation.
* Max RAG answer count option
* Metal improvements
* Fixed duplication of documents in the index
* Fixed keyboard overlapping of settings items
* Some metal fixes and improvements
* Some other fixes

4.7／5

6件の評価

File Upload Issue on iPhone App

I’m trying to use RAG and multimodal features in the LLM Farm iPhone app (iPhone 16, iOS 18.1.1), but when I press the + button to upload a file, the upload popup doesn’t appear. It works fine on my MacBook.