LLM Farm 4+

Name: LLM Farm
Author: Artem Savkin

Artem Savkin

Diseñada para iPad

- Gratis

Descripción

LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

# Features
* Various inferences
* Various sampling methods
* Metal
* Model setting templates

# Inferences
* LLaMA
* GPTNeoX
* Replit
* GPT2 + Cerebras
* Starcoder(Santacoder)
* RWKV
* Falcon
* MPT
* Bloom
* StableLM-3b-4e1t
* Qwen
* Gemma
* Phi
* Mamba
* Others

# Multimodal
* LLaVA 1.5 models
* Obsidian
* Bunny
* MobileVLM 1.7B/3B models

Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

Sampling methods
* Temperature (temp, tok-k, top-p)
* Locally Typical Sampling
* Mirostat
* Greedy
* Grammar

31 ene 2025

Versión 1.4.3

## Changes
* llama.cpp updated to b4562
* Added support MiniCPM-1B, Minicpm-omni, Deepseek-R1-Qwen distill, PhiMoE, DeepSeek V3 models
* Added supprot Minerva 7B, Deepseek MoE v1 & GigaChat models, Qwen2VL, Falcon3 models
* Added support InfiniAI Megrez 3b, OLMo, QRWKV6, Llama-3_1-Nemotron models
* Ask question to PDF document content from shortcut, see shortcut example in documentation.
* Max RAG answer count option
* Metal improvements
* Fixed duplication of documents in the index
* Fixed keyboard overlapping of settings items
* Some metal fixes and improvements
* Some other fixes

Artem Savkin, que desarrolló esta app, indicó que entre las prácticas de privacidad de la app, pueden incluirse el manejo de datos que se describe a continuación. Para obtener detalles, consulta la política de privacidad del desarrollador.