LLM Farm 4+

Name: LLM Farm
Rating: 2 (1 reviews)
Author: Artem Savkin

Artem Savkin

Diseñada para iPad

- 2.0 • 1 calificación

- Gratis

Descripción

LLMFarm is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters.

# Features
* Various inferences
* Various sampling methods
* Metal
* Model setting templates

# Inferences
* LLaMA
* GPTNeoX
* Replit
* GPT2 + Cerebras
* Starcoder(Santacoder)
* RWKV
* Falcon
* MPT
* Bloom
* StableLM-3b-4e1t
* Qwen
* Gemma
* Phi
* Mamba
* Others

# Multimodal
* LLaVA 1.5 models
* Obsidian
* Bunny
* MobileVLM 1.7B/3B models

Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.

Sampling methods
* Temperature (temp, tok-k, top-p)
* Tail Free Sampling (TFS)
* Locally Typical Sampling
* Mirostat
* Greedy
* Grammar

15 oct 2024

Versión 1.3.9

Changes:
* llama.cpp updated to b3837
* Added support for llama 3.2, 3.1, RWKV, MiniCPM(2.5, 2.6, 3), Chameleon models
* Added Metal support for Mamba
* Added Llama 3.2 download links (working with LLaMa3 Instruct template)
* Added Phi 3.5 download links (working with Phi 3 template)
* Added Bunny template and download link
* Some metal improvements
* Fixed some errors for gemma2, DeepSeek-V2, ChatGLM4, llama 3.1, T5, TriLMs, BitNet models
* Fixed some other errors

2.0 de 5

1 calificación

Can’t copy text on a TEXT BASED APP?

I’m using this app on my M4 ipad. It works great (some Llama models are not supported on metal but i’m sure they’ll figure it out. But what I cannot understand is why I can’t select text to copy it (i only could copy paragraphs by holding mouse1) and as of the last update i can’t copy text at all!!. Come on maaaan, that’s like… really basic you know that don’t you?

Thanks for the feedback. The point is that text copying is allowed in the program code. This appears to be a swiftUI bug. I am working on a solution.

Artem Savkin, que desarrolló esta app, indicó que entre las prácticas de privacidad de la app, pueden incluirse el manejo de datos que se describe a continuación. Para obtener detalles, consulta la política de privacidad del desarrollador.