LLM Farm Software

diese App is an iOS and MacOS app to work with large language models (LLM). It allows you to load different LLMs with certain parameters. # Features * Various inferences * Various sampling methods * Metal * Model setting templates * LoRA adapters support * LoRA FineTune and Export # Inferences * LLaMA * GPTNeoX * Replit * GPT2 + Cerebras * Starcoder(Santacoder) * RWKV (20B tokenizer) * Falcon * MPT * Bloom * StableLM-3b-4e1t * Qwen Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings. Sampling methods * Temperature (temp, tok-k, top-p) * Tail Free Sampling (TFS) * Locally Typical Sampling * Mirostat * Greedy * Grammar (dont work with GPTNeoX, GPT-2, RWKV) * Classifier-Free Guidance