LLM Farm Reviews
Published by Artem Savkin on 2023-12-24 About: LLMFarm is an iOS and MacOS app to work with large language models (LLM). It
allows you to load different LLMs with certain parameters.
About: LLMFarm is an iOS and MacOS app to work with large language models (LLM). It
allows you to load different LLMs with certain parameters.
Table of Contents:
Note: For Falcon, Alpaca, GPT4All, Chinese LLaMA / Alpaca and Chinese LLaMA-2 / Alpaca-2, Vigogne (French), Vicuna, Koala, OpenBuddy (Multilingual), Pygmalion/Metharme, WizardLM, Baichuan 1 & 2 + derivations, Aquila 1 & 2, Mistral AI v0.1, Refact, Persimmon 8B, MPT, Bloom select llama inferece in model settings.
LLMFarm is an iOS and MacOS app to work with large language models (LLM).
It allows you to load different LLMs with certain parameters.
By dropped adobe
Finally a locally run LLM that lets you import different models. The interface is nice and simple. LLMFarm runs well, 3b models are quick on the iPad mini 7, and it will even run 7b models, albeit slowly. Kudos to the developer.
By Jadeee13
LLMFarm is exactly what I’ve been waiting for! It lets me import what ever open source LLM I want to and runs completely local and private. Thank you for creating this! 🙏
By Shinji Aoba
It’s really cool that you can run an LLM directly on your iPhone, but one feature I would like to see is to set a configuration that you use for all future chats, as doing it manually is too tedious to ask it something it simple.
By LocoDubz
Really needs some documentation on what it thinks it’s doing at times. And the fine-tune needs fixing
By dragoncoder047
I downloaded LLMFarm as an alternative to being forced to sign up for an OpenAI account to get ChatGPT. After trying a few models and finding one I liked (LLaMA2-7B) I was quite impressed as it was my first time trying this sort of large language model. The first-launch flow could be improved. When I first opened LLMFarm I kind of expected some models pre installed and was disappointed that I had to download some from LLMFarm ’s website. If models can’t be included in LLMFarm due to the file size, at least it would be nice to have a get- started prompt show up when no models are loaded, such as “Welcome to LLM Farm. To get started, you’ll need to download a model…”
Also, once you have models imported and configured, it would be nice to also have a “quick start” option when starting a new chat that would let you just duplicate the model and parameters of an existing chat (but with zero history), instead of always having to go through the rather complicated setup menu as it is right now. Although the “LLaMA2 Chat 7B NEW” settings template really helps!!
Some performance issues: when the model is started, it momentarily freezes my entire device (iPhone 15) — can’t type on keyboard, can’t open the control center, can’t go to Home Screen — for about 5 seconds, and then while the model is running and producing output it causes any other background tasks running such as playing music to glitch out and sometimes crash completely. (App Store readers: this just goes to show you how much computing power these models take!) it would be helpful if there was a toggle to put the model in a “throttled” mode where it runs slower to try and allow other things to run at the same time, and additionally when the model is in throttled mode it will allow the model to run in the background while you use other apps and you get a notification when the model completes its output. I don’t know much about how LLMs operate, but if this is physically possible I would really appreciate it being added.
By hackerlocal.us
This is one of the best LLM apps for mobile! It has a lot of customizable settings and it supports a lot of quantized models. It also supports all the quantized models. Shortcut integration is all this amazing app needs please great developer add app intents to LLMFarm !
By Carslov
iOS equivalent of draw things for LLM and not stable diffusion. Would love more settings tho and integration to the neural engine ect. And get the actual training to work
By takemusuaiki
Love LLMFarm. Surprisingly powerful and has tons of tweaking options that many apps on full computers lack. I use it on phone and iPad. I would love to see support for newer Gemma models and the ability act as an inference server like ollama or LM studio so I can run local inference for Obsidian or other apps.
Yes. LLM Farm is very safe to use. This is based on our NLP (Natural language processing) analysis of over 1 User Reviews sourced from the Appstore and the appstore cumulative rating of 5.0/5 . Justuseapp Safety Score for LLM Farm Is 64.3/100.
Yes. LLM Farm is a totally legit app. This conclusion was arrived at by running over 1 LLM Farm User Reviews through our NLP machine learning process to determine if users believe the app is legitimate or not. Based on this, Justuseapp Legitimacy Score for LLM Farm Is 78.8/100..
LLM Farm works most of the time. If it is not working for you, we recommend you excersise some patience and retry later or Contact Support.
Leave a comment: