So far so good with local models hosted on another machine running LMStudio. Would be really cool to have some additional options in the navigation frame such as folders, projects, etc to keep organization easier. Kind of a default feature imo if you follow the openAI interface progression.

It’s a pretty good app. Works fine but missing a few key issues which I removed two points for. 1st: It doesn’t handle <think> tags and this is a very common use case for LLMs today and it just displays them as raw text. It also uses the raw <think> tags as chat names when it tries to get a name which is quite annoying when all I use it for is reasoning models. 2nd: it doesn’t allow passing in key parameters which makes its use quite limited. For instance, it does not allow configuration of context length. If I am processing a longer document, it will not get any of the earlier tokens. Otherwise, this is quite a good free app! I had to build my own web-based chat to overcome these two hurdles and I don’t currently use regularly.

The app it self seems like it has decent customization. However the text is a bit small and the menus don’t transition very smoothly. It seems likeIt was built for desktop and minimal changes were made to port it to iOS. It works though. In fact it’s one of two apps I have been able to use to connect to local llms running on a home server.

By far the best app for customizing your UI when connecting to Local LLMs, and it works great! Would be 5 stars easy unless but the app disconnects from server immediately after I switch apps during text generation. Some responses take a long time and I want to multitask during that.The other is much needed feature. To integrate with iOS shortcuts similar to ChatGPT and LocallyAI.