I released a UI last week noco-ai/spellbook-docker (github.com). Has chat plugins with 50+ in v0.1.0 that handle things like simple math (multiplication, addition, …), image generation, TTS, Bing news search, etc.
- 0 Posts
- 4 Comments
Joined 1 year ago
Cake day: November 9th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
Might be overkill for your use case but the UI I created stores conversations in MariaDB, it is not multi user so anyone who accesses the UI will see the same conversations.
I am releasing a UI that meets those requirements in the next few days, was originally going to have the code ready the 31st of last month but has some stuff come up. Here is a link to the original post I made on it a few weeks back, it supports what you are looking for and has other cool features like plugins (chat function calling) and model routing.
Could you use a Spell Book this Halloween? : LocalLLaMA (reddit.com)
OpenAI is also so overwhelmed with demand that their API “limits” are a complete joke. I have a tier 4 account and have always hit server error issues when running any kind of single threaded application with their API well before hitting any of their published limits. I get more TPS from my local systems than I was ever able to get from the OpenAI API.