I’m making a web ui for Open AI, oobabooga, koboldcpp.

https://github.com/Julian-adv/IlluStory

It’s for Windows now (tauri exe).

For what? I’m partial to silly tavern and the textgen notebook modes to do freeform. Why care if it works with openAI? That’s literally the opposite of “self hosted for privacy”.

I am releasing a UI that meets those requirements in the next few days, was originally going to have the code ready the 31st of last month but has some stuff come up. Here is a link to the original post I made on it a few weeks back, it supports what you are looking for and has other cool features like plugins (chat function calling) and model routing.

Could you use a Spell Book this Halloween? : LocalLLaMA (reddit.com)

Oobabooga can work with OpenAI, can be self-hosted and store system prompts and dialogs

I’m collecting UIs for local models and UIs powered by OAI API (the second one is outdated, by ~4 months). Everyone’s “best” varies, but overall, I haven’t noticed much progress.

Huggingface chat-ui is nice and can be self-hosted as well: https://github.com/huggingface/chat-ui

Not sure it’s any better than what you’re already using, but it’s worth checking out.

RemindMe! 2 weeks

I would also add multi modal features to the requirements.

• LoLLMS, seen getting updates, V7 appeard recently, I like it but it’s more “for fun” than for doing some work I need to do. It’s super easy, and has lot of plugins, like you just choose personality artist, and for SD it just forks the A1111 and provide image. Also it should recognize images and read docs. Best impresion on me so far.

• LMstudio

-oobabooga