Hi,
A lot of roleplay models I tried like to continue the story with some sappy s*** and I hate it. I tried to tell them not to, but they aren’t listening to me.
For an example:
X does y. What will happen next? Only time will tell…
Together, x and y are unstoppable. It is a testament to the spirit and unyielding hope they have.
Except multiply the amount of garbage by three.
I tried many models and they all seem to do this. I am getting really tired of it as when it starts it’s almost impossible to get it to stop and it just ruins a perfectly good roleplay with this crap…
Sorry for the rant, I’m just a bit frustrated haha.
For anyone capable of running 70b models (i.e. 48GB VRAM), you might want to check out my latest merge: sophosympatheia/xwin-stellarbright-erp-v2. It is the latest iteration of some experiments I’ve been conducting and I like how it performs with the provided prompt template and sampler settings on the HF page.
Sorry for the lack of more quantizations right now and full weights. I’m getting additional SSD storage next week that should help.