I have a double 3090 setup, so I can run 4bit 70b GPTQ. 70b blows all the smaller models out the water, at least for now. Not interested in any of your questions except the last one. If you use a dual GPU setup like me nothing in SD actually supports multi-GPU, even stuff that sounds like it’ll be amazing with 2 GPUS, (kohya LoRA creation, for example) doesn’t actually work with multiGPU

That isn’t paranoid at all. I backup everything to two 18TB HDDs everytime I make a new SD LoRA or train an SVC/RVC voice clone.

Upgrade to a 70b setup and watch your problems disappear, plus SillyTavern swiping.

Nope. Have a 2x3090 system and planning to buy another 3090 system to be able to do SD LoRA training while being able to use Dolphin 70b.

I have a dungeon crawl character card that always just keeps my “inventory” in a list after the narration on every prompt, but the model I use might be too heavy since I use a dual 3090 setup, Dolphin 2.2 70B.

Significantly similar to the SD/MJ/DeviantArt trimming done by Judge Orrick to this case.

https://twitter.com/franklingraves/status/1719053140220137846?t=Cq4VFQFACWrZb1onvYvnXA&s=19