I’m using 4.5bpw quant courtesy u/Panchovix for RP.
Every time we speak about loneliness, lost love or something like this, it start t-to… s-speak… *sob* speak like… this.
And I can’t find a way to recover the conversation from this state. The narrations are fine, only character’s speech is affected. It especially prominent when using Mirostat due to lack of repetition control.
So far I tried, with little to no success:
- instruct it to speak as usual,
- rewriting it’s reply,
- temporary switching to sampler strategy with repetition penalty,
Anyone else experiences this, and how else to deal with it?
Have u tried lowering the Mirostat Tau? When my AI starts to be too incoherent i lower that and it seems to help.