Playing around with LZLV-70b 4QM, i am having a great time with the long form responses. However after a while now i am beginning to notice “AI styled writing” I tried pumping up the temperature to 1.5, repetition penalty to 1.3 and even tried mirostat mode 1,2 on the kobold.cpp
If the repetition penalty gets too high, the AI gets nonsensical. If the temperature gets too high, the AI starts to blurt out nonsense. While I am not aiming to have the AI write exactly like a person and be undetectable, after reading it so much it’s gotten pretty repetitive with it’s word usage and sentences.
I’ve tried prompting it to
" Write in a simple easy to read way make your response more conversational and less formal. Aim to increase perplexity by varying your word choices and avoiding predictable phrases "
but it’s…limited.
any tips or methods to make the AI not be so…dry?
From my experience, give it a lot, I mean really a lot, of consistent examples in the prompt how you wish it to respond in different kinds of situations, including the tones and styles. It would work. Try to give it at least 10 to 20 examples for each scenario. Consistency is the key.