I tried to apply a lot of prompting techniques in 7b and 13b models. And no matter how hard I tried, there was barely any improvement.
I tried to apply a lot of prompting techniques in 7b and 13b models. And no matter how hard I tried, there was barely any improvement.
I don’t find it useless at all. It’s just more mysterious because sometimes one line of prompt gets you the best results, and sometimes it will actually listen to much more detailed instructions… but it’s a bit of a crap shoot and trial and error.