Don’t buy the v100 at amazon.se - that price is crazy high

Nous capybara yi-34 q6 gguf works very well for complex summarization (which requires some instruction following) of large texts. Temp=0, repeat penalty =[0.9-1.1]. Prompt: SYSTEM: USER: ASSISTANT:

Yi-34-200k is trained for summarization and does it really well

Thanks! V informative, will keep for reference👍🏼

Yea, the non-tuned (base) or lightly tuned Yi versions that I’ve recently have been in need of fixes…

Check out the gron tool