Arkonias@alien.topBtoLocalLLaMA•What is the best 7B model for reading comprehension and instruction following at the moment?English
1·
1 year agoOpenHermes 2.5 Mistral has been quite good for me. It follows the CYOA prompt that I use well.
OpenHermes 2.5 Mistral has been quite good for me. It follows the CYOA prompt that I use well.
Save the $$$ for a few months and go and buy a used 3090 or two. It’ll be worth it in the long run, and save any headaches of trying to frakenstein a bunch of 8 GB cards together.
Make sure you are using the Codellama Instruct preset. Also, work on your prompting:
“You are tasked to write a python script that takes an email address…”
Censorship is bad. AI is for porn.
3090 on old hardware sounds like bottleneck hell.
Use the black friday sales to upgrade your Motherboard, Ram, CPU, and PSU.