minus-squarezodireddit@alien.topBtoLocalLLaMA•GTX 4070ti and 32gb RAM run Llama 13b?linkfedilinkEnglisharrow-up1·1 year agoI’m no expert in this but I’m using a 13b llama 2 model I’m happy with, with just a 3060 and it runs fine. It’s probably not the raw model but it’s pretty good. I also have 32gb of ram linkfedilink
I’m no expert in this but I’m using a 13b llama 2 model I’m happy with, with just a 3060 and it runs fine. It’s probably not the raw model but it’s pretty good. I also have 32gb of ram