minus-squareFluboxer@alien.topBtoLocalLLaMA•I’m extremely confused about system requirements. Some people are worried about ram and others about vram. I have 64gb of ram and 12gb vram. What size of model can I run?linkfedilinkEnglisharrow-up1·1 year ago7b and 13b fully in vram. 7b models have 35, 13b have 43 layers iirc 70b involving ram linkfedilink
7b and 13b fully in vram. 7b models have 35, 13b have 43 layers iirc
70b involving ram