minus-squareAtharv_Jaju@alien.topBtoLocalLLaMA•Fitting 70B models in a 4gb GPU, The whole model, no quants or distil or anything!linkfedilinkEnglisharrow-up1·1 year agoI feel the 70 B model itself won’t fit my storage ( SSD ) since I have only 50 GB left. linkfedilink
minus-squareAtharv_Jaju@alien.topBtoLocalLLaMA•When OpenAI takes neutering to the extreme...linkfedilinkEnglisharrow-up1·1 year agoNGL this is comedy for me 😆 linkfedilink
I feel the 70 B model itself won’t fit my storage ( SSD ) since I have only 50 GB left.