minus-squareyeawhatever@alien.topBtoLocalLLaMA•Quantizing 70b models to 4-bit, how much does performance degrade?linkfedilinkEnglisharrow-up1·3 years agoabout 44 GB linkfedilink
about 44 GB