oobabooga4@alien.topB to LocalLLaMAEnglish · 1 year agoQuIP#: SOTA 2-bit quantization method, now implemented in text-generation-webui (experimental)github.comexternal-linkmessage-square6linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkQuIP#: SOTA 2-bit quantization method, now implemented in text-generation-webui (experimental)github.comoobabooga4@alien.topB to LocalLLaMAEnglish · 1 year agomessage-square6linkfedilink
Omg how can I run it on 3090?