minus-squareProperSauce@alien.topBtoLocalLLaMA•Yi-34B and Yi-34B-Chat are outlinkfedilinkEnglisharrow-up1·2 years agoSometimes models have like 15 separate downloads how do I know which one to use? Do I download all of them and put them in my oobabooga model folder and then load the first one? linkfedilink
minus-squareProperSauce@alien.topBtoLocalLLaMA•🐺🐦⬛ Huge LLM Comparison/Test: Part II (7B-20B) Roleplay TestslinkfedilinkEnglisharrow-up1·2 years agoHow do I run a 70B llm on my 4090? Most of the 70B say they require like 40gb of Vram. linkfedilink
Sometimes models have like 15 separate downloads how do I know which one to use? Do I download all of them and put them in my oobabooga model folder and then load the first one?