minus-squarezBlackVision11@alien.topBtoLocalLLaMA•Why is no one releasing 70b models?linkfedilinkEnglisharrow-up1·1 year agoYes I also hope it get’s exllamav2 support, here is a issue regarding it: (Qwen model not supported) · Issue #160 · turboderp/exllamav2 (github.com) linkfedilink
minus-squarezBlackVision11@alien.topBtoLocalLLaMA•Why is no one releasing 70b models?linkfedilinkEnglisharrow-up1·1 year agoQwen 72b is comming in 2 days 👍 Will be a real beast. linkfedilink
Yes I also hope it get’s exllamav2 support, here is a issue regarding it: (Qwen model not supported) · Issue #160 · turboderp/exllamav2 (github.com)