minus-squareerikqu_@alien.topBtoLocalLLaMA•How much does Quantization actually impact models? - KL Divergence TestslinkfedilinkEnglisharrow-up1·1 year agoReminds me of pruning, pruning has been shown to have little impact on model performance in other areas, although I haven’t seen it applied to this space much (afaik) linkfedilink
minus-squareerikqu_@alien.topBtoLocalLLaMA•New Claude 2.1 Refuses to kill a Python process :)linkfedilinkEnglisharrow-up1·1 year agoClaude is so nerfed, it’s unusable imo linkfedilink
Reminds me of pruning, pruning has been shown to have little impact on model performance in other areas, although I haven’t seen it applied to this space much (afaik)