minus-squarelemonlimeandbitters@alien.topBtoLocalLLaMA•most powerful model for an A6000?linkfedilinkEnglisharrow-up1·1 year agoI’m also mucking about with A6000’s. 120b models quantised to 3bpw fit well with a 4K context in 48gb and are a lot of fun. Of course, soon you’ll realise how much more you can do with 2 a6000s… linkfedilink
I’m also mucking about with A6000’s. 120b models quantised to 3bpw fit well with a 4K context in 48gb and are a lot of fun. Of course, soon you’ll realise how much more you can do with 2 a6000s…