mcmoose1900@alien.topB to LocalLLaMAEnglish · 1 year agoNouse-Capybara-34B 200Khuggingface.coexternal-linkmessage-square12fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkNouse-Capybara-34B 200Khuggingface.comcmoose1900@alien.topB to LocalLLaMAEnglish · 1 year agomessage-square12fedilink
minus-squaremcmoose1900@alien.topOPBlinkfedilinkEnglisharrow-up1·1 year agoPrecisely 47K fits in 24GB at 4bpw. I have not tried 3.5, but I think it could be much more.
200K context!!
Precisely 47K fits in 24GB at 4bpw.
I have not tried 3.5, but I think it could be much more.