Hyddro26@alien.topB to LocalLLaMAEnglish · 1 year agoWhat is considered the best uncensored LLM right now?message-squaremessage-square38fedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareWhat is considered the best uncensored LLM right now?Hyddro26@alien.topB to LocalLLaMAEnglish · 1 year agomessage-square38fedilinkfile-text
minus-squaretimtulloch11@alien.topBlinkfedilinkEnglisharrow-up1·1 year agoI’ve just started using zephyr 7b beta gptq. Pretty impressed so far, especially for a 7b
minus-squareNo-Belt7582@alien.topBlinkfedilinkEnglisharrow-up1·1 year agoHow are you serving your gptq models?
minus-squaretimtulloch11@alien.topBlinkfedilinkEnglisharrow-up1·1 year agoI use oobabooga, just recently mostly using autogen to call its api
I’ve just started using zephyr 7b beta gptq. Pretty impressed so far, especially for a 7b
How are you serving your gptq models?
I use oobabooga, just recently mostly using autogen to call its api