grigio@alien.topB to LocalLLaMAEnglish · 2 years agoIs Open LLM Leaderboard reliable source ? yi:34B is at the top but I get better results with neural-chat:7B modelmessage-squaremessage-square23linkfedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareIs Open LLM Leaderboard reliable source ? yi:34B is at the top but I get better results with neural-chat:7B modelgrigio@alien.topB to LocalLLaMAEnglish · 2 years agomessage-square23linkfedilinkfile-text
minus-squaremeetrais@alien.topBlinkfedilinkEnglisharrow-up1·2 years agoSame experience here. I got excellent results from quantized models of Intel-Neural-7B and Mistral-7B but bad results with quantized model of Yi-34B.
minus-squareInevitable_Host_1446@alien.topBlinkfedilinkEnglisharrow-up1·2 years agoI’m not sure what the point of Neural-7B is, given that it’s super censored corporate safety bot. If that’s what people want they might as well just use ChatGPT, which is faster and better otherwise.
minus-squareNixellion@alien.topBlinkfedilinkEnglisharrow-up1·2 years agoPrivacy and cost Also no, 7B is as fast or faster than ChatGPT depending on ChatGPT load.
minus-squaregrigio@alien.topOPBlinkfedilinkEnglisharrow-up1·2 years agoneural-chat from Intel is not censored! Just use a good system prompt
Same experience here. I got excellent results from quantized models of Intel-Neural-7B and Mistral-7B but bad results with quantized model of Yi-34B.
I’m not sure what the point of Neural-7B is, given that it’s super censored corporate safety bot. If that’s what people want they might as well just use ChatGPT, which is faster and better otherwise.
Privacy and cost Also no, 7B is as fast or faster than ChatGPT depending on ChatGPT load.
neural-chat from Intel is not censored! Just use a good system prompt