minus-squarea_slay_nub@alien.topBtoLocalLLaMA•Qwen-72B releasedlinkfedilinkEnglisharrow-up1·2 years agoBit disappointed by the coding performance but it is a general use case model. It’s insane how good gpt 3.5 is for how fast it is. linkfedilink
minus-squarea_slay_nub@alien.topBtoLocalLLaMA•is there any other tools like vLLM or TensorRT that can be used to speed up LLM inference?linkfedilinkEnglisharrow-up1·2 years agoLmdeploy is another one linkfedilink
minus-squarea_slay_nub@alien.topOPBtoLocalLLaMA•FACT SHEET: President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence | The White HouselinkfedilinkEnglisharrow-up1·2 years agoCare to elaborate on what the actual reality of this EO is? linkfedilink
a_slay_nub@alien.topB to LocalLLaMAEnglish · 2 years agoFACT SHEET: President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence | The White Houseplus-squarewww.whitehouse.govexternal-linkmessage-square28linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkFACT SHEET: President Biden Issues Executive Order on Safe, Secure, and Trustworthy Artificial Intelligence | The White Houseplus-squarewww.whitehouse.gova_slay_nub@alien.topB to LocalLLaMAEnglish · 2 years agomessage-square28linkfedilink
Bit disappointed by the coding performance but it is a general use case model. It’s insane how good gpt 3.5 is for how fast it is.