minus-squareAirwolfPL@alien.topOPBtoLocalLLaMA•Help for the n00b? Optimal loader parameters...linkfedilinkEnglisharrow-up1·1 year agoThanks for the informative answer. I will take a look at GGUF models (although I’m not sure yet how to split them between cpu/gpu yet (I will take a look at llama.cpp parameters). linkfedilink
AirwolfPL@alien.topB to LocalLLaMAEnglish · 1 year agoHelp for the n00b? Optimal loader parameters...plus-squaremessage-squaremessage-square3fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareHelp for the n00b? Optimal loader parameters...plus-squareAirwolfPL@alien.topB to LocalLLaMAEnglish · 1 year agomessage-square3fedilink
Thanks for the informative answer. I will take a look at GGUF models (although I’m not sure yet how to split them between cpu/gpu yet (I will take a look at llama.cpp parameters).