GerlamoRodion@alien.topB to LocalLLaMAEnglish · 2 years agoThoughts: Can you run a decent LLM on a RTX 4060 TI (16GB)?message-squaremessage-square1linkfedilinkarrow-up11arrow-down10file-text
arrow-up11arrow-down1message-squareThoughts: Can you run a decent LLM on a RTX 4060 TI (16GB)?GerlamoRodion@alien.topB to LocalLLaMAEnglish · 2 years agomessage-square1linkfedilinkfile-text
minus-squarePashax22@alien.topBlinkfedilinkEnglisharrow-up1·2 years agoYes, of course. I’m running them on a 4070Ti with only 12Gb of RAM - sometimes I have to accept slower speeds, but I can still run more or less anything I might reasonably want to (and a few things that are distinctly UNreasonable).
Yes, of course. I’m running them on a 4070Ti with only 12Gb of RAM - sometimes I have to accept slower speeds, but I can still run more or less anything I might reasonably want to (and a few things that are distinctly UNreasonable).