k_michael@alien.topOPBtoLocalLLaMA•What exactly is pulling 100-110W when running local LLM?English
1·
1 year agoOh wow, that would be much more than I expected. Could make a lot of sense as the LLM is probably hitting the RAM very hard. Thank you 🙌
Oh wow, that would be much more than I expected. Could make a lot of sense as the LLM is probably hitting the RAM very hard. Thank you 🙌
I’m not training, just running inference for fun every now and then. This question was mostly just for curiosity. But thank you, you are right!
That’s a good point actually! Thanks
Hm, you are right, I do also remember the anandtech article on m1 max power draw. Maybe the tool really isn’t reading reading the draw correctly 🤔 It’s still interesting though, if I run a 3D game on my MBP i draw maybe 65-70W under full load. The LLM must be using some component that the 3D game isn’t 🤷♂️
I think they all read from the same source, powermetrics, but interpret it in slightly different ways.