@ID4gotten - Power User

0 Posts
1 Comment

Joined 1 year ago

Cake day: October 25th, 2023

You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.

OverviewCommentsPosts

ID4gotten@alien.topBtoLocalLLaMA•I’m extremely confused about system requirements. Some people are worried about ram and others about vram. I have 64gb of ram and 12gb vram. What size of model can I run?
link
fedilink
English
arrow-up
1·
1 year ago
Do you mean
(RAM gb + VRAM gb - 5gb) * billion parameters?
And what is the 5 for? Thanks

link
fedilink