minus-squareYuriWerewolf@alien.topBtoLocalLLaMA•What is considered the best uncensored LLM right now?linkfedilinkEnglisharrow-up1·1 year agoHow did you set settings for memory sharing (layers) between gpus? I have 2 gpus: 3060Ti and 3060 and it seems like it tries to load everything on the first one and goes out of memory. linkfedilink
How did you set settings for memory sharing (layers) between gpus? I have 2 gpus: 3060Ti and 3060 and it seems like it tries to load everything on the first one and goes out of memory.