minus-squareSativaSawdust@alien.topBtoLocalLLaMA•Why is a single a100 so slow?linkfedilinkEnglisharrow-up1·1 year agoHave you tried: import torch print(torch.cuda.is_available()) linkfedilink
minus-squareSativaSawdust@alien.topBtoLocalLLaMA•Why is no one releasing 70b models?linkfedilinkEnglisharrow-up1·1 year agoLook at the market share of video cards with more than 100GB of Vram. linkfedilink
Have you tried: import torch print(torch.cuda.is_available())