WinterUsed1120@alien.topB to LocalLLaMAEnglish · 1 year agoExllama v2 vs. llama.cpp (All layes offloaded to GPU)plus-squaremessage-squaremessage-square1fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareExllama v2 vs. llama.cpp (All layes offloaded to GPU)plus-squareWinterUsed1120@alien.topB to LocalLLaMAEnglish · 1 year agomessage-square1fedilink