Holiday_Fly_590@alien.topB to LocalLLaMAEnglish · 2 years agoQuestions on Attention Sinks and Their Usage in LLM Modelsalien.topimagemessage-square5linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1imageQuestions on Attention Sinks and Their Usage in LLM Modelsalien.topHoliday_Fly_590@alien.topB to LocalLLaMAEnglish · 2 years agomessage-square5linkfedilink
minus-squareWAHNFRIEDEN@alien.topBlinkfedilinkEnglisharrow-up1·2 years agoit’s already implemented in llama.cpp
it’s already implemented in llama.cpp