minus-squareChromix_@alien.topBtoLocalLLaMA•Anyone get Amazon’s long-context MistralLite to work properly?linkfedilinkEnglisharrow-up1·1 year agoYou wrote that it works for short prompts. Did you also try slightly longer prompts (up to 4k tokens)? This doesn’t hit the sliding window yet, but still resulted in not much useful output for me and some others. linkfedilink
Chromix_@alien.topB to LocalLLaMAEnglish · 1 year agoMistralLite not able to summarize text?plus-squaremessage-squaremessage-square1fedilinkarrow-up11arrow-down10
arrow-up11arrow-down1message-squareMistralLite not able to summarize text?plus-squareChromix_@alien.topB to LocalLLaMAEnglish · 1 year agomessage-square1fedilink
You wrote that it works for short prompts. Did you also try slightly longer prompts (up to 4k tokens)? This doesn’t hit the sliding window yet, but still resulted in not much useful output for me and some others.