minus-squaredoppelkeks90@alien.topBtoLocalLLaMA•GPT-4's 128K context window testedlinkfedilinkEnglisharrow-up1·1 year agoSo what are the implications in real day useage? It’s able to retrieve every information from at least 65k if it’s small enough. What are the results with bigger chunks to be retrieved? Is it able to process all of the 64k tokens in order to generate an answer that takes all the 64k into account. For sure it’s interesting but many more test are needed to be done to have a full picture of the real capabilities. linkfedilink
So what are the implications in real day useage?
It’s able to retrieve every information from at least 65k if it’s small enough.
What are the results with bigger chunks to be retrieved?
Is it able to process all of the 64k tokens in order to generate an answer that takes all the 64k into account.
For sure it’s interesting but many more test are needed to be done to have a full picture of the real capabilities.