minus-squaremdutAi@alien.topBtoLocalLLaMA•What is the best 7B model for reading comprehension and instruction following at the moment?linkfedilinkEnglisharrow-up1·1 year agoIn my opinion, the “zephyr 7b beta” model is the best among the 7b models in terms of humane behaviors and reading comprehension. The disadvantage of this model is coding and mathematics. Here is the information screen https://cdn-uploads.huggingface.co/production/uploads/6200d0a443eb0913fa2df7cc/raxvt5ma16d7T23my34WC.png Also, if you would like to examine the model: https://huggingface.co/HuggingFaceH4/zephyr-7b-beta I can run it with Langchain on a laptop with RTX2060 6gb Ram and i7 11h and 32 ram. The secret is INT4 linkfedilink
In my opinion, the “zephyr 7b beta” model is the best among the 7b models in terms of humane behaviors and reading comprehension. The disadvantage of this model is coding and mathematics. Here is the information screen
https://cdn-uploads.huggingface.co/production/uploads/6200d0a443eb0913fa2df7cc/raxvt5ma16d7T23my34WC.png
Also, if you would like to examine the model:
https://huggingface.co/HuggingFaceH4/zephyr-7b-beta
I can run it with Langchain on a laptop with RTX2060 6gb Ram and i7 11h and 32 ram.
The secret is INT4