16k context is awesome. Now we need Goliath 120b with 16k context and I’m done with OpenAI
- 0 Posts
- 2 Comments
Joined 3 years ago
Cake day: November 14th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.


Goliath is a masterpiece so far. Running it on 4x4090, speed is OK, but not the best still.
For my taste it writes stories better than GPT4 itself, immersing deeper and avoiding useless watery poetic shit GPT4 is full of.
Just give the thing 16k context and with a 16x4096 setup it’ll be divine lol