1·
1 year agoWhat model are you going to run that can accept 100GB of context?
- 0 Posts
- 3 Comments
Joined 1 year ago
Cake day: October 29th, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
I wonder if you could get it running on two Mac Studio Ultras with 192GB of RAM each. With fewer nodes you’d reduce the communication overhead quite a bit.
Ooh… now I’ve got another model to play with. :D