1·
1 year agoYou mind shooting a few test to have real word numbers? Like what kind of speeds are you getting for a 7b q6 and 13b q6, they should fully fit in VRAM
- 0 Posts
- 5 Comments
Joined 1 year ago
Cake day: October 31st, 2023
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
You took a picture of nous capybara…
May be some kind of memgpt…
You mind shooting a few test to have real word numbers for the laptop version? Like what kind of speeds are you getting for a 7b q6 and 13b q6, they should fully fit in VRAM