@MiniEval_ - Power User

0 Posts
1 Comment

Joined 1 year ago

Cake day: November 25th, 2023

You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.

OverviewCommentsPosts

MiniEval_@alien.topBtoLocalLLaMA•Quantizing 70b models to 4-bit, how much does performance degrade?
link
fedilink
English
arrow-up
1·
1 year ago
Dual 3090/4090s. Still pricey as hell, but not out of reach for some folks.

link
fedilink