@InterestingBasil - Power User

0 Posts
2 Comments

Joined 3 years ago

Cake day: November 21st, 2023

You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.

OverviewCommentsPosts

InterestingBasil@alien.topBtoLocalLLaMA•Finetuned llama2 deployment with vllm
link
fedilink
English
arrow-up
1·
3 years ago
This is my setup and have no issues. Quantization is not well supported by VLLM

link
fedilink

InterestingBasil@alien.topBtoLocalLLaMA•Structured Output with Zephyr
link
fedilink
English
arrow-up
1·
3 years ago
Fine tune of course

link
fedilink