3 Posts
2 Comments

Joined 3 years ago

Cake day: October 29th, 2023

You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.

OverviewCommentsPosts

Longjumping-Bake-557@alien.topBtoLocalLLaMA•X.AI Grok could potentially be open sourced on a 6 month delay from launch
link
fedilink
English
arrow-up
1·
3 years ago
Which is hilarious seeing how he kept joking about “closedai” for a while

link
fedilink

Longjumping-Bake-557@alien.topB to

LocalLLaMAEnglish · 3 years ago

Why is no one releasing 70b models?

1

Why is no one releasing 70b models?

Longjumping-Bake-557@alien.topB to

LocalLLaMAEnglish · 3 years ago

Longjumping-Bake-557@alien.topB to

LocalLLaMAEnglish · 3 years ago

Discrepancy between TheBloke_Orca-2-13B-GPTQ and the original one with the tested logic question

2

1

Discrepancy between TheBloke_Orca-2-13B-GPTQ and the original one with the tested logic question

Longjumping-Bake-557@alien.topB to

LocalLLaMAEnglish · 3 years ago

2

Longjumping-Bake-557@alien.topBtoLocalLLaMA•NVidia H200 achieves nearly 12,000 tokens/sec on Llama2-13B with TensorRT-LLM
link
fedilink
English
arrow-up
1·
3 years ago
And that’s on a die just slightly bigger than the 4090. Unless they increased the size compared to h100?

link
fedilink

Longjumping-Bake-557@alien.topB to

LocalLLaMAEnglish · 3 years ago

SynthIA 70b on a single 3090, 0.17tokens/s

1

1

SynthIA 70b on a single 3090, 0.17tokens/s

Longjumping-Bake-557@alien.topB to

LocalLLaMAEnglish · 3 years ago

1