https://www.amazon.se/-/en/NVIDIA-Tesla-V100-16GB-Express/dp/B076P84525 price in my country: 81000SEK or 7758,17 USD

My current setup:
NVIDIA GeForce RTX 4050 Laptop GPU
cuda cores: 2560
memory data rate 16.00 Gbps

My laptop GPU works fine for most ML and DL tasks. I am currently finetuning a GPT-2 model with some data that I scraped. And it worked surprisingly well on my current setup. So it’s not like I am complaining.

I do however own a stationary PC with some old GTX 980 GPU. And was thinking of replacing that with the V100.

So my question to this community is: For those of you who have bought your own super-duper-GPU. Was it worth it. And what was your experience and realizations when you started tinkering with it?

Note: Please refrain giving me snarky comments about using Cloud GPU’s. I am not interested in that (And I am in fact already using one for another ML task that doesn’t involve finetuning) . I am interested to hear about the some hardware hobbyists opinion on this matter.

  • aikitoria@alien.topB
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 year ago

    Is there any such benchmark that includes both the 4090/A100 and a mac with M2 Ultra / M3 Max? I’ve searched quite a bit but didn’t find anyone comparing them on similar setups, it seems very interesting due to the large unified memory.