From what I’ve read mac somehow uses system ram and windows uses the gpu? It doesn’t make any sense to me. Any help appreciated.

  • Fluboxer@alien.topBEnglish
    1·
    1 year ago

    7b and 13b fully in vram. 7b models have 35, 13b have 43 layers iirc

    70b involving ram