Hey everyone, first time posting on here.

I’m trying to open a couple of large csv.gz files for a data analysis project. The issue is that my computer has nowhere near enough disk space to open the file (it’s upward of over 100 GB). Do you all have any thoughts on how I could potentially open these files? I’ve tried using 7ZIP and Microsoft Azure.

Here is a link to the dataset: https://data.stanford.edu/dime.

Thanks!

  • Drivingmecrazeh@alien.topBEnglish
    1·
    1 year ago

    External drive MAY work but its likely going to write to temp first, which will take up space.

    10 gallons of water in a 5 gallon bucket.

    • stinger5598@alien.topBEnglish
      1·
      1 year ago

      this … but change the working directory to the external drive as well within the program before attempting to open. that way the temp folder will have more room as well.

  • morto00x@alien.topBEnglish
    1·
    1 year ago

    If it’s urgent, you could pay for a month of cloud virtual desktop services (Amazon Workspaces, Azure Virtual Desktop, Citrix DaaS, V2 Cloud, VMWare Horizon, etc). Some of them even give you a free trial for a few weeks.