Hi everyone. I was considering backup options to Glacier Deep Archive, and wanted to know:

  1. Which software do you use to encrypt client-side, obfuscate, compress and deduplicate the data before you send it to S3?
  2. What is the difference between Restore Requests (bulk) and Outbound data transfer and which one will I be using when I want to pull my data from AWS?

I’ll be storing approximately 8TB or so of data, which is why I was looking at inexpensive ways to back it up other than buying an HDD outright.

Thanks!

  • 7Sea_Sailor@lemmy.dbzer0.comEnglish
    5·
    1 year ago

    Recently I looked into the same thing, since AWS caught my eye with their apparently ridiculously low prices. Then I found this (presumably indepdenant) review, that changed my view on things: https://b3n.org/b2-vs-s3-nas-backup/

    After reading that, I won’t go with AWS. I’m currently considering to abuse the OneDrive Office Family plan, which costs 99 $ a year for 6 TB of storage (split across 6 accounts), which comes down to 1,40 $ per month per TB. A price that I have not seen beaten by other storage / backup providers.

    • MigratingtoLemmy@lemmy.worldOPEnglish
      1·
      1 year ago

      The problem with AWS is that one need to bring all storage from glacier to regular S3 (which is quite expensive), and then their egress costs are massive. I read more about it and completely agree that AWS is not worth it at all when pulling data in.

      However, BackBlaze is quite expensive. I’d be paying $50 for my storage, which is simply not how much I’d like to pay. At this rate, I’d get a 10TB Ironwolf drive in an enclosure from Amazon for my cold storage.

      TBH, I was looking at other providers, and Dropbox looks much less expensive at $20 for 9TB. It’s a lot more than the 8TB I thought I’d be able to get away with for Glacier storage, but at least it’s not $50. I will take a look at scaleaway, but I simply trust the bigger players to be around and keep my files safe than the smaller companies.

      Edit: Scaleway seems less expensive than Dropbox with their glacier option. I really hope I can trust this company because this is an excellent price and I might even be willing to pay as much if it can be kept secure and safe. Now, I just need to read more about the value proposition of Dropbox vs Scaleway Glacier.

  • lal309@lemmy.worldEnglish
    2·
    1 year ago

    Lots of answers in the comment about this particular storage type/vendor. Regardless, to answer your original question, rclone. Hands down. If you spend 30-60 minutes actually reading their documentation, you are set and understand so much more of what’s going on under the hood.

    • MigratingtoLemmy@lemmy.worldOPEnglish
      1·
      1 year ago

      Thanks, I do know of rclone and intend to study it. I was just wondering if the likes of borg, duplicati etc could be used.

      • lal309@lemmy.worldEnglish
        1·
        1 year ago

        Can’t speak for those but I tried Kopia and it did the job okay. Ultimately tho I landed on rclone.

    • MigratingtoLemmy@lemmy.worldOPEnglish
      2·
      1 year ago

      Wait, I’m looking at the data retrieval cost (bulk request) and it says it’s priced at $0.0025 per GB? That comes out to about $21 for a retrieval! Am i missing something important?

    • Showroom7561@lemmy.caEnglish
      2·
      1 year ago

      I think that people would be using the service as a last resort, like when all other local or physical offsite backups fail.

      In that sense, the cost to recover shouldn’t be the main factor when considering it.

      • MigratingtoLemmy@lemmy.worldOPEnglish
        2·
        1 year ago

        Is there a less expensive alternative for Cloud storage with a decent SLA? I don’t want to go for the smaller companies, and BackBlaze is quite expensive too!

        • Showroom7561@lemmy.caEnglish
          1·
          1 year ago

          With my Synology NAS, I use icloud e2 for cloud storage. Reasonably priced, and it integrates with Synology’s Hyperbackup software.

          But my needs are relatively small, sending < 5TB to my cloud backup. A few more TB and I may start looking at other options.

          • MigratingtoLemmy@lemmy.worldOPEnglish
            2·
            1 year ago

            I plugged in my numbers into AWS, and I’m looking at $9 a month for storage with $21 for a bulk retrieval. That’s quite inexpensive, which is why I’m starting to think that I’m missing something important

            • g_damian@lemmy.worldEnglish
              1·
              1 year ago

              Scaleway also offers glacier storage class. ~€0.002/GB/month. €0.009/GB retrieval. €0.01/GB transfer.

          • thisispiggy@lemmy.worldEnglish
            1·
            1 year ago

            What other options? I was looking at hezner storage box and it seems pretty reasonable for storage, about $13 for 5 tb

            • Showroom7561@lemmy.caEnglish
              1·
              1 year ago

              I’m not at the “other options yet” as my idrive will review for another year in a week or so.

              At some point, it may be cheaper if I set up a small NAS as a family member’s house and stick an 8TB or 12TB drive in there.

              Really, the cloud backup for me is the last resort, and I have other redundancies available well before I’d need to use a cloud backup.