The integrity of all files in AWS is checked by calculating the hash locally and comparing it to the one returned by AWS S3.įrom time to time, I copy the local archives on my laptop to other local copies, for instance on an external HDD. It will warn for files which are stored in the cloud but I don't have a local copy, too. I can delete the DCIM folder now, as I have one local, encrypted copy of it.Īfterwards I usually run awsbackup.sh cloud-sync which uploads all local archives which are not yet stored in the cloud. This is an offline operation which does not require internet. Then I would run the command awsbackup.sh ~/DCIM/ _Business_Trip which creates a new, xz-compressed, encrypted and checksummed archive. Let's assume the new pictures are stored in a folder called DCIM. Whenever I want to add a new archive with pictures, I copy them from my smartphone or camera to my laptop. It should be as simple as possible, restoring an archives should be possible without any scripts, too.Įvery local copy of the backup has the following file structure:Īll actual content goes into the folder awsbackup.Īdditionally, some text files containing checksums are stored, too.Ī new local copy can be made by simply copying all of the files above somewhere else.

This is not as convenient, but otherwise I would need to worry about losing the private key, too.

I use a >40 characters passphrase instead of a public/private key.

File contents and file names are encrypted.

Bit-rot in local copies can be detected.

AWS is only for the 'My house burned to the ground.'-scenarios.

I have two local copies of all archives, AWS is only used for the off-site backup.

No strange dependencies, should run on any Linux system.

Total number of archives is less than 10.000.

Uploaded archives never change, only new archives are added from time to time.

It was designed with the following criterias in mind: I store around ~120GB of pictures (~550 archives) for only ~0.12 ct/month!

This is a bash script I use for storing my private picture collection at AWS S3 Deep Glacier.

Amazon glacier for personal backup