Automated Amazon EBS snapshot backup script with 7 day retention

Posted by: Admin  :  Category: Web Hosting

Linux Cpanel shared hosting: 600 GB disk space, 6 TB bandwidth, free domain, unlimited databases and ftp accounts, web hosting cheap and pro at Hostony

Hello there!

We have recently been implementing several different backup strategies for properties that reside on the Amazon cloud platform.

These strategies include scripts that incorporate s3sync and s3fs for offsite or redundant “limitless” backup storage capabilities. One of the more recent strategies we have implemented for several clients is an automated Amazon EBS volume snapshot script that only keeps 7 day retention on all snapshot backups.

The script itself is fairly straightforward, but took several dry-runs in order to fine tune it so that it would reliably create the snapshots, but more importantly would clear out old snapshots older than 7 days.

You can see the for loop for deleting older snapshots. This is done by parsing snapshot dates, converting the dates to a pure numeric value and comparing said numeric value to a “7 days ago” date variable.

Take a look at the script below, hopefully it will be useful to you! There could be more error checking, but that should be fairly easy to do.

Linux Cpanel shared hosting: 600 GB disk space, 6 TB bandwidth, free domain, unlimited databases and ftp accounts, web hosting cheap and pro at Hostony

#!/bin/bash
# EBS Snapshot volume script
# Written by Star Dot Hosting
# www.stardothosting.com

# Constants
ec2_bin="/opt/aws/bin"
my_cert="/opt/aws/cert.txt"
my_key="/opt/aws/key.txt"
instance_id=`wget -q -O- http://169.254.169.254/latest/meta-data/instance-id`

# Dates
datecheck_7d=`date +%Y-%m-%d --date '7 days ago'`
datecheck_s_7d=`date --date="$  datecheck_7d" +%s`

# Get all volume info and copy to temp file
$  ec2_bin/ec2-describe-volumes -C $  my_cert -K $  my_key  --filter "attachment.instance-id=$  instance_id" > /tmp/volume_info.txt 2>&1

# Get all snapshot info
$  ec2_bin/ec2-describe-snapshots -C $  my_cert -K $  my_key | grep "$  instance_id" > /tmp/snap_info.txt 2>&1

# Loop to remove any snapshots older than 7 days
for obj0 in $  (cat /tmp/snap_info.txt)
do

        snapshot_name=`cat /tmp/snap_info.txt | grep "$  obj0" | awk '{print $  2}'`
        datecheck_old=`cat /tmp/snap_info.txt | grep "$  snapshot_name" | awk '{print $  5}' | awk -F "T" '{printf "%s\n", $  1}'`
        datecheck_s_old=`date --date=$  datecheck_old" +%s`

#       echo "snapshot name: $  snapshot_name"
#       echo "datecheck 7d : $  datecheck_7d"
#       echo "datecheck 7d s : $  datecheck_s_7d"
#       echo "datecheck old s: $  datecheck_s_old"

        if (( $  datecheck_s_old <= $  datecheck_s_7d ));
        then
                echo "deleting snapshot $  snapshot_name ..."
                $  ec2_bin/ec2-delete-snapshot -C $  my_cert -K $  my_key $  snapshot_name
        else
                echo "not deleting snapshot $  snapshot_name ..."

        fi

done

# Create snapshot
for volume in $  (cat /tmp/volume_info.txt | grep "VOLUME" | awk '{print $  2}')
do
        description="`hostname`_backup-`date +%Y-%m-%d`"
        echo "Creating Snapshot for the volume: $  volume with description: $  description"
        $  ec2_bin/ec2-create-snapshot -C $  my_cert -K $  my_key -d $  description $  volume
done

DiggTwitterRedditDeliciousShare

*.hosting

Linux Cpanel shared hosting: 600 GB disk space, 6 TB bandwidth, free domain, unlimited databases and ftp accounts, web hosting cheap and pro at Hostony

Leave a Reply

*