Archive

Here’s a little script that uses s3cmd and calculate the total data size stored in all S3 buckets for the same account #!/bin/bash for bucket in $(s3cmd ls |awk ‘{print $3}’); do size=$(s3cmd du ${bucket} |awk ‘{print $1}’) total=$(expr $total + $size); #echo $total done echo “total=$total kb” Enjoy, Lahav

Introduction S3FS is a fuse filesystem you can use to mount s3 bucket on your local filesystem. In this guide I will show how to quickly install s3fs and use it in /etc/fstab to mount it on your local server. Tested On OS: Amazon Linux AMI release 2012.03 S3FS version: 1.61 Hardware: Virtual Machine (AWS …

Create a bucket named the same as the domain you wish to host on S3 For the domain: www.example.com the bucket should be: www.example.com.s3.amazonaws.com Create a CNAME www.example.com that points to www.example.com.s3.amazonaws.com Define the Index and Error document Complete example on AWS blog: http://aws.typepad.com/aws/2011/02/host-your-static-website-on-amazon-s3.html As always, Enjoy!

I found that sometimes s3cmd can be really slow (download speed ~3.75MB/s). Here’s a tip to fix it: the s3cmd upload/download speed can be tuned by modifying send_chunk/recv_chunk variables in the s3cfg configuration file (the default is 4096 – 4KB).

{ “Statement”: [ { "Sid": "Stmt1334692073905", "Action": [ "s3:ListAllMyBuckets" ], “Effect”: “Allow”, “Resource”: [ "arn:aws:s3:::*" ] }, { “Sid”: “Stmt1334692152097″, “Action”: [ "s3:*" ], “Effect”: “Allow”, “Resource”: [ "arn:aws:s3:::emind-test1", "arn:aws:s3:::emind-test1/*" ] } ] }