s3-parallel-put for faster uploads

/var/www# /usr/local/bin/s3-parallel-put --bucket=mediatest.visualsociety.com --host=s3.amazonaws.com --processes=10 --put=stupid --secure --content-type=guess --log-filename=/var/log/s3upload.log  .

Tested for 600GB of data
start time: 9:00AM March14
End time:-xx
11 GB uploaded in 10 minutes so far...
digital ocean droplet (2vcpu,2GB memory) NYC region to aws-s3

github: s3-parallel-put

No comments:

Post a Comment