Log in

No account? Create an account
entries friends calendar profile My Website Previous Previous Next Next
Mark Atwood
Writing my S3 command line toolset
So, there was a command line toolset for manipulating S3, called the Hanzoarchives hanzo-s3-tools. They were kind of iffy in the installation and documentation, but they worked, more or less. However, their handling of S3 ACLs was pretty poor, very not useful. And as the last straw, it seems to have gone offline and vanished.

On the other hand, there is a really good Perl library, Net::Amazon::S3. Many of my clients are more or less Perl shops, so I have been recommending that they install it. But that module lacks the scripts that bring functionality out to the command line.

So I'm writing them. Today, I've got s3mkbucket and s3rmbucket working, complete with handling of ACLs and TLS. Tomorrow will be s3putacl and s3getacl, and quickly following will be s3put, s3get, s3head, s3rm and s3ls.

All open source, of course. It will be available in my public repository, and I'll see if I can get the Net::Amazon::S3 to accept it as a patch. If he doesn't, I'll just make a Freshmeat project, and advertise it that way.

Tags: , , , ,
Current Location: Home, Capitol Hill, Seattle WA
Current Music: (Amok Vibes) Blue Lagoon

3 comments or Leave a comment
From: hollyking Date: August 23rd, 2007 03:30 am (UTC) (Link)
You beat me to it. I was just starting to layout an idea for just such a set of tools. Thanks!
fallenpegasus From: fallenpegasus Date: August 23rd, 2007 03:36 am (UTC) (Link)
Any particular suggestions or desires?

Your shop is using S3? What for? Need any help with it?
From: hollyking Date: August 23rd, 2007 03:52 am (UTC) (Link)
At this point my needs are pretty simple. I think they're all covered with the names you've laid out, but if I think of any I'll let you know.

My shop doesn't use it but I wanted to learn more about it for my own projects. There had been some rumblings of moving our kiosk to Linux but I really doubt that's going to happen so we're in the Windows world for a while. Which reminds me I want to dig more into Net::Amazon::S3 because I like it more than SOAP::Amazon::S3 but it doesn't install on Win32 with Strawberry Perl yet.

I was planning on using S3 for an offsite backup site and hosting a few files to share. My future plans are start learning about S3 then moving on to EC2. I'm still thinking about that public printing project you suggested a while ago and those two services with SQS might be just the thing to get a lot of capacity without a large investment in hardware.

So far I think it's clear in my head but I'll keep you in mind if I have any questions.
3 comments or Leave a comment