cloud computing – Unterbahn http://unterbahn.com Wed, 11 Apr 2018 16:40:54 +0000 en-US hourly 1 https://wordpress.org/?v=4.9.5 Amazon s3 storage search interface http://unterbahn.com/2009/10/amazon-s3-storage-search-interface/ http://unterbahn.com/2009/10/amazon-s3-storage-search-interface/#comments Wed, 07 Oct 2009 21:02:54 +0000 http://unterbahn.com/?p=940 Continue reading "Amazon s3 storage search interface"

Related Posts:

]]> I use Amazon S3 for backup, and find that it’s hard to use because there’s no search function, so I can’t see what I’ve backed up.

So, I extended s3cmd.rb (comes with the WONDERFUL s3cmd.rb rsync clone for Amazon S3) with a search command.

Now I can use s3sync.rb to rsync my files up, then type:

s3sync.rb search bucket_name:path/to/restrict/search search_term

and I get, for example:

backup/2009/spatial/jeff-spatial-vertical.key
backup/2009/spatial/spatial-assignment-1-jeff.pdf
backup/2009/spatial/spatial-assignment-1.key
backup/2009/spatial/spatial-assignment-1.key.zip
backup/2009/spatial/spatial-interface
backup/2009/spatial/spatial-lecture-1
backup/2009/spatial/spatial-lecture-1.key
backup/2009/spatial/spatial-lecture-1.key.zip
backup/2009/spatial/spatial-lecture-1/spatial-lecture-1.key
backup/2009/spatial/spatial-lecture-1/spatial-lecture-1.pdf
backup/2009/spatial/spatial-lecture-3.key
backup/2009/spatial/spatial-lecture-3.mov
backup/2009/spatial/spatial-lecture-3.pdf
backup/2009/spatial/spatial-uploads
backup/2009/spatial/spatial-wayfinding.key
you just spent 6.0e-05 cents

The last line is because the price of making a list request in s3 is $0.01 per 1000 requests in the US; so I thought it’d be a good idea to tell people how much they’re spending.

I’ll try to commit this to the main s3sync.net codebase, but for now you can just download it here: s3sync

Related Posts:

]]> http://unterbahn.com/2009/10/amazon-s3-storage-search-interface/feed/ 2 As cloud computing becomes more powerful and flexible, I do think we’ll need less and less… http://unterbahn.com/2008/02/as-cloud-computing-becomes-more-powerful-and-flexible-i-do-think-we%e2%80%99ll-need-less-and-less/ Sat, 16 Feb 2008 05:12:00 +0000 http://strangethoughts.tumblr.com/post/26465909 As cloud computing becomes more powerful and flexible, I do think we’ll need less and less powerful personal computers… still, 1 week at 1024x768 was enough to teach me the value of a nice monitor.

The OLPC keyboard was too tiny for my hands, or I’d give up full sized keyboards and the Mac OS forever. I think.

Number 1 thing I’d miss on Mac OS? Omnigraffle.

Related Posts:

]]> As cloud computing becomes more powerful and flexible, I do think we’ll need less and less powerful personal computers… still, 1 week at 1024×768 was enough to teach me the value of a nice monitor.

The OLPC keyboard was too tiny for my hands, or I’d give up full sized keyboards and the Mac OS forever. I think.

Number 1 thing I’d miss on Mac OS? Omnigraffle.

Related Posts:

]]> Amazon AWS supercomputing http://unterbahn.com/2008/02/amazon-aws-supercomputing/ Fri, 15 Feb 2008 19:26:02 +0000 http://strangethoughts.tumblr.com/post/26435578 Is anyone selling distributed parallel processing to universities and laboratories based on Amazon’s cloud computing initiative? Even if the base price per teraflop isn’t great, you can scale linearly and you don’t need any physical space at all… it seems like there would be a lot of benefits.

There is some discussion on the idea here, but I haven’t seen any serious implementations.

Related Posts:

]]> Is anyone selling distributed parallel processing to universities and laboratories based on Amazon’s cloud computing initiative? Even if the base price per teraflop isn’t great, you can scale linearly and you don’t need any physical space at all… it seems like there would be a lot of benefits.

There is some discussion on the idea here, but I haven’t seen any serious implementations.

Related Posts:

]]>