Book Reviews   Digital Libraries   Astronomy Log   Software   About  
The main stuff

Amazon S3 + MySQL
31 March 2006 12:59

Those who know me know I'm not a big fan of MySQL, but after reading this list of 10 possible apps that could be built on top of Amazon S3, number 6 on that list "generic virtual database with SQL interface" got me thinking. MySQL's architecture is such that it's relatively easy to plug in new table storage types (e.g., Innodb, MyISAM, BerkelyDB). How long before we'll see a table handler that uses Amazon S3? The lack of locking and transaction mechanisms from S3 might be a problem, though.

But if those hurdles could be overcome, you could (in terms of storage) scale your MySQL without worrying about adding disks or volumes or power or whatever. Latency issues will probably be some cause for concern. Is this kind of thing even worth pursuing?

Perhaps a better idea (for us Perlish folks) would be a DBD::Amazon::S3 Perl module.

Ahh, a million ideas, and no time to do much with them...*sigh*.


Comments

On 26 May 2006 12:47 ian connor wrote:
It would be good even just for large blobs withing a table. You could have the large blob be the s3 bucket entry. So that the table stuff and indexes are all local - but any large file or attachments are stored with s3 in an infinite way.


Add a comment
Your name: (Required)


Your email: (Optional, not displayed)


URL: (Optional, the address of your web site or blog)


Your comments: (Required)

Please enter the text you see in the image
The CAPTCHA image


Thank you!
Please donate
liftingupserenity.com

Some dude

Daniel Hanks

I'm a database/systems administrator working for a large web hosting company in Utah.

Interested in

perl
books
databases
genealogy
astronomy
digital archival
digital libraries
web applications
web infrastructure
distributed storage

among other things . . .

Storyteller


Pamela Hanks

is an excellent storyteller.

(She also happens to be my wife :-)

A storyteller makes a wonderful and unique addition to family, school, church or other group events. Schedule her for your next gathering.


Kiva.org

Recent Entries

Subscribe with Bloglines
- Harnessing human computational power from computer games
- I love a good roadtrip
- FamilySearch Developers Conference 2008 presentations now available online
- FHT follow up: an idea for a mobile genealogical application
- Family history and technology: it's only getting better
- President Hinckley passes away
- December is NaBoMoReMo - National Book of Mormon Reading Month
- Family History, Photos, Blogs, and Books
- The Compact Oxford English Dictionary
- 1830s English and the Book of Mormon
- Google adds My Library feature to Book Search
- Utah Open Source Conference
- Wiki diagrammer (Steal this idea!)
- Microloans at Internet-scale
- Podcasting content created by someone else
- Silver Lining thought: Parking at work
- Emerging technologies for system administrators
- Amazon S3 storage engine for MySQL, part II
- Total lunar eclipse on Sat, Mar 3, 2007
- Are you ready for the 2007 Daylight Savings time changes?

All Entries . . .

LDSOSS
LDS Open Source Software
A website discussing the use of Open-source software for applications useful to those sharing values of the Latter-day Saint (Mormon) faith.

Cool Perl Modules

My del.icio.us
Recent bookmarks

Spread the Word
Get Firefox!

--> © 2004, Daniel C. Hanks