Book Reviews   Digital Libraries   Astronomy Log   Software   About  

Amazon S3 + MySQL
31 March 2006 14:59

Those who know me know I'm not a big fan of MySQL, but after reading this list of 10 possible apps that could be built on top of Amazon S3, number 6 on that list "generic virtual database with SQL interface" got me thinking. MySQL's architecture is such that it's relatively easy to plug in new table storage types (e.g., Innodb, MyISAM, BerkelyDB). How long before we'll see a table handler that uses Amazon S3? The lack of locking and transaction mechanisms from S3 might be a problem, though.

But if those hurdles could be overcome, you could (in terms of storage) scale your MySQL without worrying about adding disks or volumes or power or whatever. Latency issues will probably be some cause for concern. Is this kind of thing even worth pursuing?

Perhaps a better idea (for us Perlish folks) would be a DBD::Amazon::S3 Perl module.

Ahh, a million ideas, and no time to do much with them...*sigh*.


Comments

On 26 May 2006 14:47 ian connor wrote:
It would be good even just for large blobs withing a table. You could have the large blob be the s3 bucket entry. So that the table stuff and indexes are all local - but any large file or attachments are stored with s3 in an infinite way.


Happiness
True love begins when the needs of others become more important than your own.
The practice of true love begets true happiness

Me

Daniel Hanks

I'm a system administrator working for Omniture

Interested in

perl
books
python
databases
genealogy
astronomy
digital archival
digital libraries
web applications
web infrastructure
distributed storage

among other things . . .

Storyteller


Pamela Hanks

is an excellent storyteller.

(She also happens to be my wife :-)

A storyteller makes a wonderful and unique addition to family, school, church or other group events. Schedule her for your next gathering.


Kiva.org
Kiva - loans that change lives

Recent Blog Entries

Subscribe with Bloglines
- OpenWest Conference 2014 Presentation Slides - Ansible
- OpenWest Conference 2013 Presentation Slides
- Utah Open Source Conference 2012 - Presentation slides
- E-Book Review: Data Mashups in R
- Book Review: Illustrated Guide to Astronomical Wonders
- Book Review: Wicked Cool Shell Scripts
- PLUG Presentation Slides: The Open Source Data Center
- Harnessing human computational power from computer games
- I love a good roadtrip
- FamilySearch Developers Conference 2008 presentations now available online
- FHT follow up: an idea for a mobile genealogical application
- Family history and technology: it's only getting better
- President Hinckley passes away
- December is NaBoMoReMo - National Book of Mormon Reading Month
- Family History, Photos, Blogs, and Books
- The Compact Oxford English Dictionary
- 1830s English and the Book of Mormon
- Google adds My Library feature to Book Search
- Utah Open Source Conference
- Wiki diagrammer (Steal this idea!)

All Entries . . .

LDSOSS
LDS Open Source Software
A website discussing the use of Open-source software for applications useful to those sharing values of the Latter-day Saint (Mormon) faith.

© 2009, Daniel C. Hanks