Horizontal Scaling with HiveDB

Britt Crawford (Cafepress.com), Justin McCarthy (CafePress.com)

Massively scalable systems used to be the sole province of large corporations with acronyms for names and budgets the size of a small country’s GDP, but with the explosion of user-created content sites scaling is now everybody’s problem.

One of the main strategies for scaling databases is to partition the data across many servers. This is a simple enough idea but requires a good deal of expertise in systems design, programming, and MySQL administration to execute successfully. Many horizontal partitioning systems have been built and put into production in corporate environments, but so far none of them have:

  • Built an easily extensible platform
  • Released their system under an open source license

This session introduces HiveDB, an open source framework for partitioning MySQL that implements the core ideas behind horizontal partitioning in as clear and concise a way as possible.

While HiveDB is written in JAVA, this session is useful for those interested in scaling MySQL in any environment. HiveDB provides a web service making it language agnostic.

Photo of Britt Crawford

Britt Crawford

Cafepress.com

Britt Crawford is a software engineer at Cafepress.com and a contributor to the HiveDB project. He helped to create and deploy a Cafepress’s HiveDB and MySQL clusters and now is now hard at work on the next version of HiveDB.

Photo of Justin McCarthy

Justin McCarthy

CafePress.com

Justin McCarthy manages a team of developers focused on improving the way people sell through Cafepress.com. He is a founding member of the HiveDB project, and was the primary advocate for committing full-time Cafepress.com engineers to the open source HiveDB effort.

Sponsors
  • Kickfire
  • Zmanda, Inc.
  • Continuent
  • EDS
  • JasperSoft
  • Sun Microsystems
  • Symantec Anti-Virus Software
  • XAware
  • Data Direct Technologies
  • Dolphin Interconnect Solutions
  • Hewlett Packard
  • Infobright, Inc
  • Linagora
  • Microsoft
  • OpSource
  • Oracle
  • Pentaho
  • R1Soft
  • Red Hat
  • Ticketmaster
  • TechRepublic

Contact Us

View a complete list of MySQL contacts.