Be Rich and Fast: Membase Key-Value Stores for Interactivity, MySQL for Full Queryability

Matt Ingenthron (Couchbase, Inc.)
Average rating: ****.
(4.00, 1 rating)

With any significant application, methods of data management never exist in isolation. These applications use a combination of key-value stores for super fast, super simple data access, MapReduce clusters for analytics and even distributed file or document stores alongside SQL databases. The MySQL community has long been open to embracing many other ways of managing and storing application data with the core SQL database capabilities.

This session will focus on how Membase is used as a simple, fast, elastic key-value database in conjunction with MySQL. The use of SQL and NoSQL together in an application deliver new capabilities and higher scalability. We need not think of one as deprecating the other.

Membase builds upon the memcached protocol by implementing an Open Source storage engine. Membase features persistence, replication and clustering through this storage engine, though it also has a protocol called TAP, which can be used to stream data from the Membase operational store into MySQL, Drizzle, Hadoop, Lucene/Solr or other datastores. For instance, MySQL adds full query capabilities across the data continuously loaded from the Membase TAP stream while Membase provides microsecond-order access via a simple key-value interface to front end applications. Deployed this way, Membase clustering simplicity allows applications to scale quickly, spreading the workload across an increasing number of nodes while still providing the richness of MySQL querying capabilities.

Membase is already in widespread use at Zynga with more than 235 Million active users per month as the simple, fast, elastic key-value store behind Farmville and CafĂ© world. It is also widely deployed behind NHN’s Naver.com, Korea’s number one search portal. It is also deployed by by AOL to service billions of ad impressions per day with intelligence, and provides ShareThis with a simple way to elastically grow their user tracking system.

Photo of Matt Ingenthron

Matt Ingenthron

Couchbase, Inc.

Matt is an experienced web architect with a software development background. He has deep expertise in building, scaling and operating global-scale Java, Ruby on Rails and AMP web applications. In recent years, he has been a contributor to the memcached project, one of the maintainers of the Java spymemcached client and a core developer on Membase.

Comments on this page are now closed.

Comments

Picture of Matt Ingenthron
Matt Ingenthron
04/20/2011 11:42am PDT

That actually is already proposed by some of my Couchbase colleagues (Trond in particular). Check out the goings on over in the memcached project list.

Current memcached can receive TAP mutations (based on the engine proposed update), but can’t send them.

Bob Wall
04/15/2011 1:45pm PDT

I liked the discussion of TAP – it would be great to get that integrated into memcached as well.

  • EnterpriseDB
  • Amazon Web Services
  • Clustrix
  • Continuent
  • Facebook
  • HTI Consultoria e Tecnologia
  • Monty Program
  • Percona
  • Rackspace Hosting
  • Schooner Information Technology
  • SkySQL
  • Xeround

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Yvonne Romaine at yromaine@oreilly.com

Media Partners Opportunities

For media partnerships, contact mediapartners@ oreilly.com

Press & Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

O'Reilly MySQL Conference Bulletin

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the O'Reilly MySQL Conference Bulletin (login required).

Contact Us

View a complete list of O'Reilly MySQL Conference Contacts