Distributed Innodb Caching with memcached

Matthew Yonkovit (MySQL), Yves Trudeau (Percona)
Average rating: ***..
(3.67, 3 ratings)

The basic idea is to push the pages that are discarded by the InnoDB buffer pool LRU mechanism (buf0lru) to memcached and before attempting to read a page from disk (buf0rea), an attemp is made to read the page from memcached first. With a proper tuned libmemcached, accessing memcached is much faster than accessing the local disk. The patch to InnoDB is suprizingly small and simple, less than 100 lines are affected. Furthermore, the patch makes MySQL not dependent on memcached.

Typical applications are: 32 bits OS with more than 4 GB of RAM (not uncommon), Improving performance of MySQL using the memory of the passive server in a Heartbeat/DRBD pair, large OLTP servers by helping to reduce the disk load by removing much of the read operations, Datawarehousing/adhoc queries using a farm of memcached servers to scale the memory to TB size. In fact, memcached could help InnoDB in nearly all applications that are disk bound.

Benchmarking results will be presented for the various use cases along with DBT2 results with and without memcached.

Matthew Yonkovit

MySQL

Matthew Yonkovit is a 12 year database veteran, who has worked on large performance tuning adventures on most major database platforms for several fortune 500 clients. He currently is a Solution Architect for Sun/MySQL and lives in St. Johns Michigan.

Photo of Yves Trudeau

Yves Trudeau

Percona

MySQL Consultant for North America, specialized in Heartbeat/DRBD, NDB Cluster and Performance tuning. Former system administrator and DBA for a company specialized in large scale opensource based infrastructure for schoolboards in Canada.

Co-presented By:

O'Reilly Media MySQL/Sun Microsystems
  • Kickfire
  • Virident
  • Infobright, Inc
  • JasperSoft
  • Intel
  • Advanced Micro Devices
  • BIRT Exchange by Actuate
  • Calpont
  • Canonical
  • Continuent
  • Dolphin Interconnect Solutions
  • Facebook
  • HiT Software, Inc.
  • IBM
  • iDashboards
  • Oracle
  • Pentaho
  • R1Soft
  • Schooner Information Technology
  • SQLstream
  • Ticketmaster
  • Zmanda, Inc.
  • Linux Journal

Sponsorship Opportunities

For information on exhibition and sponsorship opportunities at the conference, contact Sharon Cordesse at scordesse@oreilly.com

Download the MySQL Sponsor/Exhibitor Prospectus

Media Partner Opportunities

Download the Media & Promotional Partner Brochure (PDF) for information on trade opportunities with O'Reilly conferences or contact mediapartners@ oreilly.com

Press and Media

For media-related inquiries, contact Maureen Jennings at maureen@oreilly.com

MySQL Conference Newsletter

To stay abreast of conference news and to receive email notification when registration opens, please sign up for the MySQL Conference newsletter.

Contact Us

View a complete list of MySQL contacts.